New ask Hacker News story: Ask HN: How would one go about building an API for fine tuning?

Ask HN: How would one go about building an API for fine tuning?
2 by samlhuillier | 0 comments on Hacker News.
Let's say I wanted to build an API to let users upload images and the api would fine tune stable diffusion for them returning either a checkpoint or another api that let's them run inference on the fine-tuned model. Does anyone have any architecture considerations/issues they'd suggest? Two things I'm considering: - Would the problem with this approach of ad-hoc GPUs likely be cold boot? It would take a shit ton of time to load. Though with data center networks speeds that wouldn't be too much of an issue - considering the fine-tuning itself would likely dwarf boot times. - Is it possible to launch remote GPU instances ad-hoc from code? Is there a service that provides this service? Every time a call is made we'd spin up a GPU Maybe the best approach for a V1 is to use the AWS SDK or something similar to just launch instances as calls come in. Appreciate the help!

Comments

Post a Comment

Popular posts from this blog

How can Utilize Call Center Outsourcing for Increase your Business Income well?

Image
Call center outsourcing is not uncommon however, not every company can live up to the expectations of a great client. The service provider should have the ability to assist you obtain access to new abilities and competences in order to help you achieve efficiency and effectiveness in your company. Digital office providers assist business in providing unique, innovative solutions that are intended to custom-fit your personal small business needs. Some back office service providers also have fully-developed outbound calling and telemarketing services that you can utilize. The world has taken a huge leap with the technological revolution. What was impossible before now seems to be a matter of seconds. As we see more and more start-ups and digital companies emerging, we need to understand how we can account the rising number of BPO companies that can be helpful to us. Running a call center internally may be an expensive affair particularly when it...
Read more

New ask Hacker News story: Is someone trying to steal credit for inventing the eTicket?

Is someone trying to steal credit for inventing the eTicket? 2 by rexarex | 0 comments on Hacker News. The eTicket is what we use for flights today instead of physical, paper tickets printed on special paper. My understanding of the lore is that it was invented by Southwest Airlines or a company they acquired. That's what I heard on a How I Built This podcast episode with the founder of JetBlue. It's also mentioned in this research paper here https://ift.tt/RB63DSb Strangely, when I was googling I found what I suspect to be planted misinformation in a Bangkok Post article where someone named Joel Goheen claims to have invented the eTicket on JRG Airlines (https://ift.tt/bTyawJM). JRG Airlines does not exist, and appear to be just the initials of Joel R Goheen. However, he appears on a U.S. Patent for eTicketing for 1994 the same time they started using eTickets. (https://ift.tt/tzSTHf2) I think it's really strange. I did some googling of his name and eTicket and there ap...
Read more