Why does it cost so much to engineer new models? I thought AI can replace software engineers now, shouldn’t the development cost of new models decrease over time?
Joking aside - I think the whole “engineer time is expensive, computer time is cheap” approach stopped being true half a decade or so before LLMs were a thing. It was kind of self defeating - you’d think companies were trying to increase their usage of computing resources due to some misconception that it’d automatically decrease work humans have to do, saving them money in the long run.
I don’t have the numbers, but I wouldn’t be surprised if software/hardware costs exceeded engineering costs for about a decade now, with all these inefficient-on-purpose frameworks and with everything being on the cloud and with using various services for the sake of using a service.
Why does it cost so much to engineer new models? I thought AI can replace software engineers now, shouldn’t the development cost of new models decrease over time?
Joking aside - I think the whole “engineer time is expensive, computer time is cheap” approach stopped being true half a decade or so before LLMs were a thing. It was kind of self defeating - you’d think companies were trying to increase their usage of computing resources due to some misconception that it’d automatically decrease work humans have to do, saving them money in the long run.
I don’t have the numbers, but I wouldn’t be surprised if software/hardware costs exceeded engineering costs for about a decade now, with all these inefficient-on-purpose frameworks and with everything being on the cloud and with using various services for the sake of using a service.
You can’t avoid the compute requirements