I bet you can make a cheap “AI” chip for using the trained model, it seems the training is the ruinous thing today.
Remember when they predicted heavier than air flight to be centuries in the future just the week before the wright brothers flew? Me neither I wasn’t born then, but it’s an interesting example IMO.
If it does get better, it will be with technology other than LLMs, because LLMs don’t get cheaper per unit of usage as usage scales.
I suspect that we won’t have actually useful AI of some sort until LLMs get out of the way. They’re sucking all the oxygen out of the room right now.
I bet you can make a cheap “AI” chip for using the trained model, it seems the training is the ruinous thing today.
Remember when they predicted heavier than air flight to be centuries in the future just the week before the wright brothers flew? Me neither I wasn’t born then, but it’s an interesting example IMO.
And it’s also not like the hardware is improving much either, we’ve effectively hit the wall performance wise with processors and RAM.
That’s literally what all these datacenters are for, we can’t scale the individual computer performance up, so instead we build more and more of them.