Pennomi

I mean, it still could be. But LLMs are not that AGI we’re expecting.

“Don’t believe that marketing department“ is one of those things everybody needs to learn at some point in their life.

No money is exactly what’s needed to achieve this.

Uh yeah, like all the time. Anyone who says otherwise really hasn’t tried recently. I know it’s a meme that AI can’t code (and still in many cases that’s true, eg. I don’t have the AI do anything with OpenCV or complex math) but it’s very routine these days for common use cases like web development.

To be fair, if I wrote 3000 new lines of code in one shot, it probably wouldn’t run either.

LLMs are good for simple bits of logic under around 200 lines of code, or things that are strictly boilerplate. People who are trying to force it to do things beyond that are just being silly.

Even Zuckerberg admits that trying to scale LLMs larger doesn’t work because the energy and compute requirements go up exponentially. There must exist a different architecture that is more efficient, since the meat computers in our skulls are hella efficient in comparison.

Once we figure that architecture out though, it’s very likely we will be able to surpass biological efficiency like we have in many industries.