Meta's AI Chief: "I'm DONE with LLMs"

“I’m done with LLMs” - he actually never got started with.

LLMs are good at language, which is how we access intelligence. So it is the way it seems most intelligent to us. But diffusion models are best at vision. Physics engines are best at 3D modeling. We need many tools working together just like our brains have many different areas for specialized purposes as well as a cerebral cortex that helps put them all together.

"a new architecture he's proposing" .. it's not new, it's a bunch of years old at this point.

Dont underestimate what engineers can do with limitations

Thanks Weth, you’ve become my #1 channel to watch ai news! Amazing work ❤

so he's done with SOTA in ARC AGI challenge and frontier maths, done with SOTA autonomous deep research agents and coding, and now done with SOTA image generation via openAI's new LLM powered image generator etc, and is betting on his non SOTA in any of these?

LLMs function a lot like Wernicky’s Area in the brain. Which also hallucinates

Always appreciate your content Wes. Crazy that it's only been a couple years since this craziness started but I have been with you since those early days and you are always a go to for the latest AI info. Thank you sir!

does anyone know if LLM architecture is currently capable of embedding chronology directly into its data? i believe it's required not only for better causal understanding, but for identity building as well (towards machine consciousness).

I have an internal monolog, however it is not as fast as relying on intuition.