The end of the GPU era

TSMC depends on EUV lithography machines from a company called ASML. I reckon ASML that is the more critical company

Reminds me of the evolution of Bitcoin mining, CPU -> GPU -> ASIC

The AI bubble is basically Nvidia and OpenAI

The reason RAM prices went up 4x is that a massive amount of not-yet-manufactured memory was bought with money that doesn't really exist to be put into GPUs that haven't been made yet, to be installed in data centers that haven't been built, powered by infrastructure that may never exist, to satisfy demand that isn't actually there, in order to generate profits that are mathematically impossible.

Okay then the question is what makes TSMC possible? ASML - a real monopoly on lithography solutions that makes TSMC possible. I am sure it would be hard, but with the right experts a secondary TSMC Fab can be built. Fun fact: in case of an invasion, TSMC has remote kill switches for their plant equipment. Not sure if they are literal explosives. However the CEO said that this would render the entire production plant useless.

Yup, inference rather than training is becoming increasingly important. This is where NVIDIA struggles.

Remember when Apple was the first Trillion dollar company, like, one year ago... lol

GLM 4.7 flash is running on a single GPU at home now and it's agentic and capable.

imagine having a flood of 80GB gpus for cheap after whole industry figures out a beter way of compute for datacenters xD

0:38 They are working with Meta to make TPUs compatible with PyTorch so that the community can train models using PyTorch framework as good as JAX & Tensorflow works with TPUs. Thanks Theo for covering about Nvidia ❤