The Insane Infrastructure Design of DeepSeek V4

Need high quality cloud GPUs? Check out Verda now, and use the code BYCLOUD-35 for $35 of free compute credits https://verda.com/?utm_source=bycloud&utm_medium=referral&utm_campaign=sponsorship&utm_content=deepseekv4 In this video, I'll be going through the ENTIRE (actually fully in-depth) technical side of the DeepSeek-V4 paper, with visualizations and diagrams that explains all the implementations they have made. This took a while as it is a huge project, but hope you would appreciate their open knowledge efforts even more! my latest project: Intuitive AI Academy We just wrote a new piece on RL & RLHF! https://intuitiveai.academy/ limited time code "EARLY" for 40% off yearly plan My Newsletter https://mail.bycloud.ai/ My Patreon https://www.patreon.com/c/bycloud DeepSeek V4 Paper [Paper] https://www.alphaxiv.org/abs/deepseek-v4/?utm_source=bycloud Try out my fav place to learn how to code https://scrimba.com/?via=bycloudAI This video is supported by the kind Patrons & YouTube Members: 🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar, ZyanSheep, THEVIERAOS, Ricardo Raphael Corona-Moreno [Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/bycloudai [Patreon] https://www.patreon.com/bycloud [Business Inquiries] [email protected] [Other Inquiries] [email protected] [Profile & Banner Art] https://twitter.com/pygm7 [Video Editor] @aduckchicken2 Manim Animations created with Manimate https://www.manimate.ai/ [Ko-fi] https://ko-fi.com/bycloudai