Navigate Select ESC Close

DeepSeek's Insane Architecture Breakthrough [Engram Explained]

2026-03-24 Science & Technology
71.3k
4.1k
244
bycloud
bycloud
225.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

Stop scraping manually and check out SerpAPI now! https://serpapi.link/bycloud-march-2026 In this video, we will breakdown how DeepSeek's new engram works intuitively, with visualizations! Check out my latest project: Intuitive AI Academy We just wrote a new piece on MoE and Distillation! https://intuitiveai.academy/ limited time code "EARLY" for 40% off yearly plan! My Newsletter https://mail.bycloud.ai/ my project: find, discover & explain AI research semantically https://findmypapers.ai/ My Patreon https://www.patreon.com/c/bycloud DeepSeek Engram [Paper] https://arxiv.org/abs/2601.07372v1 mentioned papers [DeepSeek-V3.2] https://arxiv.org/abs/2512.02556 [DeepSeek Sparse Attention] https://github.com/deepseek-ai/DeepSeek-V3.2-Exp/blob/main/DeepSeek_V3_2.pdf Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI This video is supported by the kind Patrons & YouTube Members: 🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar [Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/bycloudai [Patreon] https://www.patreon.com/bycloud [Business Inquiries] [email protected] [Music] @IraStoria [Profile & Banner Art] https://twitter.com/pygm7 [Video Editor] Abhay [Ko-fi] https://ko-fi.com/bycloudai

Top Comments (10)

@Kuchenrolle 2026-03-24

So we're back to using n-grams. Next up: fine state automata. Qwen 5 will just be one big ass regular expression.

807 26 replies
@chel9117 2026-03-26

I’ve spent enough time reading model papers to know when something is actually a leap, and this one really does feel like a new building block rather than just another tweak!

775
@eduardomoura2813 2026-03-24

Engram? wake the fuck up samurai!

261 6 replies
@superhaainomnom8017 2026-03-24

I've never seen such complicated matters explained so well... visually, well done.

250
@burakozturk2143 2026-03-24

its nice that no AI giant has won the competition yet because then winner works only to stay on top. look how that worked out with windows for os landscape.

240 10 replies
@wooof8153 2026-03-24

Btw Deepseek seems to be trying to introduce mHc, tiered kv-cache, engram memory, and optimization for Huawei's GPUs all in one release with V4

225 8 replies
@aron2922 2026-03-24

Dude never stop making these videos. A real breath of fresh air in the world of AI slop content makers wilding out over every new slop tool. Amazing animations, clear explanations and technical subjects. You are making a big impact making these concepts aproachable.

82 1 replies
@inorganicphosphate9755 2026-03-24

Paper so old TwoMinutesPapers made a video about this before you

76 1 replies
@iamr0b0tx 2026-03-24

This feels like the origin of "Engram is all you need" arc

33 1 replies
@bycloudAI 2026-03-24

Stop scraping manually and check out SerpAPI now! https://serpapi.link/bycloud-march-2026

14 2 replies

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot