Navigate Select ESC Close

DeepSeek's Insane Architecture Breakthrough [Engram Explained]

2026-03-24 Science & Technology
71.3k
4.1k
244
bycloud
bycloud
229.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

Stop scraping manually and check out SerpAPI now! https://serpapi.link/bycloud-march-2026 In this video, we will breakdown how DeepSeek's new engram works intuitively, with visualizations! Check out my latest project: Intuitive AI Academy We just wrote a new piece on MoE and Distillation! https://intuitiveai.academy/ limited time code "EARLY" for 40% off yearly plan! My Newsletter https://mail.bycloud.ai/ my project: find, discover & explain AI research semantically https://findmypapers.ai/ My Patreon https://www.patreon.com/c/bycloud DeepSeek Engram [Paper] https://arxiv.org/abs/2601.07372v1 mentioned papers [DeepSeek-V3.2] https://arxiv.org/abs/2512.02556 [DeepSeek Sparse Attention] https://github.com/deepseek-ai/DeepSeek-V3.2-Exp/blob/main/DeepSeek_V3_2.pdf Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI This video is supported by the kind Patrons & YouTube Members: 🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar [Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/bycloudai [Patreon] https://www.patreon.com/bycloud [Business Inquiries] [email protected] [Music] @IraStoria [Profile & Banner Art] https://twitter.com/pygm7 [Video Editor] Abhay [Ko-fi] https://ko-fi.com/bycloudai

Top Comments (10)

@Kuchenrolle 2026-03-24

So we're back to using n-grams. Next up: fine state automata. Qwen 5 will just be one big ass regular expression.

1.1k 27 replies
@markkortnev 2026-03-26

I’ve spent enough time reading model papers to know when something is actually a leap, and this one really does feel like a new building block rather than just another tweak!

860 3 replies
@eduardomoura2813 2026-03-24

Engram? wake the fuck up samurai!

322 7 replies
@wooof8153 2026-03-24

Btw Deepseek seems to be trying to introduce mHc, tiered kv-cache, engram memory, and optimization for Huawei's GPUs all in one release with V4

270 10 replies
@superhaainomnom8017 2026-03-24

I've never seen such complicated matters explained so well... visually, well done.

267
@aron2922 2026-03-24

Dude never stop making these videos. A real breath of fresh air in the world of AI slop content makers wilding out over every new slop tool. Amazing animations, clear explanations and technical subjects. You are making a big impact making these concepts aproachable.

104 2 replies
@_tsu_ 2026-03-25

DeepSeek is the real OPEN AI company.

101 4 replies
@inorganicphosphate9755 2026-03-24

Paper so old TwoMinutesPapers made a video about this before you

94 1 replies
@figloalds 2026-03-25

I'm thrilled when DeepSeek releases some good new research, because last they did that we got Kimi K2.5 with the Deepseek Sparse attention and that model is extremely good At this point ima be honest it does look like DeepSeek is doing all the research and the labs are mostly just executing on DeepSeek research

29
@bycloudAI 2026-03-24

Stop scraping manually and check out SerpAPI now! https://serpapi.link/bycloud-march-2026

16 3 replies

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot