Navigate Select ESC Close

Kimi AI's Huge LLM Breakthrough Is Fascinating [Attention Residuals]

2026-05-18 Science & Technology
1.7k
178
10
bycloud
bycloud
225.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

Try Mammouth now for only €10/mo! https://mammouth.ai Kimi AI's Attention Residual paper is actually such a clean idea. I would say it is even more promising than DeepSeek's mHC. Learn AI intuitively, best intro into LLMs! https://intuitiveai.academy/ limited time code "SUMMER" for 25% off yearly plan We just wrote a new piece on RL & RLHF! My Newsletter https://mail.bycloud.ai/ My Patreon https://www.patreon.com/c/bycloud Attention Residuals [Paper] https://arxiv.org/abs/2603.15031 mHC [Paper] https://arxiv.org/abs/2512.24880 Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI This video is supported by the kind Patrons & YouTube Members: 🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar, ZyanSheep, THEVIERAOS, Ricardo Raphael Corona-Moreno [Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/bycloudai [Patreon] https://www.patreon.com/bycloud [Business Inquiries] [email protected] [Other Inquiries] [email protected] [Profile & Banner Art] https://twitter.com/pygm7 [Video Editor] @Booga04 [Ko-fi] https://ko-fi.com/bycloudai Manim Animations created with Manimate https://www.manimate.ai/

Top Comments (10)

@bycloudAI 2026-05-18

Try Mammouth now for only €10/mo! https://mammouth.ai

3 3 replies
@OperationDarkside 2026-05-18

When I was 16 I changed config files of Age of Empires 3 to make a full auto musketeer and rockets that fly across the map.

412 10 replies
@knicklichtjedi 2026-05-18

The "attention is all you need" paper continues to be relevant just by its title alone. How crazy!

252 5 replies
@ghkkkggfvhyfbuuuh 2026-05-18

This is a really elegant solution. It's one of those solutions that seem obvious after it's discovered.

97
@enjaad1654 2026-05-19

Welcome back, Densenet.

44 3 replies
@BigSources 2026-05-19

Next up we rotate the compute axis on scaling law graphs by 180° to achieve linear improvements at exponentially less cost

92 2 replies
@andreasxfjd4141 2026-05-23

Finally a channel about AI with a human voice

6 1 replies
@phineasandferbrocks4 2026-05-18

If only society also rewarded relevance over magnitude....

53 4 replies
@飛天柴犬 2026-05-19

《Attention is all you need》

19
@ollimacp 2026-05-19

In europe the 16 year old wouldn't be the lead author but a 60ish old professor who wouldn't have the capabilities to do it themselves but would take all the fame. Just because of how we suppose to publish in the West... What a guy! Splendid

29 1 replies

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot