Navigate Select ESC Close

A new way to fine-tune LLMs just dropped

2026-04-27 Science & Technology
16.3k
1.3k
109
bycloud
bycloud
225.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

Try Mammouth now for only €10/mo! https://mammouth.ai Evolution strategies were once seen as too inefficient for modern deep learning, but new LLM fine-tuning research has found a way to bring it back from the museum. This video explains how scalable evolutionary strategies could be for LLMs, and its latest developments. my latest project: Intuitive AI Academy We just wrote a new piece on RL & RLHF! https://intuitiveai.academy/ limited time code "EARLY" for 40% off yearly plan My Newsletter https://mail.bycloud.ai/ My Patreon https://www.patreon.com/c/bycloud Sauce [OpenAI paper] https://arxiv.org/abs/1703.03864 [Evolution Strategies at Scale] https://arxiv.org/abs/2509.24372 [EGGROLL] https://arxiv.org/abs/2511.16652 Try out my new fav place to learn how to code https://scrimba.com/?via=bycloudAI This video is supported by the kind Patrons & YouTube Members: 🙏Spam Maj, Alex, Chris LeDoux, DX Research Group, Poof N' Inu, Deagan, Robert Zawiasa, Ryszard Warzocha, Tobe2d, Louis Muk, Akkusativ, Kevin Tai, Mark Buckler, NO U, Tony Jimenez, Ângelo Fonseca, jiye, Anushka, Asad Dhamani, Binnie Yiu, Calvin Yan, Clayton Ford, Diego Silva, Etrotta, Gonzalo Fidalgo, Handenon, Hector, Jake Disco very, Michael Brenner, Nilly K, OlegWock, Daddy Wen, Shuhong Chen, Sid_Cipher, Stefan Lorenz, Sup, tantan assawade, Thipok Tham, Thomas Di Martino, Thomas Lin, Richárd Nagyfi, Paperboy, mika, Leo, Berhane-Meskel, Kadhai Pesalam, mayssam, Bill Mangrum, nyaa, Toru Mon, Lame Plane, Matej Macak, Len Mo, saylikhapekar, ZyanSheep, THEVIERAOS, Ricardo Raphael Corona-Moreno [Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/bycloudai [Patreon] https://www.patreon.com/bycloud [Business Inquiries] [email protected] [Profile & Banner Art] https://twitter.com/pygm7 [Video Editor] @aduckchicken2 [Ko-fi] https://ko-fi.com/bycloudai Manim Animations created with Manimate https://www.manimate.ai/

Top Comments (10)

@porku5059 2026-04-27

“grew up” watching code bullet? bro i was in college, how old are yall?

204 15 replies
@farhadkarimi 2026-04-27

The most satisfying idea in ai

165 11 replies
@diadetediotedio6918 2026-04-27

oh evolutionary algorithms my beloved

116 4 replies
@gSys1337 2026-04-27

The first paper sounds like gradient descent but without really calculating the gradient and instead only looking around until you find a better place.

52 4 replies
@michaelwoodby5261 2026-04-27

The first few minutes of this do such a solid job of explaining the problem with evolutionary AI. You simplify and break it down into manageable ideas without making it too dumb.

24
@SrIgort 2026-04-27

This sounds like a great way to maximize catastrophic forgetting

23
@robertodailey1625 2026-04-28

Hey, I'm one of the (late added) authors from the es-fine-tuning paper. Absolutely fantastic summary of the research, we've been passing it around the office. Thanks for covering it!

13 2 replies
@bycloudAI 2026-04-27

Try Mammouth now for only €10/mo! https://mammouth.ai

12 5 replies
@broccoloodle 2026-04-28

the problem with this method is if they don't scale the variance of Gaussian noise, it will learn nothing if most dimensions have little to no effect on the output.

10
@ArcturusEmrys 2026-04-27

babe wake up the constructs are trying evolution again

5

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot