Navigate Select ESC Close

The Fascinating Evolution of AI Video Generators

2024-10-21 Science & Technology
19.8k
1.1k
62
bycloud
bycloud
225.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

Try out Luma AI's Dream Machine here: https://luma.1stcollab.com/bycloudai Transformer models have become so good that, it is used even in video generation. How? In this video, I'll give you a quick run down on how the state of the art video generation is made. (It's diffusion transformers) my newsletter: https://mail.bycloud.ai PixArt-Alpha [Paper] https://arxiv.org/abs/2310.00426 Open Sora [GitHub] https://github.com/hpcaitech/Open-Sora/ This video is supported by the kind Patrons & YouTube Members: 🙏Andrew Lescelius, Ben Shaener, Chris LeDoux, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon, Diego Silva, mayssam, Kadhai Pesalam, Tim Schulz [Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/bycloudai [Patreon] https://www.patreon.com/bycloud [Music] massobeats - honey jam [Profile & Banner Art] https://twitter.com/pygm7 [Video Editor] @Askejm & Silas [Thumbnail] https://x.com/Arata_Fukoe/status/1809840865063629292

Top Comments (10)

@tannenbaumxy 2024-10-21

Yes, a deep dive into diffusion transformers for one of the next videos would be awesome!

67
@m_e_m_es4649 2024-10-21

Could you possibly make the same video for Openai's advanced voice mode?

29 3 replies
@bycloudAI 2024-10-21

You can try out Luma AI's Dream Machine here! https://luma.1stcollab.com/bycloudai I am really good at having great timing. MovieGen came out when I nearly finished the video. I'm sad. So here's a quick definition of DiT: A diffusion transformer (DiT) is a model that combines elements of diffusion models and transformers to generate data like image synthesis, audio generation, or text generation. Diffusion models are a class of probabilistic generative models that create data by iteratively denoising a latent variable, which starts from pure noise and is gradually transformed into a coherent sample. Transformers on the other hand, are neural network architectures known for their ability to model long-range dependencies in data, primarily through self-attention mechanisms. You could ultimately say that, a diffusion transformer is just a transformer with the goal of denoising. Yum. Here's MovieGen's paper: https://arxiv.org/abs/2410.13720 it contains a better run down to crafting the latest near SoTA video generation

15 2 replies
@MilesBellas 2024-10-21

A video on Diffusion Transformers = 😊👍

13
@huraqan3761 2024-10-21

De-noised bread, got it!

4
@DJTechnosapien 2024-10-22

Hey man, really appreciate your humor and memes, makes learning ML a lot more fun. Always looking forward to more!

2
@rmt3589 2024-10-25

We definitely need a dedicated video.

2
@MilesBellas 2024-10-21

Baking Bread = great metaphor

1
@TankorSmash 2024-10-21

That bread analogy was 100% chatgpt

1
@dpactootle2522 2024-10-22

I watched half of the video to remind myself that life can suck a lot sometimes.

0

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot