Navigate Select ESC Close

JEPA is just LoRA in disguise. New Insights.

2026-06-29 Science & Technology
1.3k
81
11
Discover AI
Discover AI
90.5k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

JEPA Meets LoRA (Low-Rank Adaptation): Modular AI World Models. JEPA Transition Operators for WORLD Models in AI. Modular Low-rank JEPA Adapters for AI World Models. LORA Adapters for LLMs & JEPA Adapters for World Models = new idea. JEPA Adapters: Low-Rank Modular World Models. All rights w/ authors: A GENERALIZATION THEORY FOR JEPA-BASED WORLD MODELS Jingyi Cui1∗ Qi Zhang1∗ Hongwei Wen2 Yisen Wang1† from 1 State Key Lab of General AI, School of Intelligence Science and Technology, Peking University 2 University of Sydney #airesearch #aiexplained #education #aitechnology

Top Comments (10)

@vicentevilaramirez9309 2026-06-29

Me encanta que te bases en papers científicos y novedosos. Saludos. Sigue asi

6
@AmeliaBestWaifu 2026-06-29

Maybe joint embedding isn't the way, but I'm still hyped for bong embedding and edibles embedding.

3
@stblackhole 2026-06-29

27:08 So it seems that JEPA may still have issues handling out-of-distribution data.

2
@timmygilbert4102 2026-06-29

My mental model: it's a parser, a feature extractor

2
@shaktivaderdristi 2026-06-29

So it's not the AGI?😢

1 1 replies
@aerotheory 2026-06-30

Well grounded presentation.

1
@dumfka 2026-07-01

Im building datasetless ai🤓

0 1 replies
@countofserenno7605 2026-07-02

The question is one of autoformalization: how to construct automatically something useful out of trillion-scale datasets rather than doing it ourselves

0
@EnergiaEnergy 2026-06-30

❤😂 científico se tardan mucho en llegar a este nivel de comprensión❤

0
@vas-sreeram 2026-06-30

This exactly what I was thinking especially when I was listening to yan lecunn’s presentations and so on

0

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot