Navigate Select ESC Close

The Unreasonable Effectiveness of Prompt "Engineering"

2024-09-30 Science & Technology
75.7k
2.8k
174
bycloud
bycloud
225.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

Check out the FREE non-technical guide for using AI in your business here: https://clickhubspot.com/fuu7 This video imma be yapping about why prompt engineering is unreasonable and everything that is a bit sus about it. The sequel of this video will probably be me roasting o1 (hopefully not) check out my newsletter https://mail.bycloud.ai/ Special thanks to LDJ for helping with this video OpenAI o1 [Announcement] https://openai.com/index/introducing-openai-o1-preview/ [Blogs] https://openai.com/o1/ Claude 3.5 Sonnet [Announcement] https://www.anthropic.com/news/claude-3-5-sonnet [AntThinking] https://gist.github.com/dedlim/6bf6d81f77c19e20cd40594aa09e3ecd Language Models (Mostly) Know What They Know [Paper] https://arxiv.org/abs/2207.05221 Plan-and-Solve Prompting [Paper] https://arxiv.org/abs/2305.04091 Llama-3.1 System Card [Documentation] https://www.llama.com/docs/model-cards-and-prompt-formats/meta-llama-3/ Think Before You Speak [Paper] https://arxiv.org/abs/2310.02226 Future Lens [Paper] https://arxiv.org/abs/2311.04897 This video is supported by the kind Patrons & YouTube Members: 🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Robert Zawiasa, Owen Ingraham, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Penumbraa, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth, Thipok Tham, Clayton Ford, Theo, Handenon, Diego Silva, mayssam [Discord] https://discord.gg/NhJZGtH [Twitter] https://twitter.com/bycloudai [Patreon] https://www.patreon.com/bycloud [Music 1] Spirit Blossom - RomanBelov [Music 2] Tie Me Down - PremiumMusicOdyssey [Music 3] Dimmed Lights - PremiumMusicOdyssey [Music 4] Wrapped in your Love - PremiumMusicOdyssey [Profile & Banner Art] https://twitter.com/pygm7 [Video Editor] @bhargavesque 0:00 Intro 4:21 The prooompting basics 6:36 How companies make prompting works 12:11 Does how you prompt REALLY matter?

Top Comments (10)

@ricosrealm 2024-09-30

User: "Read the question again" LLM: <I guess I was wrong... let me guess another answer>

260 8 replies
@mrmilkshake9824 2024-09-30

Seeeeeeee!!!!Its a real job guys!!! 😭😡

202 12 replies
@extinguished0ne 2024-09-30

In my view the worst nighmare for software engineer/programmer is becoming fully prompt engineer. A monkey that sit at computer and typing some bullsh!t nonesence in hope that somehow this sh!t will happen to work properly without even thoughts of what happens under the hood... Oh wait a minute...

185 13 replies
@Bhaal-Spawn 2024-09-30

I love how prompt engineering is basically "don't make mistakes and give me a good answer" and the AI is basically like "ohhhh that's what you mean" and then does it 😂

183 5 replies
@Terenfear 2024-09-30

To be honest, not a fan of the new editing style, where everything is moving, wobbling and highlighting. Otherwise, a nice video, thanks.

42
@DoktorUde 2024-09-30

You suggest that the performance of the O1 model on STEM questions indicates that reasoning fine-tuning only uncovers what was already present in the model. However, it seems more likely that the improved performance in STEM is due to the fact that the reasoning chains used for fine-tuning the O1 model were largely focused on STEM problems. These types of problems allow for easier verification of whether a reasoning chain leads to a correct solution. To my knowledge, they had a large language model create millions of reasoning chains specifically for STEM issues and then selected only a small fraction of those that resulted in correct answers for fine-tuning the O1 model. This approach would clearly explain why it excels in STEM while struggling with subjects like English literature, without suggesting that it is limited to merely what was already in the model.

24 2 replies
@dany_fg 2024-10-02

Prompt 'Engineering': How to talk to a computer until he tells you what you want to hear. "That sounds like torture" "Advance interigation techniques" "Tortu-" "Advance. Interigation. Techniques!"

21 2 replies
@bycloudAI 2024-09-30

BROTHERS and SISTERS HERE"S THE FREE non-technical guide for using AI in your business: https://clickhubspot.com/fuu7

17 12 replies
@scoffpickle9655 2024-09-30

Prompt engineers when chatbots improve their inference and take over their jobs

15 4 replies
@akirachisaka9997 2024-10-01

I often like to imagine models as mech suits, and the human piloting it as the pilot. In this way, it’s not really “engineering”, but a good pilot and a bad pilot can make a difference quite a lot of the time.

11 1 replies

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot