Navigate Select ESC Close

Does LLM Council/Fusion Actually Work?

2026-06-19 Science & Technology
684
51
8
Prompt Engineering
Prompt Engineering
245.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

Checkout Vercel's AI Gateway: https://vercel.plug.dev/B3rLR9K Does fusing GPT, Claude, and Gemini into one council actually beat asking a single model? I built it, gave each model a role, tallied real rankings into a leaderboard, and ran a blind benchmark to find out. The answer wasn't what I expected, and it changes when you should reach for a council at all. My voice to text App: whryte.com Website: https://engineerprompt.ai/ RAG Beyond Basics Course: https://prompt-s-site.thinkific.com/courses/rag Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0 Let's Connect: 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Patreon: https://www.patreon.com/PromptEngineering 💼Consulting: https://calendly.com/engineerprompt/consulting-call 📧 Business Contact: [email protected] Become Member: http://tinyurl.com/y5h28s6h 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0

Top Comments (10)

@QEDAGI 2026-06-19

Duuuuuuuuude :| I'm getting a headache so maybe that's why I can't find the link to your LLM Council code like you mentioned again & again & again... What's happened to the channel? It's NOT the same quality as it was in the beginning. Remember when it was exciting & new? Well, that shit's over :p You say your voice is your own, but your workflow is touched by SOOOOO much AI that you'd better proof-read AND proof-watch AND proof-listen to everything before publishing. True story.

5 7 replies
@RoyaltyInTraining. 2026-06-19

Can't wait to pay 3x usage for a tiny improvement in quality. I sure love wasting tokens!

3 1 replies
@burakaydn5661 2026-06-19

So without Vercel you cannot access multiple providers using a single endpoint?

2 2 replies
@Leneufcinqcergy 2026-06-19

Been doing this forever. It works but needs the human in the loop

1 1 replies
@SeattleSysop 2026-06-19

I've tried this out manually when I first started using llms, but by hand, and its true, some are better for certain aspects, one is better at code, one is better at the design, etc, etc. Then you have them each check each others work. I was acting as the human api gateway and orchestrator, but I think most people knew this by human nature, we just didnt do it in the design, we did a 1 vs 1, and agents are just clones of the same provider. People are finally breaking out to multi model interactions. I wrote a quick shell script to try this with lm-studio and 5 models, 1 chairman, 4 diff lm models. The only thing, is I didnt have it anonymized, then I had them work on a project, and they did group vote, and chairman had the final decision. Interested to see how multi model makes into frameworks.

1 1 replies
@richardkuhne5054 2026-06-20

I‘m using open router fusion for this and mostly to review and critique a plan before executing it in a coding agent so it takes the review points and updates the plan if it agrees

1 1 replies
@engineerprompt 2026-06-19

Checkout Vercel's AI Gateway: https://vercel.plug.dev/B3rLR9K

1
@MeinDeutschkurs 2026-06-19

Every time I think there is no other way to burn tokens easily something like this appears. A loop is missing, and switching the roles. 🎉 ah, I’ve forgotten to say that at the end there should be a council for the n^2-1 councils.

0 2 replies
@Jackson_M5 2026-06-21

Underexploited .... correct directionally

0
@CanadianGlazier 2026-06-22

you understand that i am seeing this video 3 days after posting and it is so outdated..... LLM change daily...... you can't post a YouTube video...... it is already obsolete....

0

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot