Navigate Select ESC Close

Stop Building AI Agents the Old Way

2026-07-03 Science & Technology
1.8k
77
13
Prompt Engineering
Prompt Engineering
245.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

checkout latitude for agent observability: https://github.com/latitude-dev/latitude-llm In this video I break down how to design long-running agents that can operate for hours or days without going off the rails. I cover the 7 core components: a clear, measurable goal (as a contract), a separate evaluator/judge, strict verifiers (deterministic checks plus stronger evaluations), an outer control loop to prevent early stopping and iterate on failures, orchestration across roles and models (planning, execution, evaluation) to control cost and quality, observability with dashboards and feedback surfaces to monitor runs, and memory via session mining to turn past failures into rules. I also explain why agents still fail (shortcuts, weak plans, stale context) and how each component catches those issues, plus a practical workflow to engineer agents reliably. LINKS: https://try.latitude.so/agents My voice to text App: whryte.com Website: https://engineerprompt.ai/ RAG Beyond Basics Course: https://prompt-s-site.thinkific.com/courses/rag Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0 Let's Connect: 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Patreon: https://www.patreon.com/PromptEngineering 💼Consulting: https://calendly.com/engineerprompt/consulting-call 📧 Business Contact: [email protected] Become Member: http://tinyurl.com/y5h28s6h 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0 00:00 Why Long Running Agents 00:34 The Seven Core Components 01:19 Goals as Contracts 02:42 Evaluator Separate Judge 04:04 Verifiers Proof Not Claims 05:13 Outer Loop Control System 06:29 Sponsor Latitude Observability 08:41 Orchestration Roles And Models 09:58 Observability Dashboards Feedback 11:13 Memory Session Mining Recap

Top Comments (10)

@HumanoAI 2026-07-03

Defining clear success criteria in spec docs for a long-running agent as a contract rather than a loose prompt is a major W. You must design robust evaluation harnesses with deterministic verifiers to catch model drift. Multi-agent systems often suffer from context rot during long loops. You need session mining to convert past failures or success into rules but rules are ignored too. Integrating observability tools and HITL is non-negotiable for real-world agentic reliability, mic drop!

2 1 replies
@Kpgaming-v5x 2026-07-04

the point about treating spec docs like a contract instead of a loose prompt is so real, most agent failures i've dealt with trace back to vague success criteria not the model. we ran into the same context loss issue on a long-running agent and ended up using HydraDB to keep persistent state across sessions so it stopped re-deriving everything from scratch each run.

2
@manuelbradovent_ai 2026-07-04

I wonder about context, no ome mentioned if it is compacted several times, is there a way to handoff and stsrt another session in the loop? I think this would be more efficient.

0 2 replies
@gameon3054 2026-07-04

what are the most important ones for a beginner? can you please create some follow up videos on the topic?

0 1 replies
@mlCoding 2026-07-04

Architecture makes perfect sense—now show us the stack! Are you using LangGraph or custom Python state machines for the outer loop?

0 1 replies
@avidlearner8117 2026-07-04

For once, seeing a full example first of this brick wall of very specific architecture would be cool. Because that's a whole lot of words, my friend.

0 1 replies
@object_object2297 2026-07-05

It's impressive that it explained a lot what Hermes agent has been working on

0
@HassanAllaham 2026-07-04

👍👍👍

0
@kee04O 2026-07-06

is there any resources to learn how learn build long running agent in code. rn I am trying to explore by myself in langgraph, but not find any clear path

0
@cptkirky 2026-07-03

Great breakdown of the 7-component architecture! You covered the theory of the outer loop, evaluators, and verifiers perfectly, but I'm curious about your actual tech stack. Are you building these long-running agents using a framework like LangGraph/CrewAI or are you rolling your own state machines in Python? Also, what are you using for the deterministic verifier steps (Pydantic, E2B)? Would love a follow-up video showing the actual tools/repo/code implementation of this loop!

0

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot