Week 5 · Session 5 · 2 hours · Showcase

Guardrails & Ship It

A clever agent nobody can trust is a toy. Today you make yours trustworthy: you log every step, evaluate it on real cases, and guard it against bad inputs — then you ship and demo your capstone. You’ll leave saying: “I evaluated it, guarded it, demoed it — it’s on my resume.”

Begin →
Today you will

Three real wins

🔭

Observe every step

Log the agent’s Thought/Action/Observation trace with LangSmith so you can debug it.

📊

Evaluate it

Run your agent on a small test set and score it — pass rate, not vibes.

🛡️

Guard the edges

Block prompt-injection and off-limits requests before they reach a tool.

Trust checklist: GUARD, then LOG, then EVAL, then SHIP
Before you ship: guard → log → eval.
Trust checklist: LOG what it did · EVAL whether it’s right on real cases · GUARD against bad or malicious input · then SHIP.
The Arc · check each off as you go in Colab (NB5)

Your step-by-step for today

Guard the gate

Allow it, or block it?

A guardrail sits between the user and your tools. For each incoming message, decide whether a well-guarded agent should run it or refuse.

0 / 5
Loading…
Showcase

The 4-beat demo that lands

You have 3 minutes at the Showcase. A great demo isn’t “here’s everything” — it’s four clean beats that prove your agent is real.

30s
1 · The problem

One sentence: who has this problem and why it’s annoying. No preamble.

60s
2 · The live run

Type a real request. Show the agent reason, call a tool, and answer. Let them see the loop.

45s
3 · The receipt

Show one artifact: the trace, an eval score, or a caught attack. Proof it works and is guarded.

45s
4 · The honest limit

Name one thing it can’t do yet, and what you’d build next. Engineers show the edges.

Resume bullet, with a number: “Built and shipped a tool-using LLM agent (LangChain + RAG) that answered 4/5 eval cases correctly and blocked prompt-injection; demoed publicly.”
Pick your build

Capstone menu — or bring your own

📚 Study Buddyintro
A RAG agent over your own class notes that answers questions and cites the page.
Uses: Wk1 loop · Wk3 RAG · Wk5 guardrail
🗞️ Research Crewadvanced
A Researcher + Writer + Critic crew that produces a short, sourced brief on any topic.
Uses: Wk4 multi-agent · Wk3 search · Wk5 eval
🧮 Homework Checkerintro
A tool-using agent that solves and verifies math/word problems with a calculator tool.
Uses: Wk1 tools · Wk2 memory · Wk5 eval
🎟️ Event Planner Agentadvanced
An agent with memory that plans a trip/event step by step, calling date + search tools.
Uses: Wk2 memory · Wk4 ToT · Wk5 guardrail
Lock it in

Law, badge, and the finish line

Law #5 · Week 5
An agent you can’t observe, you can’t trust.

Log every step, evaluate on real cases, guard the edges. Then — and only then — ship.

🚀

Badge earned: Shipped-It

You logged, evaluated, and guarded your agent, then gave a public 4-beat demo with a shown artifact.

🏆

All 5 badges → Agentic Architect

Loop, memory, retrieval, coordination, and trust — you can design and ship a real agent. Announced at the Showcase.

◆ Back to course home