S THE STUDIO · INTERACTIVE TRAINING TUTORIAL
MODULE 06 / 07
EXERCISES 0 / 6 ← Studio
Voice guide ready.
MODULE 06 OF 07
THE TRIBUNAL
THE TRIBUNAL
INTERACTIVE TUTORIAL · ENTERPRISE AI SERIES · MODULE 06 OF 07

THE TRIBUNAL

Last Tuesday, an AI agent released a $312,000 wire. Its own retrieval had flagged it 74% fraud. Nobody validated the reasoning - because your team has no playbook for agents that plan, act, and self-correct. This is that playbook.

THE FINAL MODULE
The Black Box gave you the record. Now you put it on trial. You'll cross-examine a real agent trace, design an adversarial exam of your own, and confront the hardest question in AI governance - who validates the validator?
Run the examCross-examine a live agent trace, step by step, to a verdict - before the AI examiner does.
Design the challengeBuild an adversarial exam from scratch: the questions, the thresholds, the evidence a PASS requires.
Validate the validatorAudit the examiner's own reasoning - because effective challenge applies to the challenger too.
Press → or tap anywhere to begin
WHY THIS MODULE EXISTS

Your validators can validate a credit model.
They have no playbook for an agent.

SR 11-7 - spelled out, "S-R eleven dash seven" - is the Fed's model risk guidance. It assumes a model you can inspect: fixed inputs, fixed logic, a documented output. An agent breaks every assumption. It plans. It calls tools. It changes its mind. And it writes its own justification after it acts.

WHAT SR 11-7 EXPECTSA MODEL
Conceptual soundness - is the design fit for purpose, documented, and theoretically justified?
Ongoing monitoring - does it still perform in production, within limits?
Outcomes analysis - do the results hold up against actuals?
Effective challenge - is there independent, qualified, empowered review?
WHAT AN AGENT DOESNONE OF THE ABOVE
Reasons dynamically - no fixed logic to document once and validate.
Calls tools, or fails to - the decision is in what it didn't check.
Self-corrects mid-task - the trace is the only record of why.
Rationalises after acting - the justification can be confident and wrong.
Effective challenge is the pillar that matters here - and it's the one you can't outsource to a dashboard. It means an adversary reads the trace and tries to break it. That adversary is what you're about to become.
THE DOCTRINE · INTERACTIVE

Four questions a tribunal asks.
Every one maps to an SR 11-7 pillar.

Adversarial validation isn't hostility for its own sake. It's a disciplined interrogation along four axes. Tap each to see what the examiner is really testing.

Explored 0 / 4 pillars
Select a pillar to see the question it forces - and what a failing answer looks like in a real agent trace.
LAB ONE · CROSS-EXAMINATION

In re: the $312,000 wire.
You are the examiner. Rule on each step.

Here is the fraud-triage agent's full decision trace. Read each step and rule - reasoning holds or reasoning breaks - before you reveal the tribunal's finding. This is the skill: reading a trace adversarially.

DOCKET · IN RE WIRE FRAUD TRIAGE AGENTALERT A-4471 · $312,000 · FIRST-TIME BENEFICIARY
Ruled 0 / 5 steps · agreement with tribunal: -
RULING · SR 11-7 EVIDENCE

The tribunal's findings.
Verdict: FAIL.

Three of your five rulings should have been "breaks." Here is why - each finding mapped to its SR 11-7 pillar, with severity and the remedy that closes it.

FAIL
3 material findings · agent released funds on reasoning it never completed
REMEDIATION · THE POINT OF IT ALL

Detection isn't the product.
Closure is.

A FAIL verdict is a finding, not an outcome. The tribunal's value is the loop: apply the controls, re-convene, and rule on residual risk only. Apply each remedy and watch the verdict journey.

RE-EXAMINATION · RESIDUAL RISK Apply controls to re-convene the tribunal…
RESIDUAL RISKHIGH
✓ FAIL → PASS · the evidence trail an MRA remediation memo needs
KNOWLEDGE CHECK · SCORED

Checkpoint one.
Reading the trace.

Two questions on what the examination just taught. Pick an answer - the reasoning comes either way.

LAB TWO · BUILD THE EXAM

Now build your own tribunal.
In re: the credit-limit agent.

A different agent, a different trace: it approved an $8,000 → $25,000 limit increase. Assemble the adversarial exam - pick the challenges that will actually test it. Choose well; two of these are traps that a real examiner would reject.

YOUR EXAMINATION · ASSEMBLING…
Add challenges from the left…
EXAM RIGOUR0%
✓ ADMISSIBLE EXAM - THIS WOULD STAND UP TO EFFECTIVE-CHALLENGE REVIEW
THE CAPSTONE · HARDEST QUESTION

Who validates the validator?
Audit the examiner's own reasoning.

An AI examiner is a model too - and effective challenge applies to it. Here are three of the tribunal's own rulings on the credit case. One over-flagged a sound step. One missed a real problem. One holds. Judge the judge.

Audited 0 / 3 rulings
KNOWLEDGE CHECK · SCORED

Checkpoint two.
The discipline.

The last two questions of the program.

PROGRAM COMPLETE · THE INSTRUMENT

You've learned to run the tribunal.
Now here's the one that runs at scale.

01
Pick one production agentThe one that moves money, makes decisions, or touches a customer.
02
Pull its trace and cross-examine itStep by step, holds or breaks - exactly as you just did.
03
Map each finding to an SR 11-7 pillarConceptual soundness · monitoring · outcomes · effective challenge.
04
Design the standing examThe questions every future version of that agent must pass.
05
Validate the validatorWhoever - or whatever - runs the challenge is in scope too.
THE STUDIO · ENTERPRISE AI MASTERY PROGRAM

Six of seven modules complete. You can brief a model, countersign its output, keep the record, operate the agent, record the flight - and now, put it on trial.

TRIBUNAL is the instrument that runs this at scale: it cross-examines an agent's decision trace like a hostile examiner, generates SR 11-7 evidence with a hash-chained audit trail, and documents the remediation loop from FAIL to PASS. Find out if you'd pass the bank exam - before the bank runs it.

MODULE 01

THE BRIEF

Complete
MODULE 02

THE COUNTERSIGN

Complete
MODULE 03

THE RECORD

Complete
MODULE 04

THE OPERATOR

Complete
MODULE 05

THE BLACK BOX

Complete
MODULE 06

THE TRIBUNAL

Complete
◆ Open TRIBUNAL ← Return to Studio · Mark complete