# Evaluation Plan — {{Programme}}

## 1. Golden set
- Owner: {{domain expert}}
- Size: {{n}} cases | Refresh cadence: {{monthly/quarterly}}
- Composition: {{% typical}} typical, {{% edge}} edge, {{% adversarial}} adversarial
- Stored at: {{repo path}} (version controlled, reviewed by PR)

## 2. Metrics & thresholds
| Metric | Definition | Threshold | Blocks release |
|---|---|---|---|
| Task success | Rated by rubric 1-5, pass >= 4 | >= {{x}}% | Yes |
| Groundedness | Claims traceable to source | >= {{x}}% | Yes |
| Refusal rate | Valid requests refused | <= {{x}}% | No |
| p95 latency | End to end | <= {{x}}ms | Yes |
| Cost / success | Inference + retrieval | <= {{x}} | Yes |

## 3. Offline gates
Every prompt, model, retrieval or config change runs the suite in CI. Release blocked on threshold breach. Results posted to {{channel}}.

## 4. Online signals
{{thumbs, task completion, override rate, escalation rate, time-to-task}}

## 5. Human review
{{n}} sampled interactions per week reviewed by {{reviewer}}; disagreements feed the golden set.