For the full specification, see 10-tests.md.
Tool Tests
Each tool inmain.tools must have at least 3 test entries:
Agent Tests
Agent tests validate tool selection (deterministic) and content assertions (partial):Three-Level Test Model
| Level | Field | Deterministic? | Description |
|---|---|---|---|
| Tool Usage | expectedTools | Yes | Which tools the agent must call |
| Content | expectedContent | Partial | Strings the response should contain |
| Quality | Manual review | No | Subjective assessment |
Test Minimum (TST001)
| Primitive | v2 Minimum | v3 Minimum |
|---|---|---|
| Tool | 1 test | 3 tests |
| Resource query | 1 test | 3 tests |
| Agent | N/A | 3 tests |