release: v3.24.0 - Agent Evaluation Framework
Major addition: Complete agent evaluation framework with production-ready template.
## Added
- **Resource Evaluation**: nao framework (score 3/5)
- Identified critical gap: agent evaluation not documented
- Technical challenge adjusted score 2/5 → 3/5
- All claims fact-checked (TypeScript 58.9%, Python 38.5%)
- **Guide Section**: Agent Evaluation (guide/agent-evaluation.md, ~3K tokens)
- Metrics: response quality, tool usage, performance, satisfaction
- Patterns: logging hooks, unit tests, A/B testing, feedback loops
- Example: analytics agent with built-in metrics
- Tools: nao framework reference, Claude Code hooks integration
- **AI Ecosystem**: Section 8.2 Domain-Specific Agent Frameworks
- nao (Analytics Agents): Database-agnostic, built-in evaluation
- Transposable patterns: context builder, evaluation hooks, DB integrations
- **Template**: Analytics Agent with Evaluation (5 files, ~1K lines)
- README: setup, usage, troubleshooting
- Agent: SQL generator with evaluation criteria, safety rules
- Hook: automated metrics logging (safety, performance, errors)
- Script: analysis with stats, safety reports, recommendations
- Report template: monthly evaluation format
## Changed
- Agent Evaluation Guide: updated template references, verified links
- Landing Site: templates count 110 → 114
- Version: 3.23.5 → 3.24.0
Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
ef7cdd899e