marketing-shibata50/claude-code-ultimate-guide
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
claude-code-ultimate-guide/machine-readable
History
Florian BRUNIAUX ef7cdd899e release: v3.24.0 - Agent Evaluation Framework 
Major addition: Complete agent evaluation framework with production-ready template.

## Added

- **Resource Evaluation**: nao framework (score 3/5)
  - Identified critical gap: agent evaluation not documented
  - Technical challenge adjusted score 2/5 → 3/5
  - All claims fact-checked (TypeScript 58.9%, Python 38.5%)

- **Guide Section**: Agent Evaluation (guide/agent-evaluation.md, ~3K tokens)
  - Metrics: response quality, tool usage, performance, satisfaction
  - Patterns: logging hooks, unit tests, A/B testing, feedback loops
  - Example: analytics agent with built-in metrics
  - Tools: nao framework reference, Claude Code hooks integration

- **AI Ecosystem**: Section 8.2 Domain-Specific Agent Frameworks
  - nao (Analytics Agents): Database-agnostic, built-in evaluation
  - Transposable patterns: context builder, evaluation hooks, DB integrations

- **Template**: Analytics Agent with Evaluation (5 files, ~1K lines)
  - README: setup, usage, troubleshooting
  - Agent: SQL generator with evaluation criteria, safety rules
  - Hook: automated metrics logging (safety, performance, errors)
  - Script: analysis with stats, safety reports, recommendations
  - Report template: monthly evaluation format

## Changed

- Agent Evaluation Guide: updated template references, verified links
- Landing Site: templates count 110 → 114
- Version: 3.23.5 → 3.24.0

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
2026-02-10 11:52:13 +01:00
..
claude-code-releases.yaml sync: Claude Code v2.1.38 release 2026-02-10 08:29:07 +01:00
cowork-reference.yaml docs: complete Cowork documentation v1.0 (Phase 2) 2026-01-20 11:23:43 +01:00
llms.txt feat: add ecosystem positioning, install script & new commands 2026-01-19 08:42:33 +01:00
README.md refactor: restructure repo into thematic directories v3.1.0 2026-01-13 15:30:02 +01:00
reference.yaml release: v3.24.0 - Agent Evaluation Framework 2026-02-10 11:52:13 +01:00

README.md

Machine-Readable References

Files optimized for LLM/AI consumption.

Contents

File Description Tokens
reference.yaml Structured index with line numbers for deep dives ~2K
llms.txt Standard LLM context file for repository indexation ~1.5K

Usage

Give Claude Code instant expertise

# Paste into any AI assistant
curl -sL https://raw.githubusercontent.com/FlorianBruniaux/claude-code-ultimate-guide/main/machine-readable/reference.yaml

Reference in Claude Code

@machine-readable/reference.yaml

Add to system prompts

Include the YAML content in your AI assistant's system prompt for Claude Code expertise.

Back to main README