skill-upEvaluation framework for Agent Skill developers

Declare your eval environment, dependencies, test cases, and grading strategy in YAML — run it locally or in CI.

Declarative Eval Config

Define evaluation environment, engine, model, and cases through YAML (eval.yaml + cases/*.yaml).

Configuration reference

Works with Qoder CLI, Claude Code, and Codex as Agent Engines.

Supports rule_based, script, and agent_judge evaluation strategies.

Grading strategies

Outputs Anthropic-compatible grading.json, benchmark.json, plus result.json, JUnit XML, and HTML reports.

Output layout

Import evals.json via skill-up import, or auto-detect with --auto.

Migration guide

Designed for local development and continuous integration pipelines.

Exit codes