Skip to main content

madbench

Toolkit for madbench, MadAppGang's Go harness for benchmarking agentic coding tools. Ships the madbench-evals skill: author bench YAML and Eval files, design checks, scaffold red-state and generated testdata, run the negative and positive controls, tune expectations, and debug failing checks.

Version0.2.2
Marketplacemagus
Commands0
Subagents0
Skills1
MCP serverno
Hooksno

Install

claudeup

Find madbench on the Plugins tab and turn it on. claudeup registers the magus marketplace if you do not have it, and installs what the plugin needs to actually run — binaries, MCP servers, CLI tools.

For a team, press s to save your plugins as a profile and commit it. Everyone else runs claudeup install — see Teams and profiles.

Prefer to do it by hand? Installing Magus has the manual path.

Skills

SkillWhat it covers
madbench:madbench-evals4 more docsAuthors, runs, and debugs madbench evals — bench YAML, checks, red-state testdata, the two controls (check / grade), expectation tuning.

Source

plugins/madbench/ on GitHub, including its full README.