Loading MCP server directory, please wait...
Run a golden set and gate LLM model swaps on accuracy, with latency and cost per request.
npx @getmcp/cli add io.github.razilzul/llm-eval-harnessRequires Docker Engine. Community-contributed server. Review source before installing.
Config file: ~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"io.github.razilzul/llm-eval-harness": {
"command": "docker",
"args": [
"run",
"-i",
"--rm",
"-e",
"ANTHROPIC_API_KEY",
"-e",
"GEMINI_API_KEY",
"ghcr.io/razilzul/llm-eval-harness:1.0.0"
],
"env": {
"ANTHROPIC_API_KEY": "",
"GEMINI_API_KEY": ""
}
}
}
}