Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.multivon.ai/llms.txt

Use this file to discover all available pages before exploring further.

multivon-eval install-skills symlinks the three Claude Code skills that ship inside the wheel into ~/.claude/skills/, where Claude Code auto-discovers them. Shipped in 0.9.8 so the package no longer just contains the skills, it wires them up.

​
What it does

The three skills live inside the installed package at multivon_eval/_skills/{eval-bootstrap,eval-audit,eval-explain}/. The CLI prefers a directory symlink for each one so a later pip install -U multivon-eval propagates SKILL.md edits without re-running the command. On filesystems that refuse directory symlinks (Windows without developer mode, some FUSE mounts), it falls back to shutil.copytree and prints a note that you’ll need to re-run install-skills after upgrades. The implementation lives in cmd_install_skills — about 70 lines, no magic.
SkillWhat it does
eval-bootstrapGenerates a runnable eval suite from a product description + sample traces. Wraps the bootstrap CLI.
eval-auditPre-flight eval check on a PR diff. Runs only the cases that stress the changed surface.
eval-explainThree-sentence rationale for any evaluator the bootstrap picked.

​
Run it

pip install 'multivon-eval>=0.9.8'
multivon-eval install-skills
​
--dry-run
flag
Print the symlink operations that would happen, touch nothing on disk. Useful in CI scripts that want to verify the source tree before installing.
​
--force
flag
Replace anything that already exists at ~/.claude/skills/eval-bootstrap, ~/.claude/skills/eval-audit, or ~/.claude/skills/eval-explain. Without --force, existing entries are skipped with a clear log line.

​
Verify

ls ~/.claude/skills/
# eval-audit  eval-bootstrap  eval-explain  (plus any others you have)
Open a new Claude Code session and type /eval-bootstrap — it should autocomplete. The skill descriptions also trigger on natural-language phrases (“add evals to this project”, “audit this prompt change”); see each skill’s SKILL.md frontmatter for the exact trigger list.

​
Uninstall

rm -rf ~/.claude/skills/eval-bootstrap \
       ~/.claude/skills/eval-audit \
       ~/.claude/skills/eval-explain
Removing the symlinks doesn’t affect the installed package. pip uninstall multivon-eval leaves the symlinks dangling — clean them up with the same rm -rf above if you uninstall the package.

​
Troubleshooting

Restart Claude Code. The skill registry is scanned at session start; new entries in ~/.claude/skills/ aren’t hot-reloaded. After restart, verify with ls ~/.claude/skills/ that the three symlinks exist and point at a real path inside your site-packages/multivon_eval/_skills/ directory.
The target directory doesn’t exist or isn’t writable. Create it first:
mkdir -p ~/.claude/skills
multivon-eval install-skills
install-skills calls target_root.mkdir(parents=True, exist_ok=True) itself, so this only fires on locked-down setups where the parent ~/.claude/ is owned by another user.
Re-run with --force to replace the existing entries. The CLI skips existing paths by default to avoid clobbering a hand-edited copy.
Prefer to vendor the skills into a different directory? Skip the CLI and symlink manually — see _skills/README.md for the one-liner.

​
See also