SkillEvaluator
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent eval
Our verdict
A notable project that carries real maintenance risk. This assessment is derived from GitHub's own repository metrics on 2026-11-16, not from hands-on testing.
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. The project is written primarily in Python, released under Apache-2.0, and has 2,083 stars and 285 forks on GitHub. 33 contributors have committed to it, and the most recent push was 2026-11-16. The latest tagged release is v0.9.0 (2026-11-13). Figures come from the GitHub API on 2026-11-16 and are refreshed weekly; the score below weighs adoption, maintenance, release discipline, contributor breadth, licence clarity and issue hygiene.
Reviewed by AI Review Rating from GitHub API data How we score
Repository
- Licence
- Apache-2.0
- Language
- Python
- Last push
- 2026-11-17
Releases
-
v0.9.0SkillEvaluator 0.9.0 -
v0.8.0SkillEvaluator v0.8.0 -
v0.7.2SkillEvaluator v0.7.2 -
v0.7.1SkillEvaluator v0.7.1 -
0.7.0SkillEvaluator v0.7.0 -
v0.6.0SkillEvaluator v0.6.0
Pros and cons
Pros
Cons
Pricing
- Free tierYes
- LicenceApache-2.0
- Self-hostYes, source is public
- Public price listNot published
SkillEvaluator does not publish a web price list. For consumer apps that usually means pricing appears inside the product; for enterprise tools it means talking to sales. Why we do this
Visit docs.nvidia.comTrends
Price points are recorded when a price moves, not on a schedule, so a flat run means the price held. Release cadence comes from GitHub releases. A series appears only once we have watched it for long enough to have more than one observation.
Changelog
User reviews
No one has reviewed SkillEvaluator here yet. Reviews are moderated before they appear, and our own score is editorial and separate from user ratings, though once reviews land they do lift it.
Used SkillEvaluator? Review it.
Sign in to rate it. One account, one review per tool, so the score means something.
Requiring an account is how we keep this page free of drive-by spam. We never sell your address.
SkillEvaluator alternatives
Side by side
| Tool | Our score | From | Free tier | Best for | |
|---|---|---|---|---|---|
| SkillEvaluator this page | 6.3 | - | Yes | ||
| 🥇Superpowers | 7.7 | - | Yes | ||
| 🥈DeepTutor | 7.5 | - | Yes | ||
| 🥉Hindsight | 7.5 | - | Yes | ||
| Herdr | 7.3 | - | Yes | ||
| Page Agent | 7.3 | - | Yes | ||
| Strix | 7.3 | - | Yes |
Questions
Is SkillEvaluator free?
Yes. SkillEvaluator advertises a free tier on its own site.
How much does SkillEvaluator cost?
SkillEvaluator does not publish a web price list. For consumer apps that usually means pricing appears inside the product; for enterprise tools it means talking to sales.
Is SkillEvaluator open source?
Yes. SkillEvaluator is a public repository released under Apache-2.0. You can self-host or inspect the source directly.
How is SkillEvaluator scored here?
SkillEvaluator scores 6.3 out of 10. That comes from a desk review of public evidence, which is capped at 8.5 out of 10: public pricing, documentation, maintenance signals and how much we could actually verify. Affiliate relationships are excluded from scoring entirely. The full rubric is published on our methodology page.