Sign in

SkillEvaluator

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent eval

6.3 Open source3.1k
SkillEvaluator homepage
docs.nvidia.com · captured 2026-11-16

Our verdict

A notable project that carries real maintenance risk. This assessment is derived from GitHub's own repository metrics on 2026-11-16, not from hands-on testing.

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior. The project is written primarily in Python, released under Apache-2.0, and has 2,083 stars and 285 forks on GitHub. 33 contributors have committed to it, and the most recent push was 2026-11-16. The latest tagged release is v0.9.0 (2026-11-13). Figures come from the GitHub API on 2026-11-16 and are refreshed weekly; the score below weighs adoption, maintenance, release discipline, contributor breadth, licence clarity and issue hygiene.

Reviewed by AI Review Rating from GitHub API data How we score

RepositoryGitHub API, refreshed weekly

3.1kStars
435Forks
5Watching
35Contributors
61Open issues
Licence
Apache-2.0
Language
Python
Last push
2026-11-17
View on GitHub

Releases

  1. v0.9.0 SkillEvaluator 0.9.0
  2. v0.8.0 SkillEvaluator v0.8.0
  3. v0.7.2 SkillEvaluator v0.7.2
  4. v0.7.1 SkillEvaluator v0.7.1
  5. 0.7.0 SkillEvaluator v0.7.0
  6. v0.6.0 SkillEvaluator v0.6.0

Pros and cons

Pros

Cons

Pricing

  • Free tierYes
  • LicenceApache-2.0
  • Self-hostYes, source is public
  • Public price listNot published

SkillEvaluator does not publish a web price list. For consumer apps that usually means pricing appears inside the product; for enterprise tools it means talking to sales. Why we do this

Visit docs.nvidia.com

Changelogwhat changed, most recent first

User reviews

No one has reviewed SkillEvaluator here yet. Reviews are moderated before they appear, and our own score is editorial and separate from user ratings, though once reviews land they do lift it.

Used SkillEvaluator? Review it.

Sign in to rate it. One account, one review per tool, so the score means something.

Create a free account Already a member? Sign in
{{ reviewsTotal }}{{ options.labels.singularReviewCountLabel }}
{{ reviewsTotal }}{{ options.labels.pluralReviewCountLabel }}
{{ options.labels.noReviewsLabel }}
{{ options.labels.newReviewButton }}
{{ userData.canReview.message }}

SkillEvaluator alternatives

Side by side

ToolOur scoreFrom Free tierBest for
SkillEvaluator this page 6.3 - Yes
🥇Superpowers 7.7 - Yes
🥈DeepTutor 7.5 - Yes
🥉Hindsight 7.5 - Yes
Herdr 7.3 - Yes
Page Agent 7.3 - Yes
Strix 7.3 - Yes

Questions

Is SkillEvaluator free?

Yes. SkillEvaluator advertises a free tier on its own site.

How much does SkillEvaluator cost?

SkillEvaluator does not publish a web price list. For consumer apps that usually means pricing appears inside the product; for enterprise tools it means talking to sales.

Is SkillEvaluator open source?

Yes. SkillEvaluator is a public repository released under Apache-2.0. You can self-host or inspect the source directly.

How is SkillEvaluator scored here?

SkillEvaluator scores 6.3 out of 10. That comes from a desk review of public evidence, which is capped at 8.5 out of 10: public pricing, documentation, maintenance signals and how much we could actually verify. Affiliate relationships are excluded from scoring entirely. The full rubric is published on our methodology page.

Related