-
Notifications
You must be signed in to change notification settings - Fork 464
[Feature] Adding support for evaluating skills ( eval-driven approach) #452
Copy link
Copy link
Open
Labels
effort/l大改动或高风险改动,需要 maintainer 负责 / Large or risky change requiring maintainer ownership.大改动或高风险改动,需要 maintainer 负责 / Large or risky change requiring maintainer ownership.enhancementNew feature or requestNew feature or requestpriority/p1高优先级 / High priority triage bucket.高优先级 / High priority triage bucket.triage/core交由 core maintainer 结合 AI 协同处理 / Issue should be handled by a core maintainer with AI support.交由 core maintainer 结合 AI 协同处理 / Issue should be handled by a core maintainer with AI support.
Metadata
Metadata
Assignees
Labels
effort/l大改动或高风险改动,需要 maintainer 负责 / Large or risky change requiring maintainer ownership.大改动或高风险改动,需要 maintainer 负责 / Large or risky change requiring maintainer ownership.enhancementNew feature or requestNew feature or requestpriority/p1高优先级 / High priority triage bucket.高优先级 / High priority triage bucket.triage/core交由 core maintainer 结合 AI 协同处理 / Issue should be handled by a core maintainer with AI support.交由 core maintainer 结合 AI 协同处理 / Issue should be handled by a core maintainer with AI support.
Type
Fields
Give feedbackNo fields configured for issues without a type.
Problem
We would like to see having support of evaluating skills like skill-scanner in the Web UI.
Additional data:
https://agentskills.io/skill-creation/evaluating-skills
Proposed Solution
Add support for evaluating skills and execute or interpret its results while publishing/exploring the skills
Alternatives Considered
No response
Impact
No response
Contract Or SDK Impact
No response