You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
NeoAgent captures skill drafts after 3+ repeated successful runs (server/services/ai/learning.js) but never re-evaluates or improves those instructions over time. Once a draft is written, it is static. Runs that use the skill and succeed or fail do not feed back into the skill text.
Hermes Agent (Nous Research) demonstrates that a closed feedback loop — measuring skill reuse success rate and rewriting instructions from task outcomes — achieves measurably faster task completion over time (reported 40% speedup in their benchmarks). The current approach captures pattern repetition but discards the signal from actual skill invocations.
Required change
Track skill usage: when an agent run invokes a skill, record the run's outcome (success/failure/user correction) against that skill.
After N uses, trigger a refinement pass: use the model to diff the current instructions against the observed successful and failed invocations and produce improved instructions.
This issue is AI generated.
Problem
NeoAgent captures skill drafts after 3+ repeated successful runs (
server/services/ai/learning.js) but never re-evaluates or improves those instructions over time. Once a draft is written, it is static. Runs that use the skill and succeed or fail do not feed back into the skill text.Hermes Agent (Nous Research) demonstrates that a closed feedback loop — measuring skill reuse success rate and rewriting instructions from task outcomes — achieves measurably faster task completion over time (reported 40% speedup in their benchmarks). The current approach captures pattern repetition but discards the signal from actual skill invocations.
Required change
auto_skill_learning(which should already be fixed per Honor the auto_skill_learning setting before capturing skill drafts #55).Acceptance criteria