Microsoft Unveils Open-Source SkillOpt for AI Agent Skill Optimization

Microsoft has released SkillOpt, a new open-source framework under an MIT License, developed to automatically optimize the skills of AI agents. Agent skills, typically stored as text-based markdown files, are crucial for adapting AI models to specific enterprise use cases and complex workflows.

Traditionally, optimizing these skills has been a manual and slow process. Users typically retype instructions, often relying on trial and error to improve performance. This lack of mathematical control can lead to instability, performance degradation, and repeated errors, particularly in multi-step workflows where frontier models may struggle with procedural discipline.

SkillOpt introduces an optimizer specifically designed for agent skills, treating the skill document itself as a trainable object that evolves based on performance feedback. It applies deep-learning-style optimization techniques to explore and implement modifications to the skill document systematically. Crucially, this adaptation occurs without altering the weights of the underlying AI model.

The framework operates through an iterative propose-and-test loop. An optimizer model analyzes execution trajectories from a frozen target model, identifying systematic procedural errors. It then proposes structural edits (add, delete, replace) to the skill document. These proposed changes are subject to an 'edit budget,' acting as a learning rate, and evaluated on a held-out validation set. Accepted edits form the new skill, while rejected edits are recorded to prevent recurrence.

Evaluations across various industry benchmarks show SkillOpt consistently outperforms existing baselines, including human-written and one-shot LLM-generated skills. It delivered an average absolute improvement of +23.5 points against no-skill baselines on GPT-5.5 and enabled significant relative gains for smaller models like GPT-5.4-nano. These improvements are noted in areas critical for enterprises, such as document data extraction and reliable automation of multi-step operations.

SkillOpt is designed for portability, efficiency, and compatibility. It is harness-agnostic, meaning skills trained in one environment can be deployed in another with significant gains. The optimized skill artifacts are compact, typically under 2,000 tokens, making them readable and manageable. For enterprise use, training a skill for a single task can cost an average of $1–5, provided there are dozens of representative examples and a scorable feedback signal for the tasks.

According to VentureBeat, Yifan Yang, Senior Research SDE at Microsoft Research Asia, highlighted that the core problem SkillOpt solves is not merely making changes, but ensuring those changes are mathematically sound and lead to verifiable improvements.