arXiv:2606.20333: SoftSkill Compresses Skill Documents into 32 Latent Tokens and Boosts LiveMath by 42.1 Points
SoftSkill is a method described in the paper arXiv:2606.20333 that converts skill documents, such as Markdown SKILL.md files, into compact continuous latent objects that guide model behavior without modifying the base model. Instead of hundreds or thousands of instruction tokens, SoftSkill uses 32 virtual tokens and achieves an improvement of 42.1 percentage points on the LiveMath task compared to operating without the skill.