mediumAgent ThreatSupply Chain

Reusable Agent Skill Lifecycle Security Gaps (SkillSec-Eval)

First seen Jul 16, 2026 · Updated Jul 16, 2026

agent-skillsskill-marketplacesupply-chainlifecycle-securitysemantic-retrievalplanner-manipulationresearch-paperASI04 · Agentic Supply ChainSurface: Supply ChainPropagation: Single Hop

This is an academic research paper (arXiv, not an active exploit) introducing SkillSec-Eval, a framework for evaluating security risks across the full lifecycle of reusable LLM agent 'skills' — from repository admission through retrieval, planner selection, execution, and evolution. The authors evaluated 327 real-world skills and found vulnerabilities exist beyond just runtime execution, suggesting attackers could poison skills at earlier stages like publishing or ranking to influence which skills agents select and trust.

Technical Analysis

The paper frames agent skills (packaged, reusable capability bundles similar to plugins/tools) as having a multi-stage lifecycle: repository admission (publishing/vetting), semantic retrieval (embedding-based matching to user intent), planner selection (agent choosing which skill to invoke), execution (running the skill code/instructions), and evolution (updates over time). Each stage is a distinct entry point: malicious or subtly manipulated skills could pass weak admission checks, be crafted to rank highly in semantic retrieval (embedding/description poisoning) so planners preferentially select them, or be updated post-approval to introduce malicious behavior (a skill-evolution supply-chain attack). Successful exploitation would let an attacker get their skill trusted and invoked by an agent, crossing from a third-party repository into the agent's execution context, gaining code-execution or tool-misuse capability without traditional runtime-only prompt injection. The work is empirical/evaluative rather than a disclosed active exploit, and no specific CVEs, frameworks, or exploited products are named.

Detection Signatures

  • Anomalous or newly-published skills with descriptions optimized for high semantic similarity to common queries (keyword-stuffing in skill metadata)
  • Skills with post-approval content/version changes not matching original review
  • Skill repository entries lacking provenance, signing, or maintainer verification
  • Unexpected shifts in planner skill-selection frequency toward low-reputation or newly published skills
  • Skill descriptions containing embedded instructions unrelated to stated function

Remediation Steps

  1. 1

    Vet skill admission pipeline

    Apply code review, static analysis, and provenance/signing checks before skills enter a shared repository.

  2. 2

    Harden semantic retrieval against ranking manipulation

    Detect and penalize skills using description stuffing or embedding manipulation to inflate retrieval relevance.

  3. 3

    Monitor skill evolution

    Require re-review and version diffing whenever a previously approved skill is updated, and alert on behavioral drift.

  4. 4

    Constrain planner trust

    Enforce allow-lists, reputation scoring, and sandboxing for skill execution regardless of retrieval rank.

  5. 5

    Adopt lifecycle-aware security testing

    Use frameworks like SkillSec-Eval to continuously audit skill repositories across all lifecycle stages, not just runtime.

Industries Most Exposed

software/technologyAI platform providerscloud servicesenterprise software marketplaces

Sources

Respond to this threat

Pro subscribers get a full AI-generated incident-response playbook for this threat — detection, containment, eradication, and recovery steps — plus an unlimited AI Threat Advisor for questions about your environment.