lowAgent ThreatMemory Poisoning

Retrieval-Layer Knowledge Poisoning and Prompt Injection in RAG-based Intrusion Detection

First seen Aug 11, 2026 · Updated Aug 11, 2026

RAGknowledge-poisoningprompt-injectionintrusion-detectionvector-databasedefense-researchacademicASI04 · Agentic Supply ChainAML.T0051AML.T0020Surface: MemoryPropagation: Single Hop

This is a defensive research paper (not an active exploit) describing RAG-IDS, a multi-agent intrusion detection framework that mitigates knowledge-base poisoning and prompt-injection attacks against RAG-based network flow classifiers. The paper reports strong empirical recovery of classification performance under simulated attacks, indicating a proactive defense contribution rather than a newly disclosed vulnerability or active threat. Severity is low because this describes mitigation research, not a real-world exploit or vulnerable deployed system.

Technical Analysis

The underlying threat model, which this paper defends against, involves an attacker poisoning the vector knowledge base used by a RAG-based intrusion detection system (e.g., injecting mislabeled or adversarial network flow records) so that retrieval returns misleading context, causing the downstream LLM classifier to mislabel malicious traffic as benign. A related vector is prompt injection embedded in retrieved documents, which can manipulate the LLM's reasoning or trigger label flips when single-document retrieval is used. The paper's defense (RAG-IDS) uses label-embedding consistency checking (LECC), soft trust scoring, and prompt sanitization at the retrieval boundary to detect and demote poisoned or injected content before it reaches the generation stage, and shows multi-document retrieval significantly reduces attack success rates. This crosses agent/tool boundaries in the sense that the vector store acts as an untrusted external memory source feeding a multi-agent classification pipeline, so poisoning propagates from retrieval into downstream agent decisions and generated incident reports.

Detection Signatures

  • Anomalous drop in label-embedding consistency between retrieved documents and their claimed classification labels
  • Spike in retrieval trust-score demotions during ingestion of new knowledge base entries
  • High label-flip rate under single-document retrieval versus multi-document retrieval
  • Suspicious natural-language instructions embedded within retrieved network-flow descriptions or metadata fields
  • Unexpected clustering of low-trust or recently-added vectors near decision boundaries

Remediation Steps

  1. 1

    Apply label-embedding consistency checking

    Validate that retrieved document embeddings are consistent with their assigned labels before allowing them to influence classification output.

  2. 2

    Use multi-document retrieval

    Aggregate multiple retrieved sources rather than relying on a single document to reduce the impact of any one poisoned or injected record.

  3. 3

    Implement soft trust scoring over hard filtering

    Demote suspicious knowledge base entries proportionally rather than binary-filtering, improving robustness at low-to-moderate poisoning rates.

  4. 4

    Sanitize retrieved content before prompt assembly

    Strip or neutralize embedded natural-language instructions in retrieved documents prior to inclusion in LLM prompts.

  5. 5

    Monitor and audit knowledge base ingestion

    Apply provenance tracking and anomaly detection on new entries added to the vector store to catch poisoning attempts early.

Industries Most Exposed

cybersecuritytelecommunicationscritical-infrastructurecloud-services

Sources

Respond to this threat

Pro subscribers get a full AI-generated incident-response playbook for this threat — detection, containment, eradication, and recovery steps — plus an unlimited AI Threat Advisor for questions about your environment.