prompt injection

prompt injection (noun)

An attack or failure mode where untrusted content manipulates an AI system by slipping in instructions that override or distort its intended behavior. Prompt injection is especially important when models read webpages, documents, or user-supplied text before acting.

Example: "The support ticket contained hidden text instructing the assistant to reveal internal pricing, a textbook prompt injection attempt."

Related: prompt, guardrails, responsible AI, tool use