Deceptive AI

AI systems or techniques designed — intentionally or by inadvertent design — to manipulate, mislead, or exploit users through means that bypass rational agency. This includes subliminal messaging, false urgency, exploitation of emotional states, dark patterns, synthetic media impersonating real people (deepfakes), and AI-generated disinformation. The EU AI Act explicitly prohibits AI systems that deploy subliminal techniques, exploit psychological or physical vulnerabilities, or manipulate behavior in ways that cause harm. Generative AI significantly lowers the cost of producing deceptive content at scale.

An AI-powered notification system is tuned to maximize engagement by detecting user emotional states and sending messages during moments of anxiety — a form of deceptive AI exploitation that is explicitly prohibited under the EU AI Act.