General session image of Knowledge Forum C

AI as a Confused Deputy: When Social Engineering Targets AI Assistants

Prompt injection, hidden instructions, and AI abuse: how attackers exploit AI assistants and how to defend against them.

Topic

AI & Quantum Security

When & Where

calendar_month

Tue, 10/27/2026 03:45 PM - 04:00 PM

location_on

Forum C, Booth 7-720

Download session as iCaldownload_for_offline

Details

  • Format:

    Technology lecture

  • Language:

    German

Session description

Speaker: Max Heidenreich

AI assistants are increasingly reading emails, triaging alerts, and taking action in security operations. They act with the permissions of their operators, yet lack the ability to judge intent. Adversaries are already exploiting this gap through prompt injection attacks and hidden instructions embedded in emails, documents, and malware samples.

This session explores documented attack scenarios, introduces the Confused Deputy principle as a useful lens for understanding AI security risks, and outlines controls that go beyond the model itself. Topics include least-privilege design, trust-boundary separation, logging and monitoring, and resilience testing against adaptive attackers. Participants will leave with three practical questions to eval ...

Sponsored by