Detecting Data Leaks in Multi-User LLM Apps via Automated User-Scoped Taint Analysis
LLM-Powered Apps (LPAs) are increasingly being deployed on shared cloud servers where multiple users interact at the same time. This creates data leak risks where one user’s private data can flow into another user’s session through shared caches, misconfigured access control policies, or concurrency bugs in multi-threaded and event-driven code. Existing taint analysis tools do not handle these risks well because they need manual source-sink marking, only track control and dataflow, and do not account for access control policies, complex app structures, or runtime environments. In this paper, we propose Access Flow Guard (AFG), a framework that automatically identifies taint sources based on user identity and permission level to detect cross-user data leaks in LPAs. Instead of manually marking sources and sinks as existing taint approaches require, AFG introduces a Multi-User, Multi-Permission (MUMP) setup. MUMP automatically identifies user input entry points by matching function signatures against patterns derived from our dataset of popular open-source LPAs. Each identified input is tagged with the user’s identity and permission level. AFG then applies Scoped Taint Pointer Analysis (STPA), building on existing pointer-based taint analysis techniques, to propagate user-tagged objects through a Pointer Assignment Graph. STPA detects where different users’ data scopes overlap. We discuss key research challenges, including treating LLM components as black boxes and refining static results through dynamic testing. This approach aims to serve as a basis for systematic security testing of LLM-integrated software in shared multi-user environments.
Tue 16 JunDisplayed time zone: Mountain Time (US & Canada) change
15:50 - 18:00 | |||
15:50 60mKeynote | Compiler-assisted Translation Validation SOAP Qirun Zhang Georgia Institute of Technology | ||
16:50 20mTalk | On the Effectiveness of Modular Testing in EvoSuite SOAP Elizabeth Dinella Bryn Mawr College | ||
17:10 20mTalk | LLM-Integrated Declarative Program Analysis SOAP Sara Baradaran University of Southern California, Amirmohammad Nazari University of Southern California, Mukund Raghothaman University of Southern California DOI | ||
17:30 20mTalk | Detecting Data Leaks in Multi-User LLM Apps via Automated User-Scoped Taint Analysis SOAP Sanjib Kumar Sen Texas A&M University - Corpus Christi, Bozhen Liu Texas A&M University - Corpus Christi | ||
17:50 10mDay closing | Closing Remarks SOAP | ||