The Proxy Knows Too Much: Sealing LLM API Routers with Attested TEEs

The article presents AEGIS, an attested API router designed to enhance security when accessing large language models (LLMs) via APIs. AEGIS confines plaintext handling to a secure hardware enclave, allowing clients to verify the enclave before releasing sensitive data, effectively blocking various malicious router attacks that exploit plaintext access. This innovation is crucial for practitioners, as it mitigates risks associated with man-in-the-middle vulnerabilities in LLM interactions while maintaining compatibility with existing APIs and ensuring minimal latency overhead.