AI and LLM Applications Findings.
8 findings in AI and LLM applications, each written up as a report carries it: what the weakness is and what it lets an attacker do, the fix, CVSS 3.1 and 4.0 ratings, the CWE and the references.
High4
Excessive Agency Granted to an LLMCVSS 8.1 · CWE-250An LLM is given more tools, permissions or freedom to act than its task needs, so manipulated or mistaken output can cause damaging actions.Improper Handling of LLM OutputCVSS 8.1 · CWE-1426LLM output is passed to browsers, databases, shells or other interpreters without validation or encoding, so manipulated output becomes an injection attack.Indirect Prompt InjectionCVSS 7.1 · CWE-77Instructions hidden in content an LLM reads, such as web pages, emails or documents, are followed as if they came from the user, acting with the user's access.Prompt InjectionCVSS 7.1 · CWE-77User input can override the instructions given to a large language model, making it ignore its restrictions, reveal data or misuse the tools it can call.
Medium4
Retrieval Without Access ControlCVSS 6.5 · CWE-1230The assistant retrieves documents for its answers without applying the requesting user's permissions, so users can obtain content they are not authorised to see.Unbounded Consumption of LLM ResourcesCVSS 6.5 · CWE-770The LLM feature sets no effective limits on request rates, input size, output length or agent steps, so users can exhaust its capacity or run up costs.Sensitive Information Disclosure by an LLMCVSS 4.3 · CWE-201The LLM feature reveals data the user should not see, such as other people's personal data, confidential records or credentials, from its training data, context or tools.System Prompt LeakageCVSS 4.3 · CWE-497Users can extract the instructions given to the LLM, revealing internal rules, tool details and any sensitive data placed in them.
The Other Areas
Web Applications 87Authentication and Sessions 32APIs 16TLS and Certificates 20Network Services 56Internal Networks 9Active Directory 44Windows and Linux Hosts 29Patching and Outdated Software 36AWS 19Azure and Microsoft 365 19Google Cloud 11Containers and Kubernetes 17Mobile Applications 22Wireless 11Email and DNS 11Thick Clients 11Source Code and Supply Chain 13Social Engineering and Physical 14IoT and OT 5