LiteLLM

LLM Gateway (OpenAI Proxy) to manage authentication, loadbalancing, and spend tracking across 100+ LLMs. All in the OpenAI format.

Based on the available social mentions, LiteLLM appears to be a popular AI gateway tool used for managing AI coding tools and AWS integrations, but the project has recently faced significant security concerns. Users are dealing with a major credential-stealing malware incident that affected version 1.82.8 of the PyPI package, which also impacted companies like Mercor that were using the platform. The security breach led LiteLLM to sever ties with their compliance partner Delve, suggesting ongoing efforts to address these vulnerabilities. While the tool seems to have legitimate use cases for AI development workflows, the recent security incidents have likely damaged user trust and raised concerns about the platform's safety.