LiteLLM: Unified Proxy for 100+ LLM APIs
A Python SDK and AI Gateway to call multiple LLM providers using OpenAI format. Features load balancing, cost tracking, and easy integration.
A Python SDK and AI Gateway to call multiple LLM providers using OpenAI format. Features load balancing, cost tracking, and easy integration.
An open-source long-horizon agent framework from ByteDance that handles complex tasks over hours using sandboxes, memories, and subagent coordination.
A comprehensive technical guide explaining the inner workings of model quantization, vital for optimizing LLMs for edge deployment.