litellm.ai · Inference & Hosting
Python SDK and proxy gateway that calls many LLM providers through one OpenAI style interface with budgets and logging.
LiteLLM is one of 10 inference and hosting tools on Drydock. See all inference and hosting tools or how we check facts.
// guides
Is LangChain free for commercial use? Yes. LangChain and LangGraph are MIT licensed. Here is what that allows, where costs start, and the one server that isn't MIT.
LiteLLM compromised again: release 1.107.0 on PyPI and Docker carried a credential stealer. How to check every host, what to rotate and how to pin safely.
What an LLM gateway is, and when to self host one like LiteLLM instead of using OpenRouter: routing, fallbacks, caching, keys, fees and security in 2026.
// related
Ollamaollama.comThe simplest way to download and run open models locally, with a CLI, desktop app and local API.Inference & HostingOpen source★ 185.1k
Basetenbaseten.coProduction inference platform for deploying open and custom models with dedicated, autoscaling GPUs.Inference & HostingPaid★ 1.2k
OpenRouteropenrouter.aiUnified API to hundreds of models from many providers with automatic fallbacks and price routing.Inference & HostingFreemiumHN 38
Modalmodal.comServerless platform for running Python and GPU workloads, from inference endpoints to sandboxes, defined in code.Inference & HostingFreemiumHN 21
vLLMdocs.vllm.aiHigh throughput LLM serving engine built around PagedAttention, with an OpenAI compatible server.Inference & HostingOpen source★ 95.7k
Replicatereplicate.comRun and deploy open models through a simple API, packaging custom models with Cog.Inference & HostingPaid★ 9.5k