modal.com · Inference & Hosting
Serverless platform for running Python and GPU workloads, from inference endpoints to sandboxes, defined in code.
Modal is one of 10 inference and hosting tools on Drydock. See all inference and hosting tools or how we check facts.
// guides
NVIDIA OpenShell explained: how the open source agent sandbox enforces file, network and credential policy, how to install it, and how it compares to Docker.
Claude Managed Agents explained: what Anthropic hosts, the $0.08 session hour plus token pricing, self hosted sandboxes, budgets, limits and open source options.
E2B vs Daytona vs Modal for running AI agent code safely: isolation, startup, persistence, time limits, GPUs and SDKs compared, with code for each sandbox.
// related
Ollamaollama.comThe simplest way to download and run open models locally, with a CLI, desktop app and local API.Inference & HostingOpen source★ 185.1k
LiteLLMlitellm.aiPython SDK and proxy gateway that calls many LLM providers through one OpenAI style interface with budgets and logging.Inference & HostingOpen source★ 62.2k
Basetenbaseten.coProduction inference platform for deploying open and custom models with dedicated, autoscaling GPUs.Inference & HostingPaid★ 1.2k
OpenRouteropenrouter.aiUnified API to hundreds of models from many providers with automatic fallbacks and price routing.Inference & HostingFreemiumHN 38
vLLMdocs.vllm.aiHigh throughput LLM serving engine built around PagedAttention, with an OpenAI compatible server.Inference & HostingOpen source★ 95.7k
Replicatereplicate.comRun and deploy open models through a simple API, packaging custom models with Cog.Inference & HostingPaid★ 9.5k