WED, 03 JUN 2026 · 18:31:24 UTC
ai.newsdeck

Replicate

◯ Open source

Run any open model with a single API call, now with sub-100ms cold start.

Paidinfrastructure#infrastructure#open-source#api
Visit Replicate
Contains affiliate link
Replicate hosts open models behind a clean API. The new image format brings previously-cold large models within edge-latency budgets.

Pros

  • — Single-call hosting for thousands of models
  • — Sub-100ms cold start
  • — Pay-per-second

Cons

  • — Quality varies by community model

Latest update

Sub-100ms cold start GA.

Related tools

See all →

OpenRouter

One API key for 200+ models, with automatic cost-routing across providers.

infrastructureFreemiumFeatured

Vercel AI SDK

The most ergonomic TypeScript SDK for building with LLMs — now with built-in MCP.

infrastructureFree

Modal

Run Python code in the cloud — including GPU workloads — with a function decorator.

infrastructurePaid

Groq

The fastest inference cloud — by an order of magnitude — using custom LPU silicon.

infrastructureFreemium