In its first blog post, Replicate described a hosted platform for sharing and running machine-learning models. It introduced Cog as a way to package inference code, weights, and dependencies so the same model could run on Replicate or on a team's own infrastructure.
Replicate
Also known as: Replicate.com · Replicate Cog · Replicate Deployments
Plain English
Replicate is a hosted inference platform for generating images and video, processing audio, and running language models. Developers can call a catalog model through an API or package and deploy their own model with Cog, Replicate's open-source tool. The company is part of Cloudflare.
Technical Overview
Cog builds a container from a model's inference code and dependencies and generates an API schema from typed inputs. Replicate calls each invocation a prediction and supports asynchronous results through polling or webhooks. Deployments give a model a stable private endpoint with a chosen version, hardware, and scaling limits. Keeping instances warm reduces cold starts and incurs idle compute charges.
Timeline (7)
2022
Milestone- Ecosystem
Replicate published a guide to calling its hosted Stable Diffusion model from Python. The guide passed a model version and prompt directly to the API, giving application developers a way to generate images without provisioning a GPU.
2023
ReleaseReplicate introduced Deployments for public and private models. Each deployment has a fixed API endpoint, so an operator can change model versions, hardware, or the number of warm instances without changing the endpoint that the application calls.
2024
ReleaseReplicate published its FLUX.1 fine-tuning API workflow. A training job produced a callable model and downloadable LoRA weights, so the learned adapter could also be used outside the hosted endpoint.
2025
ReleaseReplicate added official catalog model names to the same Predictions API endpoint that already accepted community model version IDs. A client could submit either kind of model to
POST /v1/predictionsthrough one request path.- Milestone
Cloudflare and Replicate announced that Replicate would join Cloudflare. Cloudflare described plans to use Cog for custom model deployment on Workers AI and to connect Replicate's model catalog to its developer platform.
2026
EcosystemCloudflare showed its planned bring-your-own-model workflow for Workers AI using Replicate's Cog. The preview used Cog to build a container from a model's code and environment, which would let developers deploy custom models behind the Workers AI binding.
See also (8)
Open full graphReplicate