FIFoundationIndex
IndexMapAbout
ArchitectureImageVideo

ControlNet & IP-Adapter

Also known as: ControlNet · IP-Adapter · Spatial Conditioning

Plain English

Add-on modules that give you precise visual steering over an image or video generator—letting you lock in a pose, architectural layout, depth map, sketch, or reference face/style instead of relying on text prompts alone.

Technical Overview

ControlNet clones trainable encoder/transformer blocks linked via zero-initialized convolutions to inject spatial conditioning (Canny edges, depth, OpenPose skeletons, segmentation maps) into frozen Diffusion Models. IP-Adapter injects decoupled image-prompt cross-attention from a reference image, complementing LoRA & QLoRA in production ComfyUI pipelines.

Chronological Entries (2)

Direct Relations (3)

Referenced By (1)