Diffusion (Experimental) node

Diffusion Live

Experimental — results depend entirely on the model you supply, and a good one is not easy to come by. Live video through a diffusion model, on this Mac: the newest Source picture — a camera, a video, any Grafit render — is repainted under the Prompt, over and over. Strength sets how far each frame departs from the source, Coherence keeps the noise still so the picture does not boil, Feedback carries the previous output into the next frame. It runs in the background at its own pace and drops the frames it has no time for; FPS reports the measured rate. Expect a few frames per second, set by the model: use a few-step (turbo / LCM class) model at Steps 1–2, and put a tiny VAE in the model folder.

Inputs

PortTypeDefault
ModelThe Model output of a Diffusion Model node. Use a few-step (turbo / LCM class) model, and keep a tiny VAE in its folder — both matter more for speed than any setting here.structure—
EnableOff stops the loop, clears the picture and forgets the previous frame. On starts again from the source alone.booltrue
PromptWhat every frame is repainted toward. Change it while running: the text is encoded once per change, not per frame.string
NegativeWhat to avoid. Only has an effect while Guidance is 1 or higher.string
SourceThe live picture to repaint: a camera, a video, any Grafit render. Its content is centre-cropped to a square at the model's size. Always the NEWEST picture is used; the ones in between are dropped.image—
StrengthHow far each frame departs from the source: the noise level it is pushed to before the model pulls it back. 0.3 restyles, 0.5 repaints, 0.8 mostly invents. Clamped 0.02–1.float0.5
FeedbackHow much of the previous OUTPUT is blended into the new source before repainting. 0 = every frame starts fresh (flickers); 0.3 = invented detail survives; above 0.7 the picture lags and can drift away from the source — Reset recovers. Clamped 0–0.95.float0.3
Coherence1 = the same noise field every frame, so texture stays put instead of boiling. 0 = new noise every frame (shimmering, restless). In between blends the two. Clamped 0–1.float1.0
SeedWhich fixed noise field Coherence holds. Changing it re-rolls the look of every frame at once.int42
StepsModel calls per frame; frame time grows with it. 1 for one-step models, 2–4 for LCM-class. Standard models give a rough picture at any value here. Clamped 1–8.int1
Guidance0 (off) is what few-step models expect. 1 or higher follows the prompt harder and enables Negative — it doubles the model work, except on models converted with a Unet batch of 2 (see the Model node's Info), where it is free. Not clamped.float0
FPS LimitUpper bound on frames per second, to spare heat and battery or leave GPU time to the rest of the patch. 0 = as fast as the model runs. It never makes anything faster.int0
ResetA rising edge forgets the previous output: the next frame starts from the source alone. For when high Feedback has drifted into mush.boolfalse
Safety CheckerRuns the model's own safety checker on every frame when the model folder includes one (slower); a rejected frame is not shown. No effect for models without a checker.booltrue
XHorizontal position of the picture in Grafit units. 0 is centred. Not clamped; ±2 covers the screen.float0
YVertical position of the picture in Grafit units. 0 is centred. Not clamped; ±2 covers the screen.float0
ScaleSize multiplier on top of True Size or Fit. Not clamped; 0 hides the picture.float1.0
RotationClockwise rotation in degrees. Not clamped — it keeps spinning past 360.float0
Opacity0 invisible, 1 opaque. Above 1 is already opaque.float1.0
True SizeOn: one model pixel per screen pixel — sharp, small on a large viewport. Off: scaled to fit the shorter side of the viewport (soft when the model is smaller than the screen). Scale multiplies either.booltrue

Outputs

PortType
Imageimage
Widthfloat
Heightfloat
FPSfloat
Busybool
Timefloat
Infostring

Open Diffusion Live in the interactive catalog →

Diffusion Live is one of 381 nodes in Grafit Pro.

Free download. Every feature for 7 days, no card. Then €99.99 once — or keep playing your projects as a Player.

More Diffusion (Experimental) nodes