{ Back to journal }

Tutorial

Diffusion models explained: how noise becomes an image

A practical explanation of denoising, latent space and image conditioning, with an exercise for separating style exploration from product accuracy.

Smooth bands of saturated red, blue, green and yellow across a digital colour gradient.

The description of an AI image emerging from noise sounds mysterious until you separate learning from generation. Diffusion is a family of methods, not a promise that every image tool behaves identically. Understanding its basic structure helps explain why references, settings and review matter as much as the words in a prompt.

This article describes a common diffusion approach. It does not claim that every contemporary generator uses the same architecture or exposes the same controls.

Learning to reverse corruption

In a classic denoising diffusion setup, training examples are corrupted with noise. A neural network learns a task related to reversing that corruption at different stages. At generation time, a sampling process can begin with noise and progressively construct an image using the learned model. Ho, Jain and Abbeel describe this approach in their 2020 diffusion paper.

This is a learned generation process, rather than a human artist painting each object in a planned order. A production team should therefore avoid assuming that an attractive intermediate frame means all details are settled.

What latent space changes

Latent diffusion performs the generative process in a compressed representation, with an encoder and decoder connecting that representation to images. The research by Rombach and colleagues explains why this can reduce the computational burden compared with operating directly on full image pixels. It also describes conditioning mechanisms for guiding generation.

For a creative team, the practical lesson is to ask which inputs a tool actually supports. A reference image, a mask and a text description are different kinds of instruction. Their availability and effect depend on the implementation.

A reference is a direction, not an approval

Consider an illustrative brief for a ceramic cup photographed beside a window. A supplied product reference may help guide the result, but it should not replace inspection. Check the handle, rim, logo and proportions against the reference. A pleasant composition does not settle those checks.

If the cup must be exact, separate the responsibilities. Use a photographed or rendered product as the controlled element, and experiment with surroundings where the workflow permits. Decide where compositing is acceptable before generating a long sequence of variations.

Change one thing at a time

A useful exploration starts with a fixed purpose: perhaps finding a light direction, rather than solving the entire campaign. Keep the reference and composition requirements stable while changing that one choice. Save the model version and available settings alongside the selected output.

Where a tool exposes a seed, keep a record of it. Do not treat the seed alone as a portable recipe: the model, sampling settings and software environment also matter. If a supplier cannot reproduce a selected look, a contact sheet of alternatives is more useful than an undocumented favourite.

Test whether the workflow fits the shot

Try three deliberately different lighting instructions on the same product reference. Score silhouette, label readability and material appearance separately from atmosphere. Then attempt the most likely client revision, such as changing the background while retaining the object.

This is a production exercise, not a benchmark of all diffusion models. Its purpose is to expose the cost of change in your actual workflow. If a small revision repeatedly disturbs approved details, adjust the method before building the campaign around that image.

The value of the technology is easier to judge once the team knows which decisions it can explore freely and which details need a controlled production step.

More from the journal

Film