# Generative Models at a Glance — Deep Learning & Neural Networks

Source: https://www.skillbyai.com/en/deep-learning/m-gen

> Networks that create data.

## Predict the next piece, or remove noise

**Generative models** learn to produce new data. **Autoregressive** models (GPT-style transformers) generate one token at a time by predicting the next token, repeated. **Diffusion models** learn to remove noise step by step and generate images, audio and video by starting from pure noise. **Variational autoencoders** and **GANs** are earlier families still used in places. All are trained with the same basics in this course (losses, backpropagation, optimisers) at enormous scale, and their outputs need evaluation for quality, safety and factual accuracy.

## Generative families compared

One-line summaries.

```text
family            generates by                          typical use
autoregressive    predicting the next token repeatedly   text, code, chat
diffusion         denoising random noise step by step    images, audio, video
VAE               decoding samples from a latent space   compression, latent models
GAN               generator vs discriminator game        image synthesis (older)
```

## Use APIs or pretrained checkpoints

Training generative models from scratch is expensive; most teams adapt pretrained models or call hosted ones.

**Quiz:** How do autoregressive language models generate text?

- [ ] By sorting the vocabulary
- [ ] By denoising an image
- [ ] By clustering documents
- [x] By predicting the next token repeatedly

*Answer:* By predicting the next token repeatedly. Next-token prediction, one step at a time.