1. What is the basic task an LLM is trained for?
- Run SQL queries
- Look up answers in a fact database
- Predict the next token given the previous ones
- Compress images
Show answer
Answer: Predict the next token given the previous ones
Everything an LLM produces is built by repeated next-token prediction.
Lesson: What Is a Large Language Model