โ† All models ยท GPT-2

use case ยท practical

Practical: next-token autocomplete

This is the engine behind every autocomplete: given what you've typed, what does the model think comes next? As you type, GPT-2 ranks its most likely next tokens with real probabilities. Click one to append it and keep going โ€” a hands-on feel for predictive text.

Each bar is the model's actual probability for that token in this context โ€” the sum over the whole 50,257-token vocabulary is 1. A tall, lonely bar means GPT-2 is confident; a flat spread means the sentence could go many ways.

โ† Basics ยท Back to GPT-2 ยท Next: Wild โ†’