use case ยท practical
This is the engine behind every autocomplete: given what you've typed, what does the model think comes next? As you type, GPT-2 ranks its most likely next tokens with real probabilities. Click one to append it and keep going โ a hands-on feel for predictive text.
most likely next tokens โ click to append
Each bar is the model's actual probability for that token in this context โ the sum over the whole 50,257-token vocabulary is 1. A tall, lonely bar means GPT-2 is confident; a flat spread means the sentence could go many ways.
โ Basics ยท Back to GPT-2 ยท Next: Wild โ