How top-p filters tokens

Name: How top-p filters tokens
Uploaded: 2026-10-02T13:06:03+00:00
Channel: Sebastian Raschka
Description: Top-p sampling keeps the most likely tokens until their cumulative probability reaches a chosen threshold. I walk through an example with p = 0.8, then renormalize the retained probabilities so they sum to one. An excerpt from my reasoning model series: https://www.youtube.com/watch?v=Kh9mqTzjuEQ&list=PLfrHAQCRxtUs&index=1

Sebastian RaschkaCréateur · il y a 21 jours

Voir sur YouTube

Top-p sampling keeps the most likely tokens until their cumulative probability reaches a chosen threshold. I walk through an example with p = 0.8, then renormalize the retained probabilities so they sum to one. An excerpt from my reasoning model series: https://www.youtube.com/watch?v=Kh9mqTzjuEQ&list=PLfrHAQCRxtUs&index=1

Discussion

Rejoignez la communauté pour réagir et poser vos questions.

Aucun message pour l'instant. Lancez la discussion !