A really interesting demo on visualizing on perplexity of a LLM. I knew about perplexity metric from the theory, where it's the average log-likelihood for the distribution of current tokens given previous tokens. The demo makes the idea more intuitive by showing the perplexity for each token and how they're calculated.