Skip to content
Brendan Long
  • Blog
  • About
  • Awesome Emojis

LLMs Can’t See Pixels or Characters

By Brendan Long on July 20, 2025

Current LLMs almost always process groups of characters, called tokens, instead of processing individual characters. They do this for performance reasons: Grouping 4 characters (on average) into a token reduces your effective context length by 4×.

LLMs Can't See Pixels or Characters

Read more

Follow new posts via email, RSS, or LessWrong.

Brendan Long · Public Domain (CC0).