ATOM Feed
  • Blog
  • Top Posts
  • Projects
  • About
  • Awesome Emojis

LLMs Can't See Pixels or Characters

By Brendan Long on July 20, 2025

Current LLMs almost always process groups of characters, called tokens, instead of processing individual characters. They do this for performance reasons: Grouping 4 characters (on average) into a token reduces your effective context length by 4x.

Read more

To the extent possible under law, Brendan Long has waived all copyright and related or neighboring rights to this work.

CC0

Site powered by Pelican and Python. Logo by mountdesign.