There's a semi-common meme on Twitter where people share their most X opinion, where X is a group the poster doesn't identify with; or sometimes my least X opinion, where X is a group they do identify with. In that spirit, my least libertarian opinion is that exclusivity deals with sufficiently entrenched companies* are bad and should be illegal.
Edit: I no longer fully endorse this post. While the below is true for pretraining, I think RL plausibly causes LLMs to use human-style introspective language in functional ways (I agree withthis post).
It always feels wrong when people post chats where they ask an LLM questions about …
As incomes have risen, it's important for Americans to find new ways to spend ever-increasing amounts of money. I propose that we spend some of it traveling to pick and eat fresh fruit that doesn't travel well.
Content Warning: Knowing how delicious fresh fruit can be is an infohazard for …
Current LLMs almost always process groups of characters, called tokens, instead of processing individual characters. They do this for performance reasons: Grouping 4 characters (on average) into a token reduces your effective context length by 4x.
A few jobs ago, I worked at company that collected data from disparate sources, then processed and deduplicated it into spreadsheets for ingestion by the data science and customer support teams. Some common …