Glossary

Token in AI. What it is and why your limit runs out fast

A token is a piece of text the model counts everything it reads and writes in. Usually it is part of a word, sometimes a whole short word or a character.

Limits in AI tools and the length of chat a model can still handle are counted in tokens. Text in languages such as Polish usually takes more tokens than English with the same meaning.

An example from a business

An employee keeps one chat with AI going all week and pastes contract after contract into it. With every new question the model reads the whole chat again. So a short question on Friday costs as many tokens as the whole week, and the limit runs out after a few messages.

The same goes for files. A pasted twenty page document takes up a large part of the chat even if you only ask about one paragraph. It is better to paste that paragraph.

What to watch

Start a new task in a new chat and carry over key decisions in a few sentences. Answers get better and the limit lasts longer.

Read more