root@fr:~$ lexique/token

Token

Models

The unit of text a model works with: a short word, a fragment of a word or a punctuation mark. It is also the billing unit of inference; the volume of tokens processed, in and out, determines what an agent costs to run and how much text it can read at once.

Also called Jeton, Tokens

Related terms

Inférence

Models

Running an already trained model: it receives a request and produces its answer, token by token. It is the phase that runs day after day and carries the...

Fenêtre de contexte

Models

The maximum amount of text, measured in tokens, a model can take into account to produce an answer: the question, the documents provided, the history of the...

Modèle de langage (LLM)

Models

An AI model trained on huge volumes of text to predict what comes next in a sequence, which gives it a general ability to understand and produce language....

Does this notion touch your business?

Go from definition to deployment: a first agent on your data, in France, on a model you control end to end.

The right model Let's talk about your AI