Skip to content

other

cl100k_base tokenizer

Byte-pair encoding vocabulary used by several OpenAI models and widely used offline to count the tokens a prompt will consume.

Known aliases

  • cl100k

Relationships

No evidence-backed relationships are recorded.

Current clusters