Reference index for tokenizer vocabularies, token IDs, decoded values, and bytes.
"hello"
" world"
OpenAI
Alibaba
Mistral