Token category

Qwen2 Emoji

Emoji often tokenize as multiple UTF-8 byte fragments or mixed symbol pieces. Skin tones, zero-width joiners, and flags can span several tokens.