Tiktokenizer
BPE Tokenizer Visualizer
Tokens
0
Characters
46
Compression
0x
Vocab Size
0
Show whitespace
Content
Hello, world! 👋 Welcome to the BPE Tokenizer.
Tokenized Output
Type something above to see tokens