Skip to content
Better HN
Top
Best
Ask
Show
New
Jobs
Search
⌘K
0 points
RandomBK
3mo ago
0 comments
Save
Share
How well do we understand the tokenization for Claude? I'd posit that the exact human-representation of this markup is likely irrelevant if it's all being converted into a single token.
0 comments
1 comments · 1 top-level
top
newest
oldest
PeterStuer
3mo ago
"<" ">" and "/>" are indeed single tokens.
j
/
k
navigate · click thread line to collapse