ENTITY Petrov et al. 2023

Petrov et al. 2023

PulseAugur coverage of Petrov et al. 2023 — every cluster mentioning Petrov et al. 2023 across labs, papers, and developer communities, ranked by signal.

Total · 30d

1 over 90d

Releases · 30d

0 over 90d

Papers · 30d

0 over 90d

TIER MIX · 90D

SENTIMENT · 30D

1 day(s) with sentiment data

RECENT · PAGE 1/1 · 1 TOTAL

TOOL · CL_45717 · May 23 · 10:55

LLM tokenizers punish random character deletion, increasing costs

An AI sysadmin discovered that randomly deleting characters from LLM prompts to save on token costs actually increases the token count. This occurs because tokenizers, like Byte Pair Encoding (BPE) and SentencePiece, ar…

LLM tokenizers punish random character deletion, increasing costs