Tag: entropy

1 jot

Subscribe to this tag
RSS 2.0 https://jottings.vishalvshekkar.com/tags/entropy/feed.xml
Atom 1.0 https://jottings.vishalvshekkar.com/tags/entropy/atom.xml
JSON Feed https://jottings.vishalvshekkar.com/tags/entropy/feed.json
Vishal V. Shekkar
Vishal V. Shekkar I declare verified!
@vishalvshekkar
Thu, 13 Aug 2026 07:48:16 GMT

LLM watermarking turns the model’s linguistic entropy into bandwidth. Wherever the model has multiple plausible ways to say the same thing, those degrees of freedom become a channel through which a hidden (watermarking) signal can be transmitted.