Rendered at 23:52:26 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
treetalker 1 hours ago [-]
It seems to me that a model provider who can watermark generated text (unbeknownst to the users) could also specifically watermark generated text prompted by particular users, thus enabling tracking and, consequently, harassment and control of those users and populations as a whole. Bad for anonymity and for free speech.
I hope to be corrected by someone who knows the tech much better than I do.
Vespasian 27 minutes ago [-]
That is a concerning possibility but I wonder what the threat model is.
They have all that information already and could simply classify and pass it on without the need to encode it with a probability.
n4pw01f 51 minutes ago [-]
If you look at how this works under the hood, “when two words that don’t necessarily matter to the context, it will pick one word over the other and a pattern emerges”
And that pattern will be reverse engineered in weeks by a startup
And a downstream agent produced by said startup will be built to roll those dice again and defeat the watermarking
And a the LLM vendors will combat this
And a cottage industry shall be born anew
cyanydeez 8 minutes ago [-]
To be fair, the circle jerk in virtual space is limitless. Its just unbounded reach arounds, turtle cum all the way down, human detritus as far as the eye can see.
The same VC capital will chase it because god forbid we fail at real challenges; no, we must build the torment nexus.
I hope to be corrected by someone who knows the tech much better than I do.
They have all that information already and could simply classify and pass it on without the need to encode it with a probability.
And that pattern will be reverse engineered in weeks by a startup
And a downstream agent produced by said startup will be built to roll those dice again and defeat the watermarking
And a the LLM vendors will combat this
And a cottage industry shall be born anew
The same VC capital will chase it because god forbid we fail at real challenges; no, we must build the torment nexus.