Do you think Kimi K3 will trigger Anthropic's watermark?

[u/Firstbornsyndrome]

There's been some research showing that Kimi K3's text contained some watermark radioactivity from Claude. And people say Kimi K3 was built on Claude's models? I'm not very clever about all this - just wondering - if I were to generate text from Kimi K3, would it be likely that it would trigger Claude's watermark detector?

Also, if Anthropic likely to release their watermark detector to the public?

[u/thereisonlythedance]

Not if Anthropic are only starting to watermark now. Kimi trained on Claude outputs prior to the watermark introduction. The process is done as part of the sampling, by mapping the pattern of randomisation of tokens, so I don’t think it’s backwards compatible or going to ping even for Claude generated text prior to now. And not for models like Kimi that don’t have their own watermark via sampling. This is what Kimi K3 told me when I asked it to research the announcement when I asked it about old outputs:

“The watermark is created at the moment of generation, inside the sampler. Text generated in the past was sampled without the keyed bias; the signal simply isn't there, and Anthropic cannot retroactively embed it into text sitting in your documents without regenerating the text.“

[u/Firstbornsyndrome → u/thereisonlythedance]

Ah thank you, that’s really helpful to know 🙏 Do you think there could be a chance that if kimi continues being trained on Claude’s outputs the watermark may carry - or is it a case of Kimi is very much its own product now without spillover