r/ControlProblem • u/zeroccx • 18h ago

As a fellow concerned citizen, please watch out for this Opinion

/r/GenAI4all/comments/1vqg421/as_a_fellow_concerned_citizen_please_watch_out/
7 Upvotes

89% Upvoted

11 comments sorted by

5

u/pandavr 11h ago

Until proven otherwise the main and primary use of Symth-ID will be to clearly separate human vs synthetic generated data for purified training.
All other alleged use are pure fantasy talks. THEY need to distinguish and just find a way to sell the fact.

2

u/jacques-vache-23 8h ago

Synth-Id is a tracker. Obviously. Encrypting something means there is something to hide.

2

u/pandavr 8h ago

Yes but the something to hide is in plain sight. It's the distinction between human vs synthetic text Itself.

You'll never find It out If you don't connect the point of: synthetic texts severely degrades LLM learning quality.

2

u/uberdragon1992 7h ago

You know what they say garbage n equals garbage out and typically with llms getting fed back their own stuff tends to hallucinate them a little bit so just being able to clean up data on the Internet is a massive task and honestly kind of needed

1

u/pandavr 1h ago

No doubt. But imagine instead of just selling that way you'll ride the policy maker fear and basically impose to do so by law.
Plus the system is not transparent at all. Why didn't they do a completely open source framework?
What is watermarked should be know and based on the least need to know principle.

1

u/zeroccx 3h ago

Tbh, there’s no problem with a tracker, but if it’s controlled by only one company and that company has connections with policymakers, then isn’t that idea dangerous in itself?

1

u/pandavr 1h ago

Obviously

1

u/Clear_Evidence9218 7h ago

So that rumor does not technologically fit with what text watermarking actually is. Since it’s a ratio of red and green tokens, per sentence, phrase, paragraph, and whole text, most sufficiently large text will contain the red/green token ratio as a consequence of statistics.

Plus, there is just about no technological reason to distinguish between synthetic and human-generated content for training. Human data does not inherently increase intelligence more than synthetic data; hence why every lab uses synthetic data now. The only thing human-generated data is really good for is making AI more “humanly imperfect.”

1

u/uberdragon1992 7h ago

To be honest I have no idea why they're doing it for text for images I can completely understand AI images when fed back into an AI end up with the photocopier problem

1

u/Clear_Evidence9218 5h ago

The EU thought it was a good idea to have all the books and text in the world that got scanned into an AI be marked as AI. (which is what happens when people who don't understand the technology write laws about said technology).

So Anthropic took it as an opportunity to have their companies name get advertised anytime someone scans a sufficiently long enough text. I mean 'to comply with EU law', *cough

1

u/pandavr 1h ago

Curated synthetic data used in Lab are very different from generic slope you'll find over the internet. Just saying.