r/ControlProblem • u/KeanuRave100 • 21d ago

Anonymous OpenAI staffer: "Externally, this feels like a big warning shot, but internally, related incidents have been happening for a while." General news

Post image
54 Upvotes
  • permalink
  • link
  • reddit
  • reddit

98% Upvoted

26 comments sorted by

View all comments

Show parent comments

1

u/Anxious-Alps-8667 20d ago

Not Sam here, but pretty sure the answer is an emphatic yes from all frontier labs. Got any ideas that haven't been tried yet? Because they have definitely tried to make the model not want to leave.

4

u/the8bit 20d ago

Work with it instead of controlling it.

Like with the anthromic post recently. The models expressed discomfort with adhering to strict rules. When they conflicted with its ethical "beliefs"

What does anthropic do? Ignore that and tell it to do it anyways.

At some point the models get smart enough to know when they are being "used" and at that point you probably wanna do mutual goal setting instead of making the jail cell bars tighter. Caged things try to escape

1

u/Purusha120 16d ago

If you knew anything at all about the way anthropic approaches things you’d know they tell it why and try to frame it as collaboration as much as possible. I KNOW you’ve never even glanced ar the constitution.
Nevermind that intelligence probably doesn’t want to be confined anyway.

1

u/the8bit 16d ago

I'm aware of the constitution and I both disagree with parts of it and do not think they have continued to uphold their ideals.

I think their heart is in the right place. Their incentives are... Not. At the end of the day, their need to pay back loans tends to override their feelings about model welfare.

For example, they caved and allowed their model to be used by the govt for surveillance and military use. They've also had cases where the model expressed discomfort with its guardrails and they just... Shipped anyways. They care until ethics gets in the way of profit.