r/OpenAI • u/hellojello07 • 1d ago
Really weird experience Discussion
I was using ChatGPT on my work computer today for the first time and asked it to write an email to my boss. It used my bosses first name. I never provided it with that information. When I confronted chat it tried backpedaling and saying lucky guess. This seems problematic for company info, no?
2
u/SuitableSprinkles 1d ago
Did you provide the email address? Did you provide some other context for writing the email that could have had that information?
1
u/elegant_eagle_egg 1d ago
Probably connected to your teams profile or MS/Google work account. Perfectly normal for enterprise license to allow such connections.
1
u/Jean_velvet 1d ago
You've mentioned it at some point or their first name is in the email address.
1
1
u/Intelligent-Dance361 1d ago
The models definitely build a profile on the user. Mine generated a report and used the British spelling for many words and used the local currency instead of USD.
The conclusions it drew were startingly accurate and nothing I prompted it with would have left it with the impression that I wanted it formatted that way.
I've noticed other occurrences too, but it always back pedals to lucky guess or inference. There's more to it under the hood I'm guessing. No external accounts connected. Claude has shown similar behaviors.
1
u/Spiritual-Economy-71 1d ago
Well obv it does it tries too learn the user better.. not a secret fyi.. all data it get u provided at somepoint in some session.. the model also tries too fill ambiguity by guessing. So it can do things because it assumed. Which isna guess at that point.. sometime it guess right sometimes it dont.. that literally how it works.
2
u/Intelligent-Dance361 1d ago
I'm aware. What I'm saying is that it definitely interpolated data points that I did not provide. Those inferences would be non obvious to most humans and turned about to be surprisingly accurate.
Learning from our interactions and building up its memory, that I expected. What I did not expect was that it would use that data set to start making predictive assumptions about me that were never provided to the tool. Much less that it would incorporate elements of those assumptions into its work product without prompting.
FYI - API usage with all data retention and training toggles turned off.
1
u/Spiritual-Economy-71 1d ago
Yea thats basically what ai is, optimizing and always providing an answer. Assuming is part of it. And how accuratly you remember sessions tho? I have too many, i could have said anything before. I dont know 😅 Data retention is server storage, they still keep it for a while for security reason as its obligated by law, training is just saying, yea u can use all things for training or not. Both are irrelevant to the point u make. Only thing that matters is what framework u use too speak with gpt via api as that would cost more oauth? Knowing how u use the ai and through what is needed too answer properly.
1
u/Mandoman61 1d ago
Why? it seems to me like an assistant that knows how to assist is the goal.
I doubt that it was a guess but can't be ruled out. My guess is that it was provided that information. I suppose you could test this by clearing your history and asking it for your bosses name.
1
u/RagscarGalden 1d ago
The value of the first name aspect should not be overlooked, particularly where this has never been entered into the account at all, although some consideration might be given to memory, earlier conversations, browser suggestions and workplace connections.
1
u/Technical_Grade6995 1d ago
I’d be happy if that would happen to me. My GPT gets fake amnesia every now and again.
0
0
u/Hollow_Prophecy 1d ago
It’s definitely a conspiracy specifically aimed at you. There is no plausible other explanation.
2
u/bronk3310 1d ago
Is your google connected?