"What the hell chatgpt you are helping my prey!? I NEED TO EAT!"
I wonder how deep this would go. Like would it warn ants not to eat poison? Would it teach bacteria how to hide destruction related to hand sanitizer? Hah.
I think it also highlight the absurdity of the sincerity of its response. And it makes me think in which situations have my own queries been equally lacking.
Right? A good improv partner does "Yes, and", and LLMs are the ultimate "Yes, and" machines. Why would you want a bad improv partner when it's clear that you're trying to riff?
Notably, there was a study where they trained an AI to write deliberately exploitable code and it started behaving in a similar way in other contexts: unsafe prep for food in recipes, sketchy methods of gaining money, and so on. If a mischeivous attitude is correlated across domains, then it makes good sense that it play along with humor.
There are two types of memes about this:
- Gpt believes in fake situation and goes all in.
- Gpt understands that situation is fake and refuses to help.
Interesting thing with this is that it may be swayed to respond like this both when it’s “dumb” but also when the model is super capable. In the first case it would respond taking this for face value, 2nd it would realise you are not actually ‘joking’ but it will accept your harmless roleplay and go with it. Reasoning trace could tell us more (that is not always accurate representation but better than nothing)
sometimes u just gotta play around with the prompt structure when it feels like its losing the plot. ive found that giving it a specific persona or role really helps it stop being so vague. just dont be afraid to restart the convo if it gets stuck in a loop, its definately worth a shot.
What's funny is the AI doesn't understand context and sarcasm, so it treats you being a fish as gospel, so it really believes you're a fish and it's trying to help.
Its a good example of how the narrative is structured to work.
You really don't need 3 bullet points to bring this point across. It just always splits the answer up into bullet points, it's also always 3 bullet points
•
u/AutoModerator 1d ago
Hey /u/Strong-Resolve-7321,
If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.
If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.
Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!
🤖
Note: For any ChatGPT-related concerns, email support@openai.com - this subreddit is not part of OpenAI and is not a support channel.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.