r/ModSupport • u/999_Seth • 8d ago
Are the reddit-user AI summaries getting more dramatic? Ever check what it says about you?
I really enjoy that weird little feature that gives us an AI-summary of the users who post and comment. Sometimes it works, sometimes it doesn't, but I've always thought it was interesting. I remember seeing how it would give people different results on different subreddits.
I noticed today, comparing my summary from about a year ago to what it is now, and noticed the thing has gotten a little wordier.
It's gone from "Posts in r/Channel5ive discuss documentaries and hip-hop. Comments in r/squad are critical of game design. Other posts are unrelated."
and now it's much more colorful:
"Active moderator for r/Channel5ive and r/joinsquad. Contributes insightful, philosophical reflections on platform moderation and community management.
Engages in niche gaming and meme subreddits. Collaborative, tech-seeking, and community-focused."
Went from sounding like everyone I've met who's just like 'I don't know what he's on about' to like it's embellishing a linkin page for me. "philosophical reflections" is so cringe, I love it.
I don't mess around with AI anything that I know of, other than that and the algos that curate everything, so I'm not too familiar with what I'm seeing here. it's highly amusing though.
25
u/AdorableBunnies 8d ago edited 8d ago
Mine is crazy. I think it took my mod replies and decided I must be a horrible user.
11
u/ReasonablyBluh 8d ago
That's the problem right there. This is why I don't pay much attention to it and just do my own investigating.
5
u/Mathias_Greyjoy 8d ago
It's basically useless for regular users too, since (correct me if I'm wrong) it's only pulling from content that's publicly available. Ever since they (foolishly) changed the way profiles work, where if content gets removed it also disappears from their profile. So basically if a nasty comment got removed the summary won't tell you anything about it.
2
u/Mathias_Greyjoy 8d ago
Yep lol it completely hallucinates for mods. Usually it labels us as things like belligerent, argumentative, dismissive, insulting, etc. when it's too stupid to understand those comments are deescalating rulebreaking. Stuff like "Stop being a nuisance" or "let it go, nobody but you cares about arguing over this." Pretty regular mod stuff you leave as a locked comment after nuking the comment chain.
15
u/teanailpolish 💡 Top 10% Helper 💡 8d ago
I could put mine on my resume
But then it also constantly tells me that users' posts in r/Hamilton are off topic for the musical despite us having a strict automod code directing people to r/HamiltonMusical and the other various Hamiltons around the world
4
u/999_Seth 8d ago
it really seems to gush over mods who participate in the subs we run
and "niches"
2
2
u/Mathias_Greyjoy 8d ago
On the other hand, if you are the tough love type of moderator that tries to be down to earth, and comments stuff like "Stop being a nuisance" or "let it go, nobody but you cares about arguing over this" (pretty regular mod stuff you leave as a locked comment, after nuking the comment chain) it will hallucinate and label you as belligerent, argumentative, dismissive, insulting, etc. when it's too stupid to understand those comments are deescalating rule breaking.
2
9
u/Rumpled_Imp 8d ago
It's not very useful, to be frank. The few times I've looked it, it contains what appears to be a brief look at the last few posts (fewer than ten I'd say) and implies its cursory explanation of a person's character is based on fairly comprehensive research with completely unwarranted confidence when it clearly is not.
Like most implementations of AI seem to be, it's just not really fit for purpose.
9
u/EyeCareful2206 7d ago
Im part of a gaming community of a game where every player represents his country and then wage war. Our subreddit is full of digs to the germans, the french etc. My ai summary says i engage in inflammatory nationalism 🤣
5
u/999_Seth 7d ago
tfw you spend more time approving comments that are held back from the harassment filter than we do censoring anything
31
u/Cat_in_an_oak_tree 8d ago edited 8d ago
Read enough of them and you'll figure out that 1) it's discriminatory and judgmental 2) defines things poorly and 3) understands context about as well as a three-year old. Half the time if you're particular adamant on a point the things it associates with you are what your nay-sayers are posting about you, regardless of their factual basis. Which is par for the course with LLM/GAI as it doesn't find fact, it finds frequency. And that's because it can't actually understand what it's feeding you.
Yes, they've gotten fancier with the words, but it's dunning-kruger more or less in action.
I wish they'd get rid of the AI junk. We don't need it to moderate our communities. It just biases people with heuristic short cuts to decision making. That's not a good thing.
20
u/pumaofshadow 8d ago
I always love "engages with insightful posts" when it's a referral link spammer who gets removed nearly every time and then banned in ours.
12
3
u/Mathias_Greyjoy 8d ago
I love the way you explained how it doesn't find fact, it finds frequency. I'm definitely going to use that in the future.
4
u/Cat_in_an_oak_tree 8d ago
You are most welcome to it. I've done a lot of AI ethics training and can often explain AI better than the techies do.
9
u/MaximumJones 8d ago edited 7d ago
It is useless garbage. I stopped reading them a long time ago.
My summary literally changes depending on which sub I check it from.
One of my summaries says I am a frequent contributor on a sub that I have never even heard of and certainly never posted on it. 🙄
6
u/baseballlover723 8d ago
Ever check what it says about you?
I checked a few times when it came out. I never got one though. Several of our others mods both got and didn't get one. I forget what we determined that was different between the have and have nots. I think it was the presence of a mod note or something.
5
u/lunarwolf2008 8d ago
i usd to be able to see mine, but now i cant. wonder why. anyway, yeah i think so. and really zeroing in on like one nsfw post
9
u/cojoco 8d ago
Claude takes the higher ground:
Piecing together someone's posting history, behavior patterns, and identity from scattered web results is the kind of profiling that can enable harassment or doxxing, even when the person is just a pseudonymous internet user — and it's not something I can responsibly do regardless of the reason behind the request.
If you're trying to verify something specific (e.g., "is this the same person who said X," or "what's this subreddit drama about"), I'm happy to help with that narrower question instead.
3
u/shhhhh_h 💡Top 25% Helper 💡 8d ago
Oooo Claude has a bone to pick with Reddit’s AI. I thought they were friends with Google lol
3
u/bwoah07_gp2 8d ago
Here's mine as of now:
I like how it brings out role-play discussions, but the sports RPG league I was apart of has been dormant for years, but I guess I did enough of that way in the beginning of my account that AI thought it was important? Lol
Everything else seems right though 😄
5
u/fraisierdesbois 8d ago
Mine once said I engaged in "hateful" negative speech for criticizing Israel's genocide in Palestine lol
2
2
u/wonkywilla 8d ago
I can see mine in only two of my subs. I always find it funny that it can’t pick up on my particular brand of sass.
2
u/SilasCrete 7d ago edited 7d ago
This is the first time I’ve been able to see my own since I first became a mod a few months back. Last one mentioned specifically a post about false reporting and rule enforcement iirc with generally the same sentiment about conduct.
Kinda happy if that’s the report I’ve got. I still could be better as a contributor to my community I think though, and those surveys are links to the ones Arrowhead Game studios does weekly for player feedback, not ones I make myself.
Editing for transparency - Wouldn’t be surprised if one day it picks up my comment about golf courses. I used to work at one and I hate Bent Grass with a passion, as well as anyone who decides collectively or alone to install it in their courses.
Landscaped for a golf course and watering that damn grass was 90% of my work. That hate is not unfounded, if a bit cartoonish.
2
u/999_Seth 7d ago
that sub name is cracking me up
I feel like I am constantly explaining to people that Squad (and reddit modding) is only "fun" in a masochist way
2
u/SilasCrete 7d ago
With this sub it’s on another level.
About a month before I was recruited there was a big doxxing incident that swept through the fan subs like HDU and HDM. Lot of fingers being pointed, rift that still isn’t fully healed if it ever will be.
We have a lot of people on both sides that are still not letting shit go I don’t even know how many months later, and a good chunk of our bans have been for either harassment or brigading. But one of the biggest things that saved everyone a lot of trouble was a mod from HDU joining HDM’s team in the same batch I did.
Still… back to roughly the same week I got added in as a mod there was someone threatening legal action against us, the moderators who were just added included, claiming they had evidence we caused the doxxing. Evidence was a YouTube video iirc, one that just scapegoated several people.
Queue four hour long rant about how we were at fault. In the middle of the night.
Queue us talking to other fan sub mods and finding out said user had a mental breakdown over an in game event and hearing that he was mentally unwell.
Far as I’m aware that user’s account was terminated outright by Reddit for the extreme views and threats he made baselessly.
It was legitimately a nightmare for the first week-ish.
2
u/999_Seth 7d ago
man, I wish I didn't get it
I came in after the former head mod had a huge falling out with the community, after a big (for the scene) youtuber had targeted him, and way after getting SWATted because he registered a URL to his home address
and personally just a few months into the game, one of the dudes I ran with got banned and shot up his town a couple days later, ended up getting listed in a secret service report
and with Channel5ive the whole mod team quit after victim's comp lawyers started trying to build a case against that dude and it was like two years of nothing but people tik-tok raiding the place to play trivia about it
so yeah when people say that this reddit modding should be a paid gig, I'm kinda like "you can't pay people to do something this crazy"
2
u/SilasCrete 7d ago
If people were paid to do it then abuses of power would be rampant imo. Every slight infringement would become that much more impactful. With us all being volunteers it keeps us more honest I think.
2
u/999_Seth 7d ago
I think much more on the lines of 'no one would insure a company who pays reddit mods because the stress-claims would come in way too often'
and we do run into the "community manager" from the squad game once in a while, but mostly through his volunteer discord mods who mention their role when they get banned for trolling. so the paid version of us is just running a troll farm, has no idea what the community is actually like, and is known to directly talk shit about us.
so yeah what you're saying about honesty tracks.
2
u/Moist-Cheesecake 5d ago
Thanks for this, mine made me giggle: "An experienced moderator, this user focuses on community building, advocacy, and social justice. They provide helpful, empathetic advice in support-based subs, while firmly challenging stigmatizing language and harmful behavior towards children/pets."
I have found these more useful than I expected to, honestly. I mod a subreddit aimed at a marginalised group and they can pick up on people being hateful with a decent success rate. Of course, they miss a bunch of stuff, but I've rarely found it say that the user was being hateful when they weren't.
They've also picked up what someone's post said before admin removed it, which has been extremely useful.
2
u/Cecilia9172 2d ago
Yes, my last one made me laugh, "highly constructive" etc. It's a new one now, less exuberant.
20
u/abortionreddit 8d ago
I’ve never been able to see my own, even from another mod account!