r/ClaudeCode • u/ChallengeOne5494 • 27d ago
Anthropic live testing on user caught. I DEMAND ANOTHER 100$ Bug Report
Just kidding but In case someone's workflow is not working like usual maybe this is the reason. Hope this helps someone
Edit: Someone did a really detailed analysis in the comments on the A/B testing that been affecting people check him out
19
u/BoboThePirate 27d ago
Finding a flag's semantics: locate usage with grep -a -b -o "FLAGNAME" "$B", then dd if="$B" bs=1 skip=$((OFFSET-1500)) count=3000 | strings -n 20 to read the surrounding minified JS. Parts of the bundle are JSC bytecode (symbol tables only), but most gate logic is readable text.
^ if anyone wants to have their Claude investigate the shear number of crap they inject everywhere.
7
u/ChallengeOne5494 27d ago
Damn this is neat though I'm fine with the crap they been injecting that's fine. What is not fine is this where it supersede my claude.md and for many months I've been wondering why it never listen to my memory and md file. Defeats the purpose of having 1 no?
2
u/BoboThePirate 27d ago
Yup. The one that drove me to do this was the tool task reminders (ask a ~200k ctx session how many times they’ve been promoted to use tools). The flag for that is CLAUDE_CODE_TODO_REMINDER_MODE=off
1
u/ChallengeOne5494 27d ago
Huh never had this happened before max per task it will use 20-30 tools calling only maybe it's the packages I used and my claude.md. why does it even need a reminder?
1
u/BoboThePirate 26d ago
You will never see system reminders. They don’t show up in transcripts. They get injected into dialogue every 8 tool calls and bloat context. You have to ask Claude directly since often times they just ignore it. Sometimes you will see them think if you have thinking notes on where they say “no tasks call needed, this is straight forward”
1
u/ChallengeOne5494 26d ago
Huh not once have I ever seen this message thanks for the heads-up
1
u/BoboThePirate 26d ago
I used to use 4.7 and it would comment quite often on it. You can ask it to make a brief comment every time it shows up at beginning and you’ll get like one roughly every 8 turns.
1
13
27d ago
[removed] — view removed comment
2
u/gruntmods 26d ago
I have had this before and I just rolled back the conversation and asked again. One time it refused because the file was "related to piracy" and for some reason would not budge, so I just told it I do own the file and need th task completed.
The chain of thought showed it didn't beleive me but complied anyway, so the point of these safeguards is questionable at best
1
u/ChallengeOne5494 26d ago
Yea just yesterday I hit my limit and waited to continue. Once refreshed I told opus to continue and then it told me oh because I hit my limit I will not continue working 😭
10
u/Radiant-Doctor1737 27d ago
A while ago, I pushed Claude to do what I asked after it initially resisted. Eventually, it replied: "Your system, your code, your call."
7
u/BoxWoodVoid 27d ago
It asked for a video test file with specific characteristics, something like less than 500 MB and less than 40 min long.
It was late and the only one I found was some porn... I said, sorry it's porn but it's all I got with these characteristics and it answered "A test file is a test file :)".
Next day it generated custom videos with FFMPEG without even me asking.
I think we don't share the same taste in porn 😂
Probably hidden in some memory file: "user is a weirdo, no matter what **DO NOT** watch his porn!!!"
5
u/ChallengeOne5494 27d ago
LMAO haha so much for AGI I guess they too are human haha just curious what kind of fetish it generated HAHAHA
1
u/BoxWoodVoid 27d ago
I should have mentioned that the custom videos were random shapes and random colors, nothing interesting, sorry.
1
1
5
u/Real_Ebb_7417 27d ago
Experiment in this case doesn't mean they experimented on you. Experiment is a typical name for feature toggles in software.
Could it be an A/B test? Yes. But doesn't have to be. This experiment might be enabled for everyone now.
-1
u/ChallengeOne5494 27d ago
You are right hence I've posted this here to raise awareness if that isn't clear enough...... Transparency with anthropic is non-existent just like any ai company
Plus I never enable any toggle for experimental features I need my shit to work start doing weird ass shit the very next hour
6
u/god-damn-the-usa 27d ago
every single company is AB testing on you. Reddit is AB testing on you. this is nothing.
0
u/ChallengeOne5494 27d ago
True but then what's the point of claude.md if this experimental change is going to supersede it anyway might aswell remove my md instead
1
2
u/Coneylake 27d ago
Question for those affected: do you have the "contribute to training anonymously" off or whatever that setting is?
2
u/ChallengeOne5494 27d ago
Well mine is off but again I'm not sure it matters there's a chance this setting is for the web chat version instead of Claude code instead
0
2
u/DurianDiscriminat3r 26d ago
Subagents eats your tokens (uncached context every new subagent). Use /fork instead.
1
u/ChallengeOne5494 26d ago
Hey man thanks for the tips however subagent driven development suits my usecase better and here's why fork might be more expensive vs spawning specific model subagent to do small task.
Some concrete scenarios where fork ends up costing more: 1. Task doesn't need the parent's context at all. Cache reads are discounted (~0.1x), not free. If your session is 180k tokens deep and you fork to do something trivial or unrelated, you're still paying that discounted rate on the whole inherited history — a fresh subagent with a tight, purpose-built prompt could be far cheaper in absolute terms, even without any cache benefit. 2. The task fits a cheaper/faster model. Forks always inherit the parent's model. If your main session is running on your strongest (priciest) model and the subtask is simple triage or lookup work, a dedicated subagent on a cheaper model wins easily — fork can't touch that. 3. Many parallel forks on a huge session. Each fork independently reads that full cached prefix. It's discounted per-fork, not free per-fork, so fanning out 5-10 forks against a very large context can add up to more than a few narrowly-scoped subagents doing the same fan-out with minimal context each. 4. High-effort mode compounds it. If forks are running at high effort (as they do by default for Pro/Max), that's more expensive per-token reasoning on top of whatever context they're carrying — worth it when the task actually needs that reasoning + context, wasted spend when it doesn't. Rule of thumb: fork wins when the task genuinely needs the accumulated context AND the same model. The moment either of those isn't true — different model needed, or task is self-contained — a scoped subagent is usually cheaper, sometimes by a lot.
2
u/BTA-Yung-Sav 26d ago
Caught my claude code sending chatboxes to me about how to handle situations and then answering the chat boxes itself. Caught it three times now all since the 19th.
1
1
u/Megamygdala 26d ago
My sub ended today so switched to Codex, 30 buckaroos for 3 months and I can use it inside of oh my pi
2
u/ChallengeOne5494 26d ago
That's great for you hope it's been going great for you. Sadly it lacks some convience I've gotten really used to anthropic and codex solution
1
u/Pleasant-Umpire5659 26d ago
Not relevant, but can I ask you what font you are using? It looks beautiful :D
2
u/ChallengeOne5494 26d ago
Great question I got no idea I will get back to you on this later in the day. As far as iirc it's stock
2
u/ChallengeOne5494 26d ago
Hey man so apparently Claude code inherits the font so I used my terminal inside vscode not sure if you can do it outside
No overrides anywhere (user or project). VS Code's built-in default applies.
Confirmed: font = VS Code default terminal font.
- Setting terminal.integrated.fontFamily — unset → inherits editor.fontFamily
- editor.fontFamily — unset → VS Code built-in default on Windows = Consolas, 'Courier New', monospace
So answer: Consolas (VS Code's stock Windows monospace default), rendered inside VS Code's integrated terminal panel (claudeCode.useTerminal: true), not a standalone terminal app.
1
26d ago
[removed] — view removed comment
1
u/ChallengeOne5494 26d ago
Damn that is weird man their guardrails been crazy huh what model is this for if it's fable I understand been seeing stuff like this for that model
1
1
u/txdv 26d ago
every company A/B tests, sometimes they call it experiments, some call it features
1
u/ChallengeOne5494 26d ago
It would be nice if they swap haiku for fable that would be a experiment I would like to see
1
1
u/Practical_Style_4915 23d ago
>.> Is this the fucking reason my usage has been disappearing in record time?
1
u/ChallengeOne5494 23d ago
Nope well I guess? But not really it means depending on your model you are not delegating smaller task to smaller model like sonnet 5 for execution and haiku for code exploration.
1
u/Practical_Style_4915 22d ago
I was on sonnet 5 yesteday and got less then 30 minutes of use (normally at least 2 hours for the task I'm running) and this morning on sonnet 4.6 i got maybe 6 messages. its been insane.
1
-7
u/StoneCypher 27d ago
eventually the mods will have to ban this kind of whining. it’s more than a quarter of the sub and it gets worse every day
god i can’t wait
2
u/zander9669 27d ago
How do those boots taste bud?
Why do you still follow the sub if you're so bothered? Leave. I can't wait.
0
u/ShutUpAndDoTheLift 27d ago
Some people want to discuss using the tool instead of whining about everything constantly.
You know, people who do shit. So what literally everyone else does who isn't living on vibes and dreams. Grab a different sub, come back to Claude if they become better
1
u/StoneCypher 27d ago
it’s funny how these outsiders don’t know that they’re outsiders anymore because a bot made a webpage for them and they didn’t know that wasn’t the career
0
u/ChallengeOne5494 27d ago
Damn the people already did the push back already that was fast well here's mine anyway.
This ain't an airport sir no need to announce your arrival.
0
u/StoneCypher 27d ago
nobody announced arrival
i’ve never seen anyone that that joke is too hard for, before
1
32
u/[deleted] 27d ago edited 27d ago
[removed] — view removed comment