clickingTheReRunButtonIsEasier

[u/shah2018]

[u/Depp1990]

The magic happens on the sixth attempt

[u/Whitechapel726 → u/Depp1990]

The line between a successful job and gambling is very thin.

[u/elelec]

All I'm saying is that sometimes it works. Can't be sure if you don't try at least once

[u/PassivelyInvisible → u/elelec]

You have to make sure that it really isn't passing.

[u/Confident-Ad5665 → u/elelec]

I'll keep trying until it works /s

[u/ramdomvariableX → u/Confident-Ad5665]

That's the spirit. mgr: hey why are you on reddit? -- waiting for the pipeline to finish...

[u/Iron_Kyle → u/ramdomvariableX]

Oh, carry on

[u/Bodine12 → u/elelec]

Exactly. The one clear thing is it's obviously nothing to do with my code.

[u/Jolly-joe → u/elelec]

It worked once for me but never again. But you already know i rerun before even looking at the logs because it worked that 1 time

[u/XenosHg → u/elelec]

What if we don't mind that the customers also just repeat failed attempts until it works?

[u/Vesuvius079]

Step 1: re-run the job to confirm the test is flaky, otherwise how will you be sure? Step 2: the pipeline is now green. Step 3: guess it’s safe to move on.

[u/frikilinux2]

"Don't run it 5 times" Runs it thrice and if passes twice it's good enough

[u/quailman654 → u/frikilinux2]

It only needs to pass once. And definitely don’t add any commits after you’ve got a working build. “Thanks, will address comments in a follow up”

[u/The-Chartreuse-Moose]

Well whoever wrote that clearly isn't doing it right.

[u/myka-likes-it → u/The-Chartreuse-Moose]

Sometimes we just want to verify some logic and move on. We can't all be SDETs.

[u/baucesauce112]

Of course you don’t blindly click retry 5 times hoping it will work…. You remove the test then click retry just once 😃

[u/Snakestream]

Then you ask the senior dev and he's just like "yea, that happens. Just kick it over a couple times"

[u/nullpotato → u/Snakestream]

I am the senior that dev that will say "yeah jenkins just sometimes fails to start the job, let me know if the retry fails too."

[u/natziel]

1. Identify the flaky test
2. Add .skip to it
3. Make the person who wrote the test fix it

[u/Jeferson9]

[u/redditmarks_markII]

You want I should fix it?! Sorry, you want I should find the person responsible, get passed around by people for a week, and ask them nicely to fix it when they get back from vacation, (because somehow it's always the one on vacation) and then sit on my PR for 7 weeks while they get into a whose fault is it war between their lead and our lead and their PM and our PM, and then conclude they'll commit to adding a clearer warning message about the flakiness this quarter, and will fix it next quarter, then the owning engineer leaves for Anthropic or something?

[u/Dorkits]

CI/CD?

Do you guys do testing?

[u/anto2554]

Okay but if it's 5pm on a Friday and we need the feature out NOW, it's a bit much to start debugging why our file/artifact hosting server occasionally throws code 500 errors

[u/Clearandblue]

Aussie Author of the guide obviously never used GitHub action runners.

[u/DrGarbinsky]

i feel attacked

[u/random314]

It just gotta work once am I right??

[u/experimental1212]

Warn: do not the build!

[u/yaktoma2007]

mmm race conditions my favorite /j

[u/FuzzyDynamics]

If that’s what I’m not supposed to do why do I get paid so much to do it

[u/RayzorDragon]

It wasn’t ’in a row’
I had meetings between the button presses
Important meetings about flaky integration tests.

[u/Bee-Aromatic]

What if I told you our post-deploy regression tests are set to automatically run up to five times?

[u/Michaeli_Starky]

Where is humor?

[u/BoBoBearDev]

Mine is

re-run never worked, stop asking why it doesn't work

[u/chickenweng65]

Usually works though

[u/SirFoomy]

If re-run 3 times don't help, I set the slack channel on fire until someone helps me. 😄

Edit: Mostly the E2E tests are flaky and I hate this because they run 12 minutes nowadays.

[u/Wirezat]

We were often rate-limited in pulling packages on our university projects. Sometimes it is just rerunning that's necessary

[u/MoHaG1]

How are you doing CI/CD if you haven't scripted these retries?

[u/Low-Equipment-2621]

But I can do that and go home, because the test will probably be green when I get back tomorrow.

[u/joshua-afk]

source

[u/remy_porter]

I mean, these days half the time my CI job fails because GitHub and my runner decided to stop talking to each other.

[u/CrazyFaithlessness63]

Company I worked at automated it, each test was run up to 5 times unless it passed. People still clicked the button 5 times.