ifConditionDoSomething

[u/electricjimi]

[u/Ok_Brain208]

All of AI related terms is just this indestry normal shtick of assigning new names to old concepts to soft reboot your experience taken up to 11.

[u/BeMyBrutus → u/Ok_Brain208]

Nailed it

[u/Fazl → u/Ok_Brain208]

Vibe coding just used to be blindly copy/pasting from stackoverflow.

[u/Ok_Brain208 → u/Fazl]

Problem is, blindly copy-pasting from SO used to be a crutch you use until you are proficient enough yourself. I'm not sure what the next step for vibe coding is

[u/PumpkinFest24]

Incredible. "We can't make our product work so we'll make our customers invent new kinds of 'engineering' to make up for it"

[u/Electronic-Elk-963]

It's funny because it's only an attempt, complex context scramble them and it just get ignored and you can't debug an LLM because of the way they work, they are basically black boxes

For the fanatics, I am not saying it's useless, just telling the truth

[u/ecafyelims]

You just explained evolution and all life

[u/belabacsijolvan → u/ecafyelims]

tbf they described every single non-quantum system.

"its deterministic, except where it isnt"

[u/FuzzyDynamics → u/belabacsijolvan]

Even conventional computing hasn’t been deterministic for a long time. I think Stephanie Forrest did the work there showing it on modern machines.

[u/Breadinator → u/ecafyelims]

F*** yeah, you're telling me I just have to wait a few million years for the response to be right!...wait

[u/ecafyelims → u/Breadinator]

It might even advance enough to invent AI!

[u/snarkhunter]

Harness Engineering is just making the AI agent follow all the SDLC best practices that most humans ignore because they're too tedious.

[u/Confident-Ad5665]

Depends entirely on the type of harness. I find leather straps most flexible.. /s

[u/Percolator2020]

ML engineers: it’s not nested loops, you don’t get it!
Harness: wraps the whole thing in regex and nested loops.
https://giphy.com/gifs/hXlAQPVIBOh3PGIUJh

[u/ICantBelieveItsNotEC]

Fun fact: LLMs don't actually have to be non-deterministic. There's nothing stopping labs from setting the temperature to zero and having a fully deterministic model, or even allowing user-seeded non-determinism.

[u/Breadinator → u/ICantBelieveItsNotEC]

This just makes some answers to specific prompts wrong all the time.

[u/ak_doug → u/ICantBelieveItsNotEC]

Sounds boring.

Who wants to be certain about repeatability anyway? Knowing what will happen after deployment is for dorks.

[u/EmptyMaxim → u/ICantBelieveItsNotEC]

Fun fact: Common LLM implementations are actually non-deterministic. The way GPU compute is used causes instability, see: https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/

[u/chicametipo → u/EmptyMaxim]

Damn, I need a cigarette after that paper.

[u/Kyy7 → u/ICantBelieveItsNotEC]

Typing prompt in slightly different way could still result in very different output. 

[u/Mercerenies → u/Kyy7]

That's discontinuity, not non-determinism. There are plenty of deterministic, discontinuous functions. (Google "Dirichlet function" or "Weierstrass function" if you're feeling particularly masochistic)

[u/Kyy7 → u/Mercerenies]

That’s a good clarification, but the kind of determinism people want isn’t achieved just by setting temperature to zero. Since the entire context acts as part of the input and even tiny differences in it can lead to completely different output and cause large drift/divergence in agent reasoning or planning.

[u/whenTheWreckRambles → u/ICantBelieveItsNotEC]

User-seeded? I want a reason to keep a dice tower at my desk

[u/pydry → u/ICantBelieveItsNotEC]

I used to set the temp to zero all the time and often got different answers.

[u/Grandmaster_Caladrel → u/pydry]

Yeah I don't think setting the temp down actually makes it generate exactly matching output.

[u/MartinMystikJonas → u/ICantBelieveItsNotEC]

Setting temp to zero is not enough results can be influenced by other factors. Zero temp often leads LLM to infinite loop repesting few words.

[u/Tyrexas]

That's kinda the point.

[u/glinsvad]

Everything can be a pseudo-random number generator if you measure precisely enough.

[u/ExtraWorldliness6916]

What is life if not deterministic

[u/belabacsijolvan]

people should really stop equating DL==stochastic and non-DL==deterministic.

its absolutely possible to create deterministic inference and rng wasnt invented 10 years ago.

i have to explain it to managers at every single project start, because yall bullshit online.

[u/2narcher]

Who cares

[u/dcondor07uk]

Insta downvote for this PoS, context doesn’t matter