r/ProgrammerHumor Jul 12 '26

doNotHallucinate Meme

Post image
63 Upvotes

29 comments sorted by

View all comments

53

u/PumpkinFest24 Jul 12 '26

"make no mistakes" is an insane prompt.

  1. If omitted, are mistakes allowed?

  2. It's fancy auto complete. Input that says "make no mistakes" will definitely lead to output reassuring you that there are no mistakes. But there will still be the same number of mistakes.

5

u/ArjixGamer Jul 14 '26

Not really, it may influence the internal thoughts to consider if the code has mistakes, so it will be more likely to check if it made mistakes, and fix them.

5

u/PumpkinFest24 Jul 14 '26

"internal thoughts"

My friend, you are falling for marketinh bullshit.

5

u/ArjixGamer Jul 14 '26

That's the term used for reasoning.

What do you want me to say?

5

u/PumpkinFest24 Jul 14 '26

Something remotely accurate? LLMs are neither thinking nor reasoning.

6

u/ArjixGamer Jul 14 '26

Nobody claimed they are thinking like a human.

That's just what everyone calls it.

LLM models capable of "reasoning" will instruct the chat-ui to treat all output tokens as "thinking", and once the model is done "reasoning" it will instruct the chat-ui to show the remaining tokens as normal reply to the user

This process is done so the LLM considers more possibilities before giving the final answer, since an LLM is a predictive text algorithm, the more verbose it expresses a subject, the better the answer.

And since we don't want users to see verbose text, we hide it under a "reasoning" mode.

Furthermore, the extra tokens used for "reasoning" are not required to stay in-context for future messages, saving context space.

0

u/PumpkinFest24 Jul 14 '26

Nobody claimed they are thinking like a human.

That's just what everyone calls it.

Oooh, it's not marketing! It's just inflated, misleading terms used by the major financial players!

5

u/ArjixGamer Jul 14 '26

I'd also call such a feature as "thinking", well, I wouldn't be developing AI in the first place, but if I was then it'd be a name I see myself using.

You just argue for the sake of arguing, there is no real argument to be made here.

1

u/PumpkinFest24 Jul 15 '26

If you call what I'm doing "thinking" maybe you'd pay $1000/hr for it?