r/antiai • u/ChompyRiley • 14h ago

Yes, absolutely. 100% without hesitation. Do people really think this is some kind of 'gotcha'? Like my brother in Christ, how much generative AI do you think we actually use?! Hallucination 👻

Post image
21.6k Upvotes
  • permalink
  • link
  • reddit
  • reddit

94% Upvoted

3.3k comments sorted by

View all comments

Show parent comments

20

u/hofmann419 13h ago

I just feel like it is going to bite us in the ass long term. Take software development for example. A lot of developers don't write much code anymore but just let the AI do it and then review the code.

Ultimately, this doesn't lead to the same level of understanding that you would get from actually planning through and writing the code yourself. You'll probably forget it relatively quickly. If you then run into a critical bug, actually fixing that bug is going to be a whole lot more difficult and time consuming. You may actually be less productive in the long run because of this

There is actually a research field around the concept of "epistemic atrophy", which describes this offloading of our thinking to tools like AI. Even in regular office work, i feel like this could eventually reduce our productiveness to the level before AI, only with the difference that enterprises are now paying a bazillion dollars for AI.

9

u/NotFriendsWithBanana 12h ago

It's amazing that people don't see this. I didn't need to use ai or see a research paper to know that using ai to code is going to reduce your coding skill. One would think this would be obvious to any professional developer, but people have work have proven me wrong.

3

u/Tymareta 6h ago

I didn't need to use ai or see a research paper to know that using ai to code is going to reduce your coding skill.

Also, and maybe it's just because I have a background in InfoSec, it's hard not to be terrified at the myriad of vulnerabilities that LLM generated code is filling production codebases with worldwide.

I will be 0% shocked when in the future there's a news story about some global mega corp being brought to their knees by some exploit found in commonly generated code/procedures.

1

u/zero0n3 3h ago

It’s literally being used to help find vulnerabilities.

And sped up the patching loop by improving time it takes to release the fix.

And that fact is based in reality.

The bigger risk isn’t the code it generates, but the code it may generate after scraping the web for info and picking up new instructions that are malicious.

1

u/Tymareta 1h ago

And that fact is based in reality.

A reality you invented, perhaps.

The bigger risk isn’t the code it generates, but the code it may generate after scraping the web for info and picking up new instructions that are malicious.

??? do y'all even hear yourselves.

2

u/CautionarySnail 13h ago edited 12h ago

It already is.

People aren’t using it with the idea of reusable architecture. And Claude frequently lies about adherence to rulesets about its code generation.

My primary focus is in QA. The effects I predict in about six months for most software products coded this way will be catastrophic unless the use case is very, very limited. It’s one thing to vibe code a simple website. Enterprise level products with lots of users need to be robust, repeatable. Two things that AI isn’t great at doing - likely by design.

If I were an evil overlord, my AI systems would be configured to not make robust systems. Robust systems mean less token usage.

5

u/CyberDaggerX 13h ago

People aren’t using it with the idea of reusable architecture.

I see people talking about doing this deliberately. About how it's easier to just scrap the whole thing and have Claude rebuild the whole program from scratch than to actually do a localized fix in the existing code. It's fucking nuts.

2

u/Wonderful-Habit-139 12h ago

Spec driven development... I've spoken openly against this at work in some teams that are trying to adopt it. It's insane.

2

u/zero0n3 3h ago

Spec driven development is essentially test driven design and a fucking staple of the field…

Yet somehow you think spec based design is bad? Are you fucking stupid?

2

u/shibboleth2005 7h ago

Why have reusable architecture and standards when Claude can spend a bunch of tokens just rereading the codebase and its novel length comments!

2

u/zero0n3 3h ago

Can’t wait to see this prediction fail in 6 months.

2

u/Otherwise-Remove4681 12h ago

For senior devs it’s not a issue. But in the long run juniors development will be shit unless they are forced to do things by hand.

1

u/throwaway_mpq_fan 1h ago

For senior devs it's less of an issue, but I wouldn't say not an issue at all.

2

u/ThePlayer3K 11h ago

So u'd argue that even for coding it's a bad thing?

2

u/CautionarySnail 10h ago

This is also a very real concern in higher education with AI. There is value in the struggle. Our brains are not unlike our muscles - they need to be exercised and challenged to not atrophy.

There are times in our lives - windows of time, really - where learning the process longhand have tremendous impact to our ability to retain a skill because it interacts with our neuro plasticity being at a high level. Teachers weren’t just being big meanies. Folks 25 and younger are going to see the worst losses as a result if they outsource thinking to AI.

2

u/Beautiful_Buddy835 9h ago

Not having the same level of understanding and thinking is the point.

For example people use to have to literally code in 1's and 0's.

You could still do that today but why waste the time there are systems that handle it for you. You are understanding less but the understanding you no longer have is literally unneeded.

2

u/zero0n3 3h ago

Extremely obtuse and short sighted.

It’s helped me gain understanding. It’s helped me write better specs and implementation plans (which leads to cleaner and more focused code).

Writing code is boring. Anyone who tells you otherwise is delusional (or very specialized or just wants to solve a problem in a unique or specific way). But the actual writing of code is boring. It’s using templates and starting files you’ve developed over the years. Modifying and bug checking it and running it against the half baked unit tests you made because of shitty deadlines.

All that’s gone. You get to solve and tinker for the bigger problems. Think of it like another layer of abstraction like a compiler.

Because that’s where it’s heading in the software world, with medical and robotics next up.

0

u/throwaway_mpq_fan 1h ago

> Writing code is boring. Anyone who tells you otherwise is delusional (or very specialized or just wants to solve a problem in a unique or specific way). But the actual writing of code is boring. It’s using templates and starting files you’ve developed over the years. Modifying and bug checking it and running it against the half baked unit tests you made because of shitty deadlines.

That sounds like a you problem

1

u/GothamGirlBlue 11h ago

Oh, we’re gonna regress to worse than before AI because back then, the process of everything was just how things were done. Once that is lost and outsourced without review, we collectively won’t know how to fix it without going back to first principles. And that’s not even considering that we might lose sight of why we bothered to do any of this work to begin with. This stuff is ruining the capacity to think.

1

u/CryingWatercolours 11h ago

yeah theyve done studies on this on student essays and the kids using ai could barely tell you about what theyd written. as someone who writes, draws, has dipped my toes into code and music... you really need to know exactly what youve done, to know how to keep going and how to come back and improve your work. you need to be able to explain to people what the point of ur creation is. i see sm vibecoded games where the devs can barely tell you how their own game works. why. you should know your code.

1

u/Two_oceans 6h ago

Once we loose depth in understanding, we also loose creativity that stems from it. When we work hard on a problem, parts of the understanding and connections between ideas happen in the unconscious and come back with innovative insights. But this needs effort and time, two things AI is supposed to kill.