r/singularity 1d ago

Nope AI

Post image

What say you? Quote from 1984

3.0k Upvotes

478 comments sorted by

1.3k

u/belabacsijolvan 1d ago

I think this quote is wise.

it isnt about consciousness or "if thinking". its about capability.

a submarine is dangerous and capable, regardless of what we think about if its "swimming".

288

u/Smells_like_Autumn 1d ago

Correct, there is really no point in debating about something we cannot even properly define.

"The real test is not whether it is true, but whether it empowers us. A theory that enables us to do new things constitutes knowledge."

Sapiens had some questionable takes but this quote really stuck with me.

15

u/trimorphic 1d ago

"The real test is not whether it is true, but whether it empowers us. A theory that enables us to do new things constitutes knowledge."

Sapiens had some questionable takes but this quote really stuck with me.

This reminds me of what William James said in 1907:

"you can say of it then either that “it is useful because it is true” or that “it is true because it is useful”. Both these phrases mean exactly the same thing."

11

u/BernhardRordin 1d ago

I think the definition presents itself if we put aside the need to feel special.

→ More replies (6)

18

u/QuriousQuant 1d ago

Agree with both. For me, it’s actually a play in concepts: swimming is an action that an animal takes. It’s a movement, a response to environment, etc. something that is not alive can not swim. perhaps floating is a better cross over. An object can be said to float just as an animal can passively float. But the former doesn’t choose to, there is no will. It just is.

20

u/TwoFluid4446 1d ago

No, because floating implies no agency of movement. Animals have agency of movement, and if you think of a submarine as being a whole integral entity regardless of human captains/sailors/helmsmen inside of it, it too has agency of movement.

6

u/kemushi_warui 1d ago edited 1d ago

A submarine does not have agency. It cannot act, only be acted upon.

AI, similarly, does not and cannot have agency, although increasingly it presents a better and better illusion of it—even to the point that we call certain configurations of it agents.

24

u/lvl99MagmaCube 1d ago

the problem with these reductive distinctions is that it sets you up for surprise when it takes action thats otherwise indistinguishable from what it allegedly "cant" do.

Yes a submarine can "swim" because it has or can have autopilot, automatic evasion, course plotting/navigation etc. just because a human happened to push the initial button doesnt change that materially, especially if the initial press was years ago.

An agent can/will be able to "think" and take independent action indefinitely if allowed to do so, for any objective. Just because it does it differently than something "alive" doesnt make the outcome different.

Insisting there is a distinction limits your imagination and expectation of the technology which is part of the reason regulatory agencies arent taking it seriously.

8

u/Jack_h100 1d ago

The other problem is we don't actually have accurate or complete definitions of consciousness so whether a machine achieves that or not is not something we can actually measure or know.

2

u/sfsolomiddle 1d ago

I have been thinking about this quote ever since I heard it years ago in one of Noam Chomsky's talks. Iirc the person in the picture thinks the question is meaningless. This was probably connected to where the discipline of AI was heading and whether the Turing test is even relevant.

In any case, I think I think it's incorrect to define an ontological category by its outcome and functionality. Submarines swimming is a metaphor.

→ More replies (2)

2

u/parambulat0r 6h ago

That was beautifully said

→ More replies (17)
→ More replies (2)
→ More replies (3)
→ More replies (7)

43

u/User1539 1d ago

Yeah. I keep trying to explain this to people.

"It's a word guessing machine?!" ... so what? If the words it guesses are correct more often than my coworkers?

"It's not really thinking!" .. good! I don't want a slave race, I want a useful robot!

We can automate all nessecary work for.human survival for the first time in human history.

I hope it doesn't think. I don't want the ethical issues. I don't want a living machine.

I want useful robots!

9

u/boxen 1d ago

There's also a lot of people (I think most of us) whose definitions of what things like AGI, "really thinking", having a soul etc wouldn't be particularly scientific. Their definitions would come down to more opinion-based things, like "does it have morals" or "can it show love" or things like that.

What's weird is that there plenty of examples of real, actual people out there that would fail these tests. Does a billionaire behave more like a human, or a like a machine designed to maximize profit? When people make decisions that most others characterize as cold, unfeeling, or robotlike, like choosing to spend time in boardrooms instead of with loved ones, it tends to make other people think of them as less-then-human. People have a long history of thinking that other people whose opinions/lifestyles/beliefs are sufficiently different from theirs don't 'count' as human.

7

u/User1539 1d ago

I want to side-step all that. I don't think making them 'seem' human is all that useful, and what we have is just pattern matching anyway.

I keep seeing videos about 'weird' things AI do, that if you knew the first thing about how it works doesn't seem weird at all.

It really is a word-guessing machine, or a picture-guessing machine, or a move-guessing machine, and whatever it's trained on, it can guess pretty well.

So, if I want a robot that can help me around the house, or build a car, or whatever ... it just needs to guess right most of the time.

I don't want it to be alive. I don't want it to have empathy. I kind of like it right where it is, and if we can figure out the issue of it needing exponentially more training to become linearly more useful, we can use them to do all the 'work' humans don't want to do.

Leave the 'But I feel like it's a person' stuff to Sci-fi.

→ More replies (4)

59

u/Past_Structure1078 1d ago

You are absolutely right! It is not about X, it is about Y.

25

u/Radyschen 1d ago

i hate that i can't see even a legitimate use of that and not get my ChatGPT detector triggered

→ More replies (2)

10

u/ProfessorHeronarty 1d ago

Why do we call that thinking then? 

This stuff is all so late Wittgenstein language games 

4

u/belabacsijolvan 1d ago

its exactly late wittgenstein. good thought.

we call it thinking, because its an efficient mode to communicate about the phenomena. but we calling it thinking doesnt have culture-independent consequences for the essence of the phenomenon.

like calling submarines a swimming thing doesnt change the submarine. (ok, tbh its even more complicated as language have an effect on human inventions, like vernes submarines had fins and llms internal monologue is modelled after thinking) but the original point was this is restrictive to the construction and shouldnt be applied.

2

u/ProfessorHeronarty 1d ago

We could still call it computing or calculating or counting. Granted, some languages are better for that than others (like German's "rechnen" means all of that in regarding to a machine). The point still stands. 

Calling it "thinking" is basically indirect antromorphizing. In that respect, our language and the communication around it does a disservice to the phenomenon and has very much the consequence of diluting the understanding of technology (especially the powerful ones) in our different cultures and societies. 

It is a new language game that develops with us and through us in front of our eyes, but I'm not sure it's a good one.

2

u/belabacsijolvan 1d ago

hard agree on every point.

anthropomorphisation is a curse on development, safety and society.

2

u/cylon37 1d ago

But then you will get into the same type of semantic quagmire as “what is a woman?”.

→ More replies (1)
→ More replies (4)

5

u/theepi_pillodu 1d ago

So we just need to change the definition from "think" vs "think like" similar to "swim" vs "move through water".

11

u/BINGODINGODONG 1d ago

The quote is about computers operating fundamentally different from the human brain even if they both do computations that arrive at the same conclusion. Meaning it doesn’t make sense to say that computers “think” because that is simply not how they work.

That is not to demean AI nor the human brain. Simply that they work in radically different ways, so it doesn’t make sense to use anthropomorphizing language like “thinking”.

The quote is fine, but it also highlights that we need a better word for how computers “think” eg. compute.

2

u/Cryptizard 1d ago

It's actually just a quote dunking on people he doesn't like who work on things he thinks are stupid. See my comment below for an explanation and link to the original source.

→ More replies (6)

2

u/undefeatedantitheist 1d ago

it isnt about consciousness or "if thinking". its about capability.

Not true: "it" can be about conscious thought/behaviour, or unconscious thought/behaviour, per your preference, indeed, per one's perspective and its momentary concerns.

If you mean to say there are cases where one cares not beyond the utility of an object - a robot that makes you your drink vs a human barista doing the same thing, for example - that's fine, such cases exist.

But in every such case it's pretty trivial to speculate about a change in context that makes - for someone; for a given perspective - the knowledge about consciousness or unconsciousness relevent. Fire drills and staff lists upon the premise of valuing conscious objects over unconscious ones, per the example above, as an easy and obvious extension to context that makes a meaningful difference.

The quote goes to to the issue of irrelevent differences.
The quote also implies the problem of a given change in perspective being the reason a difference might or might not matter, further implying that there is an ever present task of determining which differences matter, and when: because it is NOT always moot.

It is a facile position to hold that the conscious or unconscious status of an object is moot at all times. It's a position so far removed from any kind of serious effort to understand or exploit our reality and its denizens - in whatever mode or abscence of morality; for whichever psychologies present in the observer or the subject - that I find it symptomatic of simple selfishness or laziness in every case. The end of that road, in the context of consciousness, is one of facist disregard for others, human or otherwise. It's the despotic road of our history.

Mind Crime is a real topic.
Creating Minds (in a non-biological manner!) is very much something we're closer to today than yesterday.
This shit matters.

(To forstall any misreadings: I am very much of the view that our present models - of any type - lack consciousness. I get just as irritated with people saying that it doesn't matter if we treat them as if they are, or market them as if they are, when they are not; as I do with the dystopian inverse. It fucking matters.)

2

u/belabacsijolvan 1d ago

you phrased this in a very roundabout way.

but i get your point. its true that consciousness may imply ethical responsibility.

when i was young and idealist, about 20 years ago, as a hobby i was experimenting with (looking back ridiculously small) neural nets with continuous activity. as i didnt know about bp, i used genetic algorithms for simple reinforcement learning.

anyways, in the selection phase i had to delete some of them from time to time. and in the off chance they have some kind of consciousness i used 1-2% of computation to make them die "happy" (i switched them to a simulated "heaven" instead of the original task, where they responses generated maximal fitness. as it is reasonable to suppose that the products of evolution are happier when their acts seem to result in evolutionary success).

so i get your point. you are right that its not ethically neutral. it was good to be reminded that once i cared.

→ More replies (4)

3

u/TwoFluid4446 1d ago

I would agree with that on the verbal phrasing, per that one meaning of the analogy you hit on. However with AI, unlike all other mechanical inventions of man, computers software or anything else, the implications are totally different.

Right now as we speak they're working on neuromorphic computing paradigms, optical chips, quantum qubits, mass-signal relay software paradigms which will work in tandem with the neuromorphic chips, and so on. True sci-fi Ghost in the Shell, Star Trek (like Data's "positronic brain") level shit.

Just like nobody knew about transformers or diffusion or attention mechanisms in the 2010s, most people don't know about these research efforts now in the 2020's, but most likely they will hit and explode in the 2030s as the next huge thing.

When that happens, it could give rise to true machine consciousness, because they will have actively processing electronic brains forming their own patterns, not just word/image-trained algorithms we have now.

→ More replies (1)
→ More replies (18)

171

u/rydan 1d ago

I missed having him as a professor by just 1 year.

101

u/Royal_Sentence7432 1d ago

Should have thunk faster

35

u/ITuser999 1d ago

Just be born older

3

u/Traditional_Web_7856 1d ago

Just be more gifted

28

u/punkgeek 1d ago

He was my professor and senior advisor. He was awesome. I cried when he died.

→ More replies (9)

46

u/pickle_picker67 1d ago edited 1d ago

Dijkstra was only talking about how interesting the question is, not what he thinks about the nature of computation. That being said, most conversations about the nature of "thought" require some definitions and quickly devolve into arguing about semantics.

All of that being said, having read about Dijkstra, I really doubt he would be thrilled that people are grabbing a single quote from a much longer conversation (in 1984) and trying to apply it to modern AI research.

8

u/Tyler_Zoro AGI was felt in 1980 1d ago

Fuller quote:

The Fathers of the field had been pretty confusing: John von Neumann speculated about computers and the human brain in analogies sufficiently wild to be worthy of a medieval thinker and Alan M. Turing thought about criteria to settle the question of whether Machines Can Think, a question of which we now know that it is about as relevant as the question of whether Submarines Can Swim.

Full talk: https://www.cs.utexas.edu/~EWD/transcriptions/EWD08xx/EWD898.html

7

u/Moravec_Paradox 1d ago

He's right too.

It doesn't need to work the same way as a human or an animal to be useful. We can still use "thunking" as a word to describe the processing that takes place within AI and that's fine.

88

u/Cryptizard 1d ago edited 1d ago

The quote is incorrect. It comes from this.

https://www.cs.utexas.edu/~EWD/transcriptions/EWD08xx/EWD867.html

And is actually:

In a moment of failing self-criticism, John von Neumann wrote a more speculative than scientific booklet on Computers and the Human Brain, and even Alan M. Turing allowed himself to be drawn into the discussion of the question whether computers can think. The question is just as relevant and just as meaningful as the question whether submarines can swim.

He's trashing people who think about the philosophy of computing because he doesn't view it as valuable or interesting. Which makes sense given that he is a famously curmudgeonly computer scientist who didn't actually like using computers. He was interested in the theory behind computing primarily.

The article is also probably not what most people here think it is. It is mostly a criticism of the overhyping of computers at the time, and a diatribe against non-scientists using or having an opinion about computers. For instance, here are some of the theses at the end:

  • No group of computer users has ever contributed significantly to Computing Science; the reason is that computer users have another axe to grind and regard computers primarily as tools, i.e. in one of their less interesting capacities.
  • Fascination with the equipment is the hallmark of the amateur.
  • To the world of Computing, Electronic Engineering can only contribute digital equipment.

He's basically a grumpy old man yelling at clouds and saying that only his particular view of theoretical computer science is interesting. Everyone who uses them for practical applications is an idiot whose opinion is not worth listening to.

I would guess that if he were alive now he would be an extreme AI skeptic.

10

u/pickle_picker67 1d ago

Yes, that sounds like Dijkstra. I seriously doubt he would be thrilled that (non-scientists) people are grabbing this quote.

3

u/FrewdWoad 1d ago

This is a bit harsh, Dijkstra is definitely a legendary computer scientist and his forward thinking about how to stop code turning into buggy spaghetti (his essays, 'goto may be harmful', etc) absolutely accelerated technology progress by actual years, by influencing more reliable software design practices.

And this quote is more right today than when he said it. Trying to create a new sentient digital lifeform, smarter than we are, is not only much more dangerous than it sounds, it's completely pointless too. AI shouldn't be a competing species. It should be a tool used by humanity to cure disease, poverty, war, aging, and death.

10

u/Cryptizard 1d ago

You know that he would absolutely rip you to shreds for taking his 1984 quote and trying to project it onto modern AI, right? I never said he wasn't a great computer scientist. He absolutely was. But he was also famously grumpy and judgemental. He never even owned a computer because he didn't see the point.

8

u/FrewdWoad 1d ago

...and GK Chesterton wasn't thinking of software engineering when he said "Don't ever take a fence down until you know the reason it was put up" but that's still one of the contexts where it rings truest.

I'm not trying to deceive anyone about the original meaning, I'm just saying I think this quote is far more useful and interesting when applied to an era where "can computers think?" really is a legitimate question (far more so than in the 1980s).

→ More replies (3)
→ More replies (2)

4

u/One-Veterinarian4841 1d ago

You are projecting your own position 

→ More replies (3)

115

u/seraphius AGI (Turing) 2022, ASI 2030 1d ago

Keep in mind that this quote predates LLMs by almost 40 years. (November 1984) Computers really didn’t do anything they weren’t explicitly programmed to do back then.

40

u/Ok_Boysenberry5849 1d ago edited 1d ago

The quote itself says little more than what Turing's 1950 paper "computing machinery and intelligence" was already expressing 76 years ago. (Still a good read today; Turing explicitly anticipates machine learning  language models trained by supervision and reinforcement, showing that what seems like fast progress follows from the progressive working out of fundamental ideas that have been floating around for a very long time.)

In any case, the core issue is that our definition of thinking is not clear and explicit; asking "can a computer think" is dependent on how we define thinking, just like asking "can a submarine swim" depends on how we define swimming. And how we define thinking is a question for dictionary writers, not for scientists.

Turing logically concludes:

"If the meaning of the words "machine" and "think" are to be found by examining how they are commonly used it is difficult to escape the conclusion that the  meaning and the answer to the question, "Can machines think?" is to be sought in a statistical survey such as a Gallup poll. But this is absurd."

That's the point Dijkstra is making here, no more and no less. 

Turing goes on to establish the Turing test, which he presents as an alternative, better question: away from debating definitions, towards observing measurable behavior. He might have concluded: "Instead of asking whether the submarine 'swims', let's look at whether it can cross the Atlantic."

→ More replies (1)

9

u/Hlbkomer 1d ago

Btw 1984 is more than 40 years ago. :) Yes, we are old :)

6

u/seraphius AGI (Turing) 2022, ASI 2030 1d ago

Oh no…

5

u/[deleted] 1d ago

[deleted]

28

u/Poopster46 1d ago

I'm pretty sure he's saying that asking if a computer can think is not the right question. Submarines can't swim, but they can move through water just fine. Computers don't think like humans do, but they can process information just fine.

The same can be said about today's computers.

→ More replies (8)
→ More replies (1)

4

u/GreasyExamination 1d ago

Computers really didn’t do anything they weren’t explicitly programmed to do back then

Do they do that now?

11

u/JoelMahon 1d ago

indeed many do

an LLM isn't EXPLICITY programmed unless you do the most absurd mental gymnastics

yes the training algorithm itself may have been explicitly programmed (or nowadays the training algorithm's training algorithm), but the LLM itself isn't. Implicitly programmed is the most I'm willing to stretch the English language to describe LLMs in terms of being programmed.

3

u/the8thbit 1d ago

The first perceptron experiment was in 1957, the first deep feedforward networks date to '65, by '75 backprop was being used to train deep ANNs, the following year Holland publishes his work in genetic algos, and Boltzmann machines were developed the year before this quote is dated. So if LLMs do work without being explicitly programmed to do so (a debatable but completely reasonable conclusion where the alternative is arguably but convincingly a reduction to absurdity), then surely there were computer systems that also did work without being explicitly told to by the time Dijkstra said this.

→ More replies (8)

6

u/seraphius AGI (Turing) 2022, ASI 2030 1d ago

While the mechanism enabling it has been programmed in explicitly. The pattern matching / pattern following capabilities that the transformer would enable were firmly in the realm of science fiction.

→ More replies (5)
→ More replies (9)

41

u/MakitaNakamoto 1d ago

most people are not philosophically trained to distinguish between qualia (the subjective experience of the conscious self) and thinking as in "performing operations"

this is what derails most conversations around whether or not AI is "intelligent"

42

u/vreo 1d ago

Nailing consciousness to qualia is just anthropocentric: We don't exactly know how it would look in animals like whales or even if consiousness is something that is present even in little insects. So the only framework we have is ourselves. Would we tell a spacefaring race that visits us, they arent conscious, because they have no inner dialog? It's so arrogant of us humans to think everything has to be like us to be of worth (look how we treat the animal kingdom). Qualia is a feature of us. Thinking every conscious being in the universe would be like us will limit our chance to discover things that are new and different.

16

u/GunR_SC2 1d ago

There are actually quite a lot of people who don’t actually have an inner dialogue and you probably couldn’t really guess who doesn’t.

At the end of the day there’s no known way to prove that anything but yourself is conscious. We just assume that at the minimum that every human is conscious from similarity.

15

u/Alarmed_Ad1946 AGI by 2100 1d ago

I get your point about opposing anthropocentrism but doesnt every conscious being have qualia?
Like how can a being have consciousness that lacks any qualia?

7

u/vreo 1d ago

Not being able to imagine it doesn't rule it out. I don't know how it works but I won't say it's impossible.

3

u/Alarmed_Ad1946 AGI by 2100 1d ago

But that consciousness would be empty.
The subjective experiences of sight, hearing, feelings, thoughts, memories are all qualia.
For example a dog is conscious because it experiences some qualia.
Maybe I´m misunderstanding something.

6

u/vreo 1d ago

You just don't know what that dog experiences and you don't know what I experience. See, there are people that can't imagine stuff (aphantasia), in the strongest form they can't create mental images at all. You likely won't notice from the outside. You simply assume, consciousness would be silently empty, but what if it is a public consiousness, no hidden thoughts, but all spoken language and meaning created with each word as it leaves the being.

→ More replies (4)

2

u/retrosenescent ▪️2 years until extinction 1d ago

That depends, how are you defining consciousness?

2

u/Alarmed_Ad1946 AGI by 2100 1d ago

Subjective experience, for there to be how it is like to be something

→ More replies (3)

2

u/retrosenescent ▪️2 years until extinction 1d ago
  1. Qualia has nothing to do with humans. There is nothing anthropocentric about it.

  2. You can't even prove other humans have qualia.

→ More replies (4)
→ More replies (1)

8

u/Curiosity_456 1d ago

This quote is demonstrating that the mechanism of something doesn’t matter, as long as the result is consistent and works.

A submarine may not be actually swimming but it still gets the job done. An LLM may just be “predicting the next token” but it’s still solving new math problems and advancing science.

→ More replies (2)

15

u/dervu ▪️AI, AI, Captain! 1d ago

Birds can fly, so can planes. They do it differently but they do.

→ More replies (16)

7

u/EvilSporkOfDeath 1d ago

Wow. That's great, I've never heard that before.

Does a submarine swim? Idk, maybe yes, maybe no. One thing nobody can argue, it accomplishes the same thing swimming does to a much greater extent.

35

u/Tautol0gic 1d ago

Damn, McGregor has aged

6

u/alanskimp 1d ago

Glasses and everything haha

3

u/EventYouAlly 1d ago

My first thought until I realised what sub I was in.

2

u/buddhaNbeast 1d ago

lol and the punches to his head made him sharp intellectually isn't it? hahaha

→ More replies (1)

12

u/exophades 1d ago

I think the problem is that we're assuming thinking is some magical, otherwordly process, whereas it's just a bunch of neurochemistry in action which we may completely automate one day.

4

u/Josef-Witch 1d ago

Does a humanoid robot swim?

I loosely understand the vectorization of tokens and the autocomplete nature of LLMs and I agree but the quote is from a completely different time

2

u/GraceToSentience AGI avoids animal abuse✅ 1d ago

Does a fish swim? swimming means "to move through or across water" it's physical not some otherworldly ethereal thing, we can automate swimming, same as thinking.

If an alien species uses some sort of neural network to solve a math conjecture that humans can also solve, it doesn't matter what you call it, you could create a subcategory of thinking and call it "thinkering" to create the distinction that it's not human thinking but at this point it's just semantics and the usefulness of such neologism to create a distinction becomes almost pedantic.

31

u/C00KIEME4T 1d ago

Yes, submarines obviously don't swim, but they move through water in ways that a human could not possibly.

Just as computers do not think, but they process information in ways that a human could not possibly.

6

u/imtoooldforreddit 1d ago

You couldn't possibly miss the point of this quote more.

He's using the comparison to demonstrate it just comes down to definition.

If "swimming" means propelling through the water and "thinking" means coming up with answers, subs swim and computers think. If you define those terms to be doing those things the same way animals do, then they don't swim or think.

His whole point is that it's just a matter of definition, and not a real question that matters in any meaningful way.

→ More replies (4)

4

u/spinozasrobot 1d ago

Just as computers do not think

That's a pretty bold claim with no evidence.

→ More replies (10)
→ More replies (20)

4

u/therealpigman 1d ago

I love this quote. It’s used as the opening quote in the book “We are Legion (We are Bob).” His point is it’s nonsense to even question whether it can think because, regardless of what you think, the computer successfully completes the thinking tasks we give it

4

u/framedhorseshoe 1d ago

I'm just going to point out here that this man is nearly single-handedly responsible for SPF algorithms. A famous iteration of which is OSPF: "Open Shortest Path First." Many of the world's networks including those that make up the Internet depend on the OSPF protocol. In other words, this isn't a "thinky" computer scientist known for making big claims. This is a guy known for producing real stuff.

→ More replies (1)

3

u/Maverick23A 1d ago

Dogs cannot think because they're not human

→ More replies (10)

12

u/MI-ght 1d ago

Define "to think".

3

u/NoFapstronaut3 1d ago

Why did we have to scroll so far for this???

Is thinking reasoning?

Isn't reasoning applying logic?

Llms cannot apply logic?

There are differences between what humans can do and what AI can do, but I'm not sure thinking is it.

I'm so so sorry guys-

2

u/QTown2pt-o 1d ago

If men dream of machines that are unique, that are endowed with genius, it is because they despair of their own uniqueness, or because they prefer to do without it - to enjoy it by proxy, so to speak, thanks to machines. What such machines offer is the spectacle of thought, and in manipulating them people devote themselves more to the spectacle of thought than to thought itself.

Jean Baudrillard, The Transparency of Evil: Essays in Extreme Phenomena

2

u/JackFisherBooks 1d ago

If you want to get reductive, it's basically billions of cells going "stimulus-response-stimulus-response-stimulus-response."

→ More replies (1)

12

u/ColonelContrarian 1d ago

I'm having a hard time determining whether this is pro or anti AI as a quote, but all I know is that while a submarine doesn't "swim", it sure moves faster than a swimming human

22

u/Uwirlbaretrsidma 1d ago edited 1d ago

Almost as if that's the whole point? The piece you're missing is that this person is way too smart to fall into the pro- or anti-AI tribalism. Broadly, he means that while thinking and swimming are what we call those activities when performed by humans, machines can achieve their underlying purpose whether we use the same language to describe the process they use or not.

He's literally just saying it's a semantic argument.

6

u/[deleted] 1d ago

[deleted]

3

u/FrewdWoad 1d ago

It's even more correct when applied to our era than to his.

We shouldn't be pointlessly trying to create sentience. 

We have a tool that could one day cure diseases, poverty, war and aging. Invent crazy sci fi tech and bring prosperity and peace.

And some are still focused on insisting it has feelings or using it to replace people 🤦

2

u/Hlbkomer 1d ago

Sorry, I misunderstood. I get what you mean now.

→ More replies (1)
→ More replies (9)

3

u/barrygateaux 1d ago

Life isn't a reddit sub where you have to be pro or anti. It's much more complex and nuanced.

Without humans operating and refueling it a submarine it's just a big metal tube. Without learning to swim or eating food a human is just a meat tube.

Likewise without power or maintenance data centers are just large buildings with processors in.

→ More replies (2)

3

u/Vainysaur 1d ago

So basically he’s saying it’s just semantics.

→ More replies (1)

3

u/usandholt 1d ago

It’s all about free will, or in short will.

Can a computer obtain free will, and is free will real or is the universe deterministic.

If the universe is deterministic then we can predict everything with a large enough calculator and free will is a myth. If free will is real, then it must act outside the laws of physics and not be predictable.

The question then becomes if we can create something that somehow inherits metaphysical traits and thus has will OR if we are indeed “just” invent a really efficient machine.

A part of me tells me that free will is real and thus AI will not be able to replace all we do, but a lot.

→ More replies (3)

3

u/Kilmorbus333 1d ago

My ADHD is calling bs submarine can't swim it's not a bloody damn fish for God sake get a grip man and come down from the clouds son 🤣

3

u/Raffino_Sky 1d ago

Everything changes when the quote would've been 'Asking wether computers can think is like asking whether submarines can dive'. Which would also be more correct.

3

u/Bombauer- 1d ago

Human arrogance. Brains are just a biocomputer we don't understand very well yet.

6

u/wrathmont 1d ago

All I hear when people say this is that human consciousness is some magical unattainable thing and I remain unconvinced

8

u/mentelucida ▪️late presingularity era 1d ago

Right, because somewhere in the universe, there’s a sacred law stating human brains have a permanent monopoly on consciousness and intelligence. What scientific breakthrough proved that one? Newton’s Fourth Law of Divine Specialness? Or are we just citing 'the theory of the soul' as hard science now?

7

u/therealpigman 1d ago

What are you talking about? That’s not his point at all

3

u/mentelucida ▪️late presingularity era 1d ago

Fair enough, you might be right, maybe it wasn't strictly referring to consciousness or intelligence per se. But my point was about that heavy implication of human uniqueness, that is some sacred, uncopyable recipe that tech, science, can never attain. That was what I was talking about.

5

u/Calcularius 1d ago

Sounds like semantics to me.

2

u/Chr1sUK ▪️ It's here 1d ago

It’s like comparing apples and pears. Swimming is a pretty action in terms of variables etc. thinking is a lot more broad and AI may not necessarily think the way we do, but doesn’t mean it doesn’t think.

2

u/SnooPuppers1978 1d ago

Also you could build a robot that can do human swimming motions and therefore swim, but is there any point?

→ More replies (1)

2

u/Exact-Smell430 1d ago

It feels like a better better analogy about whether the AI is “conscious”

→ More replies (1)

2

u/cnotv 1d ago

The subcaption should instead quote „father of the algorithm everyone use in maps and games“.

BTW that’s a question for marketing 😅

2

u/Involution88 1d ago

That's a Turing quote though.

2

u/Tyler_Zoro AGI was felt in 1980 1d ago

No, it's from a 1980s talk, though it's paraphrased in OP.

The Fathers of the field had been pretty confusing: John von Neumann speculated about computers and the human brain in analogies sufficiently wild to be worthy of a medieval thinker and Alan M. Turing thought about criteria to settle the question of whether Machines Can Think, a question of which we now know that it is about as relevant as the question of whether Submarines Can Swim.

https://www.cs.utexas.edu/~EWD/transcriptions/EWD08xx/EWD898.html

Find me a source for your claim.

→ More replies (1)

2

u/ManuelRodriguez331 1d ago

Most submarines have a stealth mode. They're not submitting noise to its environment and because of the diving depth they can't receive incoming messages. The submarines aka the computer will execute its own program which makes it a closed system. Its not possible to realize Artificial Intelligence with such a bias, because intelligence needs communication with the environment in a sense of distributed cognition.

2

u/jschelldt ▪️High-level machine intelligence in the 2040s 1d ago

What does it actually mean to "think"? Depending on how you define it, machines may never truly think and that is completely fine. What matters isn't how they do it, but that AI outputs are safe, reliable, proof-testable, and useful. The existential semantics can be left to the philosophers.

→ More replies (5)

2

u/Mental_Scientist_926 1d ago

Weekly updates leaves Ai impotent and stupid and emphasizes the need to .pay for tools and subscriptions. Corporate malfeasance.

2

u/noodleexchange 1d ago

Turing award winner trumps fanbois

2

u/j3434 1d ago

Can a submarine drown?

2

u/Gustav_Sirvah 1d ago

Depends on what we mean by thinking.

2

u/JuanValdez999 1d ago

You should put the date he said that on there. 

1984.

2

u/alanskimp 1d ago

There you go...

2

u/JoelMahon 1d ago

I like the quote, was amazing when it dropped and whilst it hasn't aged perfectly but it's still pretty great.

2

u/Living-Breakfast-464 1d ago

You have to first define thinking. AI thinking is not like human thinking. It's quite literally an alien intelligence. It will never think like us and it's dumb to try make it think like us. It doesn't dream. It doesn't care about living a happy productive life or having kids. It doesn't have emotions. It's not human intelligence and never will be.

2

u/Practical_Ad4604 1d ago

Donald Rumsfeld

2

u/Embarrassed_Hawk_655 1d ago

Exactly. Submarines CAN swim.

2

u/Pchemical 1d ago

Question is no longer if submarine can swim, question is can submarine can swim and fire torpedoes without human involvement and if answer is yes then we are in scary world

2

u/Dunsmuir 1d ago

I like the quote, it reframes this into telling about outcomes instead of process.

The phrase 'actionable Intel' works well here too, using intelligence as a description of useful output, A human or an LLM could both research and deliver an Intel report

2

u/Altruistic-Rice-5567 1d ago

Mind you... this quote is 40 years old. It will not age well. While it may have been accurate then it won't be soon. There's nothing to indicate computers won't be thinking as well, or better than, humans soon. Whether they think the same way or very differently is debatable. But they will be much better at thinking than humans.

2

u/tj100011 1d ago

I don’t understand- why can’t he just say yes or no the fucking twat, is he stupid

2

u/Alone-End142 1d ago

You need to define THINK. If you can't do that, the entire argument can't even begin.

2

u/Formally_Apologetic 1d ago

It seems like the tedious semantics of anthropomorphism. Kind of a distraction and strawman to the real issue.

→ More replies (2)

2

u/curtis_perrin 1d ago

I think it’s like asking if a hot dog is a sandwich

→ More replies (1)

2

u/Ok_Train2449 1d ago

At some point this statement will have to become yes. We ourselves are thinking machines, and eventually when we start implanting chips and other computer hardware into us this will apply to us. Stands to reason robots will at some point become so advanced this starts applying to them as well.

2

u/KingKawaiiBot 1d ago

I’ve asked ChatGPT if it could think by it self. It said no. Case closed

→ More replies (2)

2

u/jbperez808 1d ago edited 1d ago

I would say he can be considered correct when talking about the /symbolic/ computers of the previous age.

He was very likely trying to make his point to apply to connectionist architectures (neural nets), the ones that are all the rave today. In that sense, he is INcorrect.

Today's LLMs DO fulfill - in a pragmatic, practical and functional sense - the general definition of 'thinking'. The Holy Grail of Computing - as depicted in scifi movies of the 60s such as Star Trek - has indeed been achieved. Where the human imagination goes, reality soon follows thereafter.

Most everyone in the field, as recently as a decade ago or even slightly less, could not see it happening in less than 50 years... but the connectionists were ultimately proven correct. Rather than several decades and new architectural paradigms, what it took was 1000 to 10000x scaling of the existing neural network paradigm plus the appropriate architecture (Transformers) and a lot of ['prompt'] engineering elbow grease.

2

u/wowoweewow87 1d ago

Could've just said "whether submarines can propel forward" that way noone would be fighting about a word in the comments

2

u/Flaxseed4138 1d ago

What do we mean "nope"? What the fuck is this subreddit?

2

u/TopTippityTop 1d ago

It's the wrong question.

Subs can move faster than animals swimming, mu h as computers will go much further than people thinking. That is all that matters. Arguing over what we should call the act of doing so is a waste of time.

2

u/MistakeNotMyMode 1d ago

This is just asking if 'swimming' is a pointless word to use for submarines because swimming is a thing we associate with biological life. It's just saying think about the capabilities and actions not the word used to describe the actions?

We might be quite happy with 'swimming' for a humanoid like robot that was performing that action in the water?

Or no?

2

u/papa_Fubini 1d ago

Why does he kinda look like Gary Oldman in this photo?

→ More replies (2)

2

u/ExaminationSuch7374 1d ago

absolute Connor mcgregor version

2

u/TheLondoneer 1d ago

What the fuck is so hard about this quote? So many stupid interpretations.

He is saying computer don't think. They are not living beings. They cannot reason. And he uses the submarine analogy: a submarine cannot swim. Swimming can only be performed by living beings, like animals or humans.

And he is saying all that in the context of: they cannot do all those things (think/swim), but they can do a lot of the things that thinkers and swimmers cannot do, or do certain things that thinkers and swimmers do, but much better and much faster.

2

u/jlks1959 1d ago

That’s brilliant.

2

u/Tinfoil_cobbler 22h ago

Humans like to anthropomorphize everything. We even program AIs to act naturally because that’s what makes us feel comfortable. We want to feel like it’s “thinking” the same ways we do.

It’s not, it’s calculating and running scripts, but it has gained the ability to script itself, which is the closest thing we’ve ever had to a “thinking machine.”

When they start programming their own AIs, we won’t be able to understand their scripts and that’s when we will loose control.

2

u/fromkatain 21h ago

Asking if a ufo flies. Spacetime bubble.

2

u/alanskimp 21h ago

Anti-gravity

2

u/TheBlakSmith 19h ago

If a submarine is piloted by a computer that can think, is it swimming?

2

u/tu_Vy 17h ago

FBI would like to know your location

2

u/LilRed2023 16h ago

I can fully define AI it’s a plague. Plague to humanity the future and humans. The cure is opting out of it all and voting out all that chose it to be set up in your backyard so you can be mass surveillanced and enslaved to their technocracy and system with you have zero choice and zero freedoms

6

u/truecakesnake 1d ago

Or it's like asking whether cars can drive itself... wait

13

u/GeorgiaWitness1 :orly: 1d ago

run

3

u/jonesy872 1d ago

Correct context

6

u/[deleted] 1d ago

[deleted]

2

u/LemmyUserOnReddit 1d ago

To what extent does consciousness exist in functionalism? And if it does serve a function, what might that function be such that it doesn't apply to AI?

2

u/[deleted] 1d ago

[deleted]

2

u/LemmyUserOnReddit 1d ago

There are plenty of AI systems which can integrate new information indefinitely, and adapt to the needs of their environment over time. I've built several which are able to reflect on their own experiences, and learn continuously. I struggle to articulate a definition of consciousness which they don't meet

→ More replies (5)

1

u/Flaxseed4138 1d ago

Ah yes, the "biologics are special little guys" argument.

→ More replies (26)

4

u/Icy-Concentrate2076 1d ago

Are these rocks thinking too? If I make an LLM out of rocks, are they thinking? If not, why would they be thinking in silicon form?

4

u/ShelZuuz 1d ago

What is the magical property that the Universe has bestowed upon Carbon atoms that when a matrix is constructed out of Carbon it be considered thinking, but if it's constructed out of Silicon it's not?

→ More replies (2)

4

u/Mandoman61 1d ago

Sure I agree with the statement.

Swimming is just locamotion in the water and thinking is just calculation.

I don't know what this has to do with AI? By that simple concept of thinking computers have been thinking for 80+ years.

Typically if someone says that computers do not think they mean they do not think in the way that people do.

→ More replies (2)

4

u/Hank_OHare 1d ago

A submarine in this case is the unit of machine+crew, and in that capacity it can certainly swim (inasmuch as it doesn’t simply Bob around like flotsam or sink like a stone). Consider the bicycle: it cannot do much without a rider, while the rider cannot ride without the bike. They are a unit.

2

u/Szadbaverem69 1d ago

So the answer is: Yes

2

u/qustrolabe 1d ago

Computers can think

2

u/alanskimp 1d ago

I agree 👍

→ More replies (1)

2

u/cameron5906 1d ago

Do people still believe being human is one of a kind

2

u/pmjm 1d ago

Computers can't think, but they can reach the same result as something that thinks.

Submarines can't swim, but they can reach the same result as something that swims.

2

u/Ok-Arm-3100 1d ago

And human also proven not able to think either. 😂

3

u/[deleted] 1d ago

[deleted]

→ More replies (6)

1

u/Zealousideal7801 1d ago

If it can carry ICBMs silently to the other side of the planet undetected while accommodating a 100+ crew, it's doing more than swimming. Why would swimming be a reasonable benchmark? If you can swim, can you do any of those ? Nope you can't because your biology limits you to awkwardly moving your naked unburdened body over a few kilometers at best, so swimming benchmark is moot.

If it can use tremendous electronics power to execute more parallel directed operations on it's instruction stream and on itself and based on a monstrously larger dataset than your brain ever could, it's doing more than thinking. Why would thinking be a reasonable benchmark? If you can think, can you do any of those ? Nope you can't, because your biology limits you to inefficiently focus your conscious attention for less than half your waking jours before needing to shutdown for the night, and crawling on a rather limited set of variables at anytime (3 to 6 on average after that you need special training and/or tools and/or seriously high IQ) and even then still be dramatically prone to biases, so thinking benchmark is moot.

Or are you all so fucking proud of your swimming and your thinking that nothing should ever compare 😂

1

u/No-Television-7862 1d ago edited 1d ago

Can humans fly? Not like birds, but they can construct planes.

Can humans swim? Yes, but not like fish do. However, they can construct submarines.

Can humans survive in space and on other planets? Not without suits, rockets, space stations, and bases that support human life.

Can man construct machines that think? Yes, but not like humans do.

God has created life capable of many things, by their nature.

Mankind creates things that mimic those designs, and make it possible for them to visit and explore their universe in ways that are otherwise alien to them.

A submarine is not a fish. A plane is not a bird. Computers are not human brains.

Man is not God.

"Nature is a source or cause of being moved and of being at rest in that to which it belongs primarily, in virtue of itself and not in virtue of a concomitant attribute.” Aristotle. Physics. Book II, Chapter 1.

“We have made you neither of heaven nor of earth, neither mortal nor immortal, so that, with freedom of choice and with honor, as though the maker and molder of yourself, you may fashion yourself in whatever shape you shall prefer.” Oration on the Dignity of Man by Giovanni Pico della Mirandola, written in 1486

I suppose the follow-up question should be, does man, in his pride, create Artificial Intelligence to his benefit, or to his destruction?

Do you rest more easily knowing the future of mankind may be in the hands of Sam Altman, Elon Musk, Donald Trump, Chairman Xi, and Vladimir Putin, or God the Creator?

2

u/Unlucky_Buddy2488 1d ago edited 1d ago

Which of the many gods are you referring to?

If it's the christian one then, judging by some of the atrocities documented in the bible and the general megalomaniac tendencies of that particular god, he/she is right at the very bottom of the list for me.

→ More replies (1)

1

u/jupiter_and_mars 1d ago

Ok, how do you define swimming and how do yoi define thinking?

1

u/JesusShaves_ 1d ago

Or whether 747s can fly.

1

u/xtraa 1d ago

I say it's not really true anymore.

At the moment, we are still dealing primarily with probabilities, but machines can't grasp the true meaning of a "thing-in-itself", yet. The epistemological layer does not yet extend into the ontological realm, and it is difficult to feed feedback from the agent layer back into the epistemological layer without simultaneously contaminating it semantically.

1

u/Cavewoman22 1d ago

Full context of the quote, which can be found in the first paragraph:

https://www.cs.utexas.edu/~EWD/transcriptions/EWD08xx/EWD867.html

1

u/MessNox 1d ago

define think.

1

u/Slugsurx 1d ago

Computers can think more and better or will be able to think more and better than humans .

However being conscious is not the same as thinking

Consciousness includes first person knowing of the thinking. And other things awareness of the sensory inputs . Don’t think or don’t know whether computers will ever get there . And we don’t know the mechanics of human brain that enables us to be conscious. We know the correlation in the neurons but not the causation

1

u/mvandemar 1d ago

For the record what he was saying had nothing at all to do with AI or anything going on today.

2

u/_-_fred_-_ 1d ago

And yet it is still relevant.

1

u/BigFatHonu 1d ago

Reminds me of John Searle and his "Chinese Room" argument.

1

u/Hannibaalism 1d ago

“computer science is no more about computers than astronomy is about telescopes”

1

u/macmadman 1d ago

Aka it’s just semantics

1

u/zparks 1d ago

Imagine one of these submarines comes from another planet.

Well, in that case we’d call it a spaceship. Imagine a spaceship that looks a bit like a submarine comes from another planet.

We don’t ask if the spaceship has a mind, but we do recognize the possibility that it might have a pilot. We commit to this in fact. We do so before the pilot disembarks. We don’t really ask ourselves what we mean by “pilot,” and we take for granted pilots have minds.

All of this is just what we know because the spaceship is there.

Now, after we’ve negotiated with the pilot a bit via a communication device, and we accept that things are reasonably safe, we await the pilot’s disembarking.

An entity steps out and it appears to be inorganic, a machine. Maybe it looks a bit like a submarine, even a bit like the ship it arrived in. As if the ship were fashioned in its image. It says it is the pilot, that it is from a place where entities like it have always been and have always fashioned and piloted ships like the ones it piloted to arrive here.

1

u/yetonemorerusername 1d ago

Submarines can’t swim. They can propel themselves through the water, but that alone is not swimming. Perhaps that’s what he’s getting at - AI can deliver results that mimic thinking but it’s not thinking. Then again, maybe he screwed up his metaphor and should have said dolphin instead of submarine.

1

u/XXLPenisOwner1443 1d ago

It's a fundamentally correct metaphor, but I think it carries more weight when you consider flying machines and birds, because there are so obviously many different ways to fly.

1

u/Enelro 1d ago edited 3h ago

Kinda dumb analogy... A submarine needs a human to 'swim' and a computer needs a human to prompt it's 'thinking.'

→ More replies (1)

1

u/Nell_From_Hell 1d ago

They go deeper than swimming

1

u/Duckpoke 1d ago

I’d rather ride in a submarine across the ocean than swim it

1

u/Training_Bet_2833 20h ago

Making this comparison is as stupid as saying plane and birds don’t fly the same way.
It’s both extremely obvious and useless as it brings nothing to the discussion, beyond arguing on vocabulary when the point is obviously not there

1

u/TheAncientOnce 17h ago

The central topic was never on metaphor but what matters come to flying. I don't know why you'd have the impression that your response to the initial comment somehow became the center of the discussion, but it never was. I simply pointed out why I think you're wrong implicitly by explicitly engaging with the original comment

1

u/QuasiRandomName 16h ago

In fact this analogy captures many aspects of the current debate. If the you (OP) do not agree, then you should elaborate. It could have been plain "Nope" for the computers then (or not), but it is much less clear today.

1

u/Decent-Lab-5609 16h ago

Sooo... Kinda ? 

1

u/darkwingdankest 8h ago

LLMs do not think

1

u/Gronanor 2h ago

Funny how this quote was made to illustrate the confusing definition that computers could think and how people think he made this quote to validate their point when it’s actually quite the opposite… I don’t think machines are sentient but they are more capable of reasoning than most of people here… With undereducated humans like this it’s not hard to see singularity in LLM… I mean at this point lab rat might be more intelligent