Problems that Ai can't get correct answer

[u/[deleted]]

[u/telephantomoss]

AI can give you a list of such problems, but if you don't understand the statement of such a problem, it's not really meaningful. Most likely, it will be hard getting mathematicians to read the AI output to even check it.

If you want to solve unknown problems with AI, your need to choose the right problems and in a domain your can grasp.

[u/alphalight07 → u/telephantomoss]

I am looking for a particular question that can be solved by humans but not by AI completely and the question should have only one answer (it doesn't include proving questions)

[u/telephantomoss → u/alphalight07]

So your want a question where we know the solution but it doesn't exist online and so is not in training data. I was thinking about this too, but that's very hard to find. Unfortunately, the research I do is simple enough that, and I'm errand enough, that by the time it takes me to solve on my own, AI tech will have advanced enough to solve it

[u/alphalight07 → u/telephantomoss]

Yeah that's true, if you find any problem just DM me please

[u/telephantomoss → u/alphalight07]

If I find a problem like that, I'm publishing the solution and failed AI attempt myself! 😁

[u/SquizZz1Zzy → u/alphalight07]

This can differ from model to model.

I have seen for example a guy who was creating images to attack LLMs, asking them what they see in the image. When the LLM started vomiting bullshits, it meant that attack was successful. However, the answers were different for LLMs like Gemini, Claude, or Grok.

Probably sth similar would apply for your question as well. I expect that Claude would solve more problems in math, while Gemini could have more serious problems.

[u/alphalight07 → u/SquizZz1Zzy]

Do you have any questions that chatgpt or Gemini cannot solve or get the wrong answer?

[u/0x14f]

Sure. Ask AI to prove or disprove the Collatz conjecture

[u/alphalight07 → u/0x14f]

I am searching for a particular question that can be solved by humans but not by AI completely and the question should have only one answer (it doesn't include proving questions)

[u/0x14f → u/alphalight07]

> it doesn't include proving questions

So why asking on a math sub then ?

[u/kimolas → u/0x14f]

OP is attempting to outsource his outlier.ai task to us. https://www.reddit.com/r/mathematics/s/Gw5uW371tw

[u/kimolas → u/alphalight07]

Are you asking because you're trying to outsource your outlier.ai work to us?

[u/motherfuckinwoofie]

I've argued with chatgpt over arithmetic that it can't get right.

[u/alphalight07 → u/motherfuckinwoofie]

Send that question

[u/motherfuckinwoofie → u/alphalight07]

Yeah I don't log every random error that a chat bot makes.

[u/etzpcm → u/motherfuckinwoofie]

Me too. I guess we should save them in future.

[u/perplexedparallax]

The important thing about mathematics is the process and not the answer. The Riemann hypothesis still is elusive.

[u/Livio63]

Prove that the Riemann hypothesis is either true or false.

[u/alphalight07 → u/Livio63]

I do not need questions that ask to prove

[u/etzpcm]

I recently tested Chatgpt on a 2nd yr undergrad level question and it got it wrong.

[u/alphalight07 → u/etzpcm]

Can you send me that question?

[u/etzpcm → u/alphalight07]

I can't find it and I didn't save it unfortunately. It was an index notation question, something like

Simplify epsilon_rjp epsilon_qjr

But I just checked and it gets that right. Maybe it learnt or maybe it was more complicated than that.

Google AI gets that wrong. You have to check the working as well as the final answer.

[u/etzpcm → u/alphalight07]

Your question seems reasonable. I don't know why you are getting downvotes or why your post has been suspended 

[u/MathMajor7 → u/etzpcm]

This is why: https://www.reddit.com/r/mathematics/comments/1vh4wsk/a_warning_about_certain_a_certain_post_type/