Ask HN: What is your go-to prompt to prove AI can be wrong?

Just over-heard one of our seniors trying to explain to a new intern that AI can actually be wrong, no matter how much its answers sound very eloquent and well-structured.

I was wondering what question/prompt everyone uses to prove so to others.

I assume it depends on each person's expertise, or some people ask about a fact that is well-known as having been a victim of the mandela effect.

P.S. As a non-native speaker, I was about to pass my submission through AI to improve text clarity and understandability, but after remembering some comments about prefering the original text, I decided against it :)

2 points | by throwaway_887 11 hours ago

2 comments

  • al_borland 8 hours ago
    Ask an AI anything you have even a remotely decent understanding of and it becomes pretty obvious that they are often wrong. I run into this on a daily basis for questions spanning multiple topics.

    It worries me that interns are needing to have this proven to them.

  • saidnooneever 11 hours ago
    i think the proof is in understanding how LLMs work, not a certain prompt. this because output isnt determenistic and hence a single prompt couldnt (theoretically) reliably prove anything. thats the exactly problem :')
    [-]
    • haute_cuisine 7 hours ago
      I'm curious, why exactly output is non-deterministic? Static weights + matrix multiplication should always return the same output, right?
      [-]
      • mejutoco 2 hours ago
        No, even with the same temperature.