Gemini randomly dumped its system prompt

(gist.github.com)

77 points | by mkaramuk 57 minutes ago

12 comments

  • andai 24 minutes ago
    > Create a logical information hierarchy using headings, section dividers, lists for items (numbered for ordered steps, bulleted for others), and tables for comparisons.

    When Gemini Pro came out about a year ago (I forget which version number), the reasoning was visible.

    The reasoning was extremely useful. It would capture the logical structure of the whole problem space.

    I found it incredibly valuable and actually more readable than the "human friendly" final output. (A massive blob of prose.)

    I was very sad when they removed it.

    • alansaber 10 minutes ago
      Yes, massive blob of prose is definitely the meta now. You can still get hierarchical data representation if you ask explicitly but they're converging on user patterns I guess.
    • cubefox 3 minutes ago
      I agree, it was very useful, also because the final response often ommited details that were acknowledged in the CoT. Though I think DeepSeek might still show the reasoning trace.
  • Mashimo 10 minutes ago
    Speaking of weird Gemini behavior, anyone else observed it injecting the approximate time in the second to last paragraph at times?

    > If you are already standing at the stove (say, at 11:51), you can simply put the pan on a burner with a little water and turn it on.

    I assume the current time gets injected into the promt, and gemini thinks it comes from the user?

    I had that a few times now. Always very close to the end of a longer response.

    Edit: Never mind. My bad. I added "Please use 24-hour time in all our future chats." to my personalized settings. I got tired of it using AM / PM system, but forgot about it.

  • throwatdem12311 38 minutes ago
    “hey chat, generate me what you think a plausible system prompt for an AI called “Gemini” built by Google would be”

    Honestly, who cares?

    • mkaramuk 33 minutes ago
      i don't. just thought someone else might be interested in
      • jubilanti 25 minutes ago
        But you have zero evidence this is actually the real system prompt.
        • mkaramuk 13 minutes ago
          yeah, just assumed it is.
          • kibwen 11 minutes ago
            The chatbot craze in microcosm.
    • gus_massa 27 minutes ago
      It would be nice to ask every chat hallucinate the system prompt of each other and compare.
  • sspiff 40 minutes ago
    Posts like these happen every other week with people thinking they've got some magic sauce.

    Every time it turns out to be hallucinations.

  • mkaramuk 38 minutes ago
    btw i am not sure this is the whole system prompt or only a portion of it. since it is too short, i assume it is partial.
    • gwbas1c 30 minutes ago
      I wonder if there's formatting that's been stripped; because when I tried to read it, it looked like I was hitting headings and had to guess at possible line breaks.

      Thanks, it really made my morning looking at it.

      • mkaramuk 11 minutes ago
        i copied and pasted the part that looked like the system prompt. because of manual copy-paste the formatting is gone. sorry for that.
  • harrouet 3 minutes ago
    Wait...

    Nothing about Goblins ?

  • philipwhiuk 43 minutes ago
    "Randomly"?

    Can you provide more explanation about how this occurred?

    • mkaramuk 39 minutes ago
      I have connected yt music app then asked about what playlists do i have then it dumped that and continued with an explanation about it couldn't list the playlist but have a idea about what type of musics i listen.

      Since the content was irrelevant, i called it as "randomly".

      • FergusArgyll 26 minutes ago
        I had something similar w gemini in gmail. I asked it a question and it just dumped out the instructions. Oddly, it didn't give me an answer - just the dumped instructions
      • nnnnico 34 minutes ago
        Hey this context is more importante than the prompt itself, make it more clear in the post! As this hints to a way to reproduce the output and likely estimate if it's an hallucination or not
    • andai 22 minutes ago
      I'm not OP but I experience this sometimes. I sometimes ask an AI to repeat all previous messages. Because I want to see what it's actually getting in terms of the user custom system prompt, and memories, and the writing style config, and so on.

      Every now and then, if you ask it that, it'll just dump everything, including system prompt. (Which will often include a message about not dumping the system prompt...)

    • haktan 18 minutes ago
      I think it can happen during any conversation. While I was using Gemini CLI at some point it started including part of its system prompt about tool usage.
  • ck2 34 minutes ago
    I would like to read a book on how the heck machine-learning "comprehends" and follows

         Balance empathy with candor
    
    "empathy" would have to be emulated like a sociopath, to a lesser extent "candor"

    but then also "balance" requires a grasp of the weight of each, even if mathematically?

    BTW what on earth happens internally when you ask another "AI" to evaluate the prompt of another "AI"

    • bauldursdev 9 minutes ago
      This is much much more complex than a traditional program, which can be followed line by line. Trying to understand every bit of the literal logic is like trying to understand a person by thinking about the neurons fired in their brain to make them say or do something.

      Unfortunately you have to learn to let go, and say, "I'll never be able to keep this all in my head", and learn to think about it in terms of of the outputs/inputs and how you can create a model capable of efficiently modeling your problem and how parameters can be nudged to get an output which is kinda shaped how you want.

      Maybe some really genius savant could keep it all in their head but I doubt it, like I said it'd be like trying to understand a person by reasoning about their neural pathways.

  • bromuk 39 minutes ago
    huge if true