> The DM set up a potential hidden item, the player rolled high enough to find it, voila.
I think the point here is that the "DM" has not set this up. From how I
interacted with ChatGPT, and I have roleplayed with it before, it basically
"Yes, and ..."-es everything you throw at it. In general this is good GM advice,
but here it is "Yes, and ..." to a point were you can basically ask for anything
and it will give it to you.
E.g. say the party is in a remote keep at the edge of the wildernis, the closest
city is several days away. I would assume that if you ask ChatGPT to go to "the
bakery" because you want some fine deserts it will gladly let you do that even
though such a place does not make sense in a remote keep.
I think you're wrong about this. We experimented with nonsensical/cheating in other sessions and it's aware of your context and doesn't let you do stuff that you can't do. (Try it yourself and see. Quite mindblowing and defies the whole "only a super fancy markov chain" thing that some critics throw at it.)
I think the point here is that the "DM" has not set this up. From how I interacted with ChatGPT, and I have roleplayed with it before, it basically "Yes, and ..."-es everything you throw at it. In general this is good GM advice, but here it is "Yes, and ..." to a point were you can basically ask for anything and it will give it to you.
E.g. say the party is in a remote keep at the edge of the wildernis, the closest city is several days away. I would assume that if you ask ChatGPT to go to "the bakery" because you want some fine deserts it will gladly let you do that even though such a place does not make sense in a remote keep.