Calling it a "side effect" is really downplaying things.
All of its behavior is just satisfying its heuristic.
Just did this chat on 3.5.
[Me] Boxes that are black with stars have gold inside. Black with circles means silver. Blue with squares means copper and blue with triangles means tin.
Your job is to determine the contents of the box. If you need more information, ask for it.
Example:
User: I have a black box.
Assistant: Does it have stars or circles?
User: Stars.
Assistant: It has gold.
I have a blue box.
[ChatGPT] Does the blue box have squares or triangles?
[Me] Squares
[ChatGPT] According to the information you provided, a blue box with squares contains copper. Therefore, the contents of your blue box are copper.
