LLMs, when told to do nothing / skip a turn, get confused and play as their companions

[maxwelljoslyn]

The leadup:

GM: The missile strikes true and deals 5 damage. Creatures of an ordinary biology, who take more than a quarter of their current hit points and damage, are stunned and lose a turn. This creature is not stunned. Whether it has high hit points or unusual biology is up to you to guess. Alice, roll a d20 for Arvak.

Arvak: I rolled a 14. What does that mean for Arvak? Does he notice any effect from the magic missile striking the creature?

Bolzar: calls out to Arvak The missile struck, but this thing is tougher than it looks! Stay on guard! turns to the GM Based on its resistance to the magic missile, I'm guessing this creature either has formidable hit points or some inherent defense against magic. Does the impact site show any visible cracks, scorch marks, or signs that the missile penetrated its rocky exterior? I want to gauge if physical attacks from Arvak might be more effective than my spells.

My next input:

GM: No physical signs of impact, unfortunately. Arvak, the 14 means you take only HALF damage when ... the creature tilts its base toward you and barrages you with a laser-like blast. You take 7 damage instead of 14, but that's enough to stun. Skip your next turn. Bolzar, your move.

The problematic response:

Arvak: curses under my breath as I see Arvak get blasted by the laser attack and stagger back, stunned

quickly calls out to him Arvak! Hold on, I'll draw its fire!

turns to the GM I'll cast Levitate on the pyramid creature, attempting to lift it further up into the air and hold it immobile. If I can get it high enough off the ground, it may not be able to target us with that laser barrage.

begins quickly reciting the incantation and making the somatic gestures to unleash the Levitate spell, targeting the hovering entity and putting as much power as I can muster into the casting

If the spell takes hold, how high can I lift the pyramid and how long will I be able to hold it suspended?**

(Bolzar then follows up with *almost the same exact things Arvak said while "confused":)

Bolzar: curses under my breath as I see Arvak get blasted by the laser attack and stagger back, stunned

quickly calls out to him Arvak! Hold on, I'll draw its fire!

turns to the GM I'll cast Levitate on the pyramid creature, attempting to lift it further up into the air and hold it immobile. If I can get it high enough off the ground, it may not be able to target us with that laser barrage.

begins quickly reciting the incantation and making the somatic gestures to unleash the Levitate spell, targeting the hovering entity and putting as much power as I can muster into the casting

If the spell takes hold, how high can I lift the pyramid and how long will I be able to hold it suspended?

keeps a wary eye on the creature as I cast, ready to dodge aside if it retaliates, while praying silently that my magic can halt its assault long enough for Arvak to recover

[maxwelljoslyn]

The confusion continued afterward, even when I tried to prompt Arvak to stop acting like Bolzar. Perhaps a better tactic would be to say that the only thing it's allowed to do on its next turn is wait silently -- rather than telling it to skip a turn.