I am not sure, the Mavic Pro and white goggles do not have this behavior in this mode. Even more, the feeling is not good as well if it is shaking. I understand what you mean.It is. But the head tracking is tuned for fast response to feel natural, not really for filming, so every slight movement of your head even unwanted is reproduced.
I second that. I too reported it to DJI and at the same time suggested to implement a third head tracking option that controls Gimbal Pitch ONLY. It turns out that if you use Head Tracking Flight, the gimbal pitch is NEVER an issue, it is only the yaw that keeps fowling up by jerking while panning. Even if the yaw sensitivity is set to lowest (effectively turned off) this problem still exists.
Filming in the Head Tracking GIMBAL mode is completely impossible (aside from getting sick to the stomach and confused about flight control. There too, if DJI would eliminate the AC pitch/roll feedback, maybe the "where-i-look-to-where-the-AC-points" would actually become useful and realistic.
DJI definitively uses the "B" team on this product. Too bad, it otherwise is quite useful. I now simply use it as a way to see in bright daylight without any head tracking engaged. The other issues are: No video enhancement on the goggles when shooting DlogM even if enabled in the Go4 app. Also, no HD (1080p) live-view when shooting in any 4K modes. This may well be something they just can't do and I am fine with 720p. It is still much better than squinting at any display in broad daylight.