I second that. I too reported it to DJI and at the same time suggested to implement a third head tracking option that controls Gimbal Pitch ONLY. It turns out that if you use Head Tracking Flight, the gimbal pitch is NEVER an issue, it is only the yaw that keeps fowling up by jerking while panning. Even if the yaw sensitivity is set to lowest (effectively turned off) this problem still exists.
Filming in the Head Tracking GIMBAL mode is completely impossible (aside from getting sick to the stomach and confused about flight control. There too, if DJI would eliminate the AC pitch/roll feedback, maybe the "where-i-look-to-where-the-AC-points" would actually become useful and realistic.
DJI definitively uses the "B" team on this product. Too bad, it otherwise is quite useful. I now simply use it as a way to see in bright daylight without any head tracking engaged. The other issues are: No video enhancement on the
goggles when shooting DlogM even if enabled in the Go4 app. Also, no HD (1080p) live-view when shooting in any 4K modes. This may well be something they just can't do and I am fine with 720p. It is still much better than squinting at any display in broad daylight.