Not sure, some seem to do Compass calibration every time,
Others only in a new location and the rest only when the App tells them to.
I think it pays every now and then to do it in an open area away from any possible interference.
Also when starting up check your position on the map and take note of which way the icon is pointing in the radar screen.
Make sure it lines up with the way the MP is facing.