Mine tends to set the home point before I can even get off the ground. Does it calibrate after you hit the 7m altitude?
It will reset the home point after takeoff if a more accurate solution becomes available - a good reason to takeoff and ascend vertically until the aircraft has a good enough view of the sky to do that.