This was my understanding, starting point is zero. No matter where you are.
Though now with UK law if you fly out over a drop/ravine/cliff and that is over 120m you're breaking the law. So the altitude reading can lull you into a false sense of height.
Though with my Air if I fly below...