Thanks so much for your analysis!
Now I know I should never start with a partially discharged battery.
I had map mode enabled to be able to quickly steer the drone back to me, standing on a 25 m high ledge. This meant that I did not see that the drone had lost so much height.
Thanks again!