That's not the rule in the UK. Depends on the drone and the pilot, of course, but if you are flying a drone you know which way it is travelling and hence its orientation (or, more specifically, its trajectory). Hence the control input you need to move it away from some other object is relative...