What's the solution? Is there one?
In my experience, there are two:
1) You can get another, external GPS receiver, such as Garmin GLO, connect via Bluetooth to your iPad.
With this setup, you receive an accuracy always better than 5m.
2) Use Autopilot to fly your drone. No worries, you must not setup waypoints or other tricky stuff.
There is a flight mode called 'Black Box' in which you can fly your drone as usual with the sticks.
(There is a different UI, but you get used to it.)
But here it comes: Autopilot has an option called 'moving operator'. Prior launch, you have to select a 'stationary operator' or 'moving operator'. When the Moving Operator option is selected, Autopilot updates automatically every second the position of the iPad via the remote control to the drone. That means, every second the aircraft has new RTH coordinates.
So, the pilot must not press any button now and then (such as in GO4), just fly. In case RTH is triggered, the aircraft returns to the 'moving' remote control.
That feature is very useful on a boat ... ;-)