If you can set the take off point directly below where you want to take your shots, just take off to same altitude and take shots before moving anywhere. It should hold position if it has a good ground lock.
I had this problem with the ipad mini. The magnets inside affecting the sticks. Once I turned the ipad around,, with home button on the right,,, it solved the problem.
You can only move the gimbal left to right with the goggles atm. But you can use Tap to Fly,,, set direction and move forward. It will fly in straight line while you can yaw the mavic.
I had this happen to me. I had the ipad mini with the home button on the left which meant the magnets interfered with the sticks. Home button on the right and a 5mm gap front the rc and I have never had the problem since.