But I could see where I was going in the
goggles. I was flying to the middle to turn left to head upstream. The drone did the opposite of what it should have done.
If you could see where you were going in the
goggles, that's a suggestion that communication between the controller and drone wasn't blocked.
I've seen the video, and clearly you were flying beneath a thick stone bridge which would block GPS, and you were above moving water, which would make the downward vision sensors useless.
Our drones fly with amazing stability when GPS or downward vision sensors can stabilize them. Take your hands off the sticks and the drone hovers. Move the right stick a bit to the right or left, or forward or backward, and the drone moves likewise. You don't have to concern yourself with minor breezes. It's all thanks to the magic of the GPS-stabilized IMU and the control software on board.
But when you deprive the drone of GPS signal, the drone suddenly starts relying on YOU to manually do the corrections for wind drift. It has no reference for what constitutes "stationary". It will not brake when the sticks are returned to the neutral position. As the wind currents swirl underneath the bridge, you must immediately move the sticks in the proper amount to precisely counteract any drifting tendency.
The drone may have been moving left when you were moving the stick right, but that would merely indicate that you hadn't moved the stick far enough right to counteract the wind that was pushing it leftward. It's very tricky to get precisely the right amount of stick movement to counteract the wind drift. Even more so when you can't clearly and directly observe the drone. It takes a lot of practice.
If you're going to fly the drone where it can't see GPS and can't clearly see stable ground within the vision sensors' range, I'd suggest first practicing with a cheap toy drone that lacks GPS and vision sensors. The cheapest, smallest toy drones are good for this sort of practice (and not good for very much more). When you can effortlessly fly one in varying winds outdoors, you're ready to fly under that bridge. Until then, keep clear skies above.