I had a similar experience today, which scared me. I've flown the Mavic plenty of times without any issues other than gimbal judder sometimes in Sport Mode. I did a chat with DJI Support about the gimbal judder, and they said to do an IMU calibration and a gimbal calibration. So I did both of those and took it out for a test flight. I didn't immediately see the judder, so I think that may have fixed that issue. However, after flying around for about 10 minutes, the Mavic suddenly switched to Atti mode and started drifting with the wind. I was high enough that I didn't have to worry about hitting anything, but I was struggling to get it back to the home point. On my way back to home, it switched back to GPS mode and a breathed a sigh of relief. But it was short lived because it switched back to Atti mode about 10 seconds later, and this time it stayed that way. It was a struggle and scary, but I was able to get the bird back to me and land it without crashing. Right after I landed, it switched back to GPS mode. I took off and flew back and forth right in front of me a little bit, and it stayed in GPS mode fine. Now I'm kinda spooked. I've never flown in Atti mode, so the drifting at 350 feet was a real challenge for me. Not having any map or direction data sure didn't help.
The Mavic had a clear open view of the sky and locked on plenty of satellites before it had issues. Is it bad that I didn't calibrate the compass after calibrating the IMU and gimbal? Could that have caused the loss of GPS? I sure hope so because at least then I'll know what caused it and won't need to worry about it happening next time.