I flew in a cave.. a rather large one (Hang En in Vietnam), so my situation may not be what you are doing.
I had no GPS, vision sensor was in and out (mostly out), and I had to manually compensate for air currents that were circulating. Even though I was in the third largest cave in the world...