Honestly, I think that was my fatal mistake. As you could see from my flight logs, I had been using the drone for a few minutes without issue at a lower altitude, and it was handling the wind just fine. The issue was when I decided to ascend. Admittedly, I am not meteorologist so I had no idea...