Mine got pulled about 500ft last weekend... I was up around 400ft and guess I got caught in some wind. Next thing I noticed it was moving pretty quick away from me and it wouldn't come back. Put it in sports mode and got it to reduce altitude then it came right back. Scary few minutes though!
You handled that well. I have had similar experiences. The winds can be dramatically different up higher.