So we fly in our neighborhood all the time, especially during the quarantine, but we do not fly over people, try not to fly over houses or backyards. We usually just skirt the outside of the neighborhood or fly over the area behind it. We are also a very close knit neighborhood, we are always involved in activities, and contribute photos and videos to the neighborhood facebook group. I think most people appreciate it, I'm sure there are those who don't, but they haven't said anything yet.
My husband is known in the neighborhood as "the guy with the drone". We had one incident with a neighbor when we were "walking the drone" one day, the drone lingered in their backyards direction for too long and they got the impression someone was spying on them. They made a post in the facebook group and we immediately let them know it was us, that we were not spying, and any are welcome to review all our footage. Not a single incident since.