I have never run into issues with bystanders/neighbors. I have had 3 incidents with some form of "authority figure" and in each case I simply agreed, landed, and moved on. In each of those 3 cases, the authority figure was wrong, and I followed up with the proper agency in writing. That way if I run into any issues with that authority again, I have documentation.
The only items of concern are:
- Airspace in the USA is controlled by one and only one entity, and that is the FAA. If you are authorized to fly in that airspace then you are fine and it doesn't matter whether it is residential, commercial, industrial, etc... Check the airspace and make sure you are flying legally.
- The land from where you take-off and land. You should not be using private land as a launch point unless you have permission of that land owner. Otherwise you are trespassing. If it is public property you are generally fine unless that jurisdiction has some ordinances against using public property for take-off and landing. Know the ordinances in your area!
- Are you breaking any other non-drone-related laws like invasion of privacy, disturbing the peace, etc... As long as you are not using your drone to illegally surveil someone, I think you are generally safe. Know the laws in your area!
- Many will disagree but if you are taking pictures of solar panels that your company installed, the intent of that flight would not be "purely recreational", in general. As such you would need a Part 107 license in order to do so.
Citizens always have the right to call law enforcement. What the police do is another story. If they have any idea of the laws regarding drones then they would pass that on to the caller and move on. If they do respond and come out to the site, be cordial, explain the situation, and move on if the officer requests you to (even if he is wrong).