Once you are flying out in remote areas you should be fine. As you said, cities (being heavily populated areas) are a no no and best left alone. But the likes of Cong, Blaskets etc. you'll be fine. I've only ever had curious bystanders approach me when flying, and never had any objections...