I'm old enough to have seen the gradual, but massive change in how people perceive new things. When 33 1/3 records came along to replace 78 rpm records, everyone embraced the change. I can go through dozens of other examples of new technology and how pretty much everyone welcomed the new stuff.
Ever since the late 70s, and most definitely since the turn of this century, people have taken to looking at the hole in the doughnut, rather than simply enjoying the tasty pastry, and increasingly I find that a large number of people not only don't embrace the new technology, but they get very opinionated, nasty, outspoken, confrontational, and mean in expressing their often-times uninformed views.
I don't know how much of this comes from seeing too many dystopian movies about bleak futures overrun by technology (e.g., "Blade Runner"), and how much is the coarsening of our culture brought about by people learning to take anonymous pot shots at each other in public forums, and then carrying that behavior over to real life.
I agree with others that unless you are a commercial operator and have permission from local authorities, you are best off not flying where there are lots of people milling around, and also not in downtown areas, even when deserted on a weekend.
On the flip side, I do not agree with the prohibitions about flying in wilderness areas, and would not back down from some hiker who gets belligerent. Some very uninformed people have very stupid views about "harming" wildlife with a drone. I have deer, bobcats, turkey, hogs, mountain lions, and many other critters around my house and believe me, every moment of their day is spent reacting to every little thing around them. And yes, they will of course react to a drone, but to them, it is just one of about ten thousand "threats" they deal with every day, and is no different and no worse than the natural threats they constantly respond to.