I'm a fixed wing pilot as well with 6000+ hours spread between small, single engine aircraft and corporate jets. I have experienced multiple bird strikes over the years, and for the most part, the result has only been a bit of a mess on the leading edge of the wing. Birds tend to be soft and malleable, and like humans, they are mostly water, so they just splatter when they hit. Even a prop strike with a bird is typically no big issue.
A UAV would be another issue all together. A direct strike to the leading edge of the wing would very likely end in damage, and although maybe not enough to cause an uncontrolled crash, that damage could become larger during continued flight as a result of the breach caused by the UAV - even a very small one - due to high speed air passing over and through it. A UAV strike to a prop could be a very big issue. A sharp nic to a prop could cause the blade to separate in the area of the strike due to the immense weight exerted on the prop due to rotational forces - which I'm told are many thousands of pounds at RPM. This is one reason pilots carefully check prop leading edges for nics. Even a small one can turn into a fatigue failure in flight.
Lastly, there is the pilot shock factor of a plane hitting anything, be it a bird or UAV. Pilots have enough to think about, and although bird strikes are unavoidable in certain circumstances, responsible operation of a UAV can greatly avoid and even completely negate the possibility. Frankly, I'm surprised we are even debating this subject.