From what I have seen it depends somewhat on your background. Many people seem to regard sUAS regulations as equivalent to vehicle speed limits, for example, which most people exceed, at least occasionally and if only by a small amount. And it is clearly heavily influenced by perception of risk.
If you think about it as similar to occasional speeding on clear roads with good visibility then the perceived risk is going to be low because, for most people, the probability of that leading to an accident will be seen as low, and the consequence of an accident is generally ignored. In the case of flying an sUAS the probability of a collision with another aircraft in most situations is certainly low, but the potential consequence (bringing down a manned aircraft) is catastrophic, and so anyone with awareness of that is likely to be more cautious. Pilots often seem to take that more conservative view, in line with their typical overall approach to aviation law and the level of risk management training involved in obtaining a pilot certificate.