Point is that drones are only allowed up to 120m, manned aircraft only down to 150m, so there is never any interferernce possible if respected in normal operations with a nice buffer zone nobody gets in.
Obviously both occasionally blow their limits, but if an accident happens the drone pilot...