Pigeons aren't predators and don't attack other birds, don't defend a home range, and by extension have no reason to attack a drone. They're excellent fliers in close quarters flocks and I've never heard of a mid-air collision between pigeons.
Hawks, falcons, eagles and such are a different concern.