1. Because of bad compass calibration and external magnetic influences. The drone does not know where it is and is trying to automatically rectify it.
2. Even with no stick input, badly calibrated sticks can still be sending out erroneous commands to the drone causing it to yaw etc.
3. Bad IMU.
4. A combination of any of the above.
