Yes, remove. As to possible damage, the jury is still out. DJI made a firmware update early on that supposedly reduced the possibility of damage, and several here have forgotten the clamp a plethora of times without damage. I've forgotten mine 4 times now...
LP