If you ask the Mavic to RTH and it captured a good image of the take off point and you flew it more than 10M from the home point, it will carry out a return to home, rotate so its facing the same way it took off, then carry out a precision landing, which isn't fast! When it gets to a couple of feet off the ground it then checks that the stored image of the take off point matches and then will adjust so it ends up a few inches from where it started.
It does this as GPS is not accurate enough to get it exactly on the point it took off from.
If you want to speed up the decent, then hand fly it home, or once its overhead, press the pause button, or cancel the auto land and hand fly it down. with full down LH stick it descends quickly, don't forget it takes time to arrest the decent, in sport mode it will descend at maximum until it hits the floor! In normal P Mode it will see the ground and do an automatic land from about 50cm up, once it starts that you get let go of the sticks and it will land itself. I wasn't a fan of this autonomous last bit but have since got used to it.