There are 2 smart hub chargers on DJI store. Supposedly the smart advance charger is faster that the regular hub. But!, also says that used with the Phantom 4 charger will be even less time . Meaning that you could use the transformer of the P4 because it would charge the Mavic batteries faster?
Purely in terms of how batteries operate. Yes. The faster you charge a battery, the more you will decrease it’s overall lifespan. Whether this is noticeable or have an effect on you is going to depend on how many batteries you have, how often you fly, and when you plan to replace your drone.