Which country are you in?
Looking at the UK packages the creator combo comes with the 240w charger.
DJI list the charging times here:
It goes without saying that your drone's lithium-ion battery is essential for flight. We trust that the first thing you did when you got your new drone is read the official manual provided. But in case you need a refresher, we’ve provided this battery charging guide for your quick convenience...
support.dji.com
Charging time
Using the DJI Mavic 240W Power Adapter to charge 1 battery: Approx. 51 minutes.
Using the DJI Mavic 240W Power Adapter to charge 3 batteries: Approx. 90 minutes (200 V to 240 V input) or 110 minutes (100 V to 127 V input).
Using the DJI 100W USB-C Power Adapter to charge 1 battery: Approx. 80 minutes.
Charging via the aircraft (65W max charging power): Approx. 115 minutes.
I'm not 100% on this but I think you'd need the charging hub to charge one battery quickly using the 240w charger?
Looking at UK prices, it's £580 to upgrade from the base package to the fly more package while it would be £180 for an extra battery, £260 for an extra battery and the charging hub or £380 for the extra battery, charging hub and 240W adapter.
Working out the maths of the fly more pack, if you bought it separately you'd pay £360 (two batteries), £80 (four pairs of props), £220 (shoulder bag) and £80 (charging hub) which is a grand total of £660. So it's not a huge saving going with the fly more pack especially if you're not wanting the shoulder bag.
In short, no I don't think you're crazy to buy the parts you need. Even if you do decide to add another battery later you're not going to be out of pocket, if the fly more pack was a lot cheaper and you were getting the extras for a similar price to the base drone plus battery plus hub I might think differently. I've not bought a Mavic 4 yet but I'd probably take a similar approach to you, I bought just one battery extra with my original Mavic and only bought the fly more pack for the
Mavic 2 because the prices went up but I managed to get it at the old price. With the Mavic 4 batteries lasting a good bit longer than the
Mavic 2 batteries one extra battery would be fine (especially since it can more easily charged on the go over USB-C) and even if I picked up another one later on I'm not losing out financially.