If you were in such a hurry to fly that you didn't install a phone/tablet, then you probably took off as soon as the RC controller says "READY TO GO."
Unfortunately, that "READY TO GO" prompt shows up quite a bit before it has acquired GPS lock, so it had no way of recording a home point. The same experiment would most likely work if you wait for about 30~45 seconds after it shows 8 GPS satellites, which is about when you should see "GPS MODE" flash onto the screen briefly. (I really wish DJI would change the controller code to suppress the "READY TO GO" message until after it has positive lock on GPS.)
In addition, if you took off straight upward for at least ten meters, the Mavic would have used its downward cameras to memorize the landing area, so it could fine-tune the landing on its return to the recorded home point.