What app are you using to to link the goggles, DJI Go or DJI Go 4? I had a similar and ended up I needed to use DJI GO. Worked fine after that. Make sure up upgrade the Goggles with DJI Assistant 2 v1.2.4 first if they are not at ver. 1.0.6.
When I did the above everything worked first try.