I have flown hundreds of military VR route operations. I believe the 107 test says these are low level routes where the military aircraft may be in excess of 250 kts. I never flew one at less than 360 knots, even as a student. The minimum altitudes vary, but we were also seldom above 400'AGL. And if a military jet is coming right at you at high speed, you may well not have sufficient time to react, depending on wind and terrain.
Check for military training routes before you fly. If you live near one, you probably already know about your local routes. If you are flying in unfamiliar territory, check the sectionals.
And if you don't think they can come up on you faster than you can react, check this video.
.
And , yes, it is a rush. And I am glad when I was doing this I didn't have to think about drones.
Wishing a Safe and Happy New Year to all.