I've been tending to use the 12MP for both wide and telephoto panos. The stitched panos are plenty wide for huge prints.
Something I use occasionally is Topaz AI to upsize images if needed. I'm really not convinced the 50MP images are much better, especially in low light areas.
Are you using the 360, 180 or Free pano modes the most often?