I believe National Forests in the US are fine to fly in, but designated wilderness areas are like the National Parks. You can't take off, land or operate from within a designated wilderness area.
You are right though. I fly in Utah and Colorado and there is still a lot of amazing places to fly and film, like Mt. Sopris