As others have said, there's not a direct route that will allow you to connect the controller directly to the Oculus. In order for this to happen, I'm assuming DJI and Oculus (Facebook) would have to collaborate on a version of the DJI Fly app that can run on the Oculus and make use of the Oculus Link cable. Unfortunately, this is highly unlikely.
However, as slup mentions above, there are a couple of work-around options. One is the single-lens box
goggle like the MovieMask (no longer in production) or the replacement MagiMask ($129+tax & shipping). You will need at least a 1m cable to connect your phone to the controller from inside the mask.
But, if you already have a Quest and would like to use it, there is an option to cast your phone screen to the Quest. For iPhone users, this is done using by side-loading an app called AirScreen onto your Quest headset. I don't have an Android phone, but I believe that there is a similar app that will work. I've used this method with my iPhone SE, and while there is a slight lag, I have found it to be a very enjoyable way to fly as long as I'm not trying any quick maneuvers through obstacle-laden terrain. Once you're up above the treeline, it's great. It's also a good way to allow a friend to join in the fun by letting them wear the headset while you fly with your phone.