This is an area that is horribly managed. The bottom line is that legally, you are able to operate there.
BUT (and this is a big but) the locals can stop you and give you infringement notices. If you then want to fight this, you may go to court...
As far as I am aware the rules by Parks Victoria prevent you OPERATING a drone from Parks Victoria managed lands. This includes many Conservation Reserves and Wildlife Sanctuaries as well as National Parks. You really need to check who the land...