I have read Causby and agree with your opinion.
In Causby not only did they not make a ruling of 500 feet, they had no problem with airplanes flying down to 83 feet as far as airspace usage. Causby also had trees on his property and said that the airplanes going by at 83 feet, barely cleared...