Duh!Tip: Don't always quote the law at people. You can fly a lot more places than people think, as long as you follow the rules. This includes your neighbor's yard.
I hope you don't mean taking off, landing or operating IN his yard but rather flying OVER his yard.