There is nothing worse than having a bad relationship with a neighbor, over anything.
In the main I agree with letting it go but, always be on the lookout for a chance at making it up with him. Perhaps have a Bar-B-Q and invite a few close neighbors, including him. Then take that chance to...