No disrespect but you don't know how many people you've pissed off, just because you didn't hear from anyone. Before RID, it wasn't easy to locate the pilot and likely no one ever tried. They just hated what you did and either dealt with it or reported it and the authorities never did anything about it (because they couldn't). I'm not doing anything unsafe either but I don't know if you've ever flown a
DJI FPV but it *sounds* unsafe which is enough to stir up anyone. Plus I don't think it is possible for anyone to know for sure if you've flown overhead of a person below unless you fly strictly in the outback.
You may not have been approached by police but that's law enforcement just doesn't make contact with anyone and demand details; at least not here in the US. They respond to complaints. Or, if they are curious but they'll ask, not demand. I've never provided my details to anyone either but I've had contact with several LEO and Karens but nothing has ever come of it, I'm not very "approachable" and unless you are FLEO you can kick rocks. If you haven't had any contact then you're lucky; let us know how your first experience goes, hopefully well.