I do still fly in the south of Sweden, but I usually stay out of the cities.
On three different occasions, the police drove past me while flying without even stopping to talk to me.
In general, I don't think they will have a problem with you if you fly responsibly and don't bother people or...