The FAA doesn't care if you had catch or not. They do not restrict it in any way.
What the FAA cares about is that you either fly under Part 107 or all the rules of a Community Based Organization such as the AMA. In order to fly as a hobbyist you must follow all AMA rules (at least until another CBO is identified). It is the AMA that expressly prohibits hand catch. If you are neither Part 107 or Hobbyist, then you are technically in violation.
Nobody will ever have legal issues over hand catch, unless it involves a question of legal liability for some sort of damage or injury, in which case a lawyer will be on it like a dog on a soup bone.
I understand that - but if your not meeting the requirements of 101.41(b) then you must meet the operational requirements of Part 107 - nothing about hand catching there. As stated, I don't see the FEDS getting involved with this