I've got a Galaxy Tab S2 and having the same issue and getting very frustrated.
Like you've said, Clear Defaults, connect to remote, it prompts for which app to use, and NOT setting a default app still makes automatically lock in that USB device, maybe not as default, but until the tablet is...