Had same issue using Sony z3 I now use Samsung tab s with no issues.
Make sure you have no apps running in background and your phone memory as spare space.
Have you tried using USB port at the bottom of the controller with phone/tablet charging lead. I have no problem connecting with Sony z3 or tab s. I just have issues with lag on the tab s screen.