I noticed that the small "holder" for the phone end of the cable was creating a poor connection. I'm assuming it was bending or putting some other pressure that the connector didn't like.
Anyway... I haven't had a single issue since I removed it, and just let the cable get held by the phone instead.