In all states there are no fault divorce laws.  So having a girlfriend, screwing an escort, spending money on port, etc. is just not relevant to the "divorce" issue.  Now does that make you an unfit parent for custody issues?  Also, since having sex generally is not "abnormal" human behavior, even then it takes a lot to be used against someone.
As far as the escorts being ratted out, well, there are reasons a smart professional person in an adult industry should use disposable phones, and take other precautions.  It's just not clients who become obssessed but what is the saying, "Heaven has no rage like love to hatred turned, Nor hell a fury like a woman scorned"  So relax, get yourself a good blow job, fuck a nice girl, and don't forget the reason to use a pro is often as purportedly stated by Charley Sheen, he didn’t pay prostitutes for the sex; he paid them “to leave.”