Yes, let it go, I personally won't meet a client who would rush me in the first place, unless I'm on stand by mode, I would be ready anytime, but if he show up early, I will tell him to wait until the exact time we talked about, if he can't wait, I ussually let it go, I'm not going to put myself in trouble, and I will not meet client if I feel uncomfortable, I rather watch TV or facebooking in my hotel room than meeting someone who would make me feel uncomfortable...
If he ever email you or text you about his bad date with you, just remind him that what he did was making you uncomfortable and cost your performance, if he bad mouth it about it, keep it calm, and say sorry for the bad time, you are working to make a living and have fun at the same time. I would feel bad as well if i didnt make my clients smile, but I always make sure that I feel comfortable no matter what, or just tell them str8 to their face that what they do is making me uncomfortable, especially when they rush me to do anything, thats a big NO NO for me, I don't want them to rush me nor do I want to rush them, I like to take my time, so I can have fun seducing my clients, in my session, I like to be touched and caressing my body with maybe sensual back rub, but it's all up to the clients, they are all have different need and different interests...just don't deal with anything rush...I'm just glad that most of my clients I met very respectful and professional even if it's their first time, they will respect you if you show them your respect to yourself 
Good Luck Brooke and to us as well, at least it was a lesson and money can't buy happiness...
xoxoxoxo
Gee