Do you let him know?  
Do you let him know why?  

i get asked out all the time, i think in this case honesty in the best policy which usually results in loss of customer unfortunately ...
dating is time consuming and time is precious, if i am have 0 interest in spending time with the guy outside of the bedroom i am honest about it

But generally speaking  yes I tell him to save both of us some aggravation