I think guys with some facial hair can be very attractive and can create a suave and sexy appearance.  I like a man who takes pride in his looks.  BUT as previously mentioned stubble isn't pleasant on a woman's delicate skin.  I have also noticed that facial hair sometimes hold onto smells like cigarette/cigar smoke and garlic/onions.  I think that if you DO have facial hair you should keep it very neat and clean and be aware that any vigorous activity involving your face on any delicate parts of a lady might result in irritation so you may need to be more gentle.  On the flip side, sometimes actual facial hair is less uncomfortable than the 5 o clock shadow of a clean-shaven man.