Building a Bayis Neeman B'Yisrael Q&A - The Role of Attraction

I'm always stuck after a date where I don't find the boy to be attractive. He has other qualities that I'm looking for, but attraction isn't there. Any advice?