Tweezers ...I dated a girl in college and was CUH-RAZY about her! But it didn't last. Soon after though we both realized that we had a stronger attraction for one another outside of the dating/mating rituals. We've now been friends for 36 years.
You need to do what is best for you. Let him know whats happening in your mind. If he's in and you dig it..cool. If not then move on.
BTW I'm single.