What
>>2 said, if you just find him physically attractive thats nothing bad. He will probably just be glad to hear that.
In case its the other option: Well, you cant really do anything about not liking someone's looks. The only thing that could solve it is time, but I wouldnt rely on it.
You should probably tell him either way if you are that close.