There is a sort of charm in ugliness, if the person has some redeeming qualities and is only ugly enough.
or simply: