We all know him to be a proud, unpleasant sort of man; but this would be nothing if you really liked him.
or simply: