The public will not forgive us if their wish to leave is subject to a bitter and a divisive Conservative Party leadership race between Remain and Leave camps.