You don't throw the baby out with the bathwater, but you want to get rid of the bathwater so the baby can swim the next couple of days and be OK.
or simply: