Meaning: look for avoidable errors so you don’t remove something good with the bad

Origin: This idiom allegedly comes from a time when the household bathed in the same water; first, the lord would bathe, then the men, the lady, the women, the children, and the babies last. The bath water is said to have been so dirty that there was a risk of throwing the baby out with the water once everyone was done bathing!