Wiktionary
threw the baby out with the bathwater
vb. (en-simple pastthrow the baby out with the bathwater)