Because taxpayers benefit from children being born. You said it yourself: you need population replacement for society to keep running. Otherwise, who would work when you grew old?

If you pass all the cost onto women, they would have less children. You can see that in many countries.