Is downtown Toronto a suitable place to raise children?

We originally thought moving downtown was a good idea, but our kids convinced us no.