Mary may well be an ironic allusion to the Virgin Mary. The narrator remarks, "It is fortunate Mary is so good with the baby. Such a dear baby!"
This musing may seem innocent, but it underlies the unnamed narrator's uneasy feeling about being a mother. Far from the angelic, blissful state society expects mothers to experience upon the birth of their children, the narrator finds motherhood suffocating and isolating. She gives the pat response to expected from any mother, but her increasingly declining mental state says otherwise.