Reverend Parris has the same attitude about his children as he does regarding preaching and living in Salem. He feels it is a burden he's been forced to bear and his is angry about it. He is bigger than Salem, and this sinful small town is the beginning of the end for him. This is the one and only prophesy he has accurrately forseen. His wife has died, thus making him a single parent parent to Betty and now he has inherited the problem child, his niece Abigail.
Reverend Parris has been plagued by the problem of women. He doesn't understand them, he doesn't respect them and, historically, the character that the Reverend Parris was based on kept his Barbados slave Tituba, as his concubine. Salem was a sesspool of hypocrisy and Parris was not unaffected. The attitude that the devil could not touch a minister was exploited and the church was out of control.
In the play, while Parris is trying to keep his unappreciative congregation under control, his niece and daughter has been "dancing in the woods like a bunch of heathen". Instead of solving the problem and chalking it up to "girls going wild", he attempts to hide it because he is more concerned with his own reputation. The episode explodes into an international (or rather a national) incident.
He does seem to care about his daughter when she is sick and might die, but he continues his methods of bullying and intimidation to obtain is objective. He doesn't know how to minister his people, and he definitely doesn't know how to be a father to his little Betty. In the end of the play, his own fears have gotten the worst of him. The women have made a fool of him. His life, the lives of so many in the town, the destruction caused, perpetuated by the Reverend himself, has caused irrepairable damage.