i don't have children, but i can admit that super young children (<3 years old) are probably a lot of stress, because they require very much attention and don't sleep through the night.
maybe you have some kind of trauma because of prior sleep deprivation.