I came back to work when my children were two months old. At that early age they seem to have little awareness of anybody but their Raggedy Ann dolls so it wasn't a matter of them missing me. I was missing them.
There's a rule of thumb in politics. If you're at a point where you're complaining about the other guy being mean and unfair and uncivil that's probably a sign that you're losing.