You seem to be under the mistaken impression that compassion underlies morality for all people.
For authoritarians punishment - not compassion - is the basis of morality.
Excellent point, this is something I realized myself, some of my most notable cases were with self-professed Christians, but I've been retaliated against by Spiritual Satanists and atheists alike, et cetera, when I offended them in some way, and it's scary how far some people will go in order to be right and force you to change, not them. My cynical mind believes might makes right in this world, for better or worse.