I feel like equally as many people rejected Pinker because it violated their priors.

I don't have a strong opinion one way or the other -- I guess my prior is that I am skeptical of broad narratives one way or the other and I think Pinker is prone to facile generalizations -- but most of the rebuttals I've seen to Pinker seem offended by the idea of progress, rather than taking his arguments seriously.