IMO that's exactly how it should work. Comment is downvoted, gets grayed out, and then hopefully people don't reply to it.

The graying out is a way of expressing "don't feed this troll". If people start replying and get into a prolonged discussion, what is the point of the graying out in the first place?