One problem is that there isn't a feedback loop describing why a comment or article is bad, just that it is bad. Negative context-less signals lead to superstition which induces drift away from the values of the Creators.

One way to provide context could be to allow people to tag their downvotes with an adjective like "irrelevant", "mean", "notreddit", etc. Then, critically, only the author of the comment would be able to see this additional feedback.