Agree 100%, all downvotes need to have a qualifying reason for the downvote. even if it is the snarky downvoted for excessive reward. That way normal users can see and decide what to do about the downvoter.
If a bot can leave a stupid I upvoted your post comment then it can leave a I downvoted your post comment, just as easily.