When it comes to freedom of speech concerns, downvotes have nothing to do with it as there are plenty of interfaces that will show it regardless and it doesn't remove it from the blockchain. Freedom of speech doesn't mean that a person should also be able to earn on what they say.
Let's just say, hypothetically, that the Chinese Censorship Brigade decided they wanted to create an account (or buy an existing account) with (a relatively small) 2 million steem-power and start obliterating any accounts they didn't like (anything not written in Chinese).
Now imagine they managed to get their account up to (82) rep, and then power-stomped your blog (@tarazkp) into (-11) rep so ALL of your posts were automatically hidden behind some sort of vague warning message (strongly suggesting you're an unscrupulous person).
Would you be, you know, "totally ok with that", since "there are plenty of interfaces that will show it regardless" and nobody "deserves" to make a few steem-pennies off their blog if a whale decides to ambush you?
Who would you complain to? Or would you just go somewhere else?