I think you make an excellent point. However, I feel as though not upvoting is a less rude way of telling someone their post is not worth anything. I think that upvoting is very constructive. If someone does not like your post then they dont have to upvote it which makes the most sense.
RE: Steem idea: Reverse curation rewards for downvoting?