If You Accept the Upvotes, You Really Need to Accept the Downvotes