This vanity feature is a bone of contention for some.
The way it works now, once you vote a member you can't edit it and change your mind later on.
Also the algorithm to determine your rating seems to be a little off.
To answer your question. Yes if say I vote you 1 star then others would need to vote you say multiple stars to increase what is displayed.
But all is takes is one person to get a negative feeling and never voted to rate you with one.
And you may go from a five to a two.
Then you need several others to vote higher to change it.
_________________________
Blue Man Group