All Things oDesk
December 20, 2006 by oDesk

We made a subtle but important change in the way that we calculate the average user feedback. Here is how we used to calculate it before for providers (symmetric for buyers too):

The provider's average assignment feedback score weighted by the number of hours worked on each assignment. For example: a 100 hour assignment with a 5 feedback score and a 200 hour assignment with a 1 feedback score would result in a Feedback Score of 2.33 calculated thus: [(100 hrs * 5) + (200 hrs * 1)] / (100 hrs + 200 hrs) = 700 / 300 = 2.33

We are now switching to a dollar based weighting instead of hours. Instead of using the hours of the assignment to weigh the various assignments of a user we will be using the total dollars charged in this assignment. Here is the exact new definition from the community page https://community.odesk.com/feedback_providers

The provider's average assignment feedback score weighted by the dollars charged on each assignment. For example, a $1,000 assignment with a 5 feedback score and a $200 assignment with a 1 feedback score would result in an adjusted score of, [($1,000 * 5) + ($200 * 1)] / ($1,000 + $200) = 5,200 / 1,200 = 4.33. In addition, the number of feedbacks received is displayed in parenthesis.

In the vast majority of cases this will result in very little or no change at all because providers rate changes little across assignments. However, a user cannot "game" the system by using artificial assignments with very low rates. Such assignment will be weighed down. Furthermore, the new definition will allow us in the future to incorporate other non-hourly components into the feedback that today are not taken into account like bonus or refunds.