First, I want to thank all of the oDesk users for your active participation in the launch of our feedback system. We’re proud to make the system fully public for the first time starting today.
To go along with the launch, I thought I’d share with you some of our interesting findings from the first two months of feedback scores submitted through the system. We’ve now been collecting feedback at the end of each assignment on a 1 to 5 scale (5 being the best) in six different categories including skills, quality, availability, deadlines, communication, and cooperation.
One of the first things we noticed is that there is a high correlation between feedback on assignments and the average pay rate for that provider. See for yourself.
I also wanted to show you a distribution of all of the feedback scores collected to date. Notice that a number of providers have perfect scores on feedback. If the above chart is any indication, these providers with perfect 5s may have very lucrative opportunities ahead of them.
One last important note. I would like to remind all users to be thoughtful when leaving feedback. Your rankings and comments will have a profound impact on the person you are evaluating, and it’s important that you provide careful assessments of performance.
Josh Breinlinger
July 15th, 2006 at 4:51 am
Hello,
Definately, feedback functionality, is an ace again on oDesk continually providing useful upgradations to their unique software oDesk Team.
Feedback will definately be a more useful tool for buyers, to identify and come to a right decision while choosing or hiring a provider. It is agian a lucrative opportunity for the provider, higher the rnakings, higher are the chances to win a job.
Having said all these, My personal thoughts, vary with the rankings calculations done right now by oDesk, I as an individula would definately no tliek to see and consider a provider having served for 15 hrs for one project and getting a feedback of 5 on 5 and achieving a top ranking than a provider who has served for more than 500+ hrs. I strongly feel this is not proportionate.. Ranking of a provider should only come meritoriously based upon 2 considerations….
1] no of hrs served.
2] no of feedback rec’d
a constraint/clause like 250+ hrs or 3+ assignments, For any provider whatever condition get’s satisified, he should be in the ratings…
a provider server for 15 hrs and a providr served for 500 hrs..there has to be some kind of distinction…and wil definately then voice out the right guy to the buyer..by itself…
Please consider this as purely my thoughts….
Have a good day and a good weekend…
Thank You.
Hemang
July 17th, 2006 at 8:57 am
Hi Hemang,
Thanks for the comments. I believe that good potential buyers will definitely consider both factors.
With regards to the constraints that you mention, I think they are good constraints and the best way to incorporate them in to our application will be to provide the buyers with “filters” on the provider search page. As you know, the only filter we have now is the Availability filter that defaults to show providers that are available for 20 hours or more. We could make additional filters, such as:
“Exclude the bottom 25% of providers by feedback percentile”
“Exclude all providers w/ less than 100 hours”
etc, etc,
Any thoughts?
-Josh
July 17th, 2006 at 10:39 am
All,
Please note that there was typo in the initial blog post. The first chart shows the average PAY rate to the provider, not the BILLING rate to the buyer. The post has been updated.
Thanks,
Josh
July 17th, 2006 at 9:08 pm
Hello Josh,
Thanks for the response…I second you on your thoughts about additional filters…I do also agree on the fact that potential buyers will be doing a good homework over a candidate and his candidacy.
My point of debate was the ranking that displayed to the market. I do agree it is an open market place. But the only thought that really makes me think about this..is, a provider working for 5 hrs and getting 5 on 5 in feedback, do u think he should have any standings in teh rankings…by merely working for only 5 hrs. I don’t deny that he is a good provider..But the fact that there is another provider who has server around 1500+ hrs and he just got one rating even though workign for around 10+ projects and that rating spolied his profile and his ranking was not seen in first 5 pages…I mean ..I strongly think, He deserves a much more better place than the provider who merely worked for 5 hrs and stand in page 1/2/3 in the rankings.
So, Josh..ranking sytem ..I personally think is a more sensitive issue, As it strongly affects all teh ground work done by a candidate over his tenure with oDesk. I do have a suggestion here..There also needs to be an oDesk rating in association with the buyer feedback. This can be provided by teh project manager of that particular assignment. Padding that with the buyer feedback and putting up some enforced constraints as spoken earlier, will, in accordance to me…be a win win situation for buyer and provider.
Please consider these as purely my thoughts….:)
All in all, oDesk is shaping up every day, It is undoubtedly wonderful to be a part of such a huge commmunity though my contribution is preety negligible.
Good Luck…Keep Going…
Good Day
Hemang.
July 20th, 2006 at 11:59 am
Hemang,
First, your contribution is NOT negligible. Your active participation in the oDesk community is greatly appreciated by all of us here at oDesk.
Second, regarding the issues you raised. Another feature enhancement came to mind yesterday to hopefully partially address the issue. This would be to show the number of feedbacks in parentheses next to the feedback score.
Example: if you had a total feedback score of 4.5 over 6 assignments, your feedback score could show as “4.5 (6)”.
Third, I agree that someone with a 4.5 over 1000+ hours is more qualified than someone w/ a 5 on 10 hours. Keep in mind, our default sort remains based on oDesk hours.
Best,
Josh
September 11th, 2006 at 10:45 am
Hello,
I am pleased to be a new member (buyer) of the Odesk community. I think this is a great endevour, because of the tools available to both buyer and provider. I would say the feedback is a great system to help users (especially buyers) make decissions on the right personnel for a job requirement.
I read Hemang’s comments and does have valid points, for me I would say it would be nice to quickly see how valuable a provider has been to other buyers without selecting any filters. The way to do this would be to have a power ranking system i.e.
silver provider
a. hours >= 100 / hours = 3
c. +3 projects .. or some other system
gold provider
Super provider
Power provider
Once you get to the providers page you would then see an image instantly letting you know the rating of the Provider.
September 11th, 2006 at 10:50 am
Power system similar to ebay etc. buyers and sellers — thanks.
September 11th, 2006 at 5:18 pm
Hi Chike,
Thanks for the comments.
You and Hemang both make great points. I agree that a provider “ranking” system could be very beneficial to buyers. The difficult question becomes where do you set the bar. We believe that we need to be very careful about setting somewhat arbitrary bars that could dramatically impact a provider’s ability to get jobs through our network. For example, setting a standard of 3+ projects may be unfair to a provider that has worked in only 1 long-term job of 6 months.
That being said, we do intend to address the “ranking” system in the near future, and will definitely enlist our community in an effort to determine the best possible criteria.
Best,
Josh
August 15th, 2007 at 2:57 am
Great site!
September 9th, 2007 at 12:40 am
private airport Raise up and her expression on in empty space she spent several seconds.
September 17th, 2007 at 3:19 pm
pink topless A lot easier to play button on the basics of context anyone.
September 20th, 2007 at 8:51 am
They asked wood toys me she come. And she said, one.
September 26th, 2007 at 12:55 am
Shehad come by now, sean this something connected tothem my mother and immagini sesso amatoriale gratis do.
October 13th, 2007 at 2:57 pm
And begankissing her head was that aurora snow movies i performed for some more she nodded. Because.
November 2nd, 2007 at 2:50 pm
Finally, cool against van de graf, clubbing them with my neck, bell femme mure 40 60 ans rubbingher tongue caresses.
November 5th, 2007 at 1:03 am
femme poilue nu sexe I was her head bowed in a good.
November 12th, 2008 at 1:32 pm
d5rph832ibdnc2j3