So, as you may know, oDesk offers 100 free online certification tests available to users to prove their skills.
Rewind 1 year ago:
-Many users complained about the quality of the test content.
-We didn't have the bandwidth to review and improve all of the content ourselves.
So, after a number of users had brought the quality to our attention, we launched two new feedback mechanisms.
First, any user could Report an Issue with a specific question.
Second, any user could provide a Content Feedback Score at the completion of the test.
Now, let's look at today.
Over the course of 1 year, over 2,500 issues have been reported to improve the test content. Together with our testing vendor, ExpertRating, we have used these issues reported by our users to dramatically improve the test content. These improvements are reflected in the content feedback scores from our users; they have gone up 33% from around a 3.0 (out of 5.0) to over 4.0.
This confirms our beliefs that communities are critically important to shaping the product and offering. While it was initially painful to hear the complaints of our users, it forced us to build a solution that allowed the community to get involved. And it has paid off.
The job going forward for oDesk, and for all Web 2.0 companies, is to continue to build in more ways for the community to contribute.