I was excited to start working on crowdsourcing projects for Appen. However, I found it impossible to earn more than $3/hr. Consider: most assignments are to pick between 2 different search results (lists just like you see them in search engines). You have to scan both sides and pick the best rating it also and highlighting elements on the page, which defined your choice. It takes at least 30 sec. 30 sec if you have it on roll. It took about 1 min for me. Then, you submit your choice and the nextbone comes up. You get paid for all satisfactory choices you made from 10c to 15c a choice. Before you get access to the assignment you have to complete qualification test (7-10 similar judgement choices) and training. This takes another 30 min. Now calculate: your pay is 10c a minute plus unpaid test and training. This is a joke.