linkstream2 microblog

galaxy collaboration networks

https://www.zooniverse.org/

https://99designs.com/

Tumor genome simulation w/ #crowdsourcing to benchmark…SNV detection http://www.nature.com/nmeth/journal/v12/n7/full/nmeth.3407.html Addresses lack of gold standards & privacy

Ewing, Houlahan…..Stuart, Boutros (2015) “Combining accurate
tumour genome simulation with crowd-sourcing to benchmark somatic
single nucleotide variant detection” Nature Methods 12(7):623-630
(PMID: 25984700)

A crowdsourced benchmark of somatic mutation detection algorithms was
introduced for the ICGC-TCGA DREAM challenge. This has the advantage
of dealing with the lack of gold standard data and the issue of
sharing private genomic data. All groups worked on three different
simulated tumor-normal pairs generated with BAMSurgeon, by directly
adding synthetic mutations to existing reads. An ensemble of
pipelines outperforms the best individual pipeline in all cases,
assessed on the basis of recall, precision and F-score.
Parameterization and genomic localization both have an effect on
pipeline performance, while characteristics of prediction errors
differed for most pipelines.

Crowdsourcing sites like Amazon Mechanical Turk, CrowdFlower, Upwork, TaskRabbit, among others, have given researchers access to a large participant pool that operates around the clock.

https://www.taskrabbit.com/
http://upwork.com
http://www.crowdflower.com/
http://fiverr.com
https://www.mturk.com/mturk/welcome

Draw Figs from a Sketch

https://www.fiverr.com/

Crowd-sourcing w AMZN mechanical turk

http://www.crowdflower.com/

also odesk
http://www.behind-the-enemy-lines.com/2012/02/mturk-vs-odesk-my-experiences.html

Curation of gene–mutation relations… automated extraction &
#crowdsourcing http://database.oxfordjournals.org/content/2014/bau094.abstract?ct $AMZN’s turkers help to get 90% accuracy

1st Trial of #Crowdsourced Grading: Students grade each other with further grading of this grading http://techre.vu/18C7RVJ MT @andrewsu

http://www.technologyreview.com/view/519001/first-trial-of-crowdsourced-grading-for-computer-science-homework