Tumor genome simulation w/ #crowdsourcing to benchmark…SNV detection http://www.nature.com/nmeth/journal/v12/n7/full/nmeth.3407.html Addresses lack of gold standards & privacy
Ewing, Houlahan…..Stuart, Boutros (2015) “Combining accurate
tumour genome simulation with crowd-sourcing to benchmark somatic
single nucleotide variant detection” Nature Methods 12(7):623-630
(PMID: 25984700)
A crowdsourced benchmark of somatic mutation detection algorithms was
introduced for the ICGC-TCGA DREAM challenge. This has the advantage
of dealing with the lack of gold standard data and the issue of
sharing private genomic data. All groups worked on three different
simulated tumor-normal pairs generated with BAMSurgeon, by directly
adding synthetic mutations to existing reads. An ensemble of
pipelines outperforms the best individual pipeline in all cases,
assessed on the basis of recall, precision and F-score.
Parameterization and genomic localization both have an effect on
pipeline performance, while characteristics of prediction errors
differed for most pipelines.