The model challenge assessment period is still in progress. Interested to see how we the results are being assessed? Please visit the model-compare pages at http://model-compare.emdatabank.org. There you can view and compare the submitted models via more than a dozen different whole-model and residue level metrics, as summarized here.
The Assessment Phase of the EMDataBank Map Challenge is now officially open, and all are welcome to participate.
The Challenge Phase (July 2015-Apr 2016) was a tremendous success, with 66 submitted maps spread across the 7 image data benchmark targets. We recognize the significant time commitment required and are grateful to the 27 challengers who contributed their efforts and made their results available for analysis.
Following review, the challenge data and files are now publicly available to assessors. The authors of the entries and the software used have been suppressed to promote a blind assessment. We welcome input from the assessors as to how to most usefully evaluate these results. For example, assessment/comparison methods could include statistical analyses, resolution estimation, or fitting of atomic models. Some suggestions are provided on the website but these are not meant to be prescriptive.