The Assessment Phase of the EMDataBank Map Challenge is now officially open, and all are welcome to participate.
The Challenge Phase (July 2015-Apr 2016) was a tremendous success, with 66 submitted maps spread across the 7 image data benchmark targets. We recognize the significant time commitment required and are grateful to the 27 challengers who contributed their efforts and made their results available for analysis.
Following review, the challenge data and files are now publicly available to assessors. The authors of the entries and the software used have been suppressed to promote a blind assessment. We welcome input from the assessors as to how to most usefully evaluate these results. For example, assessment/comparison methods could include statistical analyses, resolution estimation, or fitting of atomic models. Some suggestions are provided on the website but these are not meant to be prescriptive.
Following two amazing challenge submission finishes in April (66 maps!) and in June (106 models!), we have been working with our respective committees to prepare and organize the data for blinded assessments and to perform preliminary analyses. This process has taken more time than originally anticipated, so we have been making adjustments to assessment phase timelines. For the map challenge, we plan to announce the beginning of the assessment phase in early November. Watch this space for more details!
EMDataBank Challenge Modellers, Please complete your model submissions this week--the deadline is this coming Friday at 21:00 UTC. Any questions/issues please let us know (firstname.lastname@example.org). Thanks for participating!