You are here

map challenge

Joint Challenges Wrap-Up Meeting Oct 6-8

In 2016 EMDataBank ran two community challenges in parallel to create awareness of the need for cryoEM structure validation as a routine process in research studies and publications, and to expedite development of quantitative tools for assessment

Map Challenge: Data Released!

Several updates for the map challenge:

Map Challenge Assessment Update

Map Challenge Assessors:

  • If you have not yet completed your analysis, the deadline for submitting assessment reports is now end of April (April 30). After that time we will be releasing the masked software/submitter info.
  • We are working on the planning for a two day face-to-face discussion of assessment results, and are considering several possible dates/locations either over the summer or (more likely) in September.
  • Following the workshop each assessor/assessment group will have the opportunity to publish their findings in a journal special issue.

Map Challenge Webinar

As a reminder the Blind Assessment phase of the EMDataBank Map Challenge.is now open. A 1 hour webinar held on November 17 @15:00 UTC (9:00 US-CT, 10:00 US-ET, 15:00 UK, 16:00 Eur, 23:00 China) covered these topics:

  • map challenge submissions overview
  • how the submitted data and files were prepared for blind assessment
  • how to download/access the data
  • what preliminary analyses are already available
  • how to participate in the assessment phase
  • Q/A period

You can view/listen to the recorded webinar here:

 

 

Map Challenge Assessment Phase is Now Open

The Assessment Phase of the EMDataBank Map Challenge is now officially open, and all are welcome to participate.

The Challenge Phase (July 2015-Apr 2016) was a tremendous success, with 66 submitted maps spread across the 7 image data benchmark targets. We recognize the significant time commitment required and are grateful to the 27 challengers who contributed their efforts and made their results available for analysis.

Following review, the challenge data and files are now publicly available to assessors.  The authors of the entries and the software used have been suppressed to promote a blind assessment. We welcome input from the assessors as to how to most usefully evaluate these results.  For example, assessment/comparison methods could include statistical analyses, resolution estimation, or fitting of atomic models. Some suggestions are provided on the website but these are not meant to be prescriptive. 

Assessment Phases are Coming Soon

Following two amazing challenge submission finishes in April (66 maps!) and in June (106 models!), we have been working with our respective committees to prepare and organize the data for blinded assessments and to perform preliminary analyses. This process has taken more time than originally anticipated, so we have been making adjustments to assessment phase timelines. For the map challenge, we plan to announce the beginning of the assessment phase in early November.  Watch this space for more details! 

Map Submission Deadline Extended (Again)

By popular request, we are extending the map challenge submission deadline to April 15, 2016 @ 21:00 UTC (5 PM US ET).  Click here to see the new deadline time in your location.

 

Clarification about symmetry of the GroEL simulated data

The authors of the GroEL simulated dataset have asked us to let all map challenge participants know that 4HEL, the model from which the images were generated, is non-symmetrical, owing to unmatched crystallographic symmetry (P212121).   They have just become aware of this issue following discussion with two challenge participants.

Challenge Submissions Update

The following updates have been made to the challenges site this week:

  1. Model challenge submissions are now open.
  2. Challenge submissions (both map and model) now require login to the challenges site.  Emails have been sent out to all challenger registrants with their login information.
  3. Challenge news is now available via rss feed.

A note about BMV image frame data

Some map challenge participants may be encountering difficulty processing the BMV individual frames data (not the original boxed out particle images). One has to work out the image processing scheme which is a part of the challenge. To help challengers understand the data, the BMV raw data providers have provided the following note:

Pages

EMDataBank Validation Challenges are supported by NIH National Institute of General Medical Sciences

Please send your challenge questions, comments and feedback to challenges@emdatabank.org

Theme by Danetsoft and Danang Probo Sayekti inspired by Maksimer