ISMRM 2015 Tractography challenge - Submission details


The challenge is now closed. If you recently processed the data and would like to get some scores to compare with the published results, please note that a standalone tool to compute the scores should be released in the coming weeks.

To stay in the loop about this release, please see the challenge home for details on how to subscribe to the mailing list.

Details on submissions

For the sake of posterity, here are the details related to the submission process and the accepted formats.

Contestants were asked to submit their best tractography result in world-space, aligned with the original b0 image and T1 image (which overlap). The submitted file must contain the whole brain tractogram. Accepted formats were

  • Trackvis (.trk)
  • Mrtrix (.tck)
  • VTK (.vtk or .fib)
For details on our specific requirements for the files formats, as well as tools to check if everything is correct, please see the submitted file specifications page.

In addition to the tractography results, contestants were also asked to submit a high-level description of the pipeline used to produce the tractogram. References to methods and code were also be included, when possible.

Templates explaining the expected content can be downloaded here: .docx, .txt.

If the description is not provided, the submissions were not scored.

A limit of 5 submissions per participant were accepted and a file size of maximum 2 Gigabytes per tractogram was allowed.

Submission validation

The organizers are aware that various tools and toolkits may work in different space, and that processing the data using a succession of tools may change the space in which the final results are produced.

To be correctly evaluated and scored, the submitted tractography files must live in the same space as the original images. We provide a small Python script that will test if the coordinates seem to be in the correct space. However, please note that there is no warranty, even if the script says the points are in the correct space, that your tracts are correctly aligned with the reference anatomy. See here for the script and instructions on how to use it.

Alternatively, you can also validate the space of your points by checking that, in world space, the final coordinates are between

X [-1.0, 179.0] [-179.0, 1.0]
Y [-1.0, 215.0] [-215.0, 1.0]
Z [-1.0, 179.0] [-1.0, 179.0]