The ISMRM 2015 Tractography Challenge

The results

To understand the different between the different versions, please consult on the one hand, the Tractometer description page for the difference in scoring methods, and on the other and, the ISMRM Challenge Data page for the difference in ground truth data.

Initial results

Click to show

These are the results as presented in the original paper (initial data, scoring based on segmentation with Recobundles). You may download the details as an excel file, or view results in your browser, or load results printed as PDF: (results ordered by submission number) or (results ordered by scores).

Please be careful! Wrong numbers have been published in papers citing the ISMRM Challenge paper. Always refer to this table.

Fig 1. Initial scores. Mean scores over all bundles, again averaged over all submitted tractograms.

Initial results, with updated bundle masks

Click to show

These are nearly the same as above, with the same ground truth bundles and the same scoring system based on Recobundles, but with updated bundle masks. As suggested in 2017 in Rheault et al, bundle masks should not recover only voxels containing streamlines points (even after resampling), but should rather account for the whole segment between two points. New bundles masks were computed with newer scripts (scil_compute_streamlines_density_maps). Segmented bundles are thus the same (VS, IS, VB), but OL, OR, ORn, f1 metrics are slightly improved.

You may download the details as an excel file, or view results in your browser, or load results printed as PDF: (results ordered by submission number) or (results ordered by scores).

Fig 2. Scores with updated bundle masks. Mean scores over all bundles, again averaged over all submitted tractograms.

Results using the ROI-segmentation-based scoring

(Will be added soon).

Click to show

The full results of the challenge are presented here. We still refer to the submission IDs to make it easier for users to search for their submissions.

If you are unsure of the submission IDs assigned to your group, please use the contact page to ask for them.

All submissions files are downloadable through Zenodo DOI