Originally, the Tractometer evaluation was developed with the original Fibercup dataset in mind. All results produced with this version of the system (such as those published in Medical Image Analysis) were based on this dataset.
This first generation of test runs and results provided us and the community with interesting insights into various aspects of the whole diffusion processing pipeline. For example, it was shown in our MIA paper that some processing pipeline configurations can yield up to 70% of invalid connections. As a reminder, Invalid Connections are streamlines that connect 2 grey matter regions which are known not to be connected in reality. This is a huge number!
All those insights helped the community realize that diffusion processing pipelines need to correctly take this into account in the next generation of algorithms, in order to provide results that are meaningful and can be used in neuroscience analyses.
However, the original Fibercup dataset has begun showing its limitations. For instance, it is only 3 slices thick, so it is quite limited when trying to evaluate more complex 3D fibers configurations.
We still keep everything that is related to the Fibercup runs of the Tractometer online, to help people who may still use it. You can find the various sections here and in the submenu:
