Testing

[JoeZiminski]

• check results against existing pipelines from researchers
• check SI, CatGT, IBL against each-other

[JoeZiminski]

Reconfigure tests so they do not share output paths such that they can be parallelised with pytest-xdist or pytest-parallel

[JoeZiminski]

Do a confidence check that the last dict entry of PreprocessData get_traces() is the same data as written in the preprocessed output binary folder.

[JoeZiminski]

full backwards compatibility tests

[JoeZiminski]

at least one sanity check test that the sorting output matches some canonical data

[JoeZiminski]

Save test data on datalad so at least non-kilosort sorters can be tested on CI.

[JoeZiminski]

Still need to test:

    # ----------------------------------------------------------------------------------
    # Not Implemented
    # ----------------------------------------------------------------------------------

    def test_sorting_only_local(self):
        raise NotImplementedError

    def test_sorting_only_slurm(self):
        raise NotImplementedError

    def test_postprocessing_only_local(self):
        raise NotImplementedError

    def test_postprocessing_only_slurm(self):
        raise NotImplementedError

    def test_preprocessing_only_local(self):
        raise NotImplementedError

    def test_preproecssing_only_slurm(self):
        raise NotImplementedError

    def test_configs(self):
        # not really sure how to do this...
        raise NotImplementedError

    def test_reordering_sessions_and_runs(self):
        raise NotImplementedError

    def test_select_postprocessing_to_run(self):
        raise NotImplementedError

    def test_delete_intermediate_files(self):
        raise NotImplementedError

    def test_slurm_options(self):
        raise NotImplementedError