Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extended refactoring of the benchmark pipeline #16

Merged
merged 10 commits into from
Mar 25, 2025

Conversation

SimonGrouard
Copy link
Collaborator

@SimonGrouard SimonGrouard commented Aug 13, 2024

Refactoring of the benchmarking pipeline!

To run the benchmark, one should:

  • Create their own config.yaml config file within the benchmark_configs folder.
  • Every possible config parameter is explained within the @dataclass of the RunBenchmarkConfig inside run_benchmark_config_dataclass.py in which value compatibilities of the different provided arguments are checked.
  • To run a benchmark with the created config, run inside a terminal python /home/owkin/deepdeconv-fork/run_benchmark.py --config /home/owkin/deepdeconv-fork/benchmark_configs.config.yaml.
  • If inside the config, save: True, then every output of the experiment will be saved inside /home/owkin/project/run_benchmark_experiments/{your_experiment_name}. Otherwise, only final plots will be saved there.

@SimonGrouard SimonGrouard marked this pull request as ready for review March 21, 2025 09:05
@SimonGrouard SimonGrouard changed the title Sgrouard/extend refacto benchmark Extended refactoring of the benchmark pipeline Mar 21, 2025
Copy link
Collaborator

@khalilouardini khalilouardini left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @SimonGrouard the benchmark is great, that's definitely going to help scale the benchmarking!

@SimonGrouard SimonGrouard merged commit a2928d1 into main Mar 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants