Skip to content

Conversation

lorenzo9uerra
Copy link

Summary

This pull request adds Singularity container support for cluster deployments, and includes minor fixes and refactoring.

Changes

  • Added Makefile and scripts to run PostgreSQL through Singularity containers for cluster environments.
  • Added the possibility to set seeds through a command line argument, allowing testing of multiple seeds, while previously the seed was always set to 0. The "set_seed()" calls were removed from each separate task, as the seed only has to be set once, at the beginning of the main function. Unnecessary functions to set seeds were also removed.
  • Fixed stats["percent_detected_attacks"] calculation to properly compute the percentage of detected attacks. Moreover, "detected_attacks" is now updated with detected attacks only when a node is correctly classified, while before it was always updated.
  • Includes various other minor bug fixes and improvements.

All changes maintain backward compatibility with existing configurations and workflow.

…arity setup scripts for postgres as an alternative to docker containers for cluster environments
…ster environments. Moving all scripts to the ./scripts/ folder and deletion of ./settings/scripts/ folder
…ets the seed for the rest of the execution and avoids a seed reset to the default value. The value was previously always set to 0 and no other seeds were allowed by the code. Finally, torch.use_deterministic_algorithms automatically overwrites torch.backends.cudnn.deterministic and torch.manual_seed already calls internally torch.cuca.manual_seed_all
@TristanBilot
Copy link
Member

Hi @lorenzo9uerra, thanks for opening this PR!
I'll review it soon when I have some time to allocate on it.

@TristanBilot
Copy link
Member

@lorenzo9uerra I'll need some more time as I also have to merge some of my code and it's gonna be hard to merge given that you applied some code formatting.

@lorenzo9uerra
Copy link
Author

I have rerun ruff format on the project, I hope it helps. I don't know why it missed the pre-commit hook before

@TristanBilot
Copy link
Member

Thanks, should help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants