Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add SLURM support #43

Merged
merged 3 commits into from
Apr 14, 2024
Merged

Add SLURM support #43

merged 3 commits into from
Apr 14, 2024

Conversation

oschulz
Copy link
Contributor

@oschulz oschulz commented Apr 14, 2024

Copy link

codecov bot commented Apr 14, 2024

Codecov Report

Attention: Patch coverage is 0% with 151 lines in your changes are missing coverage. Please review.

Project coverage is 35.22%. Comparing base (a4c1b00) to head (fb3c66b).

Files Patch % Lines
src/slurm.jl 0.00% 89 Missing ⚠️
src/workers.jl 0.00% 62 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main      #43      +/-   ##
==========================================
- Coverage   39.07%   35.22%   -3.85%     
==========================================
  Files          24       25       +1     
  Lines        1336     1482     +146     
==========================================
  Hits          522      522              
- Misses        814      960     +146     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@oschulz
Copy link
Contributor Author

oschulz commented Apr 14, 2024

Usage example: Allocate SLURM resources, e.g. via

salloc --ntasks=4 --cpus-per-task=8 --mem-per-cpu=8GB --time=1:00:00

Then start Julia within the shell started by salloc:

julia

Then, in the Julia session, run

using LegendDataManagement
legend_addprocs()

Query workers:

using TypedTables
Table(LegendDataManagement.distributed_resources())

legend_addprocs() should also work in a Julia process started via sbatch.

Note: The SLURM options --cpus-per-task and --mem-per-cpu are currently required for legend_addprocs() to work.

@oschulz oschulz merged commit fb3c66b into main Apr 14, 2024
8 of 10 checks passed
@oschulz oschulz deleted the slurm branch April 14, 2024 22:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant