Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Ares is built with Infiniband EDR interconnect and nodes of the following specification:

PartitionNumber of nodesCPURAMAccelerator
plgrid and plgrid-*53248 cores, Intel(R) Xeon(R) Platinum 8268 CPU @ 2.90GHz192GB
plgrid-bigmem25648 cores, Intel(R) Xeon(R) Platinum 8268 CPU @ 2.90GHz384GB
plgrid-gpu-v100932 cores, Intel(R) Xeon(R) Gold 6242 CPU @ 2.80GHz384GBTesla V100-SXM2

Job submission

Jobs Ares is using Slurm resource manager, jobs should be submitted to the following partitions:

NameTimelimitRemarks
plgrid72hStandard partition.
plgrid-long168hUsed for jobs with extended runtime.
plgrid-testing1hHigh priority, testing jobs, limited to 3 jobs.
plgrid-bigmem72hJobs using an extended amount of memory.
plgrid-now12hThe highest priority, interactive jobs, limited to 1 running job.
plgrid-gpu-v10072hGPU partition.

Storage

Available storage spaces are described in the following table:

LocationPhysical locationPurpose
$HOME/net/people/<login>Storing own applications, configuration files
$SCRATCH/net/pr2/scratch/people/<login>High-speed storage used for short-lived data heavily used in computations.
group storage/net/pr2/projects/plgrid/<group name>Long term storage, used for data living for the period of computing grant.

Current usage, capacity and other storage attributes can be checked by issuing the hpc-fs command.

...

and the environment can be purged by:

module purge

More information

Ares is following Prometheus' configuration and usage patterns. Prometheus documentation can be found here: https://kdm.cyfronet.pl/portal/Prometheus:Basics