...
| Partition | Number of nodes | CPU | RAM | Default | Accelerator |
|---|---|---|---|---|---|
| plgrid | 532 | 48 cores, Intel(R) Xeon(R) Platinum 8268 CPU @ 2.90GHz | 192GB | 3.76 GB3850MB | |
| plgrid-bigmem | 256 | 48 cores, Intel(R) Xeon(R) Platinum 8268 CPU @ 2.90GHz | 384GB | 7.5 GB7700MB | |
| plgrid-gpu-v100 | 9 | 32 cores, Intel(R) Xeon(R) Gold 6242 CPU @ 2.80GHz | 384GB | 11.23 GB11500MB | 8x Tesla V100-SXM2 |
Job submission
...
| Name | Timelimit | Remarks |
|---|---|---|
| plgrid | 72h | Standard partition. |
| plgrid-long | 168h | Used for jobs with extended runtime. |
| plgrid-testing | 1h | High priority, testing jobs, limited to 3 jobs. |
| plgrid-bigmem | 72h | Currently unavailable. For jobs using an extended amount of memory. |
| plgrid-now | 12h | The highest priority, interactive jobs, 1 running job at most. |
| plgrid-gpu-v100 | 48h | GPU partition. |
...
Ares uses a new scheme of naming accounts for CPU and GPU computing grants. CPU-only grants are named: grantname-cpu, while GPU accounts use grantname-gpu suffix. Please mind that sbatch -A grantname won't work on its own. You need to add the -cpu or -gpu suffix! Available computing grants, with respective account names (allocations), can be viewed by using the hpc-grants command.
...
| Location | Location in the filesystem | Purpose |
|---|---|---|
| $HOME | /net/people/plgrid/<login> | Storing own applications, and configuration files |
| $SCRATCH | /net/pr2/scratch/people/<login> or /net/ascratch/people/<login> | High-speed storage for short-lived data used in computations. Data older than 30 days can be deleted without notice. Please note that scratch can have two physical locations. It is best to rely on the $SCRATCH environment variable. |
| $PLG_GROUPS_STORAGE/<group name> | /net/pr2/projects/plgrid/<group name> | Long-term storage , for data living for the period of computing grant. |
...
Please use the following commands for interacting to interact with the account and storage management system:
hpc-grants-shows shows available grants, resource allocations, consumed resourcedhpc-fs- shows available storagehpc-jobs- shows currently pending/running jobshpc-jobs-history- shows information about past jobs
...
Applications and libraries are available through the modules system. Please note that the module structure was flattened, and module paths have changed compared to Prometheus! The list of available modules can be obtained by issuing the command:
...