Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Configuration of cryoSPARC environment

...

  1. Submit job

    Code Block
    languagebash
    titlejob submision
    sbatch cryosparc-master.slurm


    Warning
    titlecryoSPARC master job

    There should be only one job which run cryoSPARC master in plgrid-servicies partition per user.


  2. Check whether job was started

    Code Block
    languagebash
    titlejobs status
    squeue -j <JobID>


  3. Common states of jobs

    • PD - PENDING - Job is awaiting resource allocation.
    • R - RUNNING - Job currently has an allocation and is running.
    • CF - CONFIGURING  - Job has been allocated resources, but are waiting for them to become ready for use (e.g. booting). On Prometheus CF state could last for up to 8 minutes in case when nodes that have been in power save mode.
    • CG - COMPLETING  - Job is in the process of completing. Some processes on some nodes may still be active.
  4. Make a tunnel

    In your directory cat job log file:

    Code Block
    languagebash
    titleListing of job's log
    cat cryosparc-master-log-<JobID>.txt

    where `XXXXXXX` is your sbatch job id which is displayed after you run it f.e. `cat cryosparc-master-log-49145683.txt`

    It will show you something like this:

    Code Block
    languagebash
    titleExample of job log
    Copy/Paste this in your local terminal to ssh tunnel with remote
    -----------------------------------------------------------------
    ssh -o ServerAliveInterval=300 -N -L 40100:172.20.68.193:40100 plgusername@pro.cyfronet.pl
    -----------------------------------------------------------------
    Then open a browser on your local machine to the following address
    ------------------------------------------------------------------
    localhost:48511 
    ------------------------------------------------------------------


  5. Exec in another shell at your local computer given command to make a tunnel:

    Code Block
    languagebash
    titleTunneling
    ssh -o ServerAliveInterval=300 -N -L 40100:172.20.68.193:40100 plgusername@pro.cyfronet.pl


  6. Log into cryoSPARK web application - open in browser: `localhost:40100`


Work in progres

Info
titleOptional lanes/clusters


You could create additional lanes/clusters for other maximal duration of SLURM job:

  1. Start interactive job using command

    Code Block
    languagebash
    titleInteractive job


  2. Load cryoSPARC environment using modules

    Code Block
    languagebash
    titleInteractive job


  3. copy cluster config cluster_info.json  and script template cluster_script.sh from

...

  1. $CRYOSPARC_ADDITIONAL_FILES_DIR directory  to your working directory
  2. modify files accordingly
    1. in config cluster_info.json change name of lane/cluster to avoid overwriting default prometheus lane
    2. in cluster_script.sh change --time, --partition or other parts of script template accordingly
  3. run command cryosparcm cluster connect <name-of-cluster-form-cluster_info.json> to add lane/cluster
  4. repeat above points to create another lane if nessesary