Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Start interactive job using command

    Code Block
    languagebash
    titleInteractive job
    srun -p plgrid-services --nodes=1 --ntasks=1 --time=0-1 --pty bash


  2. Load cryoSPARC environment using modules

    Code Block
    languagebash
    titleLoad cryoSPARC environment
    module add plgrid/apps/cryosparc/3.2


  3. Copy cluster config cluster_info.json  and script template cluster_script.sh from $CRYOSPARC_ADDITIONAL_FILES_DIR directory  to your working directory

    Code Block
    languagebash
    titleCopy files
    cp $CRYOSPARC_ADDITIONAL_FILES_DIR/cluster_info.json .
    cp $CRYOSPARC_ADDITIONAL_FILES_DIR/cluster_script.sh .


  4. Modify files accordingly
    1. in config cluster_info.json change name of lane/cluster to avoid overwriting default prometheus* lanes
    2. in cluster_script.sh change --time, --partition or other parts of script template accordingly
  5. Start  cryoSPARC master

    Code Block
    languagebash
    titlerun cryoSPARC master
    cryosparcm restart


    Warning
    titlecryoSPARC master job

    There should be only one job which run cryoSPARC master per user. Therefore you should stop job with cryoSPARC master before this step


  6. run command cryosparcm cluster connect <name-of-cluster-form-cluster_info.json> to add lane/cluster

    Code Block
    languagebash
    titleadd line
    cryosparcm cluster connect <name-of-cluster-form-cluster_info.json>


  7. Repeat above points to create another lane if necessary
  8. Stop cryoSPARC master

    Code Block
    languagebash
    titlerun cryoSPARC master
    cryosparcm stop


  9. End interactive job

    Code Block
    languagebash
    titleend interactive job
    exit


Known problems and issues

List of known problems and issues

After restart there is database: ERROR (spawn error)

Sometimes when cryoSPARC master is shut down it can not restart due to database error. It leads to

Code Block
titlecryoSPARC log with error
CryoSPARC is not already running.
If you would like to restart, use cryosparcm restart
Starting cryoSPARC System master process..
CryoSPARC is not already running.
database: ERROR (spawn error)

In such case you should check logs for errors

main log in  ~/.cryosparc/log/run/command_core.log

Code Block
titledatabase log
less ~/.cryosparc/log/run/command_core.log 

supervisor log in  ~/.cryosparc/log/run/supervisord.log

Code Block
titledatabase log
less ~/.cryosparc/log/run/supervisord.log 

database log in ~/.cryosparc/log/run/database.log

Code Block
titledatabase log
less ~/.cryosparc/log/run/database.log 

...

Code Block
titlecryoSPARC log with error
AssertionError: {'code': 500, 'data': None, 'message': "OtherError: node is not in primary or recovering state, full error:
{'ok': 0.0, 'errmsg': 'node is not in primary or recovering state', 'code': 13436, 'codeName': 'NotMasterOrSecondary'}

then:

Warning
titlebackup of cryoSPARC projects

Backup all your projects and data before removing cryoSPARC database. Usually it should not be a problem to import them without backup but you should backup projects just in case. You have to remember that each cryoSPARC database start naming projects from P1, therefore it is best to backup projects to i.e. $PLG_GROUPS_STORAGE/<your-plggteam> space.

you have to move current cryoSPARC database

Code Block
titledatabase log
mv ~/.cryosparc/cryosparc_database ~/.cryosparc/cryosparc_database-$(date+"%Y-%m-%d")

...

rerun  configuration of cryoSPARC to rebuild database

...