Skip to content

Add batch submission feature #4

@vkuznet

Description

@vkuznet

On main notebook interface I should remove Profile and add Batch button. Internally, I need another batch submission script to send CHAP to batch node. Follow CHESS batch page to see how to structure job submission.

We need the following steps:

  • create tarball of given workflow, i.e. we'll need to copy all workflow files along with yaml configurations
  • create another script for batch submission
  • the batch_submit.sh should call qsub command and copy necessary files to some area to unpack
  • need to decide how to deal with conda, therefore it may be I need to have proper conda environment in batch nodes or will need to create them dynamically
  • should fetch job ID and provide link to chap.log that user can find their batch job

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions