Skip to content

Add support for CryoSPARC #1416

Open
vanzod wants to merge 17 commits intomainfrom
feature/cryosparc
Open

Add support for CryoSPARC #1416
vanzod wants to merge 17 commits intomainfrom
feature/cryosparc

Conversation

@vanzod
Copy link
Copy Markdown
Contributor

@vanzod vanzod commented Mar 10, 2023

Provide option in config.yml to install and setup CryoSPARC on top of Slurm cluster.

CryoSPARC master/worker architecture is implemented by deploying the master node as cluster login node and workload submitted to CycleCloud Slurm scheduler. CryoSPARC installation and configuration is performed via dedicated CycleCloud project. Multiple Slurm partitions can be configured as CryoSPARC lanes with the applications.target_queues variable.

Due to hardcoded absolute paths in CryoSPARC code the portal is not reachable through the OOD proxy. Until a suitable OOD feature is available (OSC/ondemand#2311), CryoSPARC portal is accessible in Az-HOP from a Linux interactive session. An XFCE application menu shortcut is added in Education -> CryoSPARC.

// MariaDB
AllowMariaDBIn : ['700', 'Inbound', 'Allow', 'Tcp', 'MariaDB', 'asg', 'asg-mariadb-client', 'subnet', 'admin']

// Cluster applications
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would try to make this generic.

{% endif %}
{% endfor %}

{% if cryosparc_enabled %}
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This for me is too application specific and we can't do this for every app. This could be solved by having single node definition, on which we could specify which cluster-init project to add

@samkleeman1
Copy link
Copy Markdown

Hi - what is the status of this. We would be interested to use az-hop for cryosparc deployment

line 138 has an extra `{% endif % }` that causes failure during configuration
* Update slurm_cluster_info.json

updated `worker_bin_path` to match install path

* Update 03-install_cryosparc.sh.j2

added section to connect worker nodes to the master
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants