Skip to content

Rework environment setup#78

Open
tvoigtlaender wants to merge 44 commits intomainfrom
sandboxing_newenv
Open

Rework environment setup#78
tvoigtlaender wants to merge 44 commits intomainfrom
sandboxing_newenv

Conversation

@tvoigtlaender
Copy link
Contributor

This PR improves on the environment procurement in the following ways:

  • Updates environment to utilize conda over LCG stacks.
  • Implements sandboxing for local compile tasks.
  • Add CROWN as a Kingmaker submodule.

This approach allows for a single container image to be usable for all x64 architectures instead of the current setup that only works with specific distros and versions.
Also allows for greater flexibility for future changes in the environment past the software available through LCG stacks.
As a result, the split setup through the kingmaker-images submodule can be retired after sufficient testing of the new environment.
The final goal is to then also deploy the production container image via cern cvmfs unpacked.

CROWN was originally kept as an "at setuptime" clone of the repo, but as the software becomes more stable, submoduling makes more sense.
See CROWN PR for further changes.
Various changes were necessary to allow for consistent behaviour both remote and local. Therefore, the new CROWN branch will be incompatible with older versions of Kingmaker and vice versa.

@tvoigtlaender
Copy link
Contributor Author

tvoigtlaender commented Feb 14, 2026

Related tasks that are not part of this PR:

  • Switch to singularity style HTCondor containers and source them from /cvmfs
  • Remove kingmake-images from repository and replace with a fixed (singularity) image
  • Adapt CROWN CI pipeline to new setup

@tvoigtlaender
Copy link
Contributor Author

tvoigtlaender commented Feb 25, 2026

Additional goals for the PR have been reached.
Final step:

  • move back to /cvmfs/unpacked image when available

tvoigtlaender and others added 11 commits February 27, 2026 17:15
Restore lxplus compatibility

To use run
`source setup.sh -a KingMaker_lxplus -e <eos path for env>`
instead of 
`source setup.sh`

This will be initially slow to setup due to limited write speeds.
Once sandboxing with afs file systems is possible, this should be replaced.
…_sandbox]. Then revert to use basic KingMaker env locally. Add necessary env Variables to sandboxing
…ker env. Use locally mounted in law over internal law import of law sandboxing.
@tvoigtlaender
Copy link
Contributor Author

Image is now updated to the cvmfs path.
Usage of sandboxing with lxplus enabled and an alternative config for lxplus was added.
Also now allows mixed compilation/execution between local condor env and container env.

With this, all target features for this PR are implemented.

@tvoigtlaender tvoigtlaender requested a review from nshadskiy March 4, 2026 09:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant