Skip to content

Add bufr-query to bundles#112

Closed
mranst wants to merge 3 commits into
developfrom
feature/add_bufr_query
Closed

Add bufr-query to bundles#112
mranst wants to merge 3 commits into
developfrom
feature/add_bufr_query

Conversation

@mranst
Copy link
Copy Markdown
Collaborator

@mranst mranst commented Feb 19, 2026

I was surprised at how easy this was to implement but I'm pretty sure it works. I have a test build under
/discover/nobackup/manstett/SwellExperiments/jedi_build

We can change the swell modules file to include this, but for testing purposes, the steps to use bufr-query from this are:
source /discover/nobackup/projects/gmao/advda/swell/jedi_modules/spackstack_1.9_intel
module unload bufr-query

export PYTHONPATH=/discover/nobackup/manstett/SwellExperiments/jedi_build/build-intel-release/lib/python3.11/site-packages/:$PYTHONPATH

This should allow you to import bufr from python. The executables such as bufr2netcdf.x are located in
/discover/nobackup/manstett/SwellExperiments/jedi_build/build-intel-release/bin

@Dooruk
Copy link
Copy Markdown
Collaborator

Dooruk commented Feb 19, 2026

Well, that is neat. I actually tested this yesterday as well, my approach was to use bufr-query as an extra repo.

feature/doruk/bufr-query-install

Does your installation pass all of the bufr-query ctests in its build folder?

How do you handle py-wxflow, netcdf4/4.9.2-ser libraries? I had to run make -j64 command in build folder to actually get executables though.

I thought those packages were needed: GEOS-ESM/swell#671 (comment)

Obsbuilder is the tricky part as it's a python package. Were you able to add it to your PYTHONPATH, I'm not sure if BUILD_PYTHON_BINDINGS in CMakelists.txt was active for me while building.

@mranst
Copy link
Copy Markdown
Collaborator Author

mranst commented Feb 19, 2026

Ah, I knew it was too good to be true. Most of the ctests are failing, but since I was able to use the executables I thought it was good. Regarding the other libraries, I could be wrong, but I thought that since they're available in spack-stack, cmake is able to find them when building it.

@mranst mranst closed this Feb 19, 2026
@Dooruk
Copy link
Copy Markdown
Collaborator

Dooruk commented Feb 19, 2026

I think only extra module that needs to be loaded is py-wxflow/0.2.0. And it will require unloading of bufr-query first see below:

develop...feature/doruk/bufr-query-install

@mranst
Copy link
Copy Markdown
Collaborator Author

mranst commented Feb 19, 2026

@Dooruk Do ctests pass for your build?

@Dooruk
Copy link
Copy Markdown
Collaborator

Dooruk commented Feb 19, 2026

@Dooruk Do ctests pass for your build?

Yeah except for obs_builder tests are passing. I see the bindings under lib folder so it might simply be a $PYTHONPATH problem.

I'm testing ioda ctests now but not sure if they test the bufr backend. @cohen-seth do you know?

/discover/nobackup/projects/gmao/soca/swell/JediBundles/ioda_02182026

@Dooruk
Copy link
Copy Markdown
Collaborator

Dooruk commented Feb 19, 2026

test_ioda_bufr_mhs passes but these two failed. I still suspect $PYTHONPATH but also could be the python build of ObsBuilder.

    Start 487: test_ioda_bufr_python_encoder

487/494 Test #487: test_ioda_bufr_python_encoder ..................................................................***Failed 1.07 sec
Start 488: test_ioda_bufr_python_parallel
488/494 Test #488: test_ioda_bufr_python_parallel .................................................................***Failed 2.58 sec

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants