Skip to content

Introduce multi-encoder, crop yield UC and concept captions#67

Merged
vdplasthijs merged 74 commits intomainfrom
develop
Mar 23, 2026
Merged

Introduce multi-encoder, crop yield UC and concept captions#67
vdplasthijs merged 74 commits intomainfrom
develop

Conversation

@gabrieletijunaityte
Copy link
Copy Markdown
Contributor

@gabrieletijunaityte gabrieletijunaityte commented Mar 23, 2026 •
edited
Loading

What does this PR do?

  • Renae eo encoders as geo encoders.
  • Introduce crop yield UC for Africa.
  • Introduce multi-encoder.
  • Introduce consistent alignment validation through concept captions.

Before submitting

  • Did you make sure title is self-explanatory and the description concisely explains the PR?
  • Did you make sure your PR does only one thing, instead of bundling different changes together?
  • Did you list all the breaking changes introduced by this pull request?
  • Did you test your PR locally with pytest command?

gabrieletijunaityte and others added 30 commits March 4, 2026 12:55
@gabrieletijunaityte
rename caption folders
463c0ac
@gabrieletijunaityte
Introduce concept captions and validation logic with top-k metrics
ba10999
@gabrieletijunaityte
Add constructive concept eval for test split
ed48c48
@gabrieletijunaityte
add concept caption v1
f486bc4
@gabrieletijunaityte
add contrastive concept top-k metrics
4f9467a
@gabrieletijunaityte
test fixes
cd9b840
@gabrieletijunaityte
Merge branch 'develop' into feature/contrastive_setup
7b792a8
@gabrieletijunaityte
Change column ids
0aaa7e0
@gabrieletijunaityte
Move auc out of if statement and rename k_threshold
b02edd6
@gabrieletijunaityte
Rename k_threshold
4bf4f0f
@gabrieletijunaityte
Add no_grad for text embedding
ddf30fc
@gabrieletijunaityte
Move data bound model configuration into setup methods
c19a304
@gabrieletijunaityte
return dic of scores and average them later
a529674
@gabrieletijunaityte
Fix tests
339ef88
@gabrieletijunaityte
Resolve threshold_k naming confusion and remove redundant dictionary
a4a164e
@vdplasthijs
Merge pull request #57 from WUR-AI/feature/contrastive_setup
d492299 
Introduce evaluation on concept captions
@vdplasthijs
Merge branch 'develop' into feature/refactor-model-setup
dcb998e
@gabrieletijunaityte
Add setup to basemodel
a8da730
@gabrieletijunaityte
abstracting setup method
c04cc06
@gabrieletijunaityte
Merge branch 'feature/refactor-model-setup' of github.com:WUR-AI/aeth…
8530874 
…er into feature/refactor-model-setup
@gabrieletijunaityte
Merge pull request #59 from WUR-AI/feature/refactor-model-setup
cb58282 
Setup method of the models
@vdplasthijs
Merge remote-tracking branch 'WUR-AI/develop' into feature/butterfly-…
de8b340 
…data
@vdplasthijs
minor gee update
2f118bd 
in case outside of radius_max, return radius_max
@robknapen
Crop Yield Africa use case - dataset and example tabular regression o…
ccd7ac0 
…nly experiment.
@robknapen
Crop Yield Africa use case - example coords and fusion experiments; i…
8fa2a9f 
…mproved epoch r2 metric calculation.
@robknapen
The eo_encoders to geo_encoders renaming and refactoring
a03d228
@robknapen
Missed renames
1a20366
@robknapen
Crop Yield use case: tessera embeddings download script
9c205b0
@robknapen
Crop Yield use case: tessera modality added to dataset
2ef555a
@robknapen
Configurable coords encoder in MultiModalEncoder
90b6a49
gabrieletijunaityte and others added 23 commits March 12, 2026 09:56
@gabrieletijunaityte
Add setup method to all geo-encoders
9af0d5c
@gabrieletijunaityte
Add setup method and fix devices/dtypes
d85d329
@gabrieletijunaityte
Add setup method and simplify architecture
ffdf985
@gabrieletijunaityte
Change how trainable parts are reported/printed
62422ff
@gabrieletijunaityte
Add setup to prediction heads + docs
aea39af
@gabrieletijunaityte
pre-commit hook changes
ca43ec8
@gabrieletijunaityte
Setup method for mlp projector
afef0b6
@gabrieletijunaityte
Introduce encoder wrapper to remove multi-modal encoder
6200a78
@gabrieletijunaityte
Merge branch 'develop' of github.com:WUR-AI/aether into feature/encod…
58cf1eb 
…er-wrapper

# Conflicts:
#	tests/test_yield_africa.py
@gabrieletijunaityte
Fix encoder tests
94832e0
@gabrieletijunaityte
fix tests
004b803
@gabrieletijunaityte
fix tests
0855b4a
@gabrieletijunaityte
Fix depth of summary report for modules
215e603
@robknapen
Crop Yield use case: Reduced MLP projector, equal contribution of spa…
eb571bc 
…tial and tabular encoders (for now).
@gabrieletijunaityte
fix value 0 being ignored
e27ecdc
@gabrieletijunaityte
Add model set up print statements
e6115bf
@gabrieletijunaityte
Merge branch 'feature/encoder-wrapper' of github.com:WUR-AI/aether in…
673fc0a 
…to feature/encoder-wrapper
@gabrieletijunaityte
Guatemala UC tessera
dbdd476
@gabrieletijunaityte
Alignment training
6891a51
@gabrieletijunaityte
De-duplicate geotessera requirements
0c710d9 
Remove from optional
@gabrieletijunaityte
Create input and output dimensions as attributes
9e406a4
@gabrieletijunaityte
Fix broken tests
d358066
@gabrieletijunaityte
Merge pull request #63 from WUR-AI/feature/encoder-wrapper
4023d96 
Geo-encoder wrapper
@gabrieletijunaityte gabrieletijunaityte marked this pull request as ready for review March 23, 2026 15:26
@gabrieletijunaityte
Copy link
Copy Markdown
Contributor Author

gabrieletijunaityte commented Mar 23, 2026

Im not sure how our develop branch got out of sync with main?

@vdplasthijs vdplasthijs merged commit ec2f1a1 into main Mar 23, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@vdplasthijs vdplasthijs vdplasthijs approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@gabrieletijunaityte @vdplasthijs @robknapen