Skip to content

Add multi-view support and incremental finalize handling in cdf_file_annotation#237

Open
mostafasafdarnejadCognite wants to merge 1 commit into
added/key-extraction-aliasingfrom
multi_view_sotre_processed_file_in_raw
Open

Add multi-view support and incremental finalize handling in cdf_file_annotation#237
mostafasafdarnejadCognite wants to merge 1 commit into
added/key-extraction-aliasingfrom
multi_view_sotre_processed_file_in_raw

Conversation

@mostafasafdarnejadCognite
Copy link
Copy Markdown
Member

Summary

  • Add backward-compatible multi-view target-entity configuration support (targetEntitiesViews + legacy targetEntitiesView) in launch/prepare flows.
  • Update launch data retrieval and cache conversion to handle entities across multiple target views, normalize search properties, and deduplicate entity nodes.
  • Improve finalize processing to handle terminal file-level detect items incrementally and write finalized-file processing records to RAW for traceability.

Test plan

  • Run unit tests for modified cdf_file_annotation services.
  • Trigger a file-annotation run in a non-prod environment and validate multi-view entity resolution.
  • Verify finalize cycle updates statuses correctly for mixed terminal/pending file items.
  • Confirm RAW table annotation_finalize_processed_files receives expected rows for finalized files.

Made with Cursor

Enable backward-compatible multi-view target entity config in launch/prepare flows, normalize search properties, and finalize files incrementally based on terminal item states.
Persist finalized file outcomes to RAW for traceability and improve per-file error handling in finalize/promote paths.
@mostafasafdarnejadCognite mostafasafdarnejadCognite marked this pull request as ready for review April 17, 2026 17:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant