Skip to content

Fix#7453 Add option to omit failed values from Data Validator log messages#7570

Merged
hansva merged 1 commit into
apache:mainfrom
leehaut:hotfix/lance-common-100
Jul 20, 2026
Merged

Fix#7453 Add option to omit failed values from Data Validator log messages#7570
hansva merged 1 commit into
apache:mainfrom
leehaut:hotfix/lance-common-100

Conversation

@leehaut

@leehaut leehaut commented Jul 19, 2026

Copy link
Copy Markdown
Contributor

Fix #7453

Summary

  • Add a Data Validator option "Do not log failed validation data" (suppress_log_failed_data, default false) that omits failed field/row values from validation error messages (shown as ?), while still logging errors and routing rejected rows to error handling.
  • Fix Data Validator dialog: after removing a validation rule, select and display the nearest remaining rule instead of leaving the editor blank.
  • Add unit tests for validation rules, suppress-failed-data behavior, meta serialization/clone, and dialog selection index logic.
  • Introduce BaseTransform.isLoggingErrorDescriptions() so transforms can optionally control whether putError writes error descriptions to the log.

@hansva
hansva merged commit 47054d4 into apache:main Jul 20, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature Request]: Parameter for the "Data Validator" transformation

2 participants