[
https://issues.apache.org/jira/browse/HUDI-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17373077#comment-17373077
]
ASF GitHub Bot commented on HUDI-2072:
--------------------------------------
satishkotha commented on pull request #3153:
URL: https://github.com/apache/hudi/pull/3153#issuecomment-872586093
> @satishkotha : Thanks for adding this very useful feature. One high level
comment: For validations, sometimes we want the complete view of the table for
doing global uniqueness check across partitions. I see that
SparkPrecommitValidator has getPartitionsModified API which can be overridden
to get it but that would mean that we can't reuse the SQL based validators
without having to override them. Can we make it configurable to perform global
vs local checks ?
>
> Will let you clean up the code and will do the final review when it is
ready.
>
> Thanks.
> Balaji.V
@bvaradar This seems like a new feature request. Can we handle this as part
of another PR? Btw, do you think global uniqueness can be checked before the
write stage starts (using the index)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> Add Precommit validator framework
> ---------------------------------
>
> Key: HUDI-2072
> URL: https://issues.apache.org/jira/browse/HUDI-2072
> Project: Apache Hudi
> Issue Type: New Feature
> Reporter: satish
> Assignee: satish
> Priority: Major
> Labels: pull-request-available
>
> We want to run pre-commit validators before 'promoting' a inflight operation
> to commit.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
