[
https://issues.apache.org/jira/browse/HUDI-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499148#comment-17499148
]
sivabalan narayanan commented on HUDI-2463:
-------------------------------------------
AS fo now, we ingest batch number into the dataset and use that as
preCombine/ordering field. Don't think we can support arbitrary preCombine
field here. If not, merging input records across different rounds might result
in inconsistent behavior.
> Add support for preCombine field in test suite infra
> ----------------------------------------------------
>
> Key: HUDI-2463
> URL: https://issues.apache.org/jira/browse/HUDI-2463
> Project: Apache Hudi
> Issue Type: Task
> Components: Testing
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Major
> Fix For: 0.11.0
>
>
> As of now, source orderding field/preCombine field is static and is populated
> and set internally by test infra. Relax this constraint to allow any field by
> end user to be set for source ordering/precombine field.
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
