[
https://issues.apache.org/jira/browse/HUDI-6907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lin Liu updated HUDI-6907:
--------------------------
Description:
As title.
We have confirmed that the `HoodieSparkRecord` payload, that is `InternalRow`
is written to the disk.
Though I have traced into the execution and created reasonable workflow, and
did not find any transformation happened, I cannot 100% guarantee it did not
happened at all. We need a better way to confirm that. But it should be OK for
now.
was:
As title.
We have confirmed that the `HoodieSparkRecord` is written to the disk.
But we haven't confirmed if the `HoodieSparkRecord` has been transformed during
the process, though I have traced into the execution and did not find any
transformation happened. But I cannot guarantee it did not happend at all. We
need a better way to confirm that. But it should be OK for now.
> E2E support HoodieSparkRecord
> ------------------------------
>
> Key: HUDI-6907
> URL: https://issues.apache.org/jira/browse/HUDI-6907
> Project: Apache Hudi
> Issue Type: Test
> Reporter: Lin Liu
> Assignee: Lin Liu
> Priority: Major
> Fix For: 1.0.0
>
>
> As title.
>
> We have confirmed that the `HoodieSparkRecord` payload, that is `InternalRow`
> is written to the disk.
> Though I have traced into the execution and created reasonable workflow, and
> did not find any transformation happened, I cannot 100% guarantee it did not
> happened at all. We need a better way to confirm that. But it should be OK
> for now.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
