samirakarki commented on issue #8135:
URL: https://github.com/apache/hudi/issues/8135#issuecomment-1475531867
@nsivabalan
Both tables are in the same zone i.e. landing Zone (this is the zone where
data is landed from RDS database).
As I stated above, for our use casetable 1 data didn’t alter in the
incremental load.
1. The screen shot below is the table 2(after incremental load :
Here id = 26, record changed for “complete” column to False.
2. The screenshot below is output table from s3 target bucket (result from
joined table 1 and 2)
execution_id is the primary key from table 2 and step_execution_id is
primary key from table 1. In this target table step_execution-id is the primary
key.
After the incremental load, six rows with execution_id =26, completed column
data hasn’t updated to “False”.Although,completed flag changed to “false” for
that id (table2) as show in above screenshot.
This is one use case we are trying to solve.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
