gamblewin commented on issue #8260: URL: https://github.com/apache/hudi/issues/8260#issuecomment-1483873637
> what do you think does this solve your issue ? sry, it's been really busy lately, thx so much for your help again. yeah, I want to use Flink to catch changed data from hudi raw table and perform INC join on these changed data and upsert INC join result into the wide hudi table. Actually, The scenario I want to test is same as the one shown in the image below. <img width="712" alt="image" src="https://user-images.githubusercontent.com/39117591/227730611-2548d069-75a6-47fa-8939-8bf7314c005f.png";> For now, I have a few questions about hudi: 1. Can I get changelog from COW table or is there any way to catch data change info from COW table? 2. If I want to get data change info from a MOR table, is there any differences between using timestamp and using changelog? 3. Now back to the scenario I want to test, so the possible way is: - Use Flink to get delta data from hudi raw dataset - Use Flink to perform join operation on these delta data - Then upsert INC join result into hudi wide table? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
![https://user-images.githubusercontent.com/39117591/227730611-2548d069-75a6-47fa-8939-8bf7314c005f.png"](https://user-images.githubusercontent.com/39117591/227730611-2548d069-75a6-47fa-8939-8bf7314c005f.png"){kind=link}