sanket-khedikar opened a new issue #2284: URL: https://github.com/apache/hudi/issues/2284
Hi Team, We have started using hudi for our one of clean layer framework and we came across one scenario where we have to maintain history of data for some tables. But it seems Hudi doesn't provide SCD2 functionality yet. As per our RnD, Hudi support SCD1 i.e. Overwriting the older record with latest records. In case of Hudi, we are not actually overwriting but while fetching we are getting only latest record using upsert operation. SCD2 : Slowly changing Dimension Type 2: Here we maintain the history of data. If SCD2 is possible in Hudi, can someone share the method how we can achieve it? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
