[GitHub] [hudi] git-raj commented on issue #2284: [SUPPORT] : Is there a option to achieve SCD 2 in Hudi?

2021-01-25 Thread GitBox
git-raj commented on issue #2284: URL: https://github.com/apache/hudi/issues/2284#issuecomment-766523668 using AWS Glue pySpark and Hudi and S3 as data store: i'm trying to do the traditional SCD Type 2 where old record gets updated with the insert datetime on 'effective to' field,

[GitHub] [hudi] git-raj commented on issue #2284: [SUPPORT] : Is there a option to achieve SCD 2 in Hudi?

2021-01-24 Thread GitBox
git-raj commented on issue #2284: URL: https://github.com/apache/hudi/issues/2284#issuecomment-766523668 using AWS Glue pySpark and Hudi and S3 as data store: i'm trying to do the traditional SCD Type 2 where old record gets updated with the insert datetime on 'effective to' field,