Hi All, We are using COW tables and INSERT_DROP_DUPS fails with HoodieUpsertException even on a 700 GB data. The data is partitioned and stored in GCS. Executors 150Exec memory 40gExec cores 8
Does INSERT_DROP_DUPS work with large data? Any recommendations to make it work such as spark config settings? Thanks,Bindu