bhasudha commented on issue #1777: URL: https://github.com/apache/hudi/issues/1777#issuecomment-653726518
How big is your `results` df ? You don't have to do the CONCAT for combining multiple columns for record key. You could simply pass them as comma separated columns and set the config `hoodie.datasource.write.keygenerator.class` to `org.apache.hudi.keygen.ComplexKeyGenerator. Other questions: 1. Is above all the configs you have passed and using defaults for the rest? 2. And could you also share your spark ui to help debug further? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
