yihua commented on issue #5984: URL: https://github.com/apache/hudi/issues/5984#issuecomment-1169362306
@rubenssoto Based on your description, it looks like you tried to bulk insert the data from the source. Likely the shuffle failure is due to out-of-memory on the executors. What are the memory and parallelism configs (Hudi bulk insert shuffle parallelism and spark parallelism) you use? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
