[GitHub] [hudi] andreagarcia20 commented on issue #8302: [SUPPORT] Hudi Job fails when trying to upsert/insert data due to Executor Process Lost

[via GitHub]

andreagarcia20 commented on issue #8302:
URL: https://github.com/apache/hudi/issues/8302#issuecomment-1486362145

   The error of the executors when failing is: _ExecutorLostFailure (executor 8 
exited caused by one of the running tasks) Reason: Executor Process Lost_
   
   <img width="932" alt="image" 
src="https://user-images.githubusercontent.com/129081554/228160566-84ae057c-d7cd-4cd2-a543-98bce1b33e80.png";>
   
   We are using 32 executor-cores and the executor-memory is by default 230051M 
(we have tried to increase and decrease these parameters but we do not know 
exactly how this affects our workload) 
    
   <img width="691" alt="image" 
src="https://user-images.githubusercontent.com/129081554/228161407-bfe0af97-eac3-443a-b614-3ebcb113b118.png";>
   
   We also have an spark.default.parallelism equal to cores x instances x 2 (in 
this case 256)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org