Hi, my spark application failed due to take too much time during GC. Looking at the logs I found these things: 1.there are Young GC takes too much time,and not found Full GC happen this; 2.The time takes too much during the object copy; 3.It happened more easily when there were not enough resources; 4.It happens during the Reduce majority.
have anyone met the same question? thanks
--------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
