Even though i provide hint of wn4's ip addressSpark schedules on
wn12020-09-17 01:21:50,038 DEBUG [dag-scheduler-event-loop]
scheduler.TaskSetManager: Valid locality levels for TaskSet 11.0:
NODE_LOCAL, RACK_LOCAL, ANY2020-09-17 01:21:50,039 DEBUG
[dispatcher-event-loop-0] cluster.YarnScheduler: parentName: , name:
TaskSet_11.0, runningTasks: 02020-09-17 01:21:50,040 INFO 
[dispatcher-event-loop-0] scheduler.TaskSetManager: Starting task 0.0 in
stage 11.0 (TID 13,
wn1-vegasr.r0erhw3gxezevknl0vbc42vctb.dx.internal.cloudapp.net, executor 6,
partition 5, NODE_LOCAL, 4994 bytes)2020-09-17 01:21:50,040 DEBUG
[dispatcher-event-loop-0] scheduler.TaskSetManager: No tasks for locality
level NODE_LOCAL, so moving to locality level RACK_LOCAL2020-09-17
01:21:50,041 DEBUG [dispatcher-event-loop-0] scheduler.TaskSetManager: No
tasks for locality level RACK_LOCAL, so moving to locality level
ANY2020-09-17 01:21:50,042 DEBUG [dispatcher-event-loop-0]
cluster.YarnSchedulerBackend$YarnDriverEndpoint: Launching task 13 on
executor id: 6 hostname:
wn1-vegasr.r0erhw3gxezevknl0vbc42vctb.dx.internal.cloudapp.net.



--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

Reply via email to