dongjoon-hyun commented on PR #43328: URL: https://github.com/apache/spark/pull/43328#issuecomment-1767538421
To @yaooqinn , > Also, RELAUNCHING might be considered as Waiting too I tested the `RELAUNCHING` case by killing a worker and realized that I was confused. It's in `Completed Drivers` instead of `Running Drivers` because it's used by `removeDriver`. https://github.com/apache/spark/blob/0cb4a84f6ab0c1bd101e6bc72be82987bbc02e9b/core/src/main/scala/org/apache/spark/deploy/master/Master.scala#L995 ``` 23/10/17 19:46:35 INFO Master: Telling app of lost executor: 0 23/10/17 19:46:35 INFO Master: Re-launching driver-20231017194619-0005 23/10/17 19:46:35 INFO Master: Removing driver: driver-20231017194619-0005 23/10/17 19:46:35 INFO Master: Start scheduling for app app-20231017194620-0005 with rpId: 0 23/10/17 19:46:35 WARN Master: App app-20231017194620-0005 requires more resource than any of Workers could have. 23/10/17 19:46:35 WARN Master: Driver driver-20231017194635-0006 requires more resource than any of Workers could have. 23/10/17 19:46:35 INFO Master: Start scheduling for app app-20231017194620-0005 with rpId: 0 23/10/17 19:46:35 WARN Master: App app-20231017194620-0005 requires more resource than any of Workers could have. 23/10/17 19:46:35 INFO Master: Telling app of lost worker: worker-20231017194525-127.0.0.1-56936 23/10/17 19:46:35 WARN Master: Driver driver-20231017194635-0006 requires more resource than any of Workers could have. 23/10/17 19:46:35 INFO Master: Start scheduling for app app-20231017194620-0005 with rpId: 0 23/10/17 19:46:35 WARN Master: App app-20231017194620-0005 requires more resource than any of Workers could have. 23/10/17 19:46:35 INFO Master: Received unregister request from application app-20231017194620-0005 ``` I'll make a follow-up of this PR (SPARK-45500) instead of - #43007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
