Github user peterableda commented on a diff in the pull request:
https://github.com/apache/spark/pull/13552#discussion_r66217380
--- Diff:
yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala ---
@@ -353,7 +353,7 @@ private[yarn] class YarnAllocator(
} else if (missing < 0) {
val numToCancel = math.min(numPendingAllocate, -missing)
- logInfo(s"Canceling requests for $numToCancel executor containers")
+ logInfo(s"Canceled requests for $numToCancel executor container(s)")
--- End diff --
No it already did. Follow the messages:
16/06/07 18:53:48 INFO yarn.YarnAllocator: Driver requested a total number
of 619 executor(s).
16/06/07 18:53:48 INFO yarn.YarnAllocator: Canceling requests for 4
executor containers
16/06/07 18:53:48 INFO yarn.YarnAllocator: Driver requested a total number
of 614 executor(s).
16/06/07 18:53:48 INFO yarn.YarnAllocator: Canceling requests for 5
executor containers
So: 619 - 5 = 614
The Cancel msg is coming after the executors are already canceled and we
already logged the new requested a total number.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
