Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r190429348
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
---
@@ -249,6 +259,10 @@ private[spark] class Client(
val capability = Records.newRecord(classOf[Resource])
capability.setMemory(amMemory + amMemoryOverhead)
capability.setVirtualCores(amCores)
+ if (amResources.nonEmpty) {
--- End diff --
So the goal of my original comments was to avoid noisy logs. There were too
many before, and there is none now. Neither is a good place to be.
You want to log a warning message if the user is setting these properties
but the YARN libraries don't support the feature.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
