[
https://issues.apache.org/jira/browse/SPARK-31946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130015#comment-17130015
]
wuyi commented on SPARK-31946:
------------------------------
oh, I mean, for the **decommission** feature, we should register someone signal
successfully. Otherwise, the decommissioning will not be triggered as expected
later.
If the POSIX compliant signal doesn't work, then, we may need to use another
signal which works for both Linux and macOS(not sure for Windows).
> Failed to register SIGPWR handler on MacOS
> ------------------------------------------
>
> Key: SPARK-31946
> URL: https://issues.apache.org/jira/browse/SPARK-31946
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Affects Versions: 3.1.0
> Environment: macOS 10.14.6
> Reporter: wuyi
> Priority: Major
>
>
> {code:java}
> 20/06/09 22:54:54 WARN SignalUtils: Failed to register SIGPWR handler -
> disabling decommission feature.
> java.lang.IllegalArgumentException: Unknown signal: PWR
> at sun.misc.Signal.<init>(Signal.java:143)
> at
> org.apache.spark.util.SignalUtils$.$anonfun$register$1(SignalUtils.scala:83)
> at scala.collection.mutable.HashMap.getOrElseUpdate(HashMap.scala:86)
> at org.apache.spark.util.SignalUtils$.register(SignalUtils.scala:81)
> at
> org.apache.spark.executor.CoarseGrainedExecutorBackend.onStart(CoarseGrainedExecutorBackend.scala:86)
> at org.apache.spark.rpc.netty.Inbox.$anonfun$process$1(Inbox.scala:120)
> at org.apache.spark.rpc.netty.Inbox.safelyCall(Inbox.scala:203)
> at org.apache.spark.rpc.netty.Inbox.process(Inbox.scala:100)
> at
> org.apache.spark.rpc.netty.MessageLoop.org$apache$spark$rpc$netty$MessageLoop$$receiveLoop(MessageLoop.scala:75)
> at
> org.apache.spark.rpc.netty.MessageLoop$$anon$1.run(MessageLoop.scala:41)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> {code}
> Seem like MacOS is *POSIX* compliant. But SIGPWR is not specified in the
> *POSIX* specification. See [https://en.wikipedia.org/wiki/Signal_(IPC)#SIGPWR]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
