Jia Yu created SEDONA-534:
-----------------------------
Summary: Disable Python warning message of finding jars
Key: SEDONA-534
URL: https://issues.apache.org/jira/browse/SEDONA-534
Project: Apache Sedona
Issue Type: Bug
Reporter: Jia YuSedona Python tries to find what jars are used. However, if a user puts a jar in SPARK_HOME/jars directly, this will give annoying warning message ``` WARNING root:config.py:160 Failed to get the value of spark.jars from SparkConf: An error occurred while calling o132.get. [443|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:444]: java.util.NoSuchElementException: spark.jars [444|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:445] at org.apache.spark.sql.errors.QueryExecutionErrors$.noSuchElementExceptionError(QueryExecutionErrors.scala:1660) [445|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:446] at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:4546) [446|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:447] at scala.Option.getOrElse(Option.scala:189) [447|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:448] at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:4546) [448|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:449] at org.apache.spark.sql.RuntimeConfig.get(RuntimeConfig.scala:72) [449|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:450] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [450|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:451] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [451|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:452] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [452|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:453] at java.lang.reflect.Method.invoke(Method.java:498) [453|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:454] at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) [454|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:455] at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357) [455|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:456] at py4j.Gateway.invoke(Gateway.java:282) [456|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:457] at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) [457|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:458] at py4j.commands.CallCommand.execute(CallCommand.java:79) [458|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:459] at py4j.ClientServerConnection.waitForCommands(ClientServerConnection.java:182) [459|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:460] at py4j.ClientServerConnection.run(ClientServerConnection.java:106) [460|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:461] at java.lang.Thread.run(Thread.java:750) [461|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:462] [462|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:463]WARNING root:config.py:160 Failed to get the value of spark.yarn.dist.jars from SparkConf: An error occurred while calling o132.get. [463|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:464]: java.util.NoSuchElementException: spark.yarn.dist.jars [464|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:465] at org.apache.spark.sql.errors.QueryExecutionErrors$.noSuchElementExceptionError(QueryExecutionErrors.scala:1660) [465|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:466] at org.apache.spark.sql.internal.SQLConf.$anonfun$getConfString$3(SQLConf.scala:4546) [466|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:467] at scala.Option.getOrElse(Option.scala:189) [467|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:468] at org.apache.spark.sql.internal.SQLConf.getConfString(SQLConf.scala:4546) [468|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:469] at org.apache.spark.sql.RuntimeConfig.get(RuntimeConfig.scala:72) [469|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:470] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [470|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:471] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [471|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:472] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [472|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:473] at java.lang.reflect.Method.invoke(Method.java:498) [473|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:474] at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) [474|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:475] at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357) [475|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:476] at py4j.Gateway.invoke(Gateway.java:282) [476|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:477] at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) [477|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:478] at py4j.commands.CallCommand.execute(CallCommand.java:79) [478|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:479] at py4j.ClientServerConnection.waitForCommands(ClientServerConnection.java:182) [479|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:480] at py4j.ClientServerConnection.run(ClientServerConnection.java:106) [480|https://github.com/apache/sedona/actions/runs/8748611247/job/24008937714?pr=1343#step:16:481] at java.lang.Thread.run(Thread.java:750) ``` -- This message was sent by Atlassian Jira (v8.20.10#820010)
