Igor Calabria created SUBMARINE-705:
---------------------------------------
Summary: Unable to run tests in spark-security with spark-3.0 +
hadoop-3.2 profiles
Key: SUBMARINE-705
URL: https://issues.apache.org/jira/browse/SUBMARINE-705
Project: Apache Submarine
Issue Type: Bug
Components: Security
Reporter: Igor Calabria
{code:java}
mvn -pl :submarine-spark-security clean test -Pranger-2.0 -Pspark-3.0
-Phadoop-3.2
{code}
Fails withÂ
{code:java}
*** RUN ABORTED ***
java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338)
at
org.apache.spark.deploy.SparkHadoopUtil$.org$apache$spark$deploy$SparkHadoopUtil$$appendS3AndSparkHadoopHiveConfigurations(SparkHadoopUtil.scala:456)
at
org.apache.spark.deploy.SparkHadoopUtil$.newConfiguration(SparkHadoopUtil.scala:427)
at
org.apache.spark.deploy.SparkHadoopUtil.newConfiguration(SparkHadoopUtil.scala:122)
at org.apache.spark.deploy.SparkHadoopUtil.<init>(SparkHadoopUtil.scala:49)
at
org.apache.spark.deploy.SparkHadoopUtil$.instance$lzycompute(SparkHadoopUtil.scala:397)
at
org.apache.spark.deploy.SparkHadoopUtil$.instance(SparkHadoopUtil.scala:397)
at org.apache.spark.deploy.SparkHadoopUtil$.get(SparkHadoopUtil.scala:418)
at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:95){code}
This is most likely caused by a guava version conflict
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
