[
https://issues.apache.org/jira/browse/KYLIN-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17323787#comment-17323787
]
Gaurav Rawat commented on KYLIN-4976:
-------------------------------------
yes did follow the instructions there is no error on the UI though but I see
this error in the logs , The build job now has been running since 652 mins ..
As I am using emr **6.0** with **hadoop 3.2.1-amzn-0v I had used
spark-**2.4.7-bin-without-hadoop-scala-2.12.tgz** for kylin though I am not
sure why cant we use the existing emr spark version **2.4.7**
> error java.lang.NoSuchMethodError:
> scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object; while
> building sample cube
> -------------------------------------------------------------------------------------------------------------------------------
>
> Key: KYLIN-4976
> URL: https://issues.apache.org/jira/browse/KYLIN-4976
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v4.0.0-beta
> Reporter: Gaurav Rawat
> Priority: Blocker
>
> running kylin 4.0.0 and when building the sample cube get the below error on
> spark 2.4.6 EMR 6.0.0
>
> {code:java}
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : Exception
> in thread "main" java.lang.NoSuchMethodError:
> scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object;
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.deploy.SparkSubmitUtils$.parseSparkConfProperty(SparkSubmit.scala:1331)
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.deploy.SparkSubmitArguments.handle(SparkSubmitArguments.scala:448)
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.launcher.SparkSubmitOptionParser.parse(SparkSubmitOptionParser.java:163)
> 2021-04-16 02:03:59,074 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.deploy.SparkSubmitArguments.<init>(SparkSubmitArguments.scala:109)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.deploy.SparkSubmit$$anon$2$$anon$3.<init>(SparkSubmit.scala:907)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.deploy.SparkSubmit$$anon$2.parseArguments(SparkSubmit.scala:907)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:81)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
> 2021-04-16 02:03:59,075 INFO [Scheduler 866535267 Job
> 6122e04d-ee8d-41ec-acee-bc44429fc437-49] job.NSparkExecutable:41 : at
> org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
