[
https://issues.apache.org/jira/browse/HDDS-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130482#comment-17130482
]
Marton Elek commented on HDDS-3764:
-----------------------------------
Sure, I merged it. Yes, it seems to be duplicate (Spark uses Hadoop 2.7.4 by
default).
Will retest spark with your patch and close this issue.
> Spark is failing with no such method exception
> ----------------------------------------------
>
> Key: HDDS-3764
> URL: https://issues.apache.org/jira/browse/HDDS-3764
> Project: Hadoop Distributed Data Store
> Issue Type: Sub-task
> Components: build
> Reporter: Marton Elek
> Assignee: Marton Elek
> Priority: Critical
>
> When I tested the existing documentation (Spark + Kubernetes) I found that
> Spark (default distribution with Hadoop 2.7) is failing with NoSuchMethod
> exception:
> {code:java}
> Exception in thread "main" org.apache.spark.SparkException: Job aborted due
> to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure:
> Lost task 0.3 in stage 0.0 (TID 3, 10.42.0.169, executor 1):
> java.lang.NoSuchMethodError: org.apache.hadoop.util.Time.monotonicNowNanos()J
> at
> org.apache.hadoop.hdds.scm.XceiverClientGrpc.sendCommandAsync(XceiverClientGrpc.java:437)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
