Re: NoClassDefFoundError: scala/Product$class

The org.bdgenomics.adam is one of the Components of the GATK, and I just download the release version from its github website . However, when I build a new docker image with spark2.4.5 and scala 2.12.4,It works well and that makes me confused. root@master2:~# pyspark Python 2.7.17 (default,

Re: NoClassDefFoundError: scala/Product$class

How are you depending on that org.bdgenomics.adam library? Maybe you're pulling the 2.11 version of that.

Re: NoClassDefFoundError: scala/Product$class

Spark 3 supports only Scala 2.12. This actually sounds like third party library is compiled for 2.11 or something. On Fri, Jun 5, 2020 at 11:11 PM charles_cai <1620075...@qq.com> wrote: > Hi Pol, > > thanks for your suggestion, I am going to use Spark-3.0.0 for GPU > acceleration,so I update the

Re: NoClassDefFoundError: scala/Product$class

Hi Pol, thanks for your suggestion, I am going to use Spark-3.0.0 for GPU acceleration,so I update the scala to the *version 2.12.11* and the latest *2.13* ,but the error is still there, and by the way , the Spark version is *spark-3.0.0-preview2-bin-without-hadoop* Caused by:

Re: NoClassDefFoundError: scala/Product$class

Hi Charles, I believe Spark 3.0 removed the support for Scala 2.11, and that error is a version compatibility issue. You should try Spark 2.4.5 with your current setup (works with Scala 2.11 by default). Pol Santamaria On Wed, Jun 3, 2020 at 7:44 AM charles_cai <1620075...@qq.com> wrote: > Hi,

Re: NoClassDefFoundError

You better ask folks in the spark-jobserver gitter channel: https://github.com/spark-jobserver/spark-jobserver On Wed, Dec 21, 2016 at 8:02 AM, Reza zade wrote: > Hello > > I've extended the JavaSparkJob (job-server-0.6.2) and created an object > of SQLContext class. my

Re: NoClassDefFoundError: org/apache/spark/Logging in SparkSession.getOrCreate

Not sure why your code will search Logging class under org/apache/spark, this should be “org/apache/spark/internal/Logging”, and it changed long time ago. On Sun, Oct 16, 2016 at 3:25 AM, Brad Cox wrote: > I'm experimenting with Spark 2.0.1 for the first time and hitting a

Re: NoClassDefFoundError with ZonedDateTime

Which version of Java 8 do you use? AFAIK, it's recommended to exploit Java 1.8_0.66 + On Fri, Jul 22, 2016 at 8:49 PM, Jacek Laskowski wrote: > On Fri, Jul 22, 2016 at 6:43 AM, Ted Yu wrote: > > You can use this command (assuming log aggregation is turned

Re: NoClassDefFoundError with ZonedDateTime

On Fri, Jul 22, 2016 at 6:43 AM, Ted Yu wrote: > You can use this command (assuming log aggregation is turned on): > > yarn logs --applicationId XX I don't think it's gonna work for already-running application (and I wish I were mistaken since I needed it just yesterday) and

Re: NoClassDefFoundError with ZonedDateTime

You can use this command (assuming log aggregation is turned on): yarn logs --applicationId XX In the log, you should see snippet such as the following: java.class.path=... FYI On Thu, Jul 21, 2016 at 9:38 PM, Ilya Ganelin wrote: > what's the easiest way to get the

Re: NoClassDefFoundError with ZonedDateTime

what's the easiest way to get the Classpath for the spark application itself? On Thu, Jul 21, 2016 at 9:37 PM Ted Yu wrote: > Might be classpath issue. > > Mind pastebin'ning the effective class path ? > > Stack trace of NoClassDefFoundError may also help provide some clue.

Re: NoClassDefFoundError with ZonedDateTime

Might be classpath issue. Mind pastebin'ning the effective class path ? Stack trace of NoClassDefFoundError may also help provide some clue. On Thu, Jul 21, 2016 at 8:26 PM, Ilya Ganelin wrote: > Hello - I'm trying to deploy the Spark TimeSeries library in a new >

Re: NoClassDefFoundError: scala/collection/GenTraversableOnce$class

You can generate dependency tree using: mvn dependency:tree and grep for 'org.scala-lang' in the output to see if there is any clue. Cheers On Wed, Jul 29, 2015 at 5:14 PM, Benjamin Ross br...@lattice-engines.com wrote: Hello all, I’m new to both spark and scala, and am running into an

RE: NoClassDefFoundError: scala/collection/GenTraversableOnce$class

@spark.apache.org Subject: Re: NoClassDefFoundError: scala/collection/GenTraversableOnce$class You can generate dependency tree using: mvn dependency:tree and grep for 'org.scala-lang' in the output to see if there is any clue. Cheers On Wed, Jul 29, 2015 at 5:14 PM, Benjamin Ross br...@lattice

Re: NoClassDefFoundError when trying to run spark application

do you assemble the uber jar ? you can use sbt assembly to build the jar and then run. It should fix the issue -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/NoClassDefFoundError-when-trying-to-run-spark-application-tp20707p20944.html Sent from the Apache

Re: NoClassDefFoundError

See the following threads: http://search-hadoop.com/m/JW1q5kjNlK http://search-hadoop.com/m/JW1q5XqSDk Cheers On Sun, Dec 7, 2014 at 9:35 AM, Julius K fooliuskool...@gmail.com wrote: Hi everyone, I am new to Spark and encountered a problem. I want to use an external library in a java

Re: NoClassDefFoundError encountered in Spark 1.2-snapshot build with hive-0.13.1 profile

Hi Terry I think the issue you mentioned will be resolved by following PR. https://github.com/apache/spark/pull/3072 - Kousuke (2014/11/03 10:42), Terry Siu wrote: I just built the 1.2 snapshot current as of commit 76386e1a23c using: $ ./make-distribution.sh —tgz —name my-spark

Re: NoClassDefFoundError encountered in Spark 1.2-snapshot build with hive-0.13.1 profile

@spark.apache.orgmailto:user@spark.apache.org user@spark.apache.orgmailto:user@spark.apache.org Subject: Re: NoClassDefFoundError encountered in Spark 1.2-snapshot build with hive-0.13.1 profile Hi Terry I think the issue you mentioned will be resolved by following PR. https://github.com/apache/spark

Re: NoClassDefFoundError encountered in Spark 1.2-snapshot build with hive-0.13.1 profile

terry@smartfocus.com, user@spark.apache.org user@spark.apache.org Subject: Re: NoClassDefFoundError encountered in Spark 1.2-snapshot build with hive-0.13.1 profile Hi Terry I think the issue you mentioned will be resolved by following PR. https://github.com/apache/spark/pull/3072

Re: NoClassDefFoundError on ThreadFactoryBuilder in Intellij

I had an offline with Akhil, but this issue is still not resolved. 2014-10-24 0:18 GMT-07:00 Akhil Das ak...@sigmoidanalytics.com: Make sure the guava jar http://mvnrepository.com/artifact/com.google.guava/guava/12.0 is present in the classpath. Thanks Best Regards On Thu, Oct 23, 2014

Re: NoClassDefFoundError on ThreadFactoryBuilder in Intellij

I have checked out from master, cleaned/rebuilt on command line in maven, then cleaned/rebuilt in intellij many times. This error persists through it all. Anyone have a solution? 2014-10-23 1:43 GMT-07:00 Stephen Boesch java...@gmail.com: After having checked out from master/head the

Re: NoClassDefFoundError on ThreadFactoryBuilder in Intellij

Make sure the guava jar http://mvnrepository.com/artifact/com.google.guava/guava/12.0 is present in the classpath. Thanks Best Regards On Thu, Oct 23, 2014 at 2:13 PM, Stephen Boesch java...@gmail.com wrote: After having checked out from master/head the following error occurs when attempting

Re: NoClassDefFoundError: org/codehaus/jackson/annotate/JsonClass with spark-submit

By the way, for anyone using elasticsearch-hadoop, there is a fix for this here: https://github.com/elasticsearch/elasticsearch-hadoop/issues/239 Ryan - using the nightly snapshot build of 2.1.0.BUILD-SNAPSHOT fixed this for me. On Thu, Aug 7, 2014 at 3:58 PM, Nick Pentreath

Re: NoClassDefFoundError: org/codehaus/jackson/annotate/JsonClass with spark-submit

I'm also getting this - Ryan we both seem to be running into this issue with elasticsearch-hadoop :) I tried spark.files.userClassPathFirst true on command line and that doesn;t work If I put it that line in spark/conf/spark-defaults it works but now I'm getting: java.lang.NoClassDefFoundError: