subject:"java.lang.ClassNotFoundException"

Re: java.lang.ClassNotFoundException for s3a comitter

2020-07-21 Thread Gourav Sengupta

garding the mixing of Hadoop jars, this >> does not address the java.lang.ClassNotFoundException. >> >> Prebuilt Apache Spark 3.0 builds are only available for Hadoop 2.7 or >> Hadoop 3.2. Not Hadoop 3.1. >> > > sorry, I should have been clearer. Hadoop 3.2.x

Re: java.lang.ClassNotFoundException for s3a comitter

2020-07-21 Thread Steve Loughran

On Tue, 7 Jul 2020 at 03:42, Stephen Coy wrote: > Hi Steve, > > While I understand your point regarding the mixing of Hadoop jars, this > does not address the java.lang.ClassNotFoundException. > > Prebuilt Apache Spark 3.0 builds are only available for Hadoop 2.7 or > Hadoo

Re: java.lang.ClassNotFoundException for s3a comitter

2020-07-06 Thread Stephen Coy

Hi Steve, While I understand your point regarding the mixing of Hadoop jars, this does not address the java.lang.ClassNotFoundException. Prebuilt Apache Spark 3.0 builds are only available for Hadoop 2.7 or Hadoop 3.2. Not Hadoop 3.1. The only place that I have found that missing class

Re: java.lang.ClassNotFoundException for s3a comitter

2020-06-29 Thread Steve Loughran

migdisoglu wrote: > Hi all > I've upgraded my test cluster to spark 3 and change my comitter to > directory and I still get this error.. The documentations are somehow > obscure on that. > Do I need to add a third party jar to support new comitters? > > java.lang.C

Re: java.lang.ClassNotFoundException for s3a comitter

2020-06-18 Thread Stephen Coy

ll get this error.. The documentations are somehow obscure on that. Do I need to add a third party jar to support new comitters? java.lang.ClassNotFoundException: org.apache.spark.internal.io.cloud.PathOutputCommitProtocol On Thu, Jun 18, 2020 at 1:35 AM murat migdisoglu mailto:murat.migdiso...@gma

Re: java.lang.ClassNotFoundException for s3a comitter

2020-06-18 Thread murat migdisoglu

Hi all I've upgraded my test cluster to spark 3 and change my comitter to directory and I still get this error.. The documentations are somehow obscure on that. Do I need to add a third party jar to support new comitters? java.lang.ClassNotFoundException

java.lang.ClassNotFoundException: com.hortonworks.spark.cloud.commit.PathOutputCommitProtoco

2020-06-17 Thread murat migdisoglu

Hello all, we have a hadoop cluster (using yarn) using s3 as filesystem with s3guard is enabled. We are using hadoop 3.2.1 with spark 2.4.5. When I try to save a dataframe in parquet format, I get the following exception: java.lang.ClassNotFoundException

User class threw exception: java.lang.ClassNotFoundException: Failed to find data source: kafka. Please find packages at http://spark.apache.org/third-party-projects.html

2018-04-27 Thread amit kumar singh

Hi Team, I am working on structured streaming i have added all libraries in build,sbt then also its not picking up right library an failing with error User class threw exception: java.lang.ClassNotFoundException: Failed to find data source: kafka. Please find packages at http://spark.apache.org

Re: Spark Streaming - java.lang.ClassNotFoundException Scala anonymous function

2017-03-01 Thread Dominik Safaric

cheduler.scala:1422) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > > Caused by: java.lang.ClassNotFoundException: > topology.SimpleProcess

Re: Spark Streaming - java.lang.ClassNotFoundException Scala anonymous function

2017-03-01 Thread Sean Owen

org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > at > org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) > Caused by: java.lang.ClassNotFoundException: > topology.SimpleProcess

Spark Streaming - java.lang.ClassNotFoundException Scala anonymous function

2017-03-01 Thread Dominik Safaric

$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:802) Caused by: java.lang.ClassNotFoundException: topology.SimpleProcessingTopology$$anonfun$main$1$$anonfun$apply$1 at java.net.URLClassLoader.findClass

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

2017-02-26 Thread Marco Mistroni

efore and solved it by removing --jars. >>>>>> >>>>>> Cheers, >>>>>> Anahita >>>>>> >>>>>> On Saturday, February 25, 2017, Raymond Xie <xie3208...@gmail.com> >>>>>> wrote: >>>>

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

2017-02-25 Thread Marco Mistroni

p2.7.3.2.5.0.0-1245.jar >>>> /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar >>>> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >>>> >>>> Error: >>>> No main class set in JAR; please specify one with --class >

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

2017-02-25 Thread Raymond Xie

ox and am stuck >>>>> here now, can anyone tell me what's wrong with the following code and the >>>>> exception it causes and how do I fix it? Thank you very much in advance. >>>>> >>>>> spark-submit --jars /usr/hdp/2.5.0.0-1245/spark/li &g

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

2017-02-25 Thread Raymond Xie

245/spark/li >>>> b/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >>>> /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar >>>> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >>>> >>>> Erro

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

2017-02-25 Thread Anahita Talebi

1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar >>> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >>> >>> Error: >>> No main class set in JAR; please specify one with --class >>> >>> >>> spark-submit --class /usr/hdp/2.

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

2017-02-25 Thread Raymond Xie

assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar >> /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar >> /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test >> >> Error: >> java.lang.ClassNotFoundException: /usr/hdp/2.5.0.0-1245/spark/li >&

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

2017-02-25 Thread Anahita Talebi

with --class > > > spark-submit --class /usr/hdp/2.5.0.0-1245/spark/ > lib/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar > /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar > /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test > > E

Re: No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

2017-02-25 Thread yohann jardin

0-1245-hadoop2.7.3.2.5.0.0-1245.jar /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar /root/hdp/kafka_wordcount.py 192.168.128.119:2181<http://192.168.128.119:2181> test Error: java.lang.ClassNotFoundException: /usr/hdp/2.5.0.0-1245/spark/lib/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2

No main class set in JAR; please specify one with --class and java.lang.ClassNotFoundException

2017-02-25 Thread Raymond Xie

-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0-1245.jar /usr/hdp/2.5.0.0-1245/kafka/libs/kafka-streams-0.10.0.2.5.0.0-1245.jar /root/hdp/kafka_wordcount.py 192.168.128.119:2181 test Error: java.lang.ClassNotFoundException: /usr/hdp/2.5.0.0-1245/spark/lib/spark-assembly-1.6.2.2.5.0.0-1245-hadoop2.7.3.2.5.0.0

Re: java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession$ . Please Help!!!!!!!

2016-11-04 Thread shyla deshpande

I feel so good that Holden replied. Yes, that was the problem. I was running from Intellij, I removed the provided scope and works great. Thanks a lot. On Fri, Nov 4, 2016 at 2:05 PM, Holden Karau wrote: > It seems like you've marked the spark jars as provided, in this

Re: java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession$ . Please Help!!!!!!!

2016-11-04 Thread Holden Karau

It seems like you've marked the spark jars as provided, in this case they would only be provided you run your application with spark-submit or otherwise have Spark's JARs on your class path. How are you launching your application? On Fri, Nov 4, 2016 at 2:00 PM, shyla deshpande

java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession$ . Please Help!!!!!!!

2016-11-04 Thread shyla deshpande

object App { import org.apache.spark.sql.functions._ import org.apache.spark.sql.SparkSession def main(args : Array[String]) { println( "Hello World!" ) val sparkSession = SparkSession.builder. master("local") .appName("spark session example") .getOrCreate() }

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Siva A

gt;>>> I added spark-xml jar and now I ended up into this dependency >>>>>>> >>>>>>> 6/06/17 15:15:57 INFO BlockManagerMaster: Registered BlockManager >>>>>>> Exception in thread "main" *java.

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread VG

un from IDE and everything else is working fine. >>>>>>> I added spark-xml jar and now I ended up into this dependency >>>>>>> >>>>>>> 6/06/17 15:15:57 INFO BlockManagerMaster: Registered BlockManager >>>>>>> Exception in thread

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread VG

: Registered BlockManager >>>>>> Exception in thread "main" *java.lang.NoClassDefFoundError: >>>>>> scala/collection/GenTraversableOnce$class* >>>>>> at >>>>>> org.apache.spark.sql.execution.datasources.CaseInsensitiveMap.(d

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Siva A

>> org.apache.spark.sql.execution.datasources.CaseInsensitiveMap.(ddl.scala:150) >>>>> at >>>>> org.apache.spark.sql.execution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:154) >>>>> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:119) >>

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Marco Mistroni

apache.spark.sql.execution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:154) >>>> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:119) >>>> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:109) >>>> at org.a

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Siva A

.CaseInsensitiveMap.(ddl.scala:150) >>>> at >>>> org.apache.spark.sql.execution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:154) >>>> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:119) >>>> at org.apache.spark.sql.DataFrameRe

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread VG

rces.CaseInsensitiveMap.(ddl.scala:150) >>> at >>> org.apache.spark.sql.execution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:154) >>> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:119) >>> at or

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Siva A

olvedDataSource.scala:154) >> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:119) >> at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:109) >> at org.ariba.spark.PostsProcessing.main(PostsProcessing.java:19) >> Caused by:* java.lang.ClassNotFoundException: >> scala.collectio

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Siva A

xecution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:154) > at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:119) > at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:109) > at org.ariba.spark.PostsProcessing.main(PostsProcessing.

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread VG

eader.load(DataFrameReader.scala:109) at org.ariba.spark.PostsProcessing.main(PostsProcessing.java:19) Caused by:* java.lang.ClassNotFoundException: scala.collection.GenTraversableOnce$class* at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoade

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread VG

Hi Siva, I still get a similar exception (See the highlighted section - It is looking for DataSource) 16/06/17 15:11:37 INFO BlockManagerMaster: Registered BlockManager Exception in thread "main" java.lang.ClassNotFoundException: Failed to find data source: xml. Please find packag

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Marco Mistroni

Apologies for that. > I am trying to use spark-xml to load data of a xml file. > > here is the exception > > 16/06/17 14:49:04 INFO BlockManagerMaster: Registered BlockManager > Exception in thread "main" java.lang.ClassNotFoundException: Failed to > find data s

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Siva A

e. >> >> here is the exception >> >> 16/06/17 14:49:04 INFO BlockManagerMaster: Registered BlockManager >> Exception in thread "main" java.lang.ClassNotFoundException: Failed to >> find data source: org.apache.spark.xml. Please

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Siva A

thub.com/databricks/spark-xml --Siva On Fri, Jun 17, 2016 at 2:50 PM, VG <vlin...@gmail.com> wrote: > Apologies for that. > I am trying to use spark-xml to load data of a xml file. > > here is the exception > > 16/06/17 14:49:04 INFO BlockManagerMaster: Registered BlockMan

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread VG

Apologies for that. I am trying to use spark-xml to load data of a xml file. here is the exception 16/06/17 14:49:04 INFO BlockManagerMaster: Registered BlockManager Exception in thread "main" java.lang.ClassNotFoundException: Failed to find data source: org.apache.spark.xml. P

Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread Marco Mistroni

too little info it'll help if you can post the exception and show your sbt file (if you are using sbt), and provide minimal details on what you are doing kr On Fri, Jun 17, 2016 at 10:08 AM, VG wrote: > Failed to find data source: com.databricks.spark.xml > > Any suggestions

java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org

2016-06-17 Thread VG

Failed to find data source: com.databricks.spark.xml Any suggestions to resolve this

Re: ERROR TaskResultGetter: Exception while getting task result java.io.IOException: java.lang.ClassNotFoundException: scala.Some

2016-06-16 Thread Jacek Laskowski

Hi, Why do you provided spark-core while the others are non-provided? How do you assemble the app? How do you submit it for execution? What's the deployment environment? More info...more info... Jacek On 15 Jun 2016 10:26 p.m., "S Sarkar" wrote: Hello, I built

Re: [scala-user] ERROR TaskResultGetter: Exception while getting task result java.io.IOException: java.lang.ClassNotFoundException: scala.Some

2016-06-16 Thread Oliver Ruebenacker

Hello, It would be useful to see the code that throws the exception. It probably means that the Scala standard library is not being uploaded to the executers. Try adding the Scala standard library to the SBT file ("org.scala-lang" % "scala-library" % "2.10.3"), or check your configuration.

ERROR TaskResultGetter: Exception while getting task result java.io.IOException: java.lang.ClassNotFoundException: scala.Some

2016-06-15 Thread S Sarkar

Hello, I built package for a spark application with the following sbt file: name := "Simple Project" version := "1.0" scalaVersion := "2.10.3" libraryDependencies ++= Seq( "org.apache.spark" %% "spark-core" % "1.4.0" % "provided", "org.apache.spark" %% "spark-mllib"

Re: Analyzing json Data streams using sparkSQL in spark streaming returns java.lang.ClassNotFoundException

2016-03-08 Thread Tristan Nixon

" + jsonElements.collect().size()); > > final SQLContext sqlContext = > JavaSQLContextSingleton.getInstance(rdd.context()); > > final DataFrame dfJsonElement = sqlContext.read().json(jsonElements); > > executeSQLOperations(sqlContext, dfJsonElem

Analyzing json Data streams using sparkSQL in spark streaming returns java.lang.ClassNotFoundException

2016-03-08 Thread Nesrine BEN MUSTAPHA

rdd.context());* *final DataFrame dfJsonElement = sqlContext.read().json(jsonElements); * *executeSQLOperations(sqlContext, dfJsonElement);* *});* *streamCtx.start();* *streamCtx.awaitTermination();* *}* I got the following error when the red lin

starting start-master.sh throws "java.lang.ClassNotFoundException: org.slf4j.Logger" error

2015-11-26 Thread Mich Talebzadeh

Hi, I just built spark without hive jars and trying to run start-master.sh I get this error in the log. Sounds like it cannot find java.lang.ClassNotFoundException: org.slf4j.Logger Spark Command: /usr/java/latest/bin/java -cp /usr/lib/spark/sbin/../conf/:/usr/lib/spark/lib/spark

Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver

2015-11-09 Thread Tathagata Das

>> > 0.0.1-SNAPSHOT >>>>> > >>>>> > >>>>> > >>>>> > org.apache.spark >>>>> > spark-core_2.10 >>>>> > 1.5.1 >>

Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver

2015-11-09 Thread DW @ Gmail

SNAPSHOT >>>>>> > >>>>>> > >>>>>> > >>>>>> > org.apache.spark >>>>>> > spark-core_2.10 >>>>>> > 1.5.1 >>>&

Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver

2015-11-09 Thread أنس الليثي

>>>> > >>>> > >>>> > org.apache.spark >>>> > spark-streaming_2.10 >>>> > 1.5.1 >>>> > provided >>>> >

Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver

2015-11-09 Thread Tathagata Das

; twitter4j-stream >>> > 3.0.3 >>> > >>> > >>> > org.apache.spark >>> > spark-streaming-twitter_2.10 >>> > 1.0.0 >>> >

Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver

2015-11-09 Thread أنس الليثي

;> > org.apache.spark >> > spark-streaming-twitter_2.10 >> > 1.0.0 >> > >> > >> > >> > >> > >> > src >> > >> > &g

java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver

2015-11-08 Thread fanooos

comes and this exception is thrown 15/11/08 15:55:46 WARN TaskSetManager: Lost task 0.0 in stage 4.0 (TID 78, 192.168.122.39): java.io.IOException: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver at org.apache.spark.util.Utils$.tryOrIOException(Utils

Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver

2015-11-08 Thread Sean Owen

> > > > com.test.sparkTest.SimpleApp > > > > jar-with-dependencies > >

java.lang.ClassNotFoundException

2015-08-08 Thread Yasemin Kaya

/spark-submit --class MonthlyAverage --master local[4] weather.jar java.lang.ClassNotFoundException: MonthlyAverage at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method

Re: java.lang.ClassNotFoundException

2015-08-08 Thread Ted Yu

am using spark 1.3 Submitting : bin/spark-submit --class MonthlyAverage --master local[4] weather.jar error: ~/spark-1.3.1-bin-hadoop2.4$ bin/spark-submit --class MonthlyAverage --master local[4] weather.jar java.lang.ClassNotFoundException: MonthlyAverage

Re: java.lang.ClassNotFoundException

2015-08-08 Thread Yasemin Kaya

java.lang.ClassNotFoundException: MonthlyAverage at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354

Re: Strange JavaDeserialization error - java.lang.ClassNotFoundException: org/apache/spark/storage/StorageLevel

2015-03-27 Thread Ondrej Smola

: Error while invoking RpcHandler#receive() on RPC id 7178767328921933569 java.lang.ClassNotFoundException: org/apache/spark/storage/StorageLevel at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:344) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1

Re: Strange JavaDeserialization error - java.lang.ClassNotFoundException: org/apache/spark/storage/StorageLevel

2015-03-27 Thread Ondrej Smola

java.lang.ClassNotFoundException: org/apache/spark/storage/StorageLevel at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:344) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:65) at java.io.ObjectInputStream.readNonProxyDesc

Re: Strange JavaDeserialization error - java.lang.ClassNotFoundException: org/apache/spark/storage/StorageLevel

2015-03-27 Thread Ondrej Smola

java.lang.ClassNotFoundException: org/apache/spark/storage/StorageLevel at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:344) at org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:65

Re: Strange JavaDeserialization error - java.lang.ClassNotFoundException: org/apache/spark/storage/StorageLevel

2015-03-27 Thread Tathagata Das

broadcast_0_piece0 15/03/26 14:50:00 ERROR TransportRequestHandler: Error while invoking RpcHandler#receive() on RPC id 7178767328921933569 java.lang.ClassNotFoundException: org/apache/spark/storage/StorageLevel at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java

Re: Strange JavaDeserialization error - java.lang.ClassNotFoundException: org/apache/spark/storage/StorageLevel

2015-03-27 Thread Tathagata Das

memory (free 278019440) 15/03/26 14:50:00 INFO BlockManagerMaster: Updated info of block broadcast_0_piece0 15/03/26 14:50:00 ERROR TransportRequestHandler: Error while invoking RpcHandler#receive() on RPC id 7178767328921933569 java.lang.ClassNotFoundException: org/apache/spark/storage

RE: Spark SQL Thrift Server start exception : java.lang.ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory

2015-03-03 Thread Cheng, Hao

” while starting the spark shell. From: Anusha Shamanur [mailto:anushas...@gmail.com] Sent: Wednesday, March 4, 2015 5:07 AM To: Cheng, Hao Subject: Re: Spark SQL Thrift Server start exception : java.lang.ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory Hi, I am getting

Re: Spark SQL Thrift Server start exception : java.lang.ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory

2015-03-03 Thread Anusha Shamanur

*Subject:* Re: Spark SQL Thrift Server start exception : java.lang.ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory Hi, I am getting the same error. There is no lib folder in my $SPARK_HOME. But I included these jars while calling spark-shell. Now, I get

RE: Spark SQL Thrift Server start exception : java.lang.ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory

2015-03-02 Thread Cheng, Hao

, March 3, 2015 2:50 PM To: user@spark.apache.org Subject: Spark SQL Thrift Server start exception : java.lang.ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory I have installed a hadoop cluster (version : 2.6.0), apache spark (version : 1.2.1 preBuilt for hadoop 2.4

Spark SQL Thrift Server start exception : java.lang.ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory

2015-03-02 Thread fanooos

org.datanucleus.api.jdo.JDOPersistenceManagerFactory was not found. NestedThrowables: java.lang.ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory at javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1175

[graphx] failed to submit an application with java.lang.ClassNotFoundException

2014-11-27 Thread Yifan LI

Hi, I just tried to submit an application from graphx examples directory, but it failed: yifan2:bin yifanli$ MASTER=local[*] ./run-example graphx.PPR_hubs java.lang.ClassNotFoundException: org.apache.spark.examples.graphx.PPR_hubs at java.net.URLClassLoader$1.run(URLClassLoader.java:202

Re: Fixed:spark 1.1.0 - hbase 0.98.6-hadoop2 version - py4j.protocol.Py4JJavaError java.lang.ClassNotFoundException

2014-10-06 Thread serkan.dogan

Thanks MLnick, I fixed the error. First i compile spark with original version later I download this pom file to examples folder https://github.com/tedyu/spark/commit/70fb7b4ea8fd7647e4a4ddca4df71521b749521c Then i recompile with maven. mvn -Dhbase.profile=hadoop-provided -Phadoop-2.4

Re: spark 1.1.0 - hbase 0.98.6-hadoop2 version - py4j.protocol.Py4JJavaError java.lang.ClassNotFoundException

2014-10-04 Thread Nick Pentreath

. : java.lang.ClassNotFoundException: org.apache.hadoop.hbase.io.ImmutableBytesWritable at java.net.URLClassLoader$1.run(URLClassLoader.java:217) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205

spark 1.1.0 - hbase 0.98.6-hadoop2 version - py4j.protocol.Py4JJavaError java.lang.ClassNotFoundException

2014-10-03 Thread serkan.dogan

/py4j/protocol.py, line 300, in get_return_value format(target_id, '.', name), value) py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.PythonRDD.newAPIHadoopRDD. : java.lang.ClassNotFoundException: org.apache.hadoop.hbase.io.ImmutableBytesWritable

spark 1.1.0 - hbase 0.98.6-hadoop2 version - py4j.protocol.Py4JJavaError java.lang.ClassNotFoundException

2014-10-03 Thread serkan.dogan

, line 300, in get_return_value format(target_id, '.', name), value) py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.PythonRDD.newAPIHadoopRDD. : java.lang.ClassNotFoundException: org.apache.hadoop.hbase.io.ImmutableBytesWritable

Re: java.lang.ClassNotFoundException on driver class in executor

2014-09-23 Thread Barrington Henry

mailto:barrington.he...@me.com: Hi, I am running spark from my IDE (InteliJ) using YARN as my cluster manager. However, the executor node is not able to find my main driver class “LascoScript”. I keep getting java.lang.ClassNotFoundException. I tried adding the jar of the main class by running

java.lang.ClassNotFoundException on driver class in executor

2014-09-21 Thread Barrington Henry

Hi, I am running spark from my IDE (InteliJ) using YARN as my cluster manager. However, the executor node is not able to find my main driver class “LascoScript”. I keep getting java.lang.ClassNotFoundException. I tried adding the jar of the main class by running the snippet below val

Re: java.lang.ClassNotFoundException on driver class in executor

2014-09-21 Thread Andrew Or

. However, the executor node is not able to find my main driver class “LascoScript”. I keep getting java.lang.ClassNotFoundException. I tried adding the jar of the main class by running the snippet below val conf = new SparkConf().set(spark.driver.host, barrymac

Exception failure: java.lang.ClassNotFoundException: org.apache.spark.streaming.kafka.KafkaReceiver

2014-05-30 Thread Margusja

: Serialized task 9.0:0 as 1958 bytes in 0 ms 14/05/30 11:53:56 WARN TaskSetManager: Lost TID 73 (task 8.0:0) 14/05/30 11:53:56 WARN TaskSetManager: Loss was due to java.lang.ClassNotFoundException java.lang.ClassNotFoundException: org.apache.spark.streaming.kafka.KafkaReceiver

Re: java.lang.ClassNotFoundException

2014-05-12 Thread Archit Thakur

[hidden email] To unsubscribe from Apache Spark User List, click here. NAML -- View this message in context: Re: java.lang.ClassNotFoundException Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: java.lang.ClassNotFoundException - spark on mesos

2014-05-02 Thread bo...@shopify.com

I have opened a PR for discussion on the apache/spark repository https://github.com/apache/spark/pull/620 There is certainly a classLoader problem in the way Mesos and Spark operate, I'm not sure what caused it to suddenly stop working so I'd like to open the discussion there -- View this

java.lang.ClassNotFoundException

2014-05-01 Thread İbrahim Rıza HALLAÇ

HelIo. I followed A Standalone App in Java part of the tutorial https://spark.apache.org/docs/0.8.1/quick-start.html Spark standalone cluster looks it's running without a problem : http://i.stack.imgur.com/7bFv8.png I have built a fat jar for running this JavaApp on the cluster. Before maven

java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan

I am facing different kinds of java.lang.ClassNotFoundException when trying to run spark on mesos. One error has to do with org.apache.spark.executor.MesosExecutorBackend. Another has to do with org.apache.spark.serializer.JavaSerializer. I see other people complaining about similar issues. I

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Tim St Clair

: java.lang.ClassNotFoundException - spark on mesos I am facing different kinds of java.lang.ClassNotFoundException when trying to run spark on mesos. One error has to do with org.apache.spark.executor.MesosExecutorBackend. Another has to do with org.apache.spark.serializer.JavaSerializer. I see other people complaining

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan

, Tim - Original Message - From: Bharath Bhushan manku.ti...@outlook.com To: user@spark.apache.org Sent: Monday, March 31, 2014 8:16:19 AM Subject: java.lang.ClassNotFoundException - spark on mesos I am facing different kinds of java.lang.ClassNotFoundException when trying to run

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Tim St Clair

9:46:32 AM Subject: Re: java.lang.ClassNotFoundException - spark on mesos I tried 0.9.0 and the latest git tree of spark. For mesos, I tried 0.17.0 and the latest git tree. Thanks On 31-Mar-2014, at 7:24 pm, Tim St Clair tstcl...@redhat.com wrote: What versions are you running

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan

manku.ti...@outlook.com To: user@spark.apache.org Sent: Monday, March 31, 2014 9:46:32 AM Subject: Re: java.lang.ClassNotFoundException - spark on mesos I tried 0.9.0 and the latest git tree of spark. For mesos, I tried 0.17.0 and the latest git tree. Thanks On 31-Mar-2014, at 7:24 pm

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan

I was talking about the protobuf version issue as not fixed. I could not find any reference to the problem or the fix. Reg. SPARK-1052, I could pull in the fix into my 0.9.0 tree (from the tar ball on the website) and I see the fix in the latest git. Thanks On 01-Apr-2014, at 3:28 am, deric

Re: java.lang.ClassNotFoundException - spark on mesos

2014-03-31 Thread Bharath Bhushan

Another problem I noticed is that the current 1.0.0 git tree still gives me the ClassNotFoundException. I see that the SPARK-1052 is already fixed there. I then modified the pom.xml for mesos and protobuf and that still gave the ClassNotFoundException. I also tried modifying pom.xml only for

Re: java.lang.ClassNotFoundException

2014-03-26 Thread Ognen Duzlevski

Have you looked at the individual nodes logs? Can you post a bit more of the exception's output? On 3/26/14, 8:42 AM, Jaonary Rabarisoa wrote: Hi all, I got java.lang.ClassNotFoundException even with addJar called. The jar file is present in each node. I use the version of spark from

Re: java.lang.ClassNotFoundException

2014-03-26 Thread Ognen Duzlevski

: Task 1.0:1 failed 4 times (most recent failure: Exception failure in TID 6 on host 172.166.86.36 http://172.166.86.36: java.lang.ClassNotFoundException: value.models.ReIdDataSetEntry) org.apache.spark.SparkException: Job aborted: Task 1.0:1 failed 4 times (most recent failure

Re: java.lang.ClassNotFoundException

2014-03-26 Thread Jaonary Rabarisoa

failure: Exception failure in TID 6 on host 172.166.86.36: java.lang.ClassNotFoundException: value.models.ReIdDataSetEntry) org.apache.spark.SparkException: Job aborted: Task 1.0:1 failed 4 times (most recent failure: Exception failure in TID 6 on host 172.166.86.36

Re: java.lang.ClassNotFoundException

2014-03-26 Thread Aniket Mokashi

: [error] (run-main-0) org.apache.spark.SparkException: Job aborted: Task 1.0:1 failed 4 times (most recent failure: Exception failure in TID 6 on host 172.166.86.36: java.lang.ClassNotFoundException: value.models.ReIdDataSetEntry) org.apache.spark.SparkException: Job aborted: Task 1.0:1

java.lang.ClassNotFoundException in spark 0.9.0, shark 0.9.0 (pre-release) and hadoop 2.2.0

2014-03-07 Thread pradeeps8

. /org.apache.spark.SparkException: Job aborted: Task 1.0:3 failed 4 times (most recent failure: Exception failure: java.lang.ClassNotFoundException: $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$anonfun$1) at org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$spark$scheduler$DAGScheduler

89 matches

Mail list logo