Try the following spark-shell --master yarn-client --name nayan /opt/packages/xxxx-data- prepration/target/scala-2.10/xxxx-data-prepration-assembly-1.0.jar
On Thu, Apr 6, 2017 at 6:36 PM, nayan sharma <nayansharm...@gmail.com> wrote: > Hi All, > I am getting error while loading CSV file. > > val > datacsv=sqlContext.read.format("com.databricks.spark.csv").option("header", > "true").load("timeline.csv") > java.lang.NoSuchMethodError: org.apache.commons.csv. > CSVFormat.withQuote(Ljava/lang/Character;)Lorg/apache/ > commons/csv/CSVFormat; > > > I have added the dependencies in sbt file > > // Spark Additional Library - CSV Read as DFlibraryDependencies += > "com.databricks" %% "spark-csv" % “1.5.0" > > *and starting the spark-shell with command* > > spark-shell --master yarn-client --jars /opt/packages/xxxx-data- > prepration/target/scala-2.10/xxxx-data-prepration-assembly-1.0.jar --name > nayan > > > > Thanks for any help!! > > > Thanks, > Nayan >