rahul sharma created SPARK-21868: ------------------------------------- Summary: Spark job fails on java 9 NumberFormatException for input string ea Key: SPARK-21868 URL: https://issues.apache.org/jira/browse/SPARK-21868 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 2.1.0 Reporter: rahul sharma Priority: Minor
I have a sample spark job which I am successfully able to run on java 8 but when I run same program on java 9 early access, it fails with NumberFormatException. SparkConf conf = new SparkConf(); conf.setMaster("local[*]").setAppName("dataframe join example"); SparkSession session = SparkSession.builder().config(conf).getOrCreate(); Dataset<Row> ds = session.read().text(Thread.currentThread().getContextClassLoader(). getResource("employee").getPath()); System.out.println(ds.count()); Maven spark dependencies: <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-core_2.10</artifactId> <version>2.1.0</version> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-sql_2.10</artifactId> <version>2.1.0</version> </dependency> Error: Exception in thread "main" java.lang.NumberFormatException: For input string: "ea" at java.base/java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.base/java.lang.Integer.parseInt(Integer.java:695) at java.base/java.lang.Integer.parseInt(Integer.java:813) at scala.collection.immutable.StringLike$class.toInt(StringLike.scala:229) at scala.collection.immutable.StringOps.toInt(StringOps.scala:31) at org.apache.spark.SparkContext.warnDeprecatedVersions(SparkContext.scala:353) at org.apache.spark.SparkContext.(SparkContext.scala:186) at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2313) at org.apache.spark.sql.SparkSession$Builder$$anonfun$6.apply(SparkSession.scala:868) at org.apache.spark.sql.SparkSession$Builder$$anonfun$6.apply(SparkSession.scala:860) at scala.Option.getOrElse(Option.scala:120) at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:860) at Java Details: java -version java version "9-ea" Java(TM) SE Runtime Environment (build 9-ea+156) Java HotSpot(TM) 64-Bit Server VM (build 9-ea+156, mixed mode) -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org