[ https://issues.apache.org/jira/browse/SPARK-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reynold Xin resolved SPARK-18220. --------------------------------- Resolution: Fixed Fix Version/s: 2.1.0 > ClassCastException occurs when using select query on ORC file > ------------------------------------------------------------- > > Key: SPARK-18220 > URL: https://issues.apache.org/jira/browse/SPARK-18220 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.1.0 > Reporter: Jerryjung > Assignee: Wenchen Fan > Priority: Blocker > Labels: orcfile, sql > Fix For: 2.1.0 > > > Error message is below. > {noformat} > ========================================================== > 16/11/02 16:38:09 INFO ReaderImpl: Reading ORC rows from > hdfs://xxx/part-00022 with {include: [true], offset: 0, length: > 9223372036854775807} > 16/11/02 16:38:09 INFO Executor: Finished task 17.0 in stage 22.0 (TID 42). > 1220 bytes result sent to driver > 16/11/02 16:38:09 INFO TaskSetManager: Finished task 17.0 in stage 22.0 (TID > 42) in 116 ms on localhost (executor driver) (19/20) > 16/11/02 16:38:09 ERROR Executor: Exception in task 10.0 in stage 22.0 (TID > 35) > java.lang.ClassCastException: > org.apache.hadoop.hive.serde2.io.HiveVarcharWritable cannot be cast to > org.apache.hadoop.io.Text > at > org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableStringObjectInspector.getPrimitiveWritableObject(WritableStringObjectInspector.java:41) > at > org.apache.spark.sql.hive.HiveInspectors$$anonfun$unwrapperFor$23.apply(HiveInspectors.scala:526) > at > org.apache.spark.sql.hive.HadoopTableReader$$anonfun$14$$anonfun$apply$15.apply(TableReader.scala:419) > at > org.apache.spark.sql.hive.HadoopTableReader$$anonfun$14$$anonfun$apply$15.apply(TableReader.scala:419) > at > org.apache.spark.sql.hive.HadoopTableReader$$anonfun$fillObject$2.apply(TableReader.scala:435) > at > org.apache.spark.sql.hive.HadoopTableReader$$anonfun$fillObject$2.apply(TableReader.scala:426) > at scala.collection.Iterator$$anon$11.next(Iterator.scala:409) > at scala.collection.Iterator$$anon$11.next(Iterator.scala:409) > at > org.apache.spark.sql.execution.SparkPlan$$anonfun$2.apply(SparkPlan.scala:232) > at > org.apache.spark.sql.execution.SparkPlan$$anonfun$2.apply(SparkPlan.scala:225) > at > org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:804) > at > org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:804) > at > org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38) > at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:319) > at org.apache.spark.rdd.RDD.iterator(RDD.scala:283) > at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > at org.apache.spark.scheduler.Task.run(Task.scala:99) > at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > ORC dump info. > ========================================================== > File Version: 0.12 with HIVE_8732 > 16/11/02 16:39:21 INFO orc.ReaderImpl: Reading ORC rows from > hdfs://XXX/part-00000 with {include: null, offset: 0, length: > 9223372036854775807} > 16/11/02 16:39:21 INFO orc.RecordReaderFactory: Schema is not specified on > read. Using file schema. > Rows: 7 > Compression: ZLIB > Compression size: 262144 > Type: > struct<a:varchar(2),b(50),c:varchar(6),d:varchar(50),e:varchar(4),f:varchar(50),g:timestamp> > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org