GitHub user chenghao-intel opened a pull request:
https://github.com/apache/spark/pull/1439
[SPARK-2523] [SQL] Hadoop table scan
In HiveTableScan.scala, ObjectInspector was created for all of the
partition based records, which probably causes ClassCastException if the object
inspector is not identical among table & partitions.
This is the follow up with:
https://github.com/apache/spark/pull/1408
https://github.com/apache/spark/pull/1390
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/chenghao-intel/spark hadoop_table_scan
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1439.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1439
----
commit 39d6475d8cf357488fd1ec736b4d910f8237fc5b
Author: Cheng Hao <[email protected]>
Date: 2014-07-16T07:59:50Z
Add HiveDecimal & HiveVarchar support in unwrap data
commit afc39da00f53f15edb466768c24cdd73ec5bc119
Author: Cheng Hao <[email protected]>
Date: 2014-07-16T08:21:25Z
Polish the code
commit d66835b420e22f98e10556783102e7dc356e6e6a
Author: Cheng Hao <[email protected]>
Date: 2014-07-16T08:24:30Z
Fix Bug in TableScan while Paritition SerDe is not compatiable with each
other
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
