GitHub user cxzl25 opened a pull request:
https://github.com/apache/spark/pull/20406
[SPARK-23230][SQL]Error by creating a data table when using
hive.default.fileformat=orc
When hive.default.fileformat is other kinds of file types, create textfile
table cause a serda error.
We should take the default type of textfile and sequencefile both as
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.
```
set hive.default.fileformat=orc;
create table tbl( i string ) stored as textfile;
desc formatted tbl;
Serde Library org.apache.hadoop.hive.ql.io.orc.OrcSerde
InputFormat org.apache.hadoop.mapred.TextInputFormat
OutputFormat org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cxzl25/spark default_serde
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20406.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20406
----
commit f370dd6217cf8a590ef52ecc970e4dc33c235631
Author: sychen <sychen@...>
Date: 2018-01-26T12:40:48Z
take the default type of textfile and sequencefile both as
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
