pin_zhang created SPARK-11748:
---------------------------------
Summary: Result is null after alter column name of table stored as
Parquet
Key: SPARK-11748
URL: https://issues.apache.org/jira/browse/SPARK-11748
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.5.1
Reporter: pin_zhang
1. Test with the following code
hctx.sql(" create table " + table + " (id int, str string) STORED AS
PARQUET ")
val df = hctx.jsonFile("g:/vip.json")
df.write.format("parquet").mode(SaveMode.Append).saveAsTable(table)
hctx.sql(" select * from " + table).show()
// alter table
val alter = "alter table " + table + " CHANGE id i_d int "
hctx.sql(alter)
hctx.sql(" select * from " + table).show()
2. Result
after change table column name, data in null for the changed column
Result before alter table
+---+---+
| id|str|
+---+---+
| 1| s1|
| 2| s2|
+---+---+
Result after alter table
+----+---+
| i_d|str|
+----+---+
|null| s1|
|null| s2|
+----+---+
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]