Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19382#discussion_r141919805
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala ---
@@ -189,12 +189,12 @@ case class RelationConversions(
private def convert(relation: HiveTableRelation): LogicalRelation = {
val serde =
relation.tableMeta.storage.serde.getOrElse("").toLowerCase(Locale.ROOT)
if (serde.contains("parquet")) {
- val options = Map(ParquetOptions.MERGE_SCHEMA ->
+ val options = relation.tableMeta.storage.properties +
(ParquetOptions.MERGE_SCHEMA ->
--- End diff --
Hi, @gatorsmile . It's the same in the Paquet. Without this, the test case
for parquet fails.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
