Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19389#discussion_r141948681
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetPartitionDiscoverySuite.scala
---
@@ -1067,4 +1098,24 @@ class ParquetPartitionDiscoverySuite extends
QueryTest with ParquetTest with Sha
checkAnswer(spark.read.load(path.getAbsolutePath), df)
}
}
+
+ test("Resolve type conflicts - decimals, dates and timestamps in
partition column") {
+ withTempPath { path =>
+ val df = Seq((1, "2015-01-01"), (2, "2016-01-01
00:01:00")).toDF("i", "ts")
+
df.write.format("parquet").partitionBy("ts").save(path.getAbsolutePath)
--- End diff --
this passes even before the change, right?
as I mentioned on the other PR, I don't really understand why this works
despite the issue you're fixing. Regardless, seems like a good test to have.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
