Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/21389#discussion_r189964186
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala
---
@@ -2408,4 +2409,53 @@ class JsonSuite extends QueryTest with
SharedSQLContext with TestJsonData {
spark.read.option("mode", "PERMISSIVE").option("encoding",
"UTF-8").json(Seq(badJson).toDS()),
Row(badJson))
}
+
+ test("SPARK-24204 error handling for unsupported data types") {
--- End diff --
The suite doesn't assume that all file-based data source has the same
capability. In this PR, the test codes are almost the same and the only
difference are the mapping tables. For example,
- `json` -> Interval
- `orc` -> Interval, Null
- `parquet` -> Interval, Null
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
