Github user maropu commented on a diff in the pull request:
https://github.com/apache/spark/pull/20929#discussion_r177925982
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/streaming/FileStreamSourceSuite.scala
---
@@ -624,6 +624,42 @@ class FileStreamSourceSuite extends
FileStreamSourceTest {
}
}
+ test("SPARK-23772 Ignore column of all null values or empty array during
JSON schema inference") {
--- End diff --
@mengxr This test matches your intention described in the jira? (I just
want to confirm this before I brush up the code).
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
