Github user dima-asana commented on a diff in the pull request:
https://github.com/apache/spark/pull/22759#discussion_r239577117
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/test/DataFrameReaderWriterSuite.scala
---
@@ -542,6 +551,35 @@ class DataFrameReaderWriterSuite
Github user dima-asana commented on a diff in the pull request:
https://github.com/apache/spark/pull/22759#discussion_r239577230
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/test/DataFrameReaderWriterSuite.scala
---
@@ -542,6 +551,35 @@ class DataFrameReaderWriterSuite
Github user dima-asana commented on a diff in the pull request:
https://github.com/apache/spark/pull/22759#discussion_r239577173
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/test/DataFrameReaderWriterSuite.scala
---
@@ -542,6 +551,35 @@ class DataFrameReaderWriterSuite
Github user dima-asana commented on the issue:
https://github.com/apache/spark/pull/22759
> @dima-asana can you rebase, and add a simple test case or else find one
that does demonstrate the behavior here?
done, sorry for the de
GitHub user dima-asana opened a pull request:
https://github.com/apache/spark/pull/22759
[MINOR][SQL][DOC] Correct parquet nullability documentation
## What changes were proposed in this pull request?
Parquet files appear to have nullability info when being written
