Github user jamesthomp commented on the issue:
https://github.com/apache/spark/pull/21217
I would be glad for @viirya or @mgaido91 to pick this up from me. It sounds
like the remaining work is to move the test from `SQLQuerySuite` into
`AnalysisSuite`, but I'm not certain h
Github user jamesthomp commented on the issue:
https://github.com/apache/spark/pull/21217
@HyukjinKwon - I have resolved the conflict with the docs changes. Please
let me know if any additional changes are required
Github user jamesthomp commented on the issue:
https://github.com/apache/spark/pull/21217
@gatorsmile - I have added a note to the migration guide.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
GitHub user jamesthomp opened a pull request:
https://github.com/apache/spark/pull/21217
[SPARK-24151][SQL] Fix CURRENT_DATE, CURRENT_TIMESTAMP to be case
insensitive
## What changes were proposed in this pull request?
This PR adjusts the behavior of CURRENT_DATE and
Github user jamesthomp commented on the issue:
https://github.com/apache/spark/pull/20580
I'll see if I can generate a parquet file with the right schema to add for
a test, but probably cannot look at this till tom
Github user jamesthomp commented on the issue:
https://github.com/apache/spark/pull/20580
@kiszk - I've changed the implementation to no longer use
`column.isArray()` and instead just inline the decimal type check (so no
changes needed to the public api). I don't think
Github user jamesthomp commented on the issue:
https://github.com/apache/spark/pull/20580
Yeah I believe it will add support for the array type too. Spark actually
previously supported these types but the support was removed in this PR:
https://github.com/apache/spark/commit
Github user jamesthomp commented on a diff in the pull request:
https://github.com/apache/spark/pull/20580#discussion_r167459070
--- Diff:
sql/core/src/main/java/org/apache/spark/sql/execution/vectorized/WritableColumnVector.java
---
@@ -691,11 +696,6 @@ public
GitHub user jamesthomp opened a pull request:
https://github.com/apache/spark/pull/20580
[SPARK-23388][SQL] Support for Parquet Binary DecimalType in
VectorizedColumnReader
## What changes were proposed in this pull request?
Re-add support for parquet binary DecimalType in
