Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20081
Thanks! Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user chetkhatri commented on the issue:
https://github.com/apache/spark/pull/20081
@cloud-fan @srowen I am good with changes proposed. please do merge.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20081
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85392/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/20081
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20081
**[Test build #85392 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85392/testReport)**
for PR 20081 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20081
FYI, there is a JIRA for a doc about `spark.sql.parquet.writeLegacyFormat `
- https://issues-test.apache.org/jira/plugins/servlet/mobile#issue/SPARK-20937
---
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20081
> spark.sql.parquet.writeLegacyFormat - if you don't use this
configuration, hive external table won't be able to access parquet data.
Well, that's really an undocumented feature... Can
Github user chetkhatri commented on the issue:
https://github.com/apache/spark/pull/20081
@cloud-fan spark.sql.files.maxRecordsPerFile didn't worked out when i was
working with mine 30 TB of Spark Hive workload whereas repartition and coalesce
made sense.
---
Github user chetkhatri commented on the issue:
https://github.com/apache/spark/pull/20081
@cloud-fan Thanks for PR
4. spark.sql.parquet.writeLegacyFormat - if you don't use this
configuration, hive external table won't be able to access parquet data.
5. repartition and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/20081
**[Test build #85392 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85392/testReport)**
for PR 20081 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/20081
@chetkhatri @srowen @gatorsmile
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
11 matches
Mail list logo
