Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/23010
But we may forget to filter null values when we write sql. The following
function protects this situation and writes the value of null partitions as
__HIVE_DEFAULT_PARTITION__
def getParti
Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/23010
@cloud-fan, Thanks for review, Do you mean we should filter out invalid
partitions in sql before write?
---
-
To unsubscribe,
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/23010
The root cause is, `DynamicPartitionDataWriter` treats null and empty
string as different partition values, and creates new files. However, null and
empty string are converted to `__HIVE_DEFAULT_P
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/23010
cc @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h..
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99576/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23010
**[Test build #99576 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99576/testReport)**
for PR 23010 at commit
[`1f18e27`](https://github.com/apache/spark/commit/1
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/5634/
Github user eatoncys commented on the issue:
https://github.com/apache/spark/pull/23010
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23010
**[Test build #99576 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/99576/testReport)**
for PR 23010 at commit
[`1f18e27`](https://github.com/apache/spark/commit/1f
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98715/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23010
**[Test build #98715 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98715/testReport)**
for PR 23010 at commit
[`1f18e27`](https://github.com/apache/spark/commit/1
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/4941/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/23010
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional comma
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/23010
**[Test build #98715 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98715/testReport)**
for PR 23010 at commit
[`1f18e27`](https://github.com/apache/spark/commit/1f
17 matches
Mail list logo