[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user viirya closed the pull request at: https://github.com/apache/spark/pull/9067 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-152638318 @viirya Did not realized that you had don similar things, i created https://github.com/davies/spark/commit/5707f5b3421fdab0b01ee2a66acf50b59752152b, could you review that? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-151793559 @rxin I ran a simple performance measure as following. Record count: 1333635318 Record after group by: 259200 SQL query looks like: `SELECT SUM(a) as a , SUM(b) as b , SUM(c) as c , SUM(d) as d from table GROUP BY e` 4 workers (8 cores), executor memory: 512 MB. With pre-aggregation enabled: 67720191 microseconds 66424539 microseconds 62959275 microseconds With pre-aggregation disabled: 69934956 microseconds 70351959 microseconds 68437353 microseconds So looks like it roughly gains about 5% improvement in average. Not very significant, but the reduction factor is not high, so it should be expected. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-151179909 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-151179890 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-151182583 **[Test build #44359 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44359/consoleFull)** for PR 9067 at commit [`aa51d8a`](https://github.com/apache/spark/commit/aa51d8a49a32542f6add39b3f983dbb2320a9346). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-151228414 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-151228419 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44359/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-148296408 It's best to have a feature flag for this, in case it yields worse performance. Eventually we should find a way to make this the default. Can you do some performance measure to quantify the gain from this change? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-148294059 @JoshRosen Thanks for explaining this patch. It does exactly what you said. @rxin Do you think it is ok to add a configuration for turning on/off this feature? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-148182209 Can you explain what you mean by "mixing"? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9067#discussion_r42060953 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -470,12 +484,27 @@ class TungstenAggregationIterator( // Process the rest of input rows. while (inputIter.hasNext) { -val newInput = inputIter.next() -numInputRows += 1 -val groupingKey = groupProjection.apply(newInput) -buffer.copyFrom(initialAggregationBuffer) -processRow(buffer, newInput) -externalSorter.insertKV(groupingKey, buffer) +var newHashMap = initHashMap() --- End diff -- I think you might actually want to re-assign to the original `hashMap` by making it into a `var`. This will let us ensure that `UnsafeAggregationIterator.free()` is able to free all memory after failures. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-148218738 @rxin, my understanding of this patch is that it lets us continue to perform hash-based pre-aggregation on the remainder of the iterator after we've decided to spill and switch to sort-based aggregation. After we've destructed and freed the original hashMap, we'll now loop back around and continue to use a new hash map to aggregate the remainder of the iterator, spilling that map if it also becomes too large. After this patch, records will have more opportunities to be pre-aggregated before being spilled to disk or sent across the network. I wonder about the case where you're doing map-side pre-aggregation and are experiencing a very low reduction factor: in that case, this patch means that we'll do more work per record, since we'll be hashing and sorting every record, whereas before there was a chance that we'd skip hashing of some records. OTOH, if you have an input consisting of all unique keys then it's best to skip both the hashing AND the sorting and just push the records straight to the reduce side, but that optimization is kind of orthogonal to this one. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-148219612 Ideally we should be able to turn partial aggregation off when we don't see reduction. We had that in Shark, and a lot of query engines do this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298428 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298737 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298690 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298751 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298785 [Test build #43559 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43559/consoleFull) for PR 9067 at commit [`787846b`](https://github.com/apache/spark/commit/787846bc5106a6a2372e109598fd78c0a2b38427). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298429 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43557/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147298405 [Test build #43557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43557/console) for PR 9067 at commit [`787846b`](https://github.com/apache/spark/commit/787846bc5106a6a2372e109598fd78c0a2b38427). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147324890 [Test build #43559 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43559/console) for PR 9067 at commit [`787846b`](https://github.com/apache/spark/commit/787846bc5106a6a2372e109598fd78c0a2b38427). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147325034 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147325035 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43559/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147231673 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147249270 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147249443 [Test build #43546 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43546/consoleFull) for PR 9067 at commit [`dd98d57`](https://github.com/apache/spark/commit/dd98d574c42c520f260404af7b53af9f64cad20b). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147255496 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43546/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147255494 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147255481 [Test build #43546 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43546/console) for PR 9067 at commit [`dd98d57`](https://github.com/apache/spark/commit/dd98d574c42c520f260404af7b53af9f64cad20b). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147292908 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147292912 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-147294294 [Test build #43557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43557/consoleFull) for PR 9067 at commit [`787846b`](https://github.com/apache/spark/commit/787846bc5106a6a2372e109598fd78c0a2b38427). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org