[GitHub] [spark] AmplabJenkins removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function URL: https://github.com/apache/spark/pull/24557#issuecomment-490527962 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function URL: https://github.com/apache/spark/pull/24557#issuecomment-490527970 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function URL: https://github.com/apache/spark/pull/24557#issuecomment-490599686 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function URL: https://github.com/apache/spark/pull/24557#issuecomment-490599697 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function

2019-05-08 Thread GitBox
SparkQA removed a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function URL: https://github.com/apache/spark/pull/24557#issuecomment-490528827 **[Test build #105258 has

[GitHub] [spark] viirya commented on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function

2019-05-08 Thread GitBox
viirya commented on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function URL: https://github.com/apache/spark/pull/24557#issuecomment-490746455 @JoshRosen Thanks for the review! > * Could you also implement min_by(x, y)? Yes. I originally planed to have separate

[GitHub] [spark] viirya edited a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function

2019-05-08 Thread GitBox
viirya edited a comment on issue #24557: [SPARK-27653][SQL] Add max_by() SQL aggregate function URL: https://github.com/apache/spark/pull/24557#issuecomment-490746455 @JoshRosen Thanks for the review! > * Could you also implement min_by(x, y)? Yes. I originally planed to have

[GitHub] [spark] AmplabJenkins removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490745138 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490745136 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490745136 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
SparkQA removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490724858 **[Test build #105273 has

[GitHub] [spark] AmplabJenkins commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490745138 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation

2019-05-08 Thread GitBox
SparkQA commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-490744695 **[Test build #105274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105274/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
SparkQA commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490744786 **[Test build #105273 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105273/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-490744405 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-490744396 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-490744405 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-490744396 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] HyukjinKwon commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation

2019-05-08 Thread GitBox
HyukjinKwon commented on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-490743428 ok to test This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24553: [SPARK-27604][SQL] Enhance constant propagation URL: https://github.com/apache/spark/pull/24553#issuecomment-490374276 Can one of the admins verify this patch? This is an

[GitHub] [spark] wangyum commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
wangyum commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490739903 cc @dongjoon-hyun This is an

[GitHub] [spark] felixcheung commented on a change in pull request #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source

2019-05-08 Thread GitBox
felixcheung commented on a change in pull request #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source URL: https://github.com/apache/spark/pull/24548#discussion_r282334994 ## File path: docs/structured-streaming-programming-guide.md ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source URL: https://github.com/apache/spark/pull/24548#issuecomment-490606875 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source

2019-05-08 Thread GitBox
SparkQA removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source URL: https://github.com/apache/spark/pull/24548#issuecomment-490602853 **[Test build #105266 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source URL: https://github.com/apache/spark/pull/24548#issuecomment-490604859 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source URL: https://github.com/apache/spark/pull/24548#issuecomment-490606855 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24548: [MINOR][SS][DOC] Added missing config `maxFileAge` in file streaming source URL: https://github.com/apache/spark/pull/24548#issuecomment-490604864 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490735505 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490735507 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490735507 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490735505 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
SparkQA removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490718370 **[Test build #105272 has

[GitHub] [spark] SparkQA commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
SparkQA commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490735330 **[Test build #105272 has

[GitHub] [spark] chummyhe89 commented on a change in pull request #24556: [SPARK-27641][CORE] Fix MetricsSystem to remove unregistered source correctly

2019-05-08 Thread GitBox
chummyhe89 commented on a change in pull request #24556: [SPARK-27641][CORE] Fix MetricsSystem to remove unregistered source correctly URL: https://github.com/apache/spark/pull/24556#discussion_r282329325 ## File path:

[GitHub] [spark] chummyhe89 commented on a change in pull request #24556: [SPARK-27641][CORE] Fix MetricsSystem to remove unregistered source correctly

2019-05-08 Thread GitBox
chummyhe89 commented on a change in pull request #24556: [SPARK-27641][CORE] Fix MetricsSystem to remove unregistered source correctly URL: https://github.com/apache/spark/pull/24556#discussion_r282328568 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API URL: https://github.com/apache/spark/pull/24559#issuecomment-490582850 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2019-05-08 Thread GitBox
SparkQA removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API URL: https://github.com/apache/spark/pull/24559#issuecomment-490583547 **[Test build #105263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105263/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API URL: https://github.com/apache/spark/pull/24559#issuecomment-490644854 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2019-05-08 Thread GitBox
cloud-fan commented on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API URL: https://github.com/apache/spark/pull/24559#issuecomment-490729549 I think we need a design doc for the UDF API. We need to think about ease-of-use and performance.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API URL: https://github.com/apache/spark/pull/24559#issuecomment-490582840 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24559: [SPARK-27658][SQL] Add FunctionCatalog API URL: https://github.com/apache/spark/pull/24559#issuecomment-490644847 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] cloud-fan commented on a change in pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API

2019-05-08 Thread GitBox
cloud-fan commented on a change in pull request #24559: [SPARK-27658][SQL] Add FunctionCatalog API URL: https://github.com/apache/spark/pull/24559#discussion_r282326920 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalog/v2/ScalarFunction.java ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API URL: https://github.com/apache/spark/pull/24560#issuecomment-490585583 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API

2019-05-08 Thread GitBox
SparkQA removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API URL: https://github.com/apache/spark/pull/24560#issuecomment-490586311 **[Test build #105264 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105264/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API URL: https://github.com/apache/spark/pull/24560#issuecomment-490650881 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API URL: https://github.com/apache/spark/pull/24560#issuecomment-490650890 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API URL: https://github.com/apache/spark/pull/24560#issuecomment-490585571 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] cloud-fan commented on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API

2019-05-08 Thread GitBox
cloud-fan commented on issue #24560: [SPARK-27661][SQL] Add SupportsNamespaces API URL: https://github.com/apache/spark/pull/24560#issuecomment-490728914 I feel separating creating and listing namespaces may make the API too complicated. I think it's OK if some implementation throws an

[GitHub] [spark] AmplabJenkins commented on issue #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions URL: https://github.com/apache/spark/pull/23556#issuecomment-490728457 Can one of the admins verify this patch?

[GitHub] [spark] cloud-fan closed pull request #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So…

2019-05-08 Thread GitBox
cloud-fan closed pull request #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So… URL: https://github.com/apache/spark/pull/24149 This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So…

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So… URL: https://github.com/apache/spark/pull/24149#issuecomment-490570083 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So…

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So… URL: https://github.com/apache/spark/pull/24149#issuecomment-490652287 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So…

2019-05-08 Thread GitBox
SparkQA removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So… URL: https://github.com/apache/spark/pull/24149#issuecomment-490515926 **[Test build #105257 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So…

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So… URL: https://github.com/apache/spark/pull/24149#issuecomment-490570074 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So…

2019-05-08 Thread GitBox
SparkQA removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So… URL: https://github.com/apache/spark/pull/24149#issuecomment-490589051 **[Test build #105265 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So…

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So… URL: https://github.com/apache/spark/pull/24149#issuecomment-490652282 Merged build finished. Test PASSed.

[GitHub] [spark] cloud-fan commented on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So…

2019-05-08 Thread GitBox
cloud-fan commented on issue #24149: [SPARK-27207][SQL] : Ensure aggregate buffers are initialized again for So… URL: https://github.com/apache/spark/pull/24149#issuecomment-490726932 thanks, merging to master! This is an

[GitHub] [spark] nvander1 commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] Rewrite ArraysOverlap Join

2019-05-08 Thread GitBox
nvander1 commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] Rewrite ArraysOverlap Join URL: https://github.com/apache/spark/pull/24563#issuecomment-490726901 Re: benchmarks. This is only anecdotal, but I’ve used this technique at work to bring a join that ran for a day without

[GitHub] [spark] nvander1 commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] Rewrite ArraysOverlap Join

2019-05-08 Thread GitBox
nvander1 commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] Rewrite ArraysOverlap Join URL: https://github.com/apache/spark/pull/24563#issuecomment-490726294 @viirya Oops, thanks for pointing out the missing title! :) I’ve only used this when the size of the arrays

[GitHub] [spark] AmplabJenkins commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490724523 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490724523 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490724531 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490724531 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
SparkQA commented on issue #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#issuecomment-490724858 **[Test build #105273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105273/testReport)**

[GitHub] [spark] cloud-fan edited a comment on issue #24546: [SPARK-27650][SQL] separate the row iterator functionality from ColumnarBatch

2019-05-08 Thread GitBox
cloud-fan edited a comment on issue #24546: [SPARK-27650][SQL] separate the row iterator functionality from ColumnarBatch URL: https://github.com/apache/spark/pull/24546#issuecomment-490723477 > The PR description just says that this avoids referring to MutableColumnarRow in the new class

[GitHub] [spark] zhengruifeng commented on a change in pull request #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
zhengruifeng commented on a change in pull request #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#discussion_r282321898 ## File path:

[GitHub] [spark] zhengruifeng commented on a change in pull request #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
zhengruifeng commented on a change in pull request #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#discussion_r282322656 ## File path: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala

[GitHub] [spark] viirya commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL]

2019-05-08 Thread GitBox
viirya commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] URL: https://github.com/apache/spark/pull/24563#issuecomment-490723543 Btw, the PR title is empty, currently. Could you write a proper title for this work?

[GitHub] [spark] cloud-fan commented on issue #24546: [SPARK-27650][SQL] separate the row iterator functionality from ColumnarBatch

2019-05-08 Thread GitBox
cloud-fan commented on issue #24546: [SPARK-27650][SQL] separate the row iterator functionality from ColumnarBatch URL: https://github.com/apache/spark/pull/24546#issuecomment-490723477 > The PR description just says that this avoids referring to MutableColumnarRow in the new class

[GitHub] [spark] zhengruifeng commented on a change in pull request #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX

2019-05-08 Thread GitBox
zhengruifeng commented on a change in pull request #24555: [SPARK-27656][GraphX][WIP] Safely register class for GraphX URL: https://github.com/apache/spark/pull/24555#discussion_r28239 ## File path: core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490719425 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490719418 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490719418 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #20430: [SPARK-23263][TEST] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490719425 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #20430: [SPARK-23263][SQL] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
SparkQA commented on issue #20430: [SPARK-23263][SQL] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430#issuecomment-490718370 **[Test build #105272 has

[GitHub] [spark] wangyum opened a new pull request #20430: [SPARK-23263][SQL] CTAS should update stat if autoUpdate statistics is enabled

2019-05-08 Thread GitBox
wangyum opened a new pull request #20430: [SPARK-23263][SQL] CTAS should update stat if autoUpdate statistics is enabled URL: https://github.com/apache/spark/pull/20430 …update table size is enabled ## What changes were proposed in this pull request? How to reproduce: ```sql

[GitHub] [spark] beliefer commented on issue #24550: [MINOR][SS] Rename `secondLatestBatchId` to `secondLatestOffsets`

2019-05-08 Thread GitBox
beliefer commented on issue #24550: [MINOR][SS] Rename `secondLatestBatchId` to `secondLatestOffsets` URL: https://github.com/apache/spark/pull/24550#issuecomment-490713150 Thank you, @dongjoon-hyun @srowen This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL]

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] URL: https://github.com/apache/spark/pull/24563#issuecomment-490703388 Can one of the admins verify this patch? This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL]

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] URL: https://github.com/apache/spark/pull/24563#issuecomment-490703704 Can one of the admins verify this patch? This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL]

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] URL: https://github.com/apache/spark/pull/24563#issuecomment-490703304 Can one of the admins verify this patch? This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL]

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] URL: https://github.com/apache/spark/pull/24563#issuecomment-490703304 Can one of the admins verify this patch? This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL]

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24563: [SPARK-27359] [OPTIMIZER] [SQL] URL: https://github.com/apache/spark/pull/24563#issuecomment-490703388 Can one of the admins verify this patch? This is an automated message from the

[GitHub] [spark] nvander1 opened a new pull request #24563: [SPARK-27359] [OPTIMIZER] [SQL]

2019-05-08 Thread GitBox
nvander1 opened a new pull request #24563: [SPARK-27359] [OPTIMIZER] [SQL] URL: https://github.com/apache/spark/pull/24563 ## What changes were proposed in this pull request? An optimization for joins on a condition of `arrays_overlap`. I believe this worthwhile to integrate into

[GitHub] [spark] attilapiros commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

2019-05-08 Thread GitBox
attilapiros commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#issuecomment-490699288 I can see one more possible improvement here: in

[GitHub] [spark] SparkQA commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
SparkQA commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490696174 **[Test build #105271 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490696226 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490696230 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490696230 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
SparkQA removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490692583 **[Test build #105271 has

[GitHub] [spark] AmplabJenkins commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490696226 Merged build finished. Test PASSed. This is an

[GitHub] [spark] wangyum commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-05-08 Thread GitBox
wangyum commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-490695924 > Have you manually tested it? To read the Spark bucketed table in Hive side as non-bucketed table? Yes. I

[GitHub] [spark] AmplabJenkins removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490693637 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490693637 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
AmplabJenkins commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490693633 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490693633 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
SparkQA commented on issue #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562#issuecomment-490692583 **[Test build #105271 has

[GitHub] [spark] wangyum opened a new pull request #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command

2019-05-08 Thread GitBox
wangyum opened a new pull request #24562: [SPARK-27662][SQL] Fix SQL tab shows two jobs for one SQL command URL: https://github.com/apache/spark/pull/24562 ## What changes were proposed in this pull request?

[GitHub] [spark] HyukjinKwon closed pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources

2019-05-08 Thread GitBox
HyukjinKwon closed pull request #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources URL: https://github.com/apache/spark/pull/24518 This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on issue #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources

2019-05-08 Thread GitBox
HyukjinKwon commented on issue #24518: [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources URL: https://github.com/apache/spark/pull/24518#issuecomment-490690215 Merged to master. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24561: [SPARK-26130] : Change Event Timeline Display Functionality on the Stages Page to use either REST API or data from other tables

2019-05-08 Thread GitBox
AmplabJenkins removed a comment on issue #24561: [SPARK-26130] : Change Event Timeline Display Functionality on the Stages Page to use either REST API or data from other tables URL: https://github.com/apache/spark/pull/24561#issuecomment-490671885 Test PASSed. Refer to this link for

  1   2   3   4   5   >