[GitHub] [spark] dongjoon-hyun closed pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
dongjoon-hyun closed pull request #28599: URL: https://github.com/apache/spark/pull/28599 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dbtsai commented on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
dbtsai commented on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632346811 Thanks. LGTM. This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #28544: [SPARK-31387][SQL] Handle unknown operation/session ID in HiveThriftServer2Listener

2020-05-21 Thread GitBox
dongjoon-hyun commented on pull request #28544: URL: https://github.com/apache/spark/pull/28544#issuecomment-632346946 Ur, @juliuszsompolski . In https://github.com/apache/spark/pull/28544#discussion_r428188247, did you mean this PR is still failing in some environment? > We found it fa

[GitHub] [spark] dongjoon-hyun commented on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
dongjoon-hyun commented on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632344596 Could you review this PR, @dbtsai and @holdenk ? This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632332642 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632332642 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632332208 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
SparkQA commented on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632332616 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/27584/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632332208 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28600: [SPARK-31761][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
SparkQA commented on pull request #28600: URL: https://github.com/apache/spark/pull/28600#issuecomment-632331581 **[Test build #122943 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122943/testReport)** for PR 28600 at commit [`cac15d9`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632330285 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632330279 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632330017 **[Test build #122938 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122938/testReport)** for PR 28592 at commit [`b2abeeb`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632243456 **[Test build #122938 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122938/testReport)** for PR 28592 at commit [`b2abeeb`](https://gi

[GitHub] [spark] sandeep-katta opened a new pull request #28600: [SPARK-16323][SQL] cast integer to Long to avoid IntegerOverflow for IntegralDivide operator

2020-05-21 Thread GitBox
sandeep-katta opened a new pull request #28600: URL: https://github.com/apache/spark/pull/28600 ### What changes were proposed in this pull request? `IntegralDivide` operator returns Long DataType, so integer overflow case should be handled. If the operands are of type Int it will be

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632330279 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
SparkQA commented on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632322054 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/27584/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632319593 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122

[GitHub] [spark] AmplabJenkins commented on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632319582 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
SparkQA commented on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632319410 **[Test build #122942 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122942/testReport)** for PR 28599 at commit [`4a2ac39`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632319582 Merged build finished. Test PASSed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632311611 **[Test build #122942 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122942/testReport)** for PR 28599 at commit [`4a2ac39`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632317669 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632317665 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632317665 Build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632317204 **[Test build #122937 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122937/testReport)** for PR 28592 at commit [`c877ac5`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632239244 **[Test build #122937 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122937/testReport)** for PR 28592 at commit [`c877ac5`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Fix Minikube.getIfNewMinikubeStatus to understand 1.5+

2020-05-21 Thread GitBox
SparkQA commented on pull request #28599: URL: https://github.com/apache/spark/pull/28599#issuecomment-632311611 **[Test build #122942 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122942/testReport)** for PR 28599 at commit [`4a2ac39`](https://github.com

[GitHub] [spark] dongjoon-hyun opened a new pull request #28599: [SPARK-31787][K8S][TESTS][2.4] Support Minikube 1.5.x in K8s IT

2020-05-21 Thread GitBox
dongjoon-hyun opened a new pull request #28599: URL: https://github.com/apache/spark/pull/28599 ### What changes were proposed in this pull request? This is a subset of #26488 with the same ownership. ### Why are the changes needed? ### Does this PR introduce _an

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28485: [SPARK-31642] Add Pagination Support for Structured Streaming Page

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28485: URL: https://github.com/apache/spark/pull/28485#issuecomment-632294377 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28485: [SPARK-31642] Add Pagination Support for Structured Streaming Page

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28485: URL: https://github.com/apache/spark/pull/28485#issuecomment-632294377 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28485: [SPARK-31642] Add Pagination Support for Structured Streaming Page

2020-05-21 Thread GitBox
SparkQA commented on pull request #28485: URL: https://github.com/apache/spark/pull/28485#issuecomment-632293771 **[Test build #122941 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122941/testReport)** for PR 28485 at commit [`088c551`](https://github.com

[GitHub] [spark] iRakson commented on pull request #28485: [SPARK-31642] Add Pagination Support for Structured Streaming Page

2020-05-21 Thread GitBox
iRakson commented on pull request #28485: URL: https://github.com/apache/spark/pull/28485#issuecomment-632291678 @srowen @sarutak @uncleGen This PR has been updated. This is an automated message from the Apache Git Service. T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-632280810 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27664: [SPARK-30915][SS] CompactibleFileStreamLog: Avoid reading the metadata log file when finding the latest batch ID

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #27664: URL: https://github.com/apache/spark/pull/27664#issuecomment-632280288 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-632280810 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-632108254 **[Test build #122934 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122934/testReport)** for PR 25965 at commit [`1744179`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #27664: [SPARK-30915][SS] CompactibleFileStreamLog: Avoid reading the metadata log file when finding the latest batch ID

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #27664: URL: https://github.com/apache/spark/pull/27664#issuecomment-632280288 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption

2020-05-21 Thread GitBox
SparkQA commented on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-632279644 **[Test build #122934 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122934/testReport)** for PR 25965 at commit [`1744179`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #27664: [SPARK-30915][SS] CompactibleFileStreamLog: Avoid reading the metadata log file when finding the latest batch ID

2020-05-21 Thread GitBox
SparkQA commented on pull request #27664: URL: https://github.com/apache/spark/pull/27664#issuecomment-632279009 **[Test build #122933 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122933/testReport)** for PR 27664 at commit [`83451c1`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #27664: [SPARK-30915][SS] CompactibleFileStreamLog: Avoid reading the metadata log file when finding the latest batch ID

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #27664: URL: https://github.com/apache/spark/pull/27664#issuecomment-632104207 **[Test build #122933 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122933/testReport)** for PR 27664 at commit [`83451c1`](https://gi

[GitHub] [spark] gengliangwang commented on pull request #28578: [SPARK-31756][WEBUI] Add real headless browser support for UI test

2020-05-21 Thread GitBox
gengliangwang commented on pull request #28578: URL: https://github.com/apache/spark/pull/28578#issuecomment-632278408 @sarutak seems there is code conflict after https://github.com/apache/spark/pull/28585 is merged. This is

[GitHub] [spark] gengliangwang closed pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-05-21 Thread GitBox
gengliangwang closed pull request #28585: URL: https://github.com/apache/spark/pull/28585 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] gengliangwang commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

2020-05-21 Thread GitBox
gengliangwang commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-632275960 merging to master This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] sathyaprakashg closed pull request #28222: SPARK-31447 Fix issue in ExtractIntervalPart expression

2020-05-21 Thread GitBox
sathyaprakashg closed pull request #28222: URL: https://github.com/apache/spark/pull/28222 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632263512 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/122

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632263505 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632263505 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632146298 **[Test build #122935 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122935/testReport)** for PR 28592 at commit [`549a122`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632263121 **[Test build #122935 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122935/testReport)** for PR 28592 at commit [`549a122`](https://github.co

[GitHub] [spark] tgravescs commented on pull request #28094: [SPARK-29303][Web UI] Add UI support for stage level scheduling

2020-05-21 Thread GitBox
tgravescs commented on pull request #28094: URL: https://github.com/apache/spark/pull/28094#issuecomment-632261007 Merging to master This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] asfgit closed pull request #28094: [SPARK-29303][Web UI] Add UI support for stage level scheduling

2020-05-21 Thread GitBox
asfgit closed pull request #28094: URL: https://github.com/apache/spark/pull/28094 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [spark] iRakson commented on pull request #28512: [SPARK-31688][WEBUI] Refactor Pagination framework

2020-05-21 Thread GitBox
iRakson commented on pull request #28512: URL: https://github.com/apache/spark/pull/28512#issuecomment-632258679 Thank You. 😊 @srowen @sarutak This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [spark] srowen closed pull request #28512: [SPARK-31688][WEBUI] Refactor Pagination framework

2020-05-21 Thread GitBox
srowen closed pull request #28512: URL: https://github.com/apache/spark/pull/28512 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [spark] srowen commented on pull request #28512: [SPARK-31688][WEBUI] Refactor Pagination framework

2020-05-21 Thread GitBox
srowen commented on pull request #28512: URL: https://github.com/apache/spark/pull/28512#issuecomment-632255678 Merged to master This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] huaxingao commented on pull request #28553: [SPARK-31734][ML][PySpark] Add weight support in ClusteringEvaluator

2020-05-21 Thread GitBox
huaxingao commented on pull request #28553: URL: https://github.com/apache/spark/pull/28553#issuecomment-632252469 cc @srowen This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] huaxingao commented on pull request #28595: [SPARK-31781][ML][PySpark] Move param k (number of clusters) to shared params

2020-05-21 Thread GitBox
huaxingao commented on pull request #28595: URL: https://github.com/apache/spark/pull/28595#issuecomment-632252188 cc @srowen This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] huaxingao commented on pull request #28595: [SPARK-31781][ML][PySpark] Move param k (number of clusters) to shared params

2020-05-21 Thread GitBox
huaxingao commented on pull request #28595: URL: https://github.com/apache/spark/pull/28595#issuecomment-632251801 Actually the param in ALS is called ```rank``` instead of ```k```. I am a little hesitant to reuse ```k``` in RankingEvaluator because it has a totally different meaning. I

[GitHub] [spark] huaxingao commented on pull request #28590: [SPARK-31768][ML] add getMetrics in Evaluators

2020-05-21 Thread GitBox
huaxingao commented on pull request #28590: URL: https://github.com/apache/spark/pull/28590#issuecomment-632246256 > Is there any way to recompute another metric in evaluator without involving mllib.metrics? It might be better to create a ml wrapper for mllib.metrics instead of using

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-632244984 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-632244984 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632244007 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-632244056 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-632244083 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-632068610 **[Test build #122932 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122932/testReport)** for PR 28576 at commit [`161223b`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-632244056 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632244007 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-21 Thread GitBox
SparkQA commented on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-632243655 **[Test build #122932 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122932/testReport)** for PR 28576 at commit [`161223b`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-632244075 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632243456 **[Test build #122938 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122938/testReport)** for PR 28592 at commit [`b2abeeb`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-05-21 Thread GitBox
SparkQA commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-632243446 **[Test build #122939 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122939/testReport)** for PR 27617 at commit [`1eb480a`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-05-21 Thread GitBox
SparkQA commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-632243504 **[Test build #122940 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122940/testReport)** for PR 27366 at commit [`262e3c7`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632239959 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632239959 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632239244 **[Test build #122937 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122937/testReport)** for PR 28592 at commit [`c877ac5`](https://github.com

[GitHub] [spark] cloud-fan commented on pull request #28523: [SPARK-31706][SQL] add back the support of streaming update mode

2020-05-21 Thread GitBox
cloud-fan commented on pull request #28523: URL: https://github.com/apache/spark/pull/28523#issuecomment-632230688 This PR (including code diff and PR description) is verbatim as it was when created. I thought you misread this PR, because your comment right after the veto comment actually

[GitHub] [spark] SparkQA commented on pull request #28598: [SPARK-31785][SQL][TESTS] Add a helper function to test all parquet readers

2020-05-21 Thread GitBox
SparkQA commented on pull request #28598: URL: https://github.com/apache/spark/pull/28598#issuecomment-63711 **[Test build #122936 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122936/testReport)** for PR 28598 at commit [`5ffc1e4`](https://github.com

[GitHub] [spark] MaxGekk commented on a change in pull request #28598: [SPARK-31785][SQL][TESTS] Add a helper function to test all parquet readers

2020-05-21 Thread GitBox
MaxGekk commented on a change in pull request #28598: URL: https://github.com/apache/spark/pull/28598#discussion_r428779913 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetTest.scala ## @@ -162,4 +162,36 @@ private[sql] trait Par

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28598: [SPARK-31785][SQL][TESTS] Add a helper function to test all parquet readers

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28598: URL: https://github.com/apache/spark/pull/28598#issuecomment-632219275 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28598: [SPARK-31785][SQL][TESTS] Add a helper function to test all parquet readers

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28598: URL: https://github.com/apache/spark/pull/28598#issuecomment-632219275 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28598: [SPARK-31785][SQL][TESTS] Add a helper function to test all parquet readers

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28598: URL: https://github.com/apache/spark/pull/28598#issuecomment-632188410 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28598: [SPARK-31785][SQL][TESTS] Add a helper function to test all parquet readers

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28598: URL: https://github.com/apache/spark/pull/28598#issuecomment-632188410 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28598: [SPARK-31785][SQL][TESTS] Add a helper function to test all parquet readers

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28598: URL: https://github.com/apache/spark/pull/28598#issuecomment-632045706 **[Test build #122930 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122930/testReport)** for PR 28598 at commit [`1c8b0e9`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28598: [SPARK-31785][SQL][TESTS] Add a helper function to test all parquet readers

2020-05-21 Thread GitBox
SparkQA commented on pull request #28598: URL: https://github.com/apache/spark/pull/28598#issuecomment-632187258 **[Test build #122930 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122930/testReport)** for PR 28598 at commit [`1c8b0e9`](https://github.co

[GitHub] [spark] rdblue commented on pull request #28523: [SPARK-31706][SQL] add back the support of streaming update mode

2020-05-21 Thread GitBox
rdblue commented on pull request #28523: URL: https://github.com/apache/spark/pull/28523#issuecomment-632185172 This PR wasn't ready to review until late Monday where I am, and was merged less than a day later. I had also assumed that the fix would be in a separate PR, which is why I didn'

[GitHub] [spark] cloud-fan commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r428759386 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -86,6 +86,25 @@ trait DateTimeFormatte

[GitHub] [spark] cloud-fan commented on a change in pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
cloud-fan commented on a change in pull request #28592: URL: https://github.com/apache/spark/pull/28592#discussion_r428758919 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateFormatter.scala ## @@ -40,7 +41,11 @@ class Iso8601DateFormatter( e

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28128: [SPARK-31354] SparkContext only register one SparkSession ApplicationEnd listener

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28128: URL: https://github.com/apache/spark/pull/28128#issuecomment-632180091 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28128: [SPARK-31354] SparkContext only register one SparkSession ApplicationEnd listener

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28128: URL: https://github.com/apache/spark/pull/28128#issuecomment-632180091 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] cloud-fan commented on pull request #28128: [SPARK-31354] SparkContext only register one SparkSession ApplicationEnd listener

2020-05-21 Thread GitBox
cloud-fan commented on pull request #28128: URL: https://github.com/apache/spark/pull/28128#issuecomment-632179830 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [spark] cloud-fan closed pull request #28128: [SPARK-31354] SparkContext only register one SparkSession ApplicationEnd listener

2020-05-21 Thread GitBox
cloud-fan closed pull request #28128: URL: https://github.com/apache/spark/pull/28128 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] SparkQA removed a comment on pull request #28128: [SPARK-31354] SparkContext only register one SparkSession ApplicationEnd listener

2020-05-21 Thread GitBox
SparkQA removed a comment on pull request #28128: URL: https://github.com/apache/spark/pull/28128#issuecomment-632038999 **[Test build #122929 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122929/testReport)** for PR 28128 at commit [`cfa1462`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28128: [SPARK-31354] SparkContext only register one SparkSession ApplicationEnd listener

2020-05-21 Thread GitBox
SparkQA commented on pull request #28128: URL: https://github.com/apache/spark/pull/28128#issuecomment-632178495 **[Test build #122929 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122929/testReport)** for PR 28128 at commit [`cfa1462`](https://github.co

[GitHub] [spark] cloud-fan commented on pull request #27627: [WIP][SPARK-28067][SQL] Fix incorrect results for decimal aggregate sum by returning null on decimal overflow

2020-05-21 Thread GitBox
cloud-fan commented on pull request #27627: URL: https://github.com/apache/spark/pull/27627#issuecomment-632166970 Hi @skambha , I've sent you a PR to only check overflow in `evaluateExpression`, and pass the tests. Can you take a look? https://github.com/skambha/spark/pull/1 ---

[GitHub] [spark] Ngone51 commented on a change in pull request #28258: [SPARK-31486] [CORE] spark.submit.waitAppCompletion flag to control spark-submit exit in Standalone Cluster Mode

2020-05-21 Thread GitBox
Ngone51 commented on a change in pull request #28258: URL: https://github.com/apache/spark/pull/28258#discussion_r428729898 ## File path: core/src/main/scala/org/apache/spark/deploy/Client.scala ## @@ -176,6 +202,22 @@ private class ClientEndpoint( } else if (!Utils.resp

[GitHub] [spark] akshatb1 commented on a change in pull request #28258: [SPARK-31486] [CORE] spark.submit.waitAppCompletion flag to control spark-submit exit in Standalone Cluster Mode

2020-05-21 Thread GitBox
akshatb1 commented on a change in pull request #28258: URL: https://github.com/apache/spark/pull/28258#discussion_r428727134 ## File path: core/src/main/scala/org/apache/spark/deploy/Client.scala ## @@ -176,6 +202,22 @@ private class ClientEndpoint( } else if (!Utils.res

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632147078 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
AmplabJenkins commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632147078 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28592: [SPARK-31771][SQL] Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-21 Thread GitBox
SparkQA commented on pull request #28592: URL: https://github.com/apache/spark/pull/28592#issuecomment-632146298 **[Test build #122935 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122935/testReport)** for PR 28592 at commit [`549a122`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28525: [SPARK-27562][Shuffle] Complete the verification mechanism for shuffle transmitted data

2020-05-21 Thread GitBox
AmplabJenkins removed a comment on pull request #28525: URL: https://github.com/apache/spark/pull/28525#issuecomment-632142075 This is an automated message from the Apache Git Service. To respond to the message, please log on

<    1   2   3   4   5   6   >