[GitHub] [spark] HyukjinKwon commented on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-10 Thread GitBox
HyukjinKwon commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-656965789 I commented and filed two JIRAs SPARK-32278 and SPARK-32279 for Jenkins env. cc @shaneknapp FYI. Currently, PyPy 3 is not being tested in Jenkins, and PySpark

[GitHub] [spark] viirya commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
viirya commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656964407 Before merging this, can we list what works and what doesn't so far in Github Actions to replace Jenkins? After this, does it mean we can rely on Github Actions to decide if a

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-656964066 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-10 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-656959177 @srowen @huaxingao So could we use `datetime` in mysql dialect of spark? The zoneinfo index seems should be considered in mysql side because when we write timestamp to

[GitHub] [spark] AmplabJenkins commented on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-656964066 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-10 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-656959177 @srowen So could we use `datetime` in mysql dialect of spark? The zoneinfo index seems should be considered in mysql side because when we write timestamp to mysql, the

[GitHub] [spark] AmplabJenkins commented on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-656960828 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28972: [SPARK-30794][CORE] Stage Level scheduling: Add ability to set off heap memory

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28972: URL: https://github.com/apache/spark/pull/28972#issuecomment-656960828 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656960105 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
dongjoon-hyun edited a comment on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656960153 Hi, @AngersZh . The patch itself looks good and I also tested the patch and new test suite. However, Jenkins seems to unable to handle branch change for some

[GitHub] [spark] AmplabJenkins commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656960099 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656960099 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656960153 Hi, @AngersZh . It looks good and I also tested the patch and new test suite. However, Jenkins seems to unable to handle branch change for some reason. Could you make

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656960187 **[Test build #125659 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125659/testReport)** for PR 29057 at commit

[GitHub] [spark] SparkQA commented on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
SparkQA commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656959838 **[Test build #125642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125642/testReport)** for PR 29067 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656910151 **[Test build #125642 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125642/testReport)** for PR 29067 at commit

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-10 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-656959177 @srowen So could we use `datetime` in mysql dialect of spark, the zoneinfo index seems should be considered in mysql side.

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-10 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-656959177 @srowen So could we use `datetime` in mysql dialect, the zoneinfo index seems should be considered in mysql side.

[GitHub] [spark] TJX2014 commented on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-10 Thread GitBox
TJX2014 commented on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-656959177 @srowen So could we use `datetime` in mysql dialect, the zoneinfo seems should be considered in mysql side.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656957486 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656957486 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656956554 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656956570 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656956554 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29063: [SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a different encoding

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29063: URL: https://github.com/apache/spark/pull/29063#issuecomment-656955813 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29063: [SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a different encoding

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29063: URL: https://github.com/apache/spark/pull/29063#issuecomment-656955813 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due t

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656955280 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark'

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656955277 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29063: [SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a different encoding

2020-07-10 Thread GitBox
SparkQA commented on pull request #29063: URL: https://github.com/apache/spark/pull/29063#issuecomment-656955388 **[Test build #125658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125658/testReport)** for PR 29063 at commit

[GitHub] [spark] frankyin-factual commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-10 Thread GitBox
frankyin-factual commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-656955342 Turns out our class of mock doesn't have a complicated constructor. This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due t

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656955277 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
HyukjinKwon commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656954922 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656954967 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656955036 **[Test build #125657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125657/testReport)** for PR 29057 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656954967 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] frankyin-factual commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-10 Thread GitBox
frankyin-factual commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-656954852 that's the code for `StdInstantiatorStrategy`: ``` public ObjectInstantiator newInstantiatorOf(Class type) {

[GitHub] [spark] frankyin-factual commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-10 Thread GitBox
frankyin-factual commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-656954497 I think the default one uses `ObjenesisInstantiator` which uses `StdInstantiatorStrategy` that goes pretty deep in vendor-specific JVM. I switched them to use

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-10 Thread GitBox
HyukjinKwon commented on a change in pull request #28957: URL: https://github.com/apache/spark/pull/28957#discussion_r453134925 ## File path: python/run-tests.py ## @@ -161,7 +157,7 @@ def run_individual_python_test(target_dir, test_name, pyspark_python): def

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-10 Thread GitBox
HyukjinKwon commented on a change in pull request #28957: URL: https://github.com/apache/spark/pull/28957#discussion_r453134787 ## File path: dev/lint-python ## @@ -207,7 +207,7 @@ PYTHON_SOURCE="$(find . -name "*.py")" compile_python_test "$PYTHON_SOURCE" pycodestyle_test

[GitHub] [spark] SparkQA removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spar

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656882557 **[Test build #125637 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125637/testReport)** for PR 28287 at commit

[GitHub] [spark] SparkQA commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's blac

2020-07-10 Thread GitBox
SparkQA commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656954246 **[Test build #125637 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125637/testReport)** for PR 28287 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-10 Thread GitBox
HyukjinKwon commented on a change in pull request #28957: URL: https://github.com/apache/spark/pull/28957#discussion_r453134667 ## File path: dev/run-tests.py ## @@ -649,7 +649,7 @@ def main(): # if "DOCS" in changed_modules and test_env == "amplab_jenkins": #

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29063: [SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a different encoding

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29063: URL: https://github.com/apache/spark/pull/29063#issuecomment-656806031 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-10 Thread GitBox
srowen commented on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-656953804 ... that is a very significant difference in what the 8 bytes mean! This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on pull request #29063: [SPARK-32270][SQL] Use TextFileFormat in CSV's schema inference with a different encoding

2020-07-10 Thread GitBox
HyukjinKwon commented on pull request #29063: URL: https://github.com/apache/spark/pull/29063#issuecomment-656953688 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656953267 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656953326 **[Test build #125656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125656/testReport)** for PR 29057 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656953264 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656953264 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-10 Thread GitBox
HeartSaVioR commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-656953089 Unfortunately it turned out my patch didn't fix the issue (so I'm OK to revert my patch if we want to) - that said, I'd like to see the analysis how it fixes the issue if

[GitHub] [spark] SparkQA removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656885871 **[Test build #125639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125639/testReport)** for PR 27366 at commit

[GitHub] [spark] SparkQA commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
SparkQA commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656952707 **[Test build #125639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125639/testReport)** for PR 27366 at commit

[GitHub] [spark] HyukjinKwon edited a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
HyukjinKwon edited a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656951473 Yes, we should wait for Jenkins result because Jenkins and Github Actions share the same script. Also, there was an issue in Jenkins and GitHub actions about conda.

[GitHub] [spark] HyukjinKwon commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
HyukjinKwon commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656951473 Yes, we should wait for Jenkins result because Jenkins and Github Actions share the same script. Also, there was an issue in Jenkins and GitHub actions about conda.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656951474 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656951474 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
HeartSaVioR commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656950858 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656950329 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656950326 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
HyukjinKwon commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656950448 @dongjoon-hyun, that's a good idea. I was thinking about splitting it too. Let me split. This is an

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656950326 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-10 Thread GitBox
SparkQA commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656950401 **[Test build #125655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125655/testReport)** for PR 29034 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656888602 **[Test build #125640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125640/testReport)** for PR 29057 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656950041 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-656950041 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656949882 **[Test build #125640 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125640/testReport)** for PR 29057 at commit

[GitHub] [spark] TJX2014 commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-10 Thread GitBox
TJX2014 commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-656949064 Thank you very much. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-10 Thread GitBox
SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656948958 **[Test build #125654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125654/testReport)** for PR 28898 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-656948875 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-656948875 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656922596 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] TJX2014 commented on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-10 Thread GitBox
TJX2014 commented on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-656948258 @huaxingao @srowen Sure, DATETIME and TIMESTAMP seems both have 8 bytes, while DATE only 4 bytes, the only thing different in mysql seems is timezone index.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656947645 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-656941575 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-656809867 **[Test build #125630 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125630/testReport)** for PR 29053 at commit

[GitHub] [spark] SparkQA commented on pull request #29053: [SPARK-32241][SQL] Remove empty children of union

2020-07-10 Thread GitBox
SparkQA commented on pull request #29053: URL: https://github.com/apache/spark/pull/29053#issuecomment-656947959 **[Test build #125630 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125630/testReport)** for PR 29053 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656944953 **[Test build #125651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125651/testReport)** for PR 29070 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656947640 Build finished. Test FAILed. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] SparkQA commented on pull request #27988: [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

2020-07-10 Thread GitBox
SparkQA commented on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-656947711 **[Test build #125653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125653/testReport)** for PR 27988 at commit

[GitHub] [spark] SparkQA commented on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
SparkQA commented on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656947634 **[Test build #125651 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125651/testReport)** for PR 29070 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656947640 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656946453 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656946447 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656946447 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-10 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-656946531 **[Test build #125652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125652/testReport)** for PR 28969 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656822196 **[Test build #125634 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125634/testReport)** for PR 29066 at commit

[GitHub] [spark] SparkQA commented on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
SparkQA commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656946059 **[Test build #125634 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125634/testReport)** for PR 29066 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656944892 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
SparkQA commented on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656944953 **[Test build #125651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125651/testReport)** for PR 29070 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656944889 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656944889 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-656935253 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-10 Thread GitBox
SparkQA commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656944810 **[Test build #125644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125644/testReport)** for PR 28979 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-656944596 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-656922703 **[Test build #125644 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125644/testReport)** for PR 28979 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-656944591 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-656944591 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #27988: [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

2020-07-10 Thread GitBox
SparkQA commented on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-656944671 **[Test build #125650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125650/testReport)** for PR 27988 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656944368 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-656944368 This is an automated message from the Apache Git Service. To respond to the message, please log on

<    1   2   3   4   5   6   7   8   9   10   >