[GitHub] [spark] SparkQA removed a comment on issue #27803: [SPARK-31049][SQL] Support nested adjacent generators, e.g., explode(explode(v))

2020-04-12 Thread GitBox
SparkQA removed a comment on issue #27803: [SPARK-31049][SQL] Support nested adjacent generators, e.g., explode(explode(v)) URL: https://github.com/apache/spark/pull/27803#issuecomment-612709628 **[Test build #121159 has

[GitHub] [spark] SparkQA commented on issue #27803: [SPARK-31049][SQL] Support nested adjacent generators, e.g., explode(explode(v))

2020-04-12 Thread GitBox
SparkQA commented on issue #27803: [SPARK-31049][SQL] Support nested adjacent generators, e.g., explode(explode(v)) URL: https://github.com/apache/spark/pull/27803#issuecomment-612764187 **[Test build #121159 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407331253 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support URL: https://github.com/apache/spark/pull/28197#issuecomment-612762927 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support URL: https://github.com/apache/spark/pull/28197#issuecomment-612762922 Merged build finished. Test PASSed. This is an

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407330270 ## File path: python/pyspark/__init__.py ## @@ -119,5 +119,5 @@ def

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407330348 ## File path: core/src/test/java/test/org/apache/spark/JavaAPISuite.java

[GitHub] [spark] AmplabJenkins commented on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support URL: https://github.com/apache/spark/pull/28197#issuecomment-612762922 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support URL: https://github.com/apache/spark/pull/28197#issuecomment-612762927 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407329974 ## File path: python/pyspark/rdd.py ## @@ -2483,6 +2485,32 @@ def

[GitHub] [spark] SparkQA commented on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support

2020-04-12 Thread GitBox
SparkQA commented on issue #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support URL: https://github.com/apache/spark/pull/28197#issuecomment-612762632 **[Test build #121166 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121166/testReport)** for

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407329974 ## File path: python/pyspark/rdd.py ## @@ -2483,6 +2485,32 @@ def

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407329922 ## File path: python/pyspark/rdd.py ## @@ -2483,6 +2485,32 @@ def

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407324542 ## File path: python/pyspark/resource/taskresourcerequests.py ## @@

[GitHub] [spark] yaooqinn opened a new pull request #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support

2020-04-12 Thread GitBox
yaooqinn opened a new pull request #28197: [SPARK-31431][SQL] Add CalendarInterval encoder support URL: https://github.com/apache/spark/pull/28197 ### What changes were proposed in this pull request? CalenderInterval is available to be converted to/from internal Spark SQL

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407329187 ## File path: python/pyspark/resource/taskresourcerequests.py ## @@

[GitHub] [spark] maropu commented on a change in pull request #28196: [SPARK-31428][SQL][DOCS] Document Common Table Expression in SQL Reference

2020-04-12 Thread GitBox
maropu commented on a change in pull request #28196: [SPARK-31428][SQL][DOCS] Document Common Table Expression in SQL Reference URL: https://github.com/apache/spark/pull/28196#discussion_r407328776 ## File path: docs/sql-ref-syntax-qry-select-cte.md ## @@ -19,4 +19,120 @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407326535 ## File path: python/pyspark/resource/taskresourcerequests.py ## @@

[GitHub] [spark] maropu commented on a change in pull request #28196: [SPARK-31428][SQL][DOCS] Document Common Table Expression in SQL Reference

2020-04-12 Thread GitBox
maropu commented on a change in pull request #28196: [SPARK-31428][SQL][DOCS] Document Common Table Expression in SQL Reference URL: https://github.com/apache/spark/pull/28196#discussion_r407328283 ## File path: docs/sql-ref-syntax-qry-select-cte.md ## @@ -19,4 +19,120 @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407328111 ## File path: python/pyspark/resource/taskresourcerequest.py ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407328249 ## File path: python/pyspark/resource/taskresourcerequest.py ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407327964 ## File path: python/pyspark/resource/taskresourcerequest.py ## @@

[GitHub] [spark] cloud-fan commented on issue #28165: [SPARK-31392][SQL] Support CalendarInterval to be reflect to CalendarntervalType

2020-04-12 Thread GitBox
cloud-fan commented on issue #28165: [SPARK-31392][SQL] Support CalendarInterval to be reflect to CalendarntervalType URL: https://github.com/apache/spark/pull/28165#issuecomment-612760554 I'm OK too. @yaooqinn can you open a backport PR?

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407327964 ## File path: python/pyspark/resource/taskresourcerequest.py ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407327785 ## File path: python/pyspark/resource/taskresourcerequests.py ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check. URL: https://github.com/apache/spark/pull/28194#issuecomment-612759479 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check. URL: https://github.com/apache/spark/pull/28194#issuecomment-612759477 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check. URL: https://github.com/apache/spark/pull/28194#issuecomment-612759477 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check. URL: https://github.com/apache/spark/pull/28194#issuecomment-612759479 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-12 Thread GitBox
SparkQA commented on issue #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check. URL: https://github.com/apache/spark/pull/28194#issuecomment-612759184 **[Test build #121165 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407326535 ## File path: python/pyspark/resource/taskresourcerequests.py ## @@

[GitHub] [spark] cloud-fan commented on issue #28169: [SPARK-31398][SQL] Fix perf regression of loading dates before 1582 year by non-vectorized ORC reader

2020-04-12 Thread GitBox
cloud-fan commented on issue #28169: [SPARK-31398][SQL] Fix perf regression of loading dates before 1582 year by non-vectorized ORC reader URL: https://github.com/apache/spark/pull/28169#issuecomment-612757611 thanks, merging to master/3.0!

[GitHub] [spark] cloud-fan closed pull request #28169: [SPARK-31398][SQL] Fix perf regression of loading dates before 1582 year by non-vectorized ORC reader

2020-04-12 Thread GitBox
cloud-fan closed pull request #28169: [SPARK-31398][SQL] Fix perf regression of loading dates before 1582 year by non-vectorized ORC reader URL: https://github.com/apache/spark/pull/28169 This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612757013 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612757018 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
SparkQA removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612753659 **[Test build #121164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121164/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612757013 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612757018 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
SparkQA commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612756912 **[Test build #121164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121164/testReport)** for PR

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407324621 ## File path: python/pyspark/resource/taskresourcerequests.py ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407324542 ## File path: python/pyspark/resource/taskresourcerequests.py ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407324422 ## File path: python/pyspark/resource/taskresourcerequests.py ## @@

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407324205 ## File path: python/pyspark/resource/taskresourcerequests.py ## @@

[GitHub] [spark] cloud-fan commented on issue #28195: [SPARK-31425][SQL][CORE] UnsafeKVExternalSorter should also respect UnsafeAlignedOffset

2020-04-12 Thread GitBox
cloud-fan commented on issue #28195: [SPARK-31425][SQL][CORE] UnsafeKVExternalSorter should also respect UnsafeAlignedOffset URL: https://github.com/apache/spark/pull/28195#issuecomment-612755485 can we have a test? This is

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

2020-04-12 Thread GitBox
HyukjinKwon commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r407323396 ## File path: python/pyspark/resource/executorresourcerequest.py ## @@

[GitHub] [spark] cloud-fan commented on a change in pull request #28195: [SPARK-31425][SQL][CORE] UnsafeKVExternalSorter should also respect UnsafeAlignedOffset

2020-04-12 Thread GitBox
cloud-fan commented on a change in pull request #28195: [SPARK-31425][SQL][CORE] UnsafeKVExternalSorter should also respect UnsafeAlignedOffset URL: https://github.com/apache/spark/pull/28195#discussion_r407323381 ## File path:

[GitHub] [spark] maropu commented on issue #28041: [SPARK-30564][SQL] Improved extra new line and comment remove

2020-04-12 Thread GitBox
maropu commented on issue #28041: [SPARK-30564][SQL] Improved extra new line and comment remove URL: https://github.com/apache/spark/pull/28041#issuecomment-612755145 > Pretty big amount of the source code we currently generate is comment or extra whitespace/newline. If so, how

[GitHub] [spark] cloud-fan commented on a change in pull request #28195: [SPARK-31425][SQL][CORE] UnsafeKVExternalSorter should also respect UnsafeAlignedOffset

2020-04-12 Thread GitBox
cloud-fan commented on a change in pull request #28195: [SPARK-31425][SQL][CORE] UnsafeKVExternalSorter should also respect UnsafeAlignedOffset URL: https://github.com/apache/spark/pull/28195#discussion_r407322984 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612754002 Test PASSed. Refer to this link for

[GitHub] [spark] AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612753998 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612754002 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612753895 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612753897 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612753998 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612753895 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612753897 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
SparkQA commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612753659 **[Test build #121164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121164/testReport)** for PR

[GitHub] [spark] SparkQA removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
SparkQA removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612718790 **[Test build #121161 has

[GitHub] [spark] SparkQA commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
SparkQA commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612753440 **[Test build #121161 has

[GitHub] [spark] huaxingao commented on issue #28185: [SPARK-31419][SQL][DOCS] Document Table-valued Function and Inline Table

2020-04-12 Thread GitBox
huaxingao commented on issue #28185: [SPARK-31419][SQL][DOCS] Document Table-valued Function and Inline Table URL: https://github.com/apache/spark/pull/28185#issuecomment-612747918 Thank you everyone! This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612747558 Build finished. Test PASSed. This is an automated message from

[GitHub] [spark] huaxingao commented on issue #28087: [SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference

2020-04-12 Thread GitBox
huaxingao commented on issue #28087: [SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference URL: https://github.com/apache/spark/pull/28087#issuecomment-612747689 Thank you everyone! This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612747564 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612747564 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612747558 Build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
SparkQA commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612747332 **[Test build #121163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121163/testReport)** for PR

[GitHub] [spark] srowen commented on issue #28151: [SPARK-31383][SQL][DOC] Clean up the SQL documents in docs/sql-ref*

2020-04-12 Thread GitBox
srowen commented on issue #28151: [SPARK-31383][SQL][DOC] Clean up the SQL documents in docs/sql-ref* URL: https://github.com/apache/spark/pull/28151#issuecomment-612746941 Merged to master/3.0 This is an automated message

[GitHub] [spark] srowen closed pull request #28151: [SPARK-31383][SQL][DOC] Clean up the SQL documents in docs/sql-ref*

2020-04-12 Thread GitBox
srowen closed pull request #28151: [SPARK-31383][SQL][DOC] Clean up the SQL documents in docs/sql-ref* URL: https://github.com/apache/spark/pull/28151 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] srowen commented on issue #28185: [SPARK-31419][SQL][DOCS] Document Table-valued Function and Inline Table

2020-04-12 Thread GitBox
srowen commented on issue #28185: [SPARK-31419][SQL][DOCS] Document Table-valued Function and Inline Table URL: https://github.com/apache/spark/pull/28185#issuecomment-612746720 Merged to master/3.0 This is an automated

[GitHub] [spark] srowen closed pull request #28185: [SPARK-31419][SQL][DOCS] Document Table-valued Function and Inline Table

2020-04-12 Thread GitBox
srowen closed pull request #28185: [SPARK-31419][SQL][DOCS] Document Table-valued Function and Inline Table URL: https://github.com/apache/spark/pull/28185 This is an automated message from the Apache Git Service. To

[GitHub] [spark] srowen closed pull request #28087: [SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference

2020-04-12 Thread GitBox
srowen closed pull request #28087: [SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference URL: https://github.com/apache/spark/pull/28087 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] srowen commented on issue #28087: [SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference

2020-04-12 Thread GitBox
srowen commented on issue #28087: [SPARK-31319][SQL][DOCS] Document UDFs/UDAFs in SQL Reference URL: https://github.com/apache/spark/pull/28087#issuecomment-612746483 Merged to master/3.0 This is an automated message from

[GitHub] [spark] huaxingao commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
huaxingao commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612746259 Also cc @gatorsmile This is an automated message from the Apache

[GitHub] [spark] huaxingao commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function

2020-04-12 Thread GitBox
huaxingao commented on issue #28157: [SPARK-31390][SQL][DOCS] Document Window Function URL: https://github.com/apache/spark/pull/28157#issuecomment-612746102 Discussed with @HyukjinKwon offline. I will remove the Types of Window Function section because it is mainly listing the function

[GitHub] [spark] maryannxue commented on a change in pull request #27701: [SPARK-30953][SQL] InsertAdaptiveSparkPlan should apply AQE on child plan of write commands

2020-04-12 Thread GitBox
maryannxue commented on a change in pull request #27701: [SPARK-30953][SQL] InsertAdaptiveSparkPlan should apply AQE on child plan of write commands URL: https://github.com/apache/spark/pull/27701#discussion_r407305150 ## File path:

[GitHub] [spark] iRakson commented on issue #28167: [SPARK-31106][SQL] Support is_json function

2020-04-12 Thread GitBox
iRakson commented on issue #28167: [SPARK-31106][SQL] Support is_json function URL: https://github.com/apache/spark/pull/28167#issuecomment-612737278 > Hi, @iRakson . Please update the PR description with the following information which were requested by @gatorsmile . > > * [#28167

[GitHub] [spark] iRakson commented on issue #26901: [SPARK-29152][CORE][2.4] Executor Plugin shutdown when dynamic allocation is enabled

2020-04-12 Thread GitBox
iRakson commented on issue #26901: [SPARK-29152][CORE][2.4] Executor Plugin shutdown when dynamic allocation is enabled URL: https://github.com/apache/spark/pull/26901#issuecomment-612736866 gentle ping @dongjoon-hyun @vanzin

[GitHub] [spark] javierivanov commented on a change in pull request #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment.

2020-04-12 Thread GitBox
javierivanov commented on a change in pull request #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment. URL: https://github.com/apache/spark/pull/27920#discussion_r407301502 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #28177: [SPARK-31407][SQL][TEST] Fix hive/SQLQuerySuite.derived from Hive query file: drop_database_removes_partition_dirs.q

2020-04-12 Thread GitBox
cloud-fan commented on a change in pull request #28177: [SPARK-31407][SQL][TEST] Fix hive/SQLQuerySuite.derived from Hive query file: drop_database_removes_partition_dirs.q URL: https://github.com/apache/spark/pull/28177#discussion_r407301449 ## File path:

[GitHub] [spark] kachayev commented on a change in pull request #28133: [SPARK-31156][SQL] DataFrameStatFunctions API to be consistent with respect to Column type

2020-04-12 Thread GitBox
kachayev commented on a change in pull request #28133: [SPARK-31156][SQL] DataFrameStatFunctions API to be consistent with respect to Column type URL: https://github.com/apache/spark/pull/28133#discussion_r407301408 ## File path:

[GitHub] [spark] HyukjinKwon closed pull request #28182: [SPARK-29799][Streaming] add an implemention for issue SPARK-29799.

2020-04-12 Thread GitBox
HyukjinKwon closed pull request #28182: [SPARK-29799][Streaming] add an implemention for issue SPARK-29799. URL: https://github.com/apache/spark/pull/28182 This is an automated message from the Apache Git Service. To

[GitHub] [spark] cloud-fan closed pull request #28181: [SPARK-31414][SQL] Fix performance regression with new TimestampFormatter for json and csv time parsing

2020-04-12 Thread GitBox
cloud-fan closed pull request #28181: [SPARK-31414][SQL] Fix performance regression with new TimestampFormatter for json and csv time parsing URL: https://github.com/apache/spark/pull/28181 This is an automated message from

[GitHub] [spark] HeartSaVioR commented on issue #28182: [SPARK-29799][Streaming] add an implemention for issue SPARK-29799.

2020-04-12 Thread GitBox
HeartSaVioR commented on issue #28182: [SPARK-29799][Streaming] add an implemention for issue SPARK-29799. URL: https://github.com/apache/spark/pull/28182#issuecomment-612729043 That said, I'd say SPARK-23541 seems to be the better fix even we agree to pull the functionality into DStream

[GitHub] [spark] cloud-fan commented on issue #28181: [SPARK-31414][SQL] Fix performance regression with new TimestampFormatter for json and csv time parsing

2020-04-12 Thread GitBox
cloud-fan commented on issue #28181: [SPARK-31414][SQL] Fix performance regression with new TimestampFormatter for json and csv time parsing URL: https://github.com/apache/spark/pull/28181#issuecomment-612728893 good catch! LGTM, merging to master/3.0

[GitHub] [spark] kachayev commented on a change in pull request #28133: [SPARK-31156][SQL] DataFrameStatFunctions API to be consistent with respect to Column type

2020-04-12 Thread GitBox
kachayev commented on a change in pull request #28133: [SPARK-31156][SQL] DataFrameStatFunctions API to be consistent with respect to Column type URL: https://github.com/apache/spark/pull/28133#discussion_r407295549 ## File path:

[GitHub] [spark] HeartSaVioR commented on issue #28182: [SPARK-29799][Streaming] add an implemention for issue SPARK-29799.

2020-04-12 Thread GitBox
HeartSaVioR commented on issue #28182: [SPARK-29799][Streaming] add an implemention for issue SPARK-29799. URL: https://github.com/apache/spark/pull/28182#issuecomment-612727225 Adding repartition heavily affects latency if anyone is desired to have lower latency (despite the limitation

[GitHub] [spark] AmplabJenkins removed a comment on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment.

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment. URL: https://github.com/apache/spark/pull/27920#issuecomment-612726535 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment.

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment. URL: https://github.com/apache/spark/pull/27920#issuecomment-612726536 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment.

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment. URL: https://github.com/apache/spark/pull/27920#issuecomment-612726536 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment.

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment. URL: https://github.com/apache/spark/pull/27920#issuecomment-612726535 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment.

2020-04-12 Thread GitBox
SparkQA commented on issue #27920: [SPARK-31102][SQL] Spark-sql fails to parse when contains comment. URL: https://github.com/apache/spark/pull/27920#issuecomment-612726340 **[Test build #121162 has

[GitHub] [spark] cloud-fan commented on a change in pull request #28162: [SPARK-31391][SQL][TEST] Add AdaptiveTestUtils to ease the test of AQE

2020-04-12 Thread GitBox
cloud-fan commented on a change in pull request #28162: [SPARK-31391][SQL][TEST] Add AdaptiveTestUtils to ease the test of AQE URL: https://github.com/apache/spark/pull/28162#discussion_r407294384 ## File path:

[GitHub] [spark] beliefer commented on a change in pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

2020-04-12 Thread GitBox
beliefer commented on a change in pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check. URL: https://github.com/apache/spark/pull/28194#discussion_r407292501 ## File path: sql/core/src/test/resources/sql-functions/output.out ## @@ -0,0

[GitHub] [spark] turboFei edited a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
turboFei edited a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612717480 Hi @Ngone51 I have tried to add an ut

[GitHub] [spark] yaooqinn commented on issue #28106: [SPARK-31335][SQL] Add try function support

2020-04-12 Thread GitBox
yaooqinn commented on issue #28106: [SPARK-31335][SQL] Add try function support URL: https://github.com/apache/spark/pull/28106#issuecomment-612722053 @cloud-fan @HyukjinKwon @maropu, now this function only suppresses ```IllegalArgumentException | ArithmeticException | DateTimeException

[GitHub] [spark] yaooqinn commented on issue #28181: [SPARK-31414][SQL] Fix performance regression with new TimestampFormatter for json and csv time parsing

2020-04-12 Thread GitBox
yaooqinn commented on issue #28181: [SPARK-31414][SQL] Fix performance regression with new TimestampFormatter for json and csv time parsing URL: https://github.com/apache/spark/pull/28181#issuecomment-612721480 cc: @cloud-fan @maropu @dongjoon-hyun, thanks

[GitHub] [spark] AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612719055 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
AmplabJenkins removed a comment on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612719059 Test PASSed. Refer to this link for

[GitHub] [spark] AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612719059 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task

2020-04-12 Thread GitBox
AmplabJenkins commented on issue #26339: [SPARK-27194][SPARK-29302][SQL] Fix the issue that for dynamic partition overwrite a task would conflict with its speculative task URL: https://github.com/apache/spark/pull/26339#issuecomment-612719055 Merged build finished. Test PASSed.

  1   2   3   4   >