[GitHub] [spark] SparkQA commented on issue #27353: [SPARK-27166][SQL][FOLLOWUP] Refactor to build string once

2020-01-24 Thread GitBox
SparkQA commented on issue #27353: [SPARK-27166][SQL][FOLLOWUP] Refactor to build string once URL: https://github.com/apache/spark/pull/27353#issuecomment-578349325 **[Test build #117370 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117370/testReport)**

[GitHub] [spark] zero323 opened a new pull request #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-24 Thread GitBox
zero323 opened a new pull request #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331 Signed-off-by: zero323 ### What changes were proposed in this pull request? - Adds `DataFramWriterV2`

[GitHub] [spark] zero323 opened a new pull request #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions.

2020-01-24 Thread GitBox
zero323 opened a new pull request #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions. URL: https://github.com/apache/spark/pull/27278 ### What changes were proposed in this pull request? - Adds following overloaded variants to Scala

[GitHub] [spark] zero323 closed pull request #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions.

2020-01-24 Thread GitBox
zero323 closed pull request #27278: [SPARK-30569][SQL][PYSPARK][SPARKR] Add percentile_approx DSL functions. URL: https://github.com/apache/spark/pull/27278 This is an automated message from the Apache Git Service. To

[GitHub] [spark] zero323 closed pull request #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API

2020-01-24 Thread GitBox
zero323 closed pull request #27331: [WIP][SPARK-29157][SQL][PYSPARK] Add DataFrameWriterV2 to Python API URL: https://github.com/apache/spark/pull/27331 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] zero323 closed pull request #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
zero323 closed pull request #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] otterc commented on issue #22173: [SPARK-24355] Spark external shuffle server improvement to better handle block fetch requests.

2020-01-24 Thread GitBox
otterc commented on issue #22173: [SPARK-24355] Spark external shuffle server improvement to better handle block fetch requests. URL: https://github.com/apache/spark/pull/22173#issuecomment-578347705 @Victsm @tgravescs I removed the `await` and tested with our internal stress testing

[GitHub] [spark] AmplabJenkins commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578346507 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578346507 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578346501 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578346501 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
SparkQA removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578340371 **[Test build #117382 has

[GitHub] [spark] SparkQA commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
SparkQA commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578346285 **[Test build #117382 has

[GitHub] [spark] yuchenhuo commented on a change in pull request #26957: [SPARK-30314] Add identifier and catalog information to DataSourceV2Relation

2020-01-24 Thread GitBox
yuchenhuo commented on a change in pull request #26957: [SPARK-30314] Add identifier and catalog information to DataSourceV2Relation URL: https://github.com/apache/spark/pull/26957#discussion_r370888037 ## File path:

[GitHub] [spark] wypoon commented on issue #27329: [SPARK-27324][DOC][CORE] Document configurations related to executor metrics.

2020-01-24 Thread GitBox
wypoon commented on issue #27329: [SPARK-27324][DOC][CORE] Document configurations related to executor metrics. URL: https://github.com/apache/spark/pull/27329#issuecomment-578343027 > yes the change is straightforward, but what about `spark.eventLog.logStageExecutorMetrics.enabled`? Does

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27354: [SPARK-30633][SQL] Append L to seed when type is LongType

2020-01-24 Thread GitBox
dongjoon-hyun commented on a change in pull request #27354: [SPARK-30633][SQL] Append L to seed when type is LongType URL: https://github.com/apache/spark/pull/27354#discussion_r370884990 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578340619 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578340619 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578340614 Merged build finished. Test PASSed.

[GitHub] [spark] BryanCutler commented on a change in pull request #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
BryanCutler commented on a change in pull request #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#discussion_r370884250 ## File path: python/pyspark/sql/pandas/serializers.py

[GitHub] [spark] BryanCutler commented on a change in pull request #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
BryanCutler commented on a change in pull request #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#discussion_r370884090 ## File path: python/pyspark/sql/pandas/types.py

[GitHub] [spark] AmplabJenkins removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578340614 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
SparkQA commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578340371 **[Test build #117382 has

[GitHub] [spark] SparkQA commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
SparkQA commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578340382 **[Test build #117383 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117383/testReport)** for PR

[GitHub] [spark] BryanCutler commented on a change in pull request #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
BryanCutler commented on a change in pull request #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#discussion_r370883651 ## File path: python/pyspark/sql/pandas/types.py

[GitHub] [spark] BryanCutler commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
BryanCutler commented on issue #27358: [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358#issuecomment-578339814 cc @HyukjinKwon @viirya please take a look, thanks!

[GitHub] [spark] BryanCutler opened a new pull request #27358: [SPARK-30640][PYTHON[SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

2020-01-24 Thread GitBox
BryanCutler opened a new pull request #27358: [SPARK-30640][PYTHON[SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion URL: https://github.com/apache/spark/pull/27358 ### What changes were proposed in this pull request? Prevent unnecessary copies of

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578338957 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578338957 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578338961 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578338961 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27354: [SPARK-30633][SQL] Append L to seed when type is LongType

2020-01-24 Thread GitBox
dongjoon-hyun commented on a change in pull request #27354: [SPARK-30633][SQL] Append L to seed when type is LongType URL: https://github.com/apache/spark/pull/27354#discussion_r370881974 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578335329 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578335320 Merged build finished. Test FAILed. This is an

[GitHub] [spark] rxin commented on issue #23811: [SPARK-26902][SQL] Support java.time.Instant as an external type of TimestampType

2020-01-24 Thread GitBox
rxin commented on issue #23811: [SPARK-26902][SQL] Support java.time.Instant as an external type of TimestampType URL: https://github.com/apache/spark/pull/23811#issuecomment-578335396 How useful is this change? Wouldn't it break a lot of user code that use Timestmap type when they

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578335098 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
SparkQA removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578332859 **[Test build #117380 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117380/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578335092 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
SparkQA commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578335307 **[Test build #117380 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117380/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578335320 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578335329 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578335092 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578335098 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
SparkQA commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578334758 **[Test build #117381 has

[GitHub] [spark] Jeffwan commented on issue #27347: [SPARK-30626][K8S] Add SPARK_APPLICATION_ID into driver pod env

2020-01-24 Thread GitBox
Jeffwan commented on issue #27347: [SPARK-30626][K8S] Add SPARK_APPLICATION_ID into driver pod env URL: https://github.com/apache/spark/pull/27347#issuecomment-578333822 > I added your new Jira ID to the Apache Spark contributor group, too. I'd like to recommend you to use a single ID.

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578333188 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578333201 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] zero323 commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
zero323 commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578333266 @shaneknapp > N1one > i really don't want to touch the extremely fragile R

[GitHub] [spark] AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578333201 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578333188 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578332327 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
SparkQA commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578332857 **[Test build #117379 has

[GitHub] [spark] SparkQA commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT)

2020-01-24 Thread GitBox
SparkQA commented on issue #16478: [SPARK-7768][SQL] Revise user defined types (UDT) URL: https://github.com/apache/spark/pull/16478#issuecomment-578332859 **[Test build #117380 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117380/testReport)** for PR

[GitHub] [spark] SparkQA removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
SparkQA removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578326687 **[Test build #117376 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578332318 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578332318 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
SparkQA commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578332299 **[Test build #117376 has

[GitHub] [spark] AmplabJenkins commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578332327 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578331403 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578331398 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578331398 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
SparkQA commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578331388 **[Test build #117378 has

[GitHub] [spark] SparkQA removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
SparkQA removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578330869 **[Test build #117378 has

[GitHub] [spark] AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578331403 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578331257 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578331257 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578331249 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578331249 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
SparkQA commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578330841 **[Test build #117377 has

[GitHub] [spark] SparkQA commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
SparkQA commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578330869 **[Test build #117378 has

[GitHub] [spark] dongjoon-hyun commented on issue #27356: [SPARK-29924][DOCS] Document Apache Arrow JDK11 requirement

2020-01-24 Thread GitBox
dongjoon-hyun commented on issue #27356: [SPARK-29924][DOCS] Document Apache Arrow JDK11 requirement URL: https://github.com/apache/spark/pull/27356#issuecomment-578330928 Thank you, @BryanCutler ! This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-578330694 Test FAILed. Refer to this link for

[GitHub] [spark] AmplabJenkins commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-578330694 Test FAILed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-578330681 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-578330681 Merged build finished. Test FAILed.

[GitHub] [spark] dongjoon-hyun commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
dongjoon-hyun commented on issue #27357: [SPARK-30639][BUILD][test-hadoop3.2][test-java11] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578330733 Retest this please. This is an

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
dongjoon-hyun edited a comment on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578330469 It seems that Microsoft repository is broken again. Please ignore `linter-r` installation step failure. ``` E: Failed to

[GitHub] [spark] SparkQA commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-24 Thread GitBox
SparkQA commented on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-578330487 **[Test build #117373 has

[GitHub] [spark] SparkQA removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy

2020-01-24 Thread GitBox
SparkQA removed a comment on issue #27311: [SPARK-27996][WEBUI] Send HTTP redirect using the correct protocol when Spark History server is deployed behind the reverse proxy URL: https://github.com/apache/spark/pull/27311#issuecomment-578297305 **[Test build #117373 has

[GitHub] [spark] dongjoon-hyun commented on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
dongjoon-hyun commented on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578330469 It seems that Microsoft repository is broken again. ``` E: Failed to fetch

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578329288 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578329279 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578329288 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#issuecomment-578329279 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578327121 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578327127 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578327127 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578327121 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
SparkQA commented on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578326687 **[Test build #117376 has

[GitHub] [spark] Victsm commented on issue #22173: [SPARK-24355] Spark external shuffle server improvement to better handle block fetch requests.

2020-01-24 Thread GitBox
Victsm commented on issue #22173: [SPARK-24355] Spark external shuffle server improvement to better handle block fetch requests. URL: https://github.com/apache/spark/pull/22173#issuecomment-578323514 When we worked on the original fix in #21402, we were holding a wrong view of how Netty

[GitHub] [spark] AmplabJenkins commented on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578322658 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578322658 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
AmplabJenkins commented on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578322669 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578322669 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun opened a new pull request #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
dongjoon-hyun opened a new pull request #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce any

[GitHub] [spark] SparkQA commented on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30

2020-01-24 Thread GitBox
SparkQA commented on issue #27357: [SPARK-30639][BUILD] Upgrade Jersey to 2.30 URL: https://github.com/apache/spark/pull/27357#issuecomment-578322182 **[Test build #117375 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117375/testReport)** for PR 27357 at

[GitHub] [spark] zero323 commented on a change in pull request #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
zero323 commented on a change in pull request #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#discussion_r370862591 ## File path: R/pkg/tests/run-all.R ## @@ -15,6 +15,11 @@ # limitations under the

[GitHub] [spark] AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578316584 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
SparkQA removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578310193 **[Test build #117374 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0

2020-01-24 Thread GitBox
AmplabJenkins removed a comment on issue #27328: [WIP][SPARK-23435][SPARKR][TESTS] Update testthat to >= 2.0.0 URL: https://github.com/apache/spark/pull/27328#issuecomment-578316576 Merged build finished. Test FAILed. This

<    1   2   3   4   5   6   7   8   9   >