[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455400511 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455400505 Merged build finished. Test PASSed. ---

[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455400505 Merged build finished. Test PASSed. ---

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

2019-01-17 Thread GitBox
beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r248906962 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

2019-01-17 Thread GitBox
beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r248908002 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray

2019-01-17 Thread GitBox
ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#discussion_r248885211 ## File path: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarArray.java ## @@ -46

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

2019-01-17 Thread GitBox
beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r248908002 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

2019-01-17 Thread GitBox
beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r248908002 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] HyukjinKwon commented on issue #23577: [SPARK-26658][PySpark] : Call pickle.dump with protocol version 3 for Python 3…

2019-01-17 Thread GitBox
HyukjinKwon commented on issue #23577: [SPARK-26658][PySpark] : Call pickle.dump with protocol version 3 for Python 3… URL: https://github.com/apache/spark/pull/23577#issuecomment-455404767 It duplicates https://github.com/apache/spark/pull/20691 ---

[GitHub] HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

2019-01-17 Thread GitBox
HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/20691#discussion_r248910029 ## File path: python/pyspark/cloudpickle.py ## @@ -852

[GitHub] SparkQA commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
SparkQA commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455406101 **[Test build #101387 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReq

[GitHub] rednaxelafx commented on a change in pull request #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
rednaxelafx commented on a change in pull request #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#discussion_r248910745 ## File path: sql/core/src/main/scala/org/apache/spark/sql/e

[GitHub] AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455407337 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455407340 Test PASSed. Refer to this link for build results (access rights to CI server need

[GitHub] AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455407340 Test PASSed. Refer to this link for build results (access rights to CI ser

[GitHub] AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455407337 Merged build finished. Test PASSed.

[GitHub] ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray

2019-01-17 Thread GitBox
ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#discussion_r248885211 ## File path: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarArray.java ## @@ -46

[GitHub] ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray

2019-01-17 Thread GitBox
ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#discussion_r248885211 ## File path: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarArray.java ## @@ -46

[GitHub] ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray

2019-01-17 Thread GitBox
ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#discussion_r248885211 ## File path: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarArray.java ## @@ -46

[GitHub] SparkQA commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-01-17 Thread GitBox
SparkQA commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-455416162 **[Test build #101388 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101388/testR

[GitHub] SparkQA commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
SparkQA commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455416328 **[Test build #101382 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101382/testRepo

[GitHub] SparkQA removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455364736 **[Test build #101382 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101382/t

[GitHub] AmplabJenkins commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455416619 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455416623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] AmplabJenkins commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455416623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] AmplabJenkins removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455416619 Merged build finished. Test PASSed. Thi

[GitHub] SparkQA commented on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read)

2019-01-17 Thread GitBox
SparkQA commented on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read) URL: https://github.com/apache/spark/pull/23430#issuecomment-455419461 **[Test build #101389 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101389/testRepor

[GitHub] AmplabJenkins commented on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read)

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read) URL: https://github.com/apache/spark/pull/23430#issuecomment-455419542 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins commented on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read)

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read) URL: https://github.com/apache/spark/pull/23430#issuecomment-455419544 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] AmplabJenkins removed a comment on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read)

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read) URL: https://github.com/apache/spark/pull/23430#issuecomment-455419544 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] AmplabJenkins removed a comment on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read)

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23430: [SPARK-26520][SQL] data source v2 API refactor (micro-batch read) URL: https://github.com/apache/spark/pull/23430#issuecomment-455419542 Merged build finished. Test PASSed. Thi

[GitHub] liupc opened a new pull request #23580: [SPARK-26660]Add warning logs for large taskBinary size

2019-01-17 Thread GitBox
liupc opened a new pull request #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580 ## What changes were proposed in this pull request? Currently, some ML library may generate large ml model, thus causing executor may not a

[GitHub] AmplabJenkins commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580#issuecomment-455420702 Can one of the admins verify this patch? This is an autom

[GitHub] AmplabJenkins removed a comment on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580#issuecomment-455420702 Can one of the admins verify this patch? This is

[GitHub] AmplabJenkins commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580#issuecomment-455420751 Can one of the admins verify this patch? This is an autom

[GitHub] AmplabJenkins commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580#issuecomment-455420997 Can one of the admins verify this patch? This is an autom

[GitHub] AmplabJenkins removed a comment on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580#issuecomment-455420751 Can one of the admins verify this patch? This is

[GitHub] maropu commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
maropu commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455422632 retest this please This is an automated message from

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

2019-01-17 Thread GitBox
beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r248924093 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] maropu commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-17 Thread GitBox
maropu commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-455422759 NVM, I'll do it after the v2.3.3 release finished if nobody takes on it. Thi

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

2019-01-17 Thread GitBox
beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r248924093 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalC

[GitHub] SparkQA commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
SparkQA commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455423359 **[Test build #101390 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101390/testRepo

[GitHub] AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455423525 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455423527 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455423525 Merged build finished. Test PASSed. Th

[GitHub] AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23545: [SPARK-25196][SQL][WIP] Extends Analyze commands for cached tables URL: https://github.com/apache/spark/pull/23545#issuecomment-455423527 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] maropu commented on issue #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions

2019-01-17 Thread GitBox
maropu commented on issue #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions URL: https://github.com/apache/spark/pull/23556#issuecomment-455426167 Not enough to just keep an `Alias` on the top only like `CleanupAliases` in the analyzer?

[GitHub] SparkQA commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
SparkQA commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455427454 **[Test build #101383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101383/testRepo

[GitHub] SparkQA removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455387860 **[Test build #101383 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101383/t

[GitHub] AmplabJenkins commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455427585 Merged build finished. Test FAILed. This is an

[GitHub] AmplabJenkins commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455427587 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] AmplabJenkins removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455427585 Merged build finished. Test FAILed. Thi

[GitHub] SparkQA commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
SparkQA commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455427855 **[Test build #101384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] AmplabJenkins removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455427587 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] maropu commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size

2019-01-17 Thread GitBox
maropu commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580#issuecomment-455427901 Is this different from `TaskSetManager.TASK_SIZE_TO_WARN_KB`? Th

[GitHub] AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455427997 Merged build finished. Test FAILed. ---

[GitHub] AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455428001 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] SparkQA removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455391223 **[Test build #101384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] cloud-fan commented on a change in pull request #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions

2019-01-17 Thread GitBox
cloud-fan commented on a change in pull request #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions URL: https://github.com/apache/spark/pull/23556#discussion_r248928260 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalys

[GitHub] AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455427997 Merged build finished. Test FAILed. ---

[GitHub] AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455428001 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HeartSaVioR commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-17 Thread GitBox
HeartSaVioR commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455430715 I'll work on fixing UTs: not sure why `@JsonIgnore` doesn't work. Also I'm testing manually on YARN cluster as wel

[GitHub] j-esse commented on a change in pull request #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions

2019-01-17 Thread GitBox
j-esse commented on a change in pull request #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions URL: https://github.com/apache/spark/pull/23556#discussion_r248933024 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/o

[GitHub] SparkQA commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
SparkQA commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455435245 **[Test build #101385 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] liupc commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size

2019-01-17 Thread GitBox
liupc commented on issue #23580: [SPARK-26660]Add warning logs for large taskBinary size URL: https://github.com/apache/spark/pull/23580#issuecomment-455435280 @maropu Yes, they are different. `TaskSetManager.TASK_SIZE_TO_WARN_KB` is for warning a task which including addedJars, addedFile

[GitHub] SparkQA removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455399348 **[Test build #101385 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spar

[GitHub] AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455435539 Test PASSed. Refer to this link for build results (access rights to CI ser

[GitHub] AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455435539 Test PASSed. Refer to this link for build results (access rights to CI server need

[GitHub] AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455435536 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455435536 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455436351 **[Test build #101386 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] SparkQA removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455399364 **[Test build #101386 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455436588 Merged build finished. Test FAILed. ---

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455436592 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455436588 Merged build finished. Test FAILed. ---

[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455436592 Test FAILed. Refer to this link for build results (access rights to CI server nee

[GitHub] j-esse commented on issue #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions

2019-01-17 Thread GitBox
j-esse commented on issue #23556: [SPARK-26626][SQL] Maximum size for repeatedly substituted aliases in SQL expressions URL: https://github.com/apache/spark/pull/23556#issuecomment-455438556 @maropu no I don't think this is related to CleanupAliases - we can't clean up the aliases, because

[GitHub] SparkQA commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
SparkQA commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455438687 **[Test build #101387 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] SparkQA removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
SparkQA removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455406101 **[Test build #101387 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spar

[GitHub] AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455438978 Test PASSed. Refer to this link for build results (access rights to CI server need

[GitHub] AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455438978 Test PASSed. Refer to this link for build results (access rights to CI ser

[GitHub] AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455438973 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455438973 Merged build finished. Test PASSed.

[GitHub] dongjoon-hyun commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
dongjoon-hyun commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455442016 Retest this please. This is an aut

[GitHub] SparkQA commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
SparkQA commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455442253 **[Test build #101391 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101

[GitHub] AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455443263 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455443259 Merged build finished. Test PASSed. ---

[GitHub] AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455443259 Merged build finished. Test PASSed. ---

[GitHub] AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23412: [SPARK-26477][CORE] Use ConfigEntry for hardcoded configs for unsafe category URL: https://github.com/apache/spark/pull/23412#issuecomment-455443263 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455443498 I filed for the flaky test (SPARK-26646). ---

[GitHub] HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455443520 retest this please This is a

[GitHub] gatorsmile commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
gatorsmile commented on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455443946 LGTM Thanks! Merged to master/2.4 --

[GitHub] gatorsmile edited a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
gatorsmile edited a comment on issue #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579#issuecomment-455443946 LGTM Thanks! Merged to master ---

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455444380 Merged build finished. Test PASSed. ---

[GitHub] inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

2019-01-17 Thread GitBox
inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/20691#discussion_r248941059 ## File path: python/pyspark/cloudpickle.py ## @@ -852,11

[GitHub] SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-45576 **[Test build #101392 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455444380 Merged build finished. Test PASSed. ---

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455444383 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-17 Thread GitBox
AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-455444383 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] asfgit closed pull request #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec

2019-01-17 Thread GitBox
asfgit closed pull request #23579: [SPARK-26659][SQL] Fix duplicate cmd.nodeName in the explain output of DataWritingCommandExec URL: https://github.com/apache/spark/pull/23579 This is an automated message from the Apache Gi

<    1   2   3   4   5   6   7   >