[GitHub] liupc commented on issue #23537: [SPARK-26614]Fix speculation kill might cause job failure

2019-01-15 Thread GitBox
liupc commented on issue #23537: [SPARK-26614]Fix speculation kill might cause job failure URL: https://github.com/apache/spark/pull/23537#issuecomment-454348663 @pgandhi999 sorry, seems already resolved by [SPARK-23816](https://issues.apache.org/jira/browse/SPARK-23816), even though

[GitHub] liupc commented on issue #23536: [SPARK-26612]Fix speculation kill causing finished stage recomputed

2019-01-15 Thread GitBox
liupc commented on issue #23536: [SPARK-26612]Fix speculation kill causing finished stage recomputed URL: https://github.com/apache/spark/pull/23536#issuecomment-454348934 sorry, seems already resolved by SPARK-23816 This is

[GitHub] HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

2019-01-15 Thread GitBox
HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/20691#discussion_r247847071 ## File path: python/pyspark/cloudpickle.py ## @@

[GitHub] juliuszsompolski opened a new pull request #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
juliuszsompolski opened a new pull request #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551 ## What changes were proposed in this pull request? Try to make labels more obvious "avg hash probe" avg hash collisions per lookup

[GitHub] AmplabJenkins commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-454361721 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-454361715 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-454361721 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

2019-01-15 Thread GitBox
skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#issuecomment-454363213 jenkins test this please This is an automated message from

[GitHub] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

2019-01-15 Thread GitBox
SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#issuecomment-454363357 **[Test build #101254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101254/testReport)**

[GitHub] SparkQA commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2019-01-15 Thread GitBox
SparkQA commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-454369839 **[Test build #101239 has

[GitHub] AmplabJenkins removed a comment on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454369519 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454369517 Merged build finished. Test PASSed. This is an automated

[GitHub] srowen commented on a change in pull request #23486: [SPARK-26457] Show hadoop configurations in HistoryServer environment tab

2019-01-15 Thread GitBox
srowen commented on a change in pull request #23486: [SPARK-26457] Show hadoop configurations in HistoryServer environment tab URL: https://github.com/apache/spark/pull/23486#discussion_r247912791 ## File path: core/src/main/scala/org/apache/spark/SparkEnv.scala ## @@

[GitHub] SparkQA commented on issue #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions

2019-01-15 Thread GitBox
SparkQA commented on issue #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-454410652 **[Test build #101266 has

[GitHub] dongjoon-hyun closed pull request #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions

2019-01-15 Thread GitBox
dongjoon-hyun closed pull request #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291 As this is a foreign pull request (from a fork), the diff has been sent to your commit mailing list,

[GitHub] AmplabJenkins commented on issue #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-454410962 Merged build finished. Test FAILed.

[GitHub] SparkQA commented on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests

2019-01-15 Thread GitBox
SparkQA commented on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests URL: https://github.com/apache/spark/pull/23540#issuecomment-454416620 **[Test build #101246 has

[GitHub] SparkQA removed a comment on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests

2019-01-15 Thread GitBox
SparkQA removed a comment on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests URL: https://github.com/apache/spark/pull/23540#issuecomment-454336132 **[Test build #101246 has

[GitHub] AmplabJenkins commented on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests URL: https://github.com/apache/spark/pull/23540#issuecomment-454417446 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests URL: https://github.com/apache/spark/pull/23540#issuecomment-454417435 Merged build finished. Test PASSed.

[GitHub] LucaCanali commented on a change in pull request #23525: [SPARK-26595][core] Allow credential renewal based on kerberos ticket cache.

2019-01-15 Thread GitBox
LucaCanali commented on a change in pull request #23525: [SPARK-26595][core] Allow credential renewal based on kerberos ticket cache. URL: https://github.com/apache/spark/pull/23525#discussion_r247840564 ## File path:

[GitHub] caneGuy commented on a change in pull request #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-01-15 Thread GitBox
caneGuy commented on a change in pull request #23519: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23519#discussion_r247840276 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/ExchangeSuite.scala

[GitHub] SparkQA commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-15 Thread GitBox
SparkQA commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-454350416 **[Test build #101247 has

[GitHub] HyukjinKwon commented on a change in pull request #23506: [SPARK-26577][SQL] Add input optimizer when reading Hive table by SparkSQL

2019-01-15 Thread GitBox
HyukjinKwon commented on a change in pull request #23506: [SPARK-26577][SQL] Add input optimizer when reading Hive table by SparkSQL URL: https://github.com/apache/spark/pull/23506#discussion_r247845649 ## File path:

[GitHub] cloud-fan commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2019-01-15 Thread GitBox
cloud-fan commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-454354966 retest this please This is an automated message from

[GitHub] AmplabJenkins commented on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/23521#issuecomment-454357428 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/23521#issuecomment-454357428 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/23521#issuecomment-454357421 Merged build finished. Test PASSed. This is

[GitHub] SparkQA removed a comment on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types

2019-01-15 Thread GitBox
SparkQA removed a comment on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types URL: https://github.com/apache/spark/pull/23010#issuecomment-454303285 **[Test build #101240 has

[GitHub] AmplabJenkins commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types URL: https://github.com/apache/spark/pull/23010#issuecomment-454360170 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types URL: https://github.com/apache/spark/pull/23010#issuecomment-454360175 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] SparkQA commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types

2019-01-15 Thread GitBox
SparkQA commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types URL: https://github.com/apache/spark/pull/23010#issuecomment-454359887 **[Test build #101240 has

[GitHub] maropu commented on a change in pull request #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
maropu commented on a change in pull request #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#discussion_r247876262 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/BasicWriteStatsTracker.scala

[GitHub] SparkQA commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-15 Thread GitBox
SparkQA commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23490#issuecomment-454392003 **[Test build #101261 has

[GitHub] AmplabJenkins removed a comment on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/23521#issuecomment-454412387 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] cloud-fan commented on a change in pull request #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager

2019-01-15 Thread GitBox
cloud-fan commented on a change in pull request #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager URL: https://github.com/apache/spark/pull/23521#discussion_r247840967 ## File path:

[GitHub] liupc closed pull request #23537: [SPARK-26614]Fix speculation kill might cause job failure

2019-01-15 Thread GitBox
liupc closed pull request #23537: [SPARK-26614]Fix speculation kill might cause job failure URL: https://github.com/apache/spark/pull/23537 As this is a foreign pull request (from a fork), the diff has been sent to your commit mailing list, comm...@spark.apache.org

[GitHub] liupc closed pull request #23536: [SPARK-26612]Fix speculation kill causing finished stage recomputed

2019-01-15 Thread GitBox
liupc closed pull request #23536: [SPARK-26612]Fix speculation kill causing finished stage recomputed URL: https://github.com/apache/spark/pull/23536 As this is a foreign pull request (from a fork), the diff has been sent to your commit mailing list, comm...@spark.apache.org

[GitHub] LucaCanali commented on a change in pull request #23525: [SPARK-26595][core] Allow credential renewal based on kerberos ticket cache.

2019-01-15 Thread GitBox
LucaCanali commented on a change in pull request #23525: [SPARK-26595][core] Allow credential renewal based on kerberos ticket cache. URL: https://github.com/apache/spark/pull/23525#discussion_r247846894 ## File path: docs/security.md ## @@ -776,16 +776,32 @@ The

[GitHub] HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

2019-01-15 Thread GitBox
HyukjinKwon commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/20691#discussion_r247847071 ## File path: python/pyspark/cloudpickle.py ## @@

[GitHub] AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-454355870 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454355873 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-454355870 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-454355866 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454355868 Merged build finished. Test PASSed. This is an automated message

[GitHub] AmplabJenkins commented on issue #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454355868 Merged build finished. Test PASSed. This is an automated message from the

[GitHub] AmplabJenkins commented on issue #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454355873 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454355456 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support URL: https://github.com/apache/spark/pull/23396#issuecomment-454359084 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support URL: https://github.com/apache/spark/pull/23396#issuecomment-454359079 Merged build finished. Test PASSed. This is an automated

[GitHub] AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side only metrics support

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side only metrics support URL: https://github.com/apache/spark/pull/23396#issuecomment-454359084 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] maropu commented on issue #23541: [SPARK-26618][SQL] Make typed Timestamp/Date literals consistent to casting

2019-01-15 Thread GitBox
maropu commented on issue #23541: [SPARK-26618][SQL] Make typed Timestamp/Date literals consistent to casting URL: https://github.com/apache/spark/pull/23541#issuecomment-454366193 Can you add tests in `ExpressionParserSuite`?

[GitHub] juliuszsompolski commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
juliuszsompolski commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454366147 jenkins retest this please This is an automated message from the

[GitHub] AmplabJenkins commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454369519 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454369517 Merged build finished. Test PASSed. This is an automated message

[GitHub] SparkQA commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
SparkQA commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454369340 **[Test build #101258 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101258/testReport)** for PR 23551 at

[GitHub] hvanhovell commented on a change in pull request #23542: [WIP] [SPARK-25603][SQL] Pushing Down Nested Field projections

2019-01-15 Thread GitBox
hvanhovell commented on a change in pull request #23542: [WIP] [SPARK-25603][SQL] Pushing Down Nested Field projections URL: https://github.com/apache/spark/pull/23542#discussion_r247865439 ## File path:

[GitHub] eatoncys commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types

2019-01-15 Thread GitBox
eatoncys commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types URL: https://github.com/apache/spark/pull/23010#issuecomment-454369212 retest this please

[GitHub] SparkQA commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
SparkQA commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454375193 **[Test build #101260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101260/testReport)** for PR 23551 at

[GitHub] AmplabJenkins commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454375388 Merged build finished. Test FAILed. This is an automated message

[GitHub] AmplabJenkins removed a comment on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454375388 Merged build finished. Test FAILed. This is an automated

[GitHub] AmplabJenkins commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454375393 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

2019-01-15 Thread GitBox
inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/20691#discussion_r247879812 ## File path: python/pyspark/tests/test_rdd.py ## @@

[GitHub] AmplabJenkins commented on issue #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-454410970 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions URL: https://github.com/apache/spark/pull/23291#issuecomment-454410962 Merged build finished. Test FAILed.

[GitHub] deshanxiao commented on a change in pull request #23486: [SPARK-26457] Show hadoop configurations in HistoryServer environment tab

2019-01-15 Thread GitBox
deshanxiao commented on a change in pull request #23486: [SPARK-26457] Show hadoop configurations in HistoryServer environment tab URL: https://github.com/apache/spark/pull/23486#discussion_r247918057 ## File path: project/MimaExcludes.scala ## @@ -220,6 +220,9 @@ object

[GitHub] SparkQA removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2019-01-15 Thread GitBox
SparkQA removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-454355582 **[Test build #101250 has

[GitHub] HyukjinKwon commented on a change in pull request #23548: [SPARK-26620][PYTHON] Make `DataFrameReader.json()` and `csv()` in Python should accept DataFrame.

2019-01-15 Thread GitBox
HyukjinKwon commented on a change in pull request #23548: [SPARK-26620][PYTHON] Make `DataFrameReader.json()` and `csv()` in Python should accept DataFrame. URL: https://github.com/apache/spark/pull/23548#discussion_r247838776 ## File path: python/pyspark/sql/readwriter.py

[GitHub] AmplabJenkins commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-454352556 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-454352549 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories.

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23550: [SPARK-26621][CORE]Use ConfigEntry for hardcoded configs for shuffle categories. URL: https://github.com/apache/spark/pull/23550#issuecomment-454352549 Merged build finished. Test PASSed.

[GitHub] HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

2019-01-15 Thread GitBox
HyukjinKwon commented on issue #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/20691#issuecomment-454352558 Just for clarification, @inpefess, this is kind of core fix that we all should put a lot

[GitHub] SparkQA commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2019-01-15 Thread GitBox
SparkQA commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-454355582 **[Test build #101250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101250/testReport)**

[GitHub] SparkQA removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
SparkQA removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454353984 **[Test build #101248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101248/testReport)** for PR

[GitHub] AmplabJenkins removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454355449 Merged build finished. Test FAILed. This is an automated message

[GitHub] SparkQA commented on issue #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
SparkQA commented on issue #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454355439 **[Test build #101248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101248/testReport)** for PR 23551 at

[GitHub] cloud-fan commented on a change in pull request #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2019-01-15 Thread GitBox
cloud-fan commented on a change in pull request #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#discussion_r247850691 ## File path:

[GitHub] SparkQA commented on issue #23551: [SPARK-26622] Revise SQL Metrics labels

2019-01-15 Thread GitBox
SparkQA commented on issue #23551: [SPARK-26622] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-45432 **[Test build #101249 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101249/testReport)** for PR 23551 at

[GitHub] AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-454355866 Merged build finished. Test PASSed. This is an

[GitHub] SparkQA commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-01-15 Thread GitBox
SparkQA commented on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-454358755 **[Test build #101253 has

[GitHub] SparkQA commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support

2019-01-15 Thread GitBox
SparkQA commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support URL: https://github.com/apache/spark/pull/23396#issuecomment-454358728 **[Test build #101252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101252/testReport)** for PR

[GitHub] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

2019-01-15 Thread GitBox
SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#issuecomment-454364739 **[Test build #101255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101255/testReport)**

[GitHub] SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

2019-01-15 Thread GitBox
SparkQA commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#issuecomment-454367350 Kubernetes integration test starting URL:

[GitHub] juliuszsompolski commented on a change in pull request #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
juliuszsompolski commented on a change in pull request #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#discussion_r247863525 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeFixedWidthAggregationMap.java

[GitHub] AmplabJenkins removed a comment on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23551: [SPARK-26622][SQL] Revise SQL Metrics labels URL: https://github.com/apache/spark/pull/23551#issuecomment-454373014 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support

2019-01-15 Thread GitBox
SparkQA commented on issue #23396: [SPARK-26397][SQL] Driver side only metrics support URL: https://github.com/apache/spark/pull/23396#issuecomment-454379732 **[Test build #101242 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101242/testReport)** for PR

[GitHub] SparkQA removed a comment on issue #23396: [SPARK-26397][SQL] Driver side only metrics support

2019-01-15 Thread GitBox
SparkQA removed a comment on issue #23396: [SPARK-26397][SQL] Driver side only metrics support URL: https://github.com/apache/spark/pull/23396#issuecomment-454309319 **[Test build #101242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101242/testReport)**

[GitHub] skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

2019-01-15 Thread GitBox
skonto commented on issue #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#issuecomment-454385122 Integration tests still fail for the same issue. This is an

[GitHub] AmplabJenkins removed a comment on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests URL: https://github.com/apache/spark/pull/23540#issuecomment-454417446 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] srowen commented on issue #23497: [SPARK-26578][CORE] Synchronize putBytes's memory allocation and putting block on memoryManager

2019-01-15 Thread GitBox
srowen commented on issue #23497: [SPARK-26578][CORE] Synchronize putBytes's memory allocation and putting block on memoryManager URL: https://github.com/apache/spark/pull/23497#issuecomment-454417785 @kiszk do you have more of an opinion on this given the above?

[GitHub] SparkQA commented on issue #17726: [SPARK-17928] [Mesos] No driver.memoryOverhead setting for mesos cluster mode

2019-01-15 Thread GitBox
SparkQA commented on issue #17726: [SPARK-17928] [Mesos] No driver.memoryOverhead setting for mesos cluster mode URL: https://github.com/apache/spark/pull/17726#issuecomment-454417640 **[Test build #4517 has

[GitHub] AmplabJenkins removed a comment on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23540: [SPARK-26615][Core] Fixing transport server/client resource leaks in the core unittests URL: https://github.com/apache/spark/pull/23540#issuecomment-454417435 Merged build finished. Test PASSed.

[GitHub] xuanyuanking commented on a change in pull request #23396: [SPARK-26397][SQL] Driver side only metrics support

2019-01-15 Thread GitBox
xuanyuanking commented on a change in pull request #23396: [SPARK-26397][SQL] Driver side only metrics support URL: https://github.com/apache/spark/pull/23396#discussion_r247853565 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala

[GitHub] AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side only metrics support

2019-01-15 Thread GitBox
AmplabJenkins removed a comment on issue #23396: [SPARK-26397][SQL] Driver side only metrics support URL: https://github.com/apache/spark/pull/23396#issuecomment-454359079 Merged build finished. Test PASSed. This is an

[GitHub] inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+)

2019-01-15 Thread GitBox
inpefess commented on a change in pull request #20691: [SPARK-18161] [Python] Allow pickle to serialize >4 GB objects when possible (Python 3.4+) URL: https://github.com/apache/spark/pull/20691#discussion_r247854943 ## File path: python/pyspark/tests/test_rdd.py ## @@

[GitHub] AmplabJenkins commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-454370125 Test FAILed. Refer to this link for build

[GitHub] SparkQA removed a comment on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2019-01-15 Thread GitBox
SparkQA removed a comment on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-454301972 **[Test build #101239 has

[GitHub] AmplabJenkins commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2019-01-15 Thread GitBox
AmplabJenkins commented on issue #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService URL: https://github.com/apache/spark/pull/23355#issuecomment-454370120 Merged build finished. Test FAILed.

[GitHub] maropu commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably

2019-01-15 Thread GitBox
maropu commented on issue #23490: [SPARK-26543][SQL] Support the coordinator to determine post-shuffle partitions more reasonably URL: https://github.com/apache/spark/pull/23490#issuecomment-454391037 The fix looks reasonable to me and can you add tests in `ExchangeCoordinatorSuite`?

[GitHub] SparkQA commented on issue #23518: [SPARK-26600] Update spark-submit usage message

2019-01-15 Thread GitBox
SparkQA commented on issue #23518: [SPARK-26600] Update spark-submit usage message URL: https://github.com/apache/spark/pull/23518#issuecomment-454395232 **[Test build #4516 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4516/testReport)** for PR 23518

  1   2   3   4   5   6   7   8   9   10   >