[GitHub] [spark] AmplabJenkins commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530877843 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] AmplabJenkins removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530877843 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530877832 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530877832 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
SparkQA commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530878720 **[Test build #110519 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] viirya commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-12 Thread GitBox
viirya commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530879739 It is a problem in ML applications. In ML, sample is used to prepare training data. ML algorith

[GitHub] [spark] cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider URL: https://github.com/apache/spark/pull/25651#discussion_r323808342 ## File path: external/avro/src/main/scala/org/apache/spark/sql/v2/avro/AvroDataSourc

[GitHub] [spark] cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider URL: https://github.com/apache/spark/pull/25651#discussion_r323808715 ## File path: external/avro/src/main/scala/org/apache/spark/sql/v2/avro/AvroDataSourc

[GitHub] [spark] alaazbair edited a comment on issue #25682: [SPARK-28842][DOC]Cleanup the formatting/trailing spaces in the K8s integration testing guide

2019-09-12 Thread GitBox
alaazbair edited a comment on issue #25682: [SPARK-28842][DOC]Cleanup the formatting/trailing spaces in the K8s integration testing guide URL: https://github.com/apache/spark/pull/25682#issuecomment-528546021 @holdenk Could you please review my PR. -

[GitHub] [spark] cloud-fan commented on a change in pull request #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#discussion_r323810510 ## File path: core/src/test/scala/org/apache/spark/scheduler/DAGSchedule

[GitHub] [spark] cloud-fan commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-12 Thread GitBox
cloud-fan commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530882523 make sense, LGTM This is an autom

[GitHub] [spark] cloud-fan commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen URL: https://github.com/apache/spark/pull/25766#discussion_r323814030 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/Co

[GitHub] [spark] cloud-fan commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen

2019-09-12 Thread GitBox
cloud-fan commented on a change in pull request #25766: [SPARK-29061][SQL] Prints bytecode statistics in debugCodegen URL: https://github.com/apache/spark/pull/25766#discussion_r323816539 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/debug/DebuggingSuite.scal

[GitHub] [spark] dilipbiswal commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
dilipbiswal commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530887863 LGTM This is an automated message from the Apac

[GitHub] [spark] SparkQA commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
SparkQA commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530889036 **[Test build #110519 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
SparkQA removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530878720 **[Test build #110519 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530889190 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530889195 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530889190 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25743: [SPARK-29036][SQL]SparkThriftServer cancel job after execute() thread interrupted URL: https://github.com/apache/spark/pull/25743#issuecomment-530889195 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AngersZhuuuu opened a new pull request #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AngersZh opened a new pull request #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775 ### What changes were proposed in this pull request? As show in is

[GitHub] [spark] AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530891943 Can one of the admins verify this patch? --

[GitHub] [spark] dilipbiswal edited a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
dilipbiswal edited a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530887863 LGTM cc @gatorsmile This is an autom

[GitHub] [spark] AmplabJenkins commented on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup URL: https://github.com/apache/spark/pull/25774#issuecomment-530893297 Merged build finished. Test FAILed. This is an au

[GitHub] [spark] SparkQA removed a comment on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup

2019-09-12 Thread GitBox
SparkQA removed a comment on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup URL: https://github.com/apache/spark/pull/25774#issuecomment-530853522 **[Test build #110518 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110518/tes

[GitHub] [spark] AmplabJenkins commented on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup URL: https://github.com/apache/spark/pull/25774#issuecomment-530893303 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] gatorsmile commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
gatorsmile commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530893418 ok to test This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup

2019-09-12 Thread GitBox
SparkQA commented on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup URL: https://github.com/apache/spark/pull/25774#issuecomment-530893087 **[Test build #110518 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110518/testReport

[GitHub] [spark] AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-523863447 Can one of the admins verify this patch? -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup URL: https://github.com/apache/spark/pull/25774#issuecomment-530893297 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530894134 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25774: [SPARK-29069][SQL] ResolveInsertInto should not do table lookup URL: https://github.com/apache/spark/pull/25774#issuecomment-530893303 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530894382 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530894575 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530894584 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530894134 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530891943 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530894584 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530894575 Merged build finished. Test PASSed. T

[GitHub] [spark] SparkQA commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
SparkQA commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530895443 **[Test build #110520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110520/testRep

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#discussion_r323829413 ## File path: core/src/main/scala/org/apache/spark/metrics/MetricsConfig.scala

[GitHub] [spark] SparkQA commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
SparkQA commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530899693 **[Test build #110520 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110520/testRe

[GitHub] [spark] AmplabJenkins commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530899831 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] AmplabJenkins commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530899820 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530899831 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] SparkQA commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
SparkQA commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530900439 **[Test build #110516 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] SparkQA removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
SparkQA removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530895443 **[Test build #110520 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110520

[GitHub] [spark] AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25554: [SPARK-28796][DOC]Document DROP DATABASE statement in SQL Reference URL: https://github.com/apache/spark/pull/25554#issuecomment-530899820 Merged build finished. Test PASSed. T

[GitHub] [spark] SparkQA removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
SparkQA removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530839668 **[Test build #110516 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] [spark] AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530901154 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530901154 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530901159 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
SparkQA commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530901499 **[Test build #110521 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110521/t

[GitHub] [spark] dongjoon-hyun commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
dongjoon-hyun commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530901500 @srowen . I moved it from code to `conf/metrics.properties.template` to disable it by default.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530901159 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] srowen commented on a change in pull request #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
srowen commented on a change in pull request #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#discussion_r323833503 ## File path: core/src/main/scala/org/apache/spark/metrics/MetricsConfig.scala ##

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
dongjoon-hyun edited a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530901500 @srowen . - I moved it from code to `conf/metrics.properties.template` to disable it by defaul

[GitHub] [spark] dongjoon-hyun commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
dongjoon-hyun commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530902917 Thanks, @srowen . Also, cc @vanzin , @dbtsai , @holdenk ~ --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530903537 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#discussion_r323835660 ## File path: core/src/main/scala/org/apache/spark/ui/SparkUI.scala ## @@

[GitHub] [spark] AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530903544 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins removed a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530903544 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#discussion_r323835660 ## File path: core/src/main/scala/org/apache/spark/ui/SparkUI.scala ## @@

[GitHub] [spark] AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25769: [SPARK-29032][CORE] Add PrometheusServlet to monitor Master/Worker/Driver URL: https://github.com/apache/spark/pull/25769#issuecomment-530903537 Merged build finished. Test PASSed. Thi

[GitHub] [spark] viirya commented on a change in pull request #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-12 Thread GitBox
viirya commented on a change in pull request #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#discussion_r323837050 ## File path: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSu

[GitHub] [spark] SparkQA commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
SparkQA commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530906276 **[Test build #110517 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] [spark] SparkQA removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
SparkQA removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530843065 **[Test build #110517 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] [spark] AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530906997 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530907005 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530906997 Merged build finished. Test PASSed. ---

[GitHub] [spark] amanomer removed a comment on issue #25543: [SPARK-28795][DOC][SQL] Document CREATE VIEW statement in SQL Reference

2019-09-12 Thread GitBox
amanomer removed a comment on issue #25543: [SPARK-28795][DOC][SQL] Document CREATE VIEW statement in SQL Reference URL: https://github.com/apache/spark/pull/25543#issuecomment-523869660 ![image](https://user-images.githubusercontent.com/40591404/63511946-26045200-c500-11e9-9497-0498c16956

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-hadoop3.2] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-530907005 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] SparkQA commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
SparkQA commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530915867 **[Test build #110522 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110522/testR

[GitHub] [spark] dongjoon-hyun commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
dongjoon-hyun commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530916408 @srowen . I added a configuration for this and disabled it. Could you review this once more? Also, cc @db

[GitHub] [spark] AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530918006 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530918012 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530918012 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#issuecomment-530918006 Merged build finished. Test PASSed.

[GitHub] [spark] srowen commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
srowen commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#discussion_r323852556 ## File path: core/src/main/scala/org/apache/spark/internal/config/UI.scala ## @

[GitHub] [spark] AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530894382 Can one of the admins verify this patch? --

[GitHub] [spark] dongjoon-hyun commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
dongjoon-hyun commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530918502 ok to test. ---

[GitHub] [spark] SparkQA commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
SparkQA commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530918818 **[Test build #110523 has started](https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530920978 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530920984 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530920978 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25775: [WIP][SPARK-29015][SQL][test-hadoop3.2][test-java11] fix bug for jdk11, can't use 'add jar' jar's class as create table serde URL: https://github.com/apache/spark/pull/25775#issuecomment-530920984 Test PASSed. Refer to this link for build

[GitHub] [spark] gaborgsomogyi commented on issue #25618: [SPARK-28908][SS]Implement Kafka EOS sink for Structured Streaming

2019-09-12 Thread GitBox
gaborgsomogyi commented on issue #25618: [SPARK-28908][SS]Implement Kafka EOS sink for Structured Streaming URL: https://github.com/apache/spark/pull/25618#issuecomment-530922026 I would add this feature to Spark when no such hacks are needed like [this](https://github.com/apache/flink/blo

[GitHub] [spark] huaxingao opened a new pull request #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON

2019-09-12 Thread GitBox
huaxingao opened a new pull request #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON URL: https://github.com/apache/spark/pull/25776 ### What changes were proposed in this pull request? Add some common

[GitHub] [spark] brkyvz closed pull request #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks

2019-09-12 Thread GitBox
brkyvz closed pull request #25767: [SPARK-29062][SQL] Add V1_BATCH_WRITE to the TableCapabilityChecks URL: https://github.com/apache/spark/pull/25767 This is an automated message from the Apache Git Service. To respond to th

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#discussion_r323859488 ## File path: core/src/main/scala/org/apache/spark/internal/config/UI.scala ##

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#discussion_r323859488 ## File path: core/src/main/scala/org/apache/spark/internal/config/UI.scala ##

[GitHub] [spark] SparkQA commented on issue #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON

2019-09-12 Thread GitBox
SparkQA commented on issue #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON URL: https://github.com/apache/spark/pull/25776#issuecomment-530924753 **[Test build #110524 has started](https://amplab.cs.berkeley

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics

2019-09-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #25770: [SPARK-29064][CORE] Add PrometheusResource to export Executor metrics URL: https://github.com/apache/spark/pull/25770#discussion_r323859488 ## File path: core/src/main/scala/org/apache/spark/internal/config/UI.scala ##

[GitHub] [spark] brkyvz commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-12 Thread GitBox
brkyvz commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323860306 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLog

[GitHub] [spark] brkyvz commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-12 Thread GitBox
brkyvz commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323861149 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalog/v2/utils/CatalogV2Util.s

[GitHub] [spark] jeff303 opened a new pull request #25777: [SPARK-29070][CORE] Allow SparkLauncher to return full spark-submit c…

2019-09-12 Thread GitBox
jeff303 opened a new pull request #25777: [SPARK-29070][CORE] Allow SparkLauncher to return full spark-submit c… URL: https://github.com/apache/spark/pull/25777 …ommand line. Adding public getFullSparkSubmitCommand method to SparkSubmit, which delegates to new private buildFullSpa

[GitHub] [spark] AmplabJenkins commented on issue #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON URL: https://github.com/apache/spark/pull/25776#issuecomment-530926933 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON

2019-09-12 Thread GitBox
AmplabJenkins removed a comment on issue #25776: [SPARK-28985][PYTHON][ML] Add common classes (JavaPredictor/JavaClassificationModel/JavaProbabilisticClassifier) in PYTHON URL: https://github.com/apache/spark/pull/25776#issuecomment-530926939 Test PASSed. Refer to this link for build re

[GitHub] [spark] shanyu commented on a change in pull request #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-12 Thread GitBox
shanyu commented on a change in pull request #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#discussion_r323862120 ## File path: core/src/main/scala/org/apache/spark/deploy/history/ApplicationHistoryProvide

[GitHub] [spark] AmplabJenkins commented on issue #25777: [SPARK-29070][CORE] Allow SparkLauncher to return full spark-submit c…

2019-09-12 Thread GitBox
AmplabJenkins commented on issue #25777: [SPARK-29070][CORE] Allow SparkLauncher to return full spark-submit c… URL: https://github.com/apache/spark/pull/25777#issuecomment-530926719 Can one of the admins verify this patch? T

<    1   2   3   4   5   6   7   8   9   10   >