[GitHub] AmplabJenkins removed a comment on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer URL: https://github.com/apache/spark/pull/23301#issuecomment-447181610 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer URL: https://github.com/apache/spark/pull/23301#issuecomment-447181613 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

2018-12-13 Thread GitBox
SparkQA commented on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer URL: https://github.com/apache/spark/pull/23301#issuecomment-447181557 **[Test build #100115 has

[GitHub] AmplabJenkins removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447181722 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] vanzin commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-13 Thread GitBox
vanzin commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-447181780 I've been running tests with the Spark `HdfsTest` example; maybe pyspark does something different. I'll

[GitHub] AmplabJenkins removed a comment on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer URL: https://github.com/apache/spark/pull/23301#issuecomment-447181613 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
SparkQA removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447176733 **[Test build #100114 has

[GitHub] SparkQA removed a comment on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

2018-12-13 Thread GitBox
SparkQA removed a comment on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer URL: https://github.com/apache/spark/pull/23301#issuecomment-447176735 **[Test build #100115 has

[GitHub] AmplabJenkins commented on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer URL: https://github.com/apache/spark/pull/23301#issuecomment-447181610 Merged build finished. Test PASSed. This is an

[GitHub] SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-13 Thread GitBox
SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-447193235 Kubernetes integration test status success URL:

[GitHub] cloud-fan commented on a change in pull request #23315: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False

2018-12-13 Thread GitBox
cloud-fan commented on a change in pull request #23315: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23315#discussion_r241631539 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala

[GitHub] cloud-fan commented on a change in pull request #23315: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False

2018-12-13 Thread GitBox
cloud-fan commented on a change in pull request #23315: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23315#discussion_r241631759 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DatasetSuite.scala

[GitHub] asfgit closed pull request #23284: [SPARK-26337][SQL][TEST] Add benchmark for LongToUnsafeRowMap

2018-12-13 Thread GitBox
asfgit closed pull request #23284: [SPARK-26337][SQL][TEST] Add benchmark for LongToUnsafeRowMap URL: https://github.com/apache/spark/pull/23284 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] AmplabJenkins removed a comment on issue #23311: [SPARK-26362][CORE] Deprecate 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23311: [SPARK-26362][CORE] Deprecate 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447074385 Test FAILed. Refer to this link for build results

[GitHub] 10110346 commented on issue #23304: [SPARK-26353][SQL]Add typed aggregate functions: max&

2018-12-13 Thread GitBox
10110346 commented on issue #23304: [SPARK-26353][SQL]Add typed aggregate functions: max& URL: https://github.com/apache/spark/pull/23304#issuecomment-447199578 cc @rxin @cloud-fan This is an automated message from the

[GitHub] gatorsmile commented on issue #23317: [SPARK-26368][SQL] Make it clear that getOrInferFileFormatSchema doesn't create InMemoryFileIndex

2018-12-13 Thread GitBox
gatorsmile commented on issue #23317: [SPARK-26368][SQL] Make it clear that getOrInferFileFormatSchema doesn't create InMemoryFileIndex URL: https://github.com/apache/spark/pull/23317#issuecomment-447213208 Thanks! Merged to master.

[GitHub] SparkQA commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2018-12-13 Thread GitBox
SparkQA commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-447212961 **[Test build #100122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100122/testReport)**

[GitHub] AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-447212967 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-447212966 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-447212966 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write) URL: https://github.com/apache/spark/pull/23208#issuecomment-447212967 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts

2018-12-13 Thread GitBox
SparkQA commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447218676 **[Test build #100126 has

[GitHub] HeartSaVioR commented on issue #21455: [SPARK-24093][DStream][Minor]Make some fields of KafkaStreamWriter/In…

2018-12-13 Thread GitBox
HeartSaVioR commented on issue #21455: [SPARK-24093][DStream][Minor]Make some fields of KafkaStreamWriter/In… URL: https://github.com/apache/spark/pull/21455#issuecomment-447218662 Yeah, that's what also I found interestingly on Scala. Constructor parameters can be used like fields in

[GitHub] AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447218765 Merged build finished. Test PASSed.

[GitHub] gatorsmile commented on issue #23304: [SPARK-26353][SQL]Add typed aggregate functions: max&

2018-12-13 Thread GitBox
gatorsmile commented on issue #23304: [SPARK-26353][SQL]Add typed aggregate functions: max& URL: https://github.com/apache/spark/pull/23304#issuecomment-447218399 See the PR https://github.com/apache/spark/pull/18113 This is

[GitHub] AmplabJenkins removed a comment on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447218765 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447218766 Test PASSed. Refer to this link for build results (access

[GitHub] JkSelf opened a new pull request #23318: revert spark 21052 in spark 2.4 because of the performance degradation

2018-12-13 Thread GitBox
JkSelf opened a new pull request #23318: revert spark 21052 in spark 2.4 because of the performance degradation URL: https://github.com/apache/spark/pull/23318 ## What changes were proposed in this pull request? revert spark 21052 in spark 2.4 because of the discussion in

[GitHub] AmplabJenkins removed a comment on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation URL: https://github.com/apache/spark/pull/23318#issuecomment-447224488 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation

2018-12-13 Thread GitBox
SparkQA commented on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation URL: https://github.com/apache/spark/pull/23318#issuecomment-447224463 **[Test build #100128 has

[GitHub] AmplabJenkins commented on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation URL: https://github.com/apache/spark/pull/23318#issuecomment-447224493 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins removed a comment on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation URL: https://github.com/apache/spark/pull/23318#issuecomment-447224493 Test PASSed. Refer to this link for build results (access rights

[GitHub] AmplabJenkins commented on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23318: [SPARK-26316][BRANCH-2.4] Revert hash join metrics in spark 21052 that causes performance degradation URL: https://github.com/apache/spark/pull/23318#issuecomment-447224488 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23319: [SPARK-26316][BRANCH-2.3] Revert hash join metrics in spark 21052 that causes performance degradation

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23319: [SPARK-26316][BRANCH-2.3] Revert hash join metrics in spark 21052 that causes performance degradation URL: https://github.com/apache/spark/pull/23319#issuecomment-447226361 Can one of the admins verify this patch?

[GitHub] AmplabJenkins removed a comment on issue #23319: [SPARK-26316][BRANCH-2.3] Revert hash join metrics in spark 21052 that causes performance degradation

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23319: [SPARK-26316][BRANCH-2.3] Revert hash join metrics in spark 21052 that causes performance degradation URL: https://github.com/apache/spark/pull/23319#issuecomment-447227217 Can one of the admins verify this patch?

[GitHub] HeartSaVioR commented on issue #23142: [SPARK-26170][SS] Add missing metrics in FlatMapGroupsWithState

2018-12-13 Thread GitBox
HeartSaVioR commented on issue #23142: [SPARK-26170][SS] Add missing metrics in FlatMapGroupsWithState URL: https://github.com/apache/spark/pull/23142#issuecomment-447229639 Kindly ping to @tdas @zsxwing again. This is a simple patch.

[GitHub] srowen commented on issue #23295: [MINOR][SQL]Change `ThreadLocal.withInitial` to Scala lambda syntax

2018-12-13 Thread GitBox
srowen commented on issue #23295: [MINOR][SQL]Change `ThreadLocal.withInitial` to Scala lambda syntax URL: https://github.com/apache/spark/pull/23295#issuecomment-447182570 This isn't Java code though. It may well work, but it needs to be tested against 2.11. The pull request builder

[GitHub] AmplabJenkins removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447181720 Merged build finished. Test PASSed.

[GitHub] vanzin commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-13 Thread GitBox
vanzin commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-447188449 This one might have been just a bad merge on my part. Without integration tests this is hard to catch

[GitHub] SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-13 Thread GitBox
SparkQA commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-447188489 **[Test build #100118 has

[GitHub] KeiichiHirobe commented on a change in pull request #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore

2018-12-13 Thread GitBox
KeiichiHirobe commented on a change in pull request #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore URL: https://github.com/apache/spark/pull/23288#discussion_r241627197 ## File path:

[GitHub] cloud-fan commented on a change in pull request #23196: [SPARK-26243][SQL] Use java.time API for parsing timestamps and dates from JSON

2018-12-13 Thread GitBox
cloud-fan commented on a change in pull request #23196: [SPARK-26243][SQL] Use java.time API for parsing timestamps and dates from JSON URL: https://github.com/apache/spark/pull/23196#discussion_r241632054 ## File path:

[GitHub] AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Deprecate 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Deprecate 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447215547 Test PASSed. Refer to this link for build results (access

[GitHub] AmplabJenkins removed a comment on issue #23311: [SPARK-26362][CORE] Deprecate 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23311: [SPARK-26362][CORE] Deprecate 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447215547 Test PASSed. Refer to this link for build results

[GitHub] AmplabJenkins commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-447222527 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-447222523 Merged build finished. Test PASSed. This is an automated

[GitHub] AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-447222527 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #20865: [SPARK-23542] The exists action shoule be further optimized in logical plan

2018-12-13 Thread GitBox
SparkQA removed a comment on issue #20865: [SPARK-23542] The exists action shoule be further optimized in logical plan URL: https://github.com/apache/spark/pull/20865#issuecomment-447194457 **[Test build #100119 has

[GitHub] SparkQA commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts

2018-12-13 Thread GitBox
SparkQA commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447228580 **[Test build #100129 has

[GitHub] SparkQA commented on issue #20865: [SPARK-23542] The exists action shoule be further optimized in logical plan

2018-12-13 Thread GitBox
SparkQA commented on issue #20865: [SPARK-23542] The exists action shoule be further optimized in logical plan URL: https://github.com/apache/spark/pull/20865#issuecomment-447228535 **[Test build #100119 has

[GitHub] HyukjinKwon commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events

2018-12-13 Thread GitBox
HyukjinKwon commented on issue #23263: [SPARK-23674][ML] Adds Spark ML Events URL: https://github.com/apache/spark/pull/23263#issuecomment-447228688 Hey @jkbradley, @mengxr, @dbtsai and @yanboliang, would you guys mind if I ask to take a look please?

[GitHub] AmplabJenkins commented on issue #20865: [SPARK-23542] The exists action shoule be further optimized in logical plan

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #20865: [SPARK-23542] The exists action shoule be further optimized in logical plan URL: https://github.com/apache/spark/pull/20865#issuecomment-447228724 Build finished. Test FAILed. This is

[GitHub] SparkQA removed a comment on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts

2018-12-13 Thread GitBox
SparkQA removed a comment on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447227589 **[Test build #100129 has

[GitHub] AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447228595 Test FAILed. Refer to this link for build results (access

[GitHub] AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447228588 Merged build finished. Test FAILed.

[GitHub] SparkQA commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts

2018-12-13 Thread GitBox
SparkQA commented on issue #23311: [SPARK-26362][CORE] Remove 'spark.driver.allowMultipleContexts' to disallow multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447230628 **[Test build #100131 has

[GitHub] AmplabJenkins commented on issue #23319: [SPARK-26316][BRANCH-2.3] Revert hash join metrics in spark 21052 that causes performance degradation

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23319: [SPARK-26316][BRANCH-2.3] Revert hash join metrics in spark 21052 that causes performance degradation URL: https://github.com/apache/spark/pull/23319#issuecomment-447230591 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] felixcheung commented on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently.

2018-12-13 Thread GitBox
felixcheung commented on issue #23302: [SPARK-24522][UI] Create filter to apply HTTP security checks consistently. URL: https://github.com/apache/spark/pull/23302#issuecomment-447232617 Jenkins, retest this please This is an

[GitHub] HyukjinKwon commented on a change in pull request #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore

2018-12-13 Thread GitBox
HyukjinKwon commented on a change in pull request #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore URL: https://github.com/apache/spark/pull/23288#discussion_r241662133 ## File path:

[GitHub] ueshin opened a new pull request #23320: [SPARK-26370][SQL] Fix resolution of higher-order function for the same identifier.

2018-12-13 Thread GitBox
ueshin opened a new pull request #23320: [SPARK-26370][SQL] Fix resolution of higher-order function for the same identifier. URL: https://github.com/apache/spark/pull/23320 ## What changes were proposed in this pull request? When using a higher-order function with the same variable

[GitHub] gatorsmile opened a new pull request #23316: [SPARK-26367] Remove ReplaceExceptWithFilter from nonExcludableRules

2018-12-13 Thread GitBox
gatorsmile opened a new pull request #23316: [SPARK-26367] Remove ReplaceExceptWithFilter from nonExcludableRules URL: https://github.com/apache/spark/pull/23316 ## What changes were proposed in this pull request? ReplaceExceptWithFilter is optional and thus remove it from

[GitHub] gatorsmile commented on issue #23316: [SPARK-26367] [SQL] Remove ReplaceExceptWithFilter from nonExcludableRules

2018-12-13 Thread GitBox
gatorsmile commented on issue #23316: [SPARK-26367] [SQL] Remove ReplaceExceptWithFilter from nonExcludableRules URL: https://github.com/apache/spark/pull/23316#issuecomment-447092564 cc @maryannxue @cloud-fan This is an

[GitHub] danosipov commented on issue #23315: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False

2018-12-13 Thread GitBox
danosipov commented on issue #23315: [SPARK-26366][SQL] ReplaceExceptWithFilter should consider NULL as False URL: https://github.com/apache/spark/pull/23315#issuecomment-447095253 Thanks @mgaido91 ! This is an automated

[GitHub] gatorsmile commented on issue #23316: [SPARK-26367] [SQL] Remove ReplaceExceptWithFilter from nonExcludableRules

2018-12-13 Thread GitBox
gatorsmile commented on issue #23316: [SPARK-26367] [SQL] Remove ReplaceExceptWithFilter from nonExcludableRules URL: https://github.com/apache/spark/pull/23316#issuecomment-447143721 Yes. It is an optimizer rule. We can separate this from the other `Replace Operators` rules.

[GitHub] HyukjinKwon commented on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
HyukjinKwon commented on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447165583 retest this please This is an automated

[GitHub] HeartSaVioR commented on a change in pull request #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

2018-12-13 Thread GitBox
HeartSaVioR commented on a change in pull request #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer URL: https://github.com/apache/spark/pull/23301#discussion_r241608126 ## File path:

[GitHub] SparkQA removed a comment on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal

2018-12-13 Thread GitBox
SparkQA removed a comment on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal URL: https://github.com/apache/spark/pull/23308#issuecomment-446973848 **[Test build #100092 has

[GitHub] SparkQA commented on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal

2018-12-13 Thread GitBox
SparkQA commented on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal URL: https://github.com/apache/spark/pull/23308#issuecomment-447057686 **[Test build #100092 has

[GitHub] SparkQA removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
SparkQA removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447050226 **[Test build #100105 has

[GitHub] SparkQA commented on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
SparkQA commented on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447057799 **[Test build #100105 has

[GitHub] AmplabJenkins commented on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal URL: https://github.com/apache/spark/pull/23308#issuecomment-447058901 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447058575 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447058566 Merged build finished. Test FAILed. This is

[GitHub] AmplabJenkins removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447058566 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal URL: https://github.com/apache/spark/pull/23308#issuecomment-447058905 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal URL: https://github.com/apache/spark/pull/23308#issuecomment-447058905 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf*

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23314: [SPARK-26364][PYTHON][TESTING] Clean up imports in test_pandas_udf* URL: https://github.com/apache/spark/pull/23314#issuecomment-447058575 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23308: [SPARK-26308][SQL] Infer abstract decimal type for java/scala BigDecimal URL: https://github.com/apache/spark/pull/23308#issuecomment-447058901 Merged build finished. Test PASSed.

[GitHub] gatorsmile commented on issue #23303: [SPARK-26352][SQL] ReorderJoin should not change the order of output attributes

2018-12-13 Thread GitBox
gatorsmile commented on issue #23303: [SPARK-26352][SQL] ReorderJoin should not change the order of output attributes URL: https://github.com/apache/spark/pull/23303#issuecomment-447062623 @rednaxelafx Can we separate this to two PRs? One is for the non-CBO reordering. Another is for the

[GitHub] SparkQA removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-13 Thread GitBox
SparkQA removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-447015177 **[Test build #100097 has

[GitHub] SparkQA commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-13 Thread GitBox
SparkQA commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-447065202 **[Test build #100097 has

[GitHub] AmplabJenkins commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-447065633 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-447065637 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-447065633 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23300: [SPARK-26327][SQL][BACKPORT-2.2] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23300#issuecomment-447065637 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] rxin commented on issue #23311: [SPARK-26362][CORE] Deprecate 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts

2018-12-13 Thread GitBox
rxin commented on issue #23311: [SPARK-26362][CORE] Deprecate 'spark.driver.allowMultipleContexts' to discourage multiple creation of SparkContexts URL: https://github.com/apache/spark/pull/23311#issuecomment-447066359 +1 on removing it. On Thu, Dec 13, 2018 at 8:00 AM, Hyukjin

[GitHub] vanzin commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal.

2018-12-13 Thread GitBox
vanzin commented on issue #22911: [SPARK-25815][k8s] Support kerberos in client mode, keytab-based token renewal. URL: https://github.com/apache/spark/pull/22911#issuecomment-447067640 No more comments here and I plan to push this tomorrow based on the +1s I have.

[GitHub] SparkQA commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

2018-12-13 Thread GitBox
SparkQA commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23299#issuecomment-447067758 **[Test build #100098 has

[GitHub] ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-13 Thread GitBox
ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#discussion_r241504183 ## File path:

[GitHub] ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-13 Thread GitBox
ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#discussion_r241503261 ## File path:

[GitHub] ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-13 Thread GitBox
ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#discussion_r241499869 ## File path:

[GitHub] SparkQA removed a comment on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

2018-12-13 Thread GitBox
SparkQA removed a comment on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23299#issuecomment-447015171 **[Test build #100098 has

[GitHub] ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-13 Thread GitBox
ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#discussion_r241502663 ## File path:

[GitHub] ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-13 Thread GitBox
ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#discussion_r241508219 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala

[GitHub] ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-13 Thread GitBox
ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#discussion_r241503589 ## File path:

[GitHub] ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-13 Thread GitBox
ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#discussion_r241506366 ## File path:

[GitHub] ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-13 Thread GitBox
ankuriitg commented on a change in pull request #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#discussion_r241505513 ## File path:

[GitHub] AmplabJenkins commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update

2018-12-13 Thread GitBox
AmplabJenkins commented on issue #23299: [SPARK-26327][SQL][BACKPORT-2.3] Bug fix for `FileSourceScanExec` metrics update URL: https://github.com/apache/spark/pull/23299#issuecomment-447069072 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] cloud-fan commented on a change in pull request #23196: [SPARK-26243][SQL] Use java.time API for parsing timestamps and dates from JSON

2018-12-13 Thread GitBox
cloud-fan commented on a change in pull request #23196: [SPARK-26243][SQL] Use java.time API for parsing timestamps and dates from JSON URL: https://github.com/apache/spark/pull/23196#discussion_r241468755 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system

2018-12-13 Thread GitBox
AmplabJenkins removed a comment on issue #23306: [SPARK-26357][Core] Expose executors' procfs metrics to Metrics system URL: https://github.com/apache/spark/pull/23306#issuecomment-446855521 Can one of the admins verify this patch?

<    2   3   4   5   6   7   8   9   >