[GitHub] [spark] AmplabJenkins commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

AmplabJenkins commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528441672 Merged build finished. Test PASSed.

[GitHub] [spark] MrDLontheway opened a new pull request #25699: [SPARK-28050][SQL]DataFrameWriter support insertInto a specific table partition

MrDLontheway opened a new pull request #25699: [SPARK-28050][SQL]DataFrameWriter support insertInto a specific table partition URL: https://github.com/apache/spark/pull/25699 ### What changes were proposed in this pull request? support insertInto a specific table partition

[GitHub] [spark] AmplabJenkins removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

AmplabJenkins removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528441681 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

AmplabJenkins removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528441672 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528440724 **[Test build #110191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110191/testReport)** for PR 25697 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528440431 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528440426 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528440426 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528440431 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

SparkQA removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528362907 **[Test build #110186 has

[GitHub] [spark] SparkQA commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

SparkQA commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528439653 **[Test build #110186 has

[GitHub] [spark] tgravescs commented on issue #25643: [SPARK-28939][SQL] Propagate SQLConf for plans executed by toRdd

tgravescs commented on issue #25643: [SPARK-28939][SQL] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25643#issuecomment-528436555 I assume this only applies to programmatically set confs? If you set them on app launch they still apply?

[GitHub] [spark] SparkQA commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

SparkQA commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528434266 Kubernetes integration test starting URL:

[GitHub] [spark] AmplabJenkins commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

AmplabJenkins commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528433460 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

AmplabJenkins removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528433460 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

SparkQA removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528427769 **[Test build #110189 has

[GitHub] [spark] AmplabJenkins commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

AmplabJenkins commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528433470 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

AmplabJenkins removed a comment on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528433470 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

SparkQA commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528433317 **[Test build #110189 has

[GitHub] [spark] gaborgsomogyi commented on issue #19096: [SPARK-21869][SS] A cached Kafka producer should not be closed if any task is using it - adds inuse tracking.

gaborgsomogyi commented on issue #19096: [SPARK-21869][SS] A cached Kafka producer should not be closed if any task is using it - adds inuse tracking. URL: https://github.com/apache/spark/pull/19096#issuecomment-528431633 https://github.com/apache/spark/pull/22138 has been merged which

[GitHub] [spark] SparkQA commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

SparkQA commented on issue #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698#issuecomment-528427769 **[Test build #110189 has

[GitHub] [spark] SparkQA commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

SparkQA commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528427739 **[Test build #110190 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110190/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528426835 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528426817 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528426817 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528426835 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] tgravescs opened a new pull request #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

tgravescs opened a new pull request #25698: [Spark 27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs URL: https://github.com/apache/spark/pull/25698 ### What changes were proposed in this pull request? Document the resource scheduling feature -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528424128 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] peter-toth commented on a change in pull request #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

peter-toth commented on a change in pull request #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#discussion_r321333818 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DynamicPartitionPruningSuite.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528424116 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

SparkQA removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528418960 **[Test build #110188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110188/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528424128 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528424116 Merged build finished. Test FAILed. This is an automated message from

[GitHub] [spark] SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528424088 **[Test build #110188 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110188/testReport)** for PR 25697 at

[GitHub] [spark] peter-toth commented on a change in pull request #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

peter-toth commented on a change in pull request #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#discussion_r321333818 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DynamicPartitionPruningSuite.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528422467 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528422456 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528422467 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

AmplabJenkins commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528422456 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] MrDLontheway commented on issue #25657: [SPARK-28050][SQL]DataFrameWriter support insertInto a specific table partition

MrDLontheway commented on issue #25657: [SPARK-28050][SQL]DataFrameWriter support insertInto a specific table partition URL: https://github.com/apache/spark/pull/25657#issuecomment-528421431 sorry,I am a community novice , should i create a new PR ?

[GitHub] [spark] gengliangwang commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

gengliangwang commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528419397 @wangyum @gatorsmile @dongjoon-hyun @cloud-fan @younggyuchun This is

[GitHub] [spark] SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-528418960 **[Test build #110188 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110188/testReport)** for PR 25697 at

[GitHub] [spark] gengliangwang opened a new pull request #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

gengliangwang opened a new pull request #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697 ### What changes were proposed in this pull request? After https://github.com/apache/spark/pull/25158 and

[GitHub] [spark] maryannxue commented on a change in pull request #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

maryannxue commented on a change in pull request #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#discussion_r321310152 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DynamicPartitionPruningSuite.scala

[GitHub] [spark] AmplabJenkins commented on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient

AmplabJenkins commented on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient URL: https://github.com/apache/spark/pull/25696#issuecomment-528400573 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient

AmplabJenkins commented on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient URL: https://github.com/apache/spark/pull/25696#issuecomment-528400524 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient

AmplabJenkins removed a comment on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient URL: https://github.com/apache/spark/pull/25696#issuecomment-528400573 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient

AmplabJenkins removed a comment on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient URL: https://github.com/apache/spark/pull/25696#issuecomment-528400524 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

SparkQA commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528399737 **[Test build #110187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110187/testReport)**

[GitHub] [spark] SparkQA removed a comment on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient

SparkQA removed a comment on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient URL: https://github.com/apache/spark/pull/25696#issuecomment-528343489 **[Test build #110182 has

[GitHub] [spark] SparkQA commented on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient

SparkQA commented on issue #25696: [SPARK-28996][SQL] Add tests regarding username of HiveClient URL: https://github.com/apache/spark/pull/25696#issuecomment-528397430 **[Test build #110182 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528395666 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528395654 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528395654 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins commented on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528395666 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

AmplabJenkins removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528391438 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

AmplabJenkins commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528391416 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

AmplabJenkins removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528391416 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

AmplabJenkins commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528391438 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

SparkQA removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528328809 **[Test build #110181 has

[GitHub] [spark] SparkQA commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

SparkQA commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528390438 **[Test build #110181 has

[GitHub] [spark] wangyum commented on issue #25663: [SPARK-28910][SQL] Prevent schema verification when connecting to in memory derby

wangyum commented on issue #25663: [SPARK-28910][SQL] Prevent schema verification when connecting to in memory derby URL: https://github.com/apache/spark/pull/25663#issuecomment-528386444 Hi @bogdanghit Do you have an Apache JIRA account?

[GitHub] [spark] wangyum commented on issue #25663: [SPARK-28910][SQL] Prevent schema verification when connecting to in memory derby

wangyum commented on issue #25663: [SPARK-28910][SQL] Prevent schema verification when connecting to in memory derby URL: https://github.com/apache/spark/pull/25663#issuecomment-528381948 Thanks! Merging to master. This is

[GitHub] [spark] srowen commented on a change in pull request #25684: [SPARK-28980][CORE][SQL][STREAMING][MLLIB] Remove most items deprecated in Spark 2.2.0 or earlier, for Spark 3

srowen commented on a change in pull request #25684: [SPARK-28980][CORE][SQL][STREAMING][MLLIB] Remove most items deprecated in Spark 2.2.0 or earlier, for Spark 3 URL: https://github.com/apache/spark/pull/25684#discussion_r321285846 ## File path:

[GitHub] [spark] maropu commented on issue #25657: [SPARK-28050][SQL]DataFrameWriter support insertInto a specific table partition

maropu commented on issue #25657: [SPARK-28050][SQL]DataFrameWriter support insertInto a specific table partition URL: https://github.com/apache/spark/pull/25657#issuecomment-528381472 you failed to rebase... This is an

[GitHub] [spark] srowen commented on a change in pull request #25684: [SPARK-28980][CORE][SQL][STREAMING][MLLIB] Remove most items deprecated in Spark 2.2.0 or earlier, for Spark 3

srowen commented on a change in pull request #25684: [SPARK-28980][CORE][SQL][STREAMING][MLLIB] Remove most items deprecated in Spark 2.2.0 or earlier, for Spark 3 URL: https://github.com/apache/spark/pull/25684#discussion_r321285427 ## File path:

[GitHub] [spark] wangyum closed pull request #25663: [SPARK-28910][SQL] Prevent schema verification when connecting to in memory derby

wangyum closed pull request #25663: [SPARK-28910][SQL] Prevent schema verification when connecting to in memory derby URL: https://github.com/apache/spark/pull/25663 This is an automated message from the Apache Git Service.

[GitHub] [spark] srowen commented on a change in pull request #25684: [SPARK-28980][CORE][SQL][STREAMING][MLLIB] Remove most items deprecated in Spark 2.2.0 or earlier, for Spark 3

srowen commented on a change in pull request #25684: [SPARK-28980][CORE][SQL][STREAMING][MLLIB] Remove most items deprecated in Spark 2.2.0 or earlier, for Spark 3 URL: https://github.com/apache/spark/pull/25684#discussion_r321283944 ## File path: R/pkg/NAMESPACE ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

AmplabJenkins removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528378233 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

AmplabJenkins removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528378224 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

AmplabJenkins commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528378224 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

AmplabJenkins commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528378233 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] squito commented on issue #25673: [SPARK-28770][CORE][TEST] Fix ReplayListenerSuite tests that sometime…

squito commented on issue #25673: [SPARK-28770][CORE][TEST] Fix ReplayListenerSuite tests that sometime… URL: https://github.com/apache/spark/pull/25673#issuecomment-528378003 lgtm. Also I see @bzhaoopenstack confirmed this does the trick on https://github.com/apache/spark/pull/25659.

[GitHub] [spark] SparkQA removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

SparkQA removed a comment on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528322620 **[Test build #110179 has

[GitHub] [spark] SparkQA commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks

SparkQA commented on issue #25631: [SPARK-28928][SS]Use Kafka delegation token protocol on sources/sinks URL: https://github.com/apache/spark/pull/25631#issuecomment-528377158 **[Test build #110179 has

[GitHub] [spark] squito commented on a change in pull request #25673: [SPARK-28770][CORE][TEST] Fix ReplayListenerSuite tests that sometime…

squito commented on a change in pull request #25673: [SPARK-28770][CORE][TEST] Fix ReplayListenerSuite tests that sometime… URL: https://github.com/apache/spark/pull/25673#discussion_r321279255 ## File path: core/src/test/scala/org/apache/spark/scheduler/ReplayListenerSuite.scala

[GitHub] [spark] srowen commented on a change in pull request #25389: [SPARK-28657][CORE] Fix currentContext Instance failed sometimes

srowen commented on a change in pull request #25389: [SPARK-28657][CORE] Fix currentContext Instance failed sometimes URL: https://github.com/apache/spark/pull/25389#discussion_r321276810 ## File path: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala ## @@

[GitHub] [spark] srowen commented on a change in pull request #25389: [SPARK-28657][CORE] Fix currentContext Instance failed sometimes

srowen commented on a change in pull request #25389: [SPARK-28657][CORE] Fix currentContext Instance failed sometimes URL: https://github.com/apache/spark/pull/25389#discussion_r321278362 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -2991,7

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency"

AmplabJenkins removed a comment on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency" URL: https://github.com/apache/spark/pull/25690#issuecomment-528373349 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency"

AmplabJenkins removed a comment on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency" URL: https://github.com/apache/spark/pull/25690#issuecomment-528373355 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency"

AmplabJenkins commented on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency" URL: https://github.com/apache/spark/pull/25690#issuecomment-528373349 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency"

AmplabJenkins commented on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency" URL: https://github.com/apache/spark/pull/25690#issuecomment-528373355 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] srowen commented on issue #25686: [SPARK-28981][K8S] Missing library for reading/writing Snappy-compressed files

srowen commented on issue #25686: [SPARK-28981][K8S] Missing library for reading/writing Snappy-compressed files URL: https://github.com/apache/spark/pull/25686#issuecomment-528373082 See https://github.com/apache/spark/pull/25112 which suggests that the issue was resolved by the change

[GitHub] [spark] maropu commented on a change in pull request #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates

maropu commented on a change in pull request #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates URL: https://github.com/apache/spark/pull/25410#discussion_r321274467 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/timestamp.sql ## @@

[GitHub] [spark] SparkQA commented on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency"

SparkQA commented on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency" URL: https://github.com/apache/spark/pull/25690#issuecomment-528372308 **[Test build #110178 has

[GitHub] [spark] srowen commented on a change in pull request #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency"

srowen commented on a change in pull request #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency" URL: https://github.com/apache/spark/pull/25690#discussion_r321273812 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency"

SparkQA removed a comment on issue #25690: [test-hadoop3.2] Revert "[SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency" URL: https://github.com/apache/spark/pull/25690#issuecomment-528312641 **[Test build #110178 has

[GitHub] [spark] mgaido91 commented on a change in pull request #25643: [SPARK-28939][SQL] Propagate SQLConf for plans executed by toRdd

mgaido91 commented on a change in pull request #25643: [SPARK-28939][SQL] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25643#discussion_r321272374 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SQLExecutionRDD.scala

[GitHub] [spark] srowen commented on issue #25692: [SPARK-28987][CORE] DiskBlockManager#createTempShuffleBlock should skip read-only directory

srowen commented on issue #25692: [SPARK-28987][CORE] DiskBlockManager#createTempShuffleBlock should skip read-only directory URL: https://github.com/apache/spark/pull/25692#issuecomment-528369840 When you would configure Spark to use a read-only dir here? I think that falls into the

[GitHub] [spark] srowen commented on a change in pull request #25673: [SPARK-28770][CORE][TEST] Fix ReplayListenerSuite tests that sometime…

srowen commented on a change in pull request #25673: [SPARK-28770][CORE][TEST] Fix ReplayListenerSuite tests that sometime… URL: https://github.com/apache/spark/pull/25673#discussion_r321268264 ## File path: core/src/test/scala/org/apache/spark/scheduler/ReplayListenerSuite.scala

[GitHub] [spark] maropu commented on a change in pull request #25643: [SPARK-28939][SQL] Propagate SQLConf for plans executed by toRdd

maropu commented on a change in pull request #25643: [SPARK-28939][SQL] Propagate SQLConf for plans executed by toRdd URL: https://github.com/apache/spark/pull/25643#discussion_r321266640 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/SQLExecutionRDD.scala

[GitHub] [spark] srowen commented on issue #25687: [SPARK-28977][DOCS][SQL] Fix DataFrameReader.json docs to doc that partition column can be numeric, date or timestamp type

srowen commented on issue #25687: [SPARK-28977][DOCS][SQL] Fix DataFrameReader.json docs to doc that partition column can be numeric, date or timestamp type URL: https://github.com/apache/spark/pull/25687#issuecomment-528365052 I also backported to 2.4

[GitHub] [spark] SparkQA commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

SparkQA commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528362907 **[Test build #110186 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528361910 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528361920 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528361920 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-528361910 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528360984 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

SparkQA removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528307284 **[Test build #110177 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels

AmplabJenkins removed a comment on issue #25644: [SPARK-28940][SQL] Subquery reuse across all subquery levels URL: https://github.com/apache/spark/pull/25644#issuecomment-528360975 Merged build finished. Test FAILed. This is

<    1   2   3   4   5   6   7   8   9   10   >