[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-514736898 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306936154 ## File path: core/src/main/java/org/apache/spark/shuffle/api/TransferrableWritableByteChannel.ja

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306923314 ## File path: core/src/main/java/org/apache/spark/shuffle/api/ShuffleDataIO.java ## @@ -

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306943380 ## File path: core/src/test/scala/org/apache/spark/shuffle/sort/io/LocalDiskShuffleMapOutputWrite

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306922142 ## File path: core/src/main/java/org/apache/spark/shuffle/api/ShuffleDataIO.java ## @@ -

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306944462 ## File path: core/src/test/scala/org/apache/spark/shuffle/sort/io/LocalDiskShuffleMapOutputWrite

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306923065 ## File path: core/src/main/java/org/apache/spark/shuffle/api/ShuffleDataIO.java ## @@ -

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306923693 ## File path: core/src/main/java/org/apache/spark/shuffle/api/ShuffleDataIO.java ## @@ -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-514736889 Merged build finished. Test PASSed.

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306945324 ## File path: core/src/test/scala/org/apache/spark/shuffle/sort/io/LocalDiskShuffleMapOutputWrite

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306928380 ## File path: core/src/main/java/org/apache/spark/shuffle/api/ShuffleWriteSupport.java #

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306929977 ## File path: core/src/main/java/org/apache/spark/shuffle/api/TransferrableWritableByteChannel.ja

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-514736898 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-514736889 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514728574 **[Test build #108121 has started](https://amplab.cs.berkeley.edu/jenkins/job

[GitHub] [spark] AmplabJenkins removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514736681 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514736694 Test PASSed. Refer to this link for build results (access rights to C

[GitHub] [spark] SparkQA removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-514664081 **[Test build #108105 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514736694 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514736681 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
SparkQA commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514736380 **[Test build #108121 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] SparkQA commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file

2019-07-24 Thread GitBox
SparkQA commented on issue #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25134#issuecomment-514736079 **[Test build #108105 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] shivsood commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
shivsood commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514733055 > @shivsood . Please check the branch-2.4 first. :) > > * https://gith

[GitHub] [spark] gengliangwang commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL

2019-07-24 Thread GitBox
gengliangwang commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL URL: https://github.com/apache/spark/pull/25239#issuecomment-514730073 > Is this later on in this PR, or in a follow-up change? If it is in a follow-up, what is the J

[GitHub] [spark] rdblue commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL

2019-07-24 Thread GitBox
rdblue commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL URL: https://github.com/apache/spark/pull/25239#issuecomment-514729201 @gengliangwang, can you bring this up in a DISCUSS thread on the dev list? I think the decision about

[GitHub] [spark] AmplabJenkins removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514727685 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514727691 Test PASSed. Refer to this link for build results (access rights to C

[GitHub] [spark] SparkQA commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
SparkQA commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514728574 **[Test build #108121 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] AmplabJenkins commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514727685 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246#issuecomment-514727691 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder URL: https://github.com/apache/spark/pull/13621#issuecomment-514726980 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] SparkQA removed a comment on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder URL: https://github.com/apache/spark/pull/13621#issuecomment-514722287 **[Test build #108120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108120/consoleFull)** fo

[GitHub] [spark] AmplabJenkins removed a comment on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder URL: https://github.com/apache/spark/pull/13621#issuecomment-514726974 Build finished. Test FAILed. This is an automated messag

[GitHub] [spark] AmplabJenkins commented on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder URL: https://github.com/apache/spark/pull/13621#issuecomment-514726980 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenki

[GitHub] [spark] SparkQA commented on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder

2019-07-24 Thread GitBox
SparkQA commented on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder URL: https://github.com/apache/spark/pull/13621#issuecomment-514726968 **[Test build #108120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108120/consoleFull)** for PR 13

[GitHub] [spark] huaxingao opened a new pull request #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py

2019-07-24 Thread GitBox
huaxingao opened a new pull request #25246: [SPARK-28507][ML][PYSPARK] Remove deprecated API context(self, sqlContext) from pyspark/ml/util.py URL: https://github.com/apache/spark/pull/25246 ## What changes were proposed in this pull request? remove deprecated ``` def contex

[GitHub] [spark] AmplabJenkins commented on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder URL: https://github.com/apache/spark/pull/13621#issuecomment-514726974 Build finished. Test FAILed. This is an automated message from t

[GitHub] [spark] rdblue commented on issue #25180: [SPARK-28423][SQL] Merge Scan and Batch/Stream

2019-07-24 Thread GitBox
rdblue commented on issue #25180: [SPARK-28423][SQL] Merge Scan and Batch/Stream URL: https://github.com/apache/spark/pull/25180#issuecomment-514725617 > That said, Table is the actual logical data scan. No, table is a source that can be scanned. A logical scan has filters and a proj

[GitHub] [spark] dongjoon-hyun commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
dongjoon-hyun commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514724072 @shivsood . Please check the branch-2.4 first. :) - https://github.com/ap

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25240: [SPARK-28496][INFRA] Use branch name instead of tag during dry-run

2019-07-24 Thread GitBox
dongjoon-hyun commented on a change in pull request #25240: [SPARK-28496][INFRA] Use branch name instead of tag during dry-run URL: https://github.com/apache/spark/pull/25240#discussion_r306673947 ## File path: dev/create-release/release-util.sh ## @@ -150,6 +150,9 @@ func

[GitHub] [spark] SparkQA commented on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder

2019-07-24 Thread GitBox
SparkQA commented on issue #13621: [SPARK-10408] [ML] Implement stacked autoencoder URL: https://github.com/apache/spark/pull/13621#issuecomment-514722287 **[Test build #108120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108120/consoleFull)** for PR 136

[GitHub] [spark] shivsood edited a comment on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
shivsood edited a comment on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514719239 @dongjoon-hyun i will close this PR and raise a new one. I messed up this

[GitHub] [spark] AmplabJenkins removed a comment on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514719344 Merged build finished. Test FAILed. ---

[GitHub] [spark] shivsood commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
shivsood commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514719239 @dongjoon-hyun i will close this PR and raise a new one. I messed up this branch

[GitHub] [spark] shivsood closed pull request #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
shivsood closed pull request #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238 This is an automated message from th

[GitHub] [spark] AmplabJenkins commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514719344 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514719351 Test FAILed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-514718742 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514718686 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-514718731 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-514718742 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514718692 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-514718731 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514718692 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] AmplabJenkins commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514718686 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-514610689 **[Test build #108098 has started](https://amplab.cs.berkeley.edu/jenkins/job/

[GitHub] [spark] SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

2019-07-24 Thread GitBox
SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-514718018 **[Test build #108098 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPu

[GitHub] [spark] vanzin commented on a change in pull request #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#discussion_r306920189 ## File path: docs/running-on-kubernetes.md ## @@ -285,7 +285,16 @@ The configuration p

[GitHub] [spark] AmplabJenkins removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514712821 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514712828 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins removed a comment on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable URL: https://github.com/apache/spark/pull/24832#issuecomment-514712835 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] AmplabJenkins removed a comment on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable URL: https://github.com/apache/spark/pull/24832#issuecomment-514712842 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] SparkQA commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
SparkQA commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514713556 **[Test build #108117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108117/testReport

[GitHub] [spark] SparkQA commented on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable

2019-07-24 Thread GitBox
SparkQA commented on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable URL: https://github.com/apache/spark/pull/24832#issuecomment-514713551 **[Test build #108118 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108118/testReport)** for PR 24832 at

[GitHub] [spark] AmplabJenkins commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514712821 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable URL: https://github.com/apache/spark/pull/24832#issuecomment-514712842 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] vanzin commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
vanzin commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514712824 @shaneknapp see k8s failure above (also in other PRs), seems there's something wrong with infra... --

[GitHub] [spark] AmplabJenkins commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514712828 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24832: [SPARK-27845][SQL] DataSourceV2: InsertTable URL: https://github.com/apache/spark/pull/24832#issuecomment-514712835 Merged build finished. Test PASSed. This is an automated message fro

[GitHub] [spark] rdblue commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL

2019-07-24 Thread GitBox
rdblue commented on issue #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL URL: https://github.com/apache/spark/pull/25239#issuecomment-514711860 > Later on, we can add a configuration mode for throwing exceptions on out-of-range conversion.

[GitHub] [spark] dongjinleekr edited a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
dongjinleekr edited a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514697187 @zsxwing Here is the fix. Yes, you are right - [The official documentation states that 'Note that mu

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514708885 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514708874 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514708874 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514708885 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514698590 **[Test build #108115 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514708742 **[Test build #108115 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108115/te

[GitHub] [spark] gengliangwang commented on a change in pull request #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL

2019-07-24 Thread GitBox
gengliangwang commented on a change in pull request #25239: [WIP][SPARK-28495][SQL] Table insertion: follow store assignment rules of ANSI SQL URL: https://github.com/apache/spark/pull/25239#discussion_r306909735 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catal

[GitHub] [spark] AmplabJenkins removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514707419 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] SparkQA commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
SparkQA commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514707393 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark

[GitHub] [spark] AmplabJenkins commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514707419 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514707411 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514707411 Merged build finished. Test FAILed. This is an au

[GitHub] [spark] AmplabJenkins removed a comment on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test URL: https://github.com/apache/spark/pull/25243#issuecomment-514703926 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test URL: https://github.com/apache/spark/pull/25243#issuecomment-514703936 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] AmplabJenkins commented on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test URL: https://github.com/apache/spark/pull/25243#issuecomment-514703936 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test URL: https://github.com/apache/spark/pull/25243#issuecomment-514703926 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function URL: https://github.com/apache/spark/pull/25220#issuecomment-514703411 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] DylanGuedes commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

2019-07-24 Thread GitBox
DylanGuedes commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-514703690 Ok, thank you for the explanation. I found that code snippet in a .sql file, that's why I thought that it was related to SQL Language itself

[GitHub] [spark] AmplabJenkins removed a comment on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function URL: https://github.com/apache/spark/pull/25220#issuecomment-514703405 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function URL: https://github.com/apache/spark/pull/25220#issuecomment-514703405 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function URL: https://github.com/apache/spark/pull/25220#issuecomment-514703411 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenki

[GitHub] [spark] SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514691937 **[Test build #108110 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514702717 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514702726 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514702726 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514702717 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function

2019-07-24 Thread GitBox
SparkQA commented on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function URL: https://github.com/apache/spark/pull/25220#issuecomment-514702636 **[Test build #108097 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108097/testReport)** for PR 252

[GitHub] [spark] SparkQA removed a comment on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #25220: [SPARK-28459][SQL] Add `make_timestamp` function URL: https://github.com/apache/spark/pull/25220#issuecomment-514601058 **[Test build #108097 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108097/testReport)** for

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-07-24 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-514702556 **[Test build #108110 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108110/te

<    2   3   4   5   6   7   8   9   10   11   >