[GitHub] [spark] zsxwing commented on a change in pull request #25237: [SPARK-28489][SS] Fix a bug that KafkaOffsetRangeCalculator.getRanges may drop offsets

2019-07-24 Thread GitBox
zsxwing commented on a change in pull request #25237: [SPARK-28489][SS] Fix a bug that KafkaOffsetRangeCalculator.getRanges may drop offsets URL: https://github.com/apache/spark/pull/25237#discussion_r306992273 ## File path: external/kafka-0-10-sql/src/main/scala/org/apache/spark/s

[GitHub] [spark] SparkQA commented on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test

2019-07-24 Thread GitBox
SparkQA commented on issue #25243: [SPARK-28498][SQL][TEST] always create a fresh copy of the SparkSession before each test URL: https://github.com/apache/spark/pull/25243#issuecomment-514775760 **[Test build #108116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514774639 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514774639 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514774650 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514774650 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] SparkQA removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514769734 **[Test build #108127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514774528 **[Test build #108127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] vanzin commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
vanzin commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514774336 I think the ceph thing is #25222; but there were separate errors. I filed SPARK-28509, too. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514772224 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514772439 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-p

[GitHub] [spark] SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514772482 **[Test build #108128 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108128/testReport)*

[GitHub] [spark] AmplabJenkins removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514772215 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514772215 Merged build finished. Test FAILed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514772224 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514771967 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514713556 **[Test build #108117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108117/te

[GitHub] [spark] AmplabJenkins removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514771961 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514771961 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514771967 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] shaneknapp commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
shaneknapp commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514771854 test this please This is an automated message from th

[GitHub] [spark] SparkQA commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0

2019-07-24 Thread GitBox
SparkQA commented on issue #25245: [SPARK-25382][SQL][PYSPARK] Remove ImageSchema.readImages in 3.0 URL: https://github.com/apache/spark/pull/25245#issuecomment-514771799 **[Test build #108117 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108117/testRepor

[GitHub] [spark] SparkQA removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514698576 **[Test build #108113 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108113/tes

[GitHub] [spark] SparkQA commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S.

2019-07-24 Thread GitBox
SparkQA commented on issue #25236: [SPARK-28487][k8s] More responsive dynamic allocation with K8S. URL: https://github.com/apache/spark/pull/25236#issuecomment-514770987 **[Test build #108113 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108113/testReport

[GitHub] [spark] shaneknapp commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
shaneknapp commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514770458 ok, i'm seeing errors when it's trying to pull the ceph nano image: ``` 29e6fcdce5ba41a998b1d3d82be276ca ce

[GitHub] [spark] AmplabJenkins removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514769884 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514769874 Merged build finished. Test FAILed. This i

[GitHub] [spark] AmplabJenkins commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514769874 Merged build finished. Test FAILed. This is an aut

[GitHub] [spark] SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514769850 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-

[GitHub] [spark] AmplabJenkins commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514769884 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514769734 **[Test build #108127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] shaneknapp commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
shaneknapp commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514768583 test this please This is an autom

[GitHub] [spark] imback82 commented on a change in pull request #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-07-24 Thread GitBox
imback82 commented on a change in pull request #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r306982571 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/Data

[GitHub] [spark] imback82 commented on a change in pull request #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-07-24 Thread GitBox
imback82 commented on a change in pull request #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r306982252 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/S

[GitHub] [spark] AmplabJenkins removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514765840 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] SparkQA removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514761641 **[Test build #108125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108125/test

[GitHub] [spark] AmplabJenkins commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514765830 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514765840 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514765830 Merged build finished. Test PASSed. This i

[GitHub] [spark] SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514765696 **[Test build #108125 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108125/testReport)

[GitHub] [spark] younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#discussion_r306979725 ## File path: sql/core/src/test/resources/sql-tests/inputs/udf/udf-win

[GitHub] [spark] younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#discussion_r306979757 ## File path: sql/core/src/test/resources/sql-tests/inputs/udf/udf-win

[GitHub] [spark] younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#discussion_r306979641 ## File path: sql/core/src/test/resources/sql-tests/inputs/udf/udf-win

[GitHub] [spark] younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#discussion_r306979641 ## File path: sql/core/src/test/resources/sql-tests/inputs/udf/udf-win

[GitHub] [spark] younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
younggyuchun commented on a change in pull request #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#discussion_r306979542 ## File path: sql/core/src/test/resources/sql-tests/results/udf/udf-wi

[GitHub] [spark] SparkQA commented on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
SparkQA commented on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#issuecomment-514764322 **[Test build #108126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] AmplabJenkins removed a comment on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-514763383 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-514764201 Can one of the admins verify this patch? ---

[GitHub] [spark] SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514763781 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distri

[GitHub] [spark] AmplabJenkins removed a comment on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#issuecomment-514763567 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-514763174 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#issuecomment-514763573 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins commented on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#issuecomment-514763573 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins commented on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25195: [SPARK-28288][SQL][PYTHON][TESTS] Convert and port 'window.sql' into UDF test base URL: https://github.com/apache/spark/pull/25195#issuecomment-514763567 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-514763383 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-514763174 Can one of the admins verify this patch? ---

[GitHub] [spark] shivsood commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
shivsood commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514761824 Create a new PR https://github.com/apache/spark/pull/25248 -

[GitHub] [spark] shivsood opened a new pull request #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
shivsood opened a new pull request #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248 ## What changes were proposed in this pull request? This is a backport of SPARK-28152 to Spark 2.4.

[GitHub] [spark] SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
SparkQA commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514761641 **[Test build #108125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108125/testReport)*

[GitHub] [spark] AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514761053 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514761026 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing

[GitHub] [spark] AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514761053 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514761044 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514761044 Merged build finished. Test PASSed. ---

[GitHub] [spark] shaneknapp commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
shaneknapp commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514759383 test this please This is an automated message from th

[GitHub] [spark] SparkQA removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514752837 **[Test build #108124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514758138 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514758132 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514758005 **[Test build #108124 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514758132 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514758138 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514755609 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-p

[GitHub] [spark] rdblue commented on a change in pull request #25198: [SPARK-28443][SQL] Spark sql add exception when create field type NullType

2019-07-24 Thread GitBox
rdblue commented on a change in pull request #25198: [SPARK-28443][SQL] Spark sql add exception when create field type NullType URL: https://github.com/apache/spark/pull/25198#discussion_r306967046 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rul

[GitHub] [spark] AmplabJenkins removed a comment on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink URL: https://github.com/apache/spark/pull/25232#issuecomment-514753037 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink URL: https://github.com/apache/spark/pull/25232#issuecomment-514753030 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink URL: https://github.com/apache/spark/pull/25232#issuecomment-514753037 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] SparkQA removed a comment on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink

2019-07-24 Thread GitBox
SparkQA removed a comment on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink URL: https://github.com/apache/spark/pull/25232#issuecomment-514695344 **[Test build #108111 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108111/testRepo

[GitHub] [spark] AmplabJenkins commented on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink URL: https://github.com/apache/spark/pull/25232#issuecomment-514753030 Merged build finished. Test FAILed. This is an automat

[GitHub] [spark] SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
SparkQA commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514752837 **[Test build #108124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] SparkQA commented on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink

2019-07-24 Thread GitBox
SparkQA commented on issue #25232: [SPARK-28475][CORE] Add regex MetricFilter to GraphiteSink URL: https://github.com/apache/spark/pull/25232#issuecomment-514752651 **[Test build #108111 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108111/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-514751996 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-514752001 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins commented on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-514751996 Merged build finished. Test PASSed. This

[GitHub] [spark] shaneknapp commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage

2019-07-24 Thread GitBox
shaneknapp commented on issue #24879: [SPARK-28042][K8S] Support using volume mount as local storage URL: https://github.com/apache/spark/pull/24879#issuecomment-514751738 > @shaneknapp see k8s failure above (also in other PRs), seems there's something wrong with infra... i will tak

[GitHub] [spark] AmplabJenkins commented on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-514752001 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-514751622 Can one of the admins verify this patch?

[GitHub] [spark] shaneknapp commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image

2019-07-24 Thread GitBox
shaneknapp commented on issue #25222: [SPARK-28465][K8s] Fix integration tests which fail due to missing ceph-nano image URL: https://github.com/apache/spark/pull/25222#issuecomment-514751401 test this please This is an autom

[GitHub] [spark] SparkQA commented on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-07-24 Thread GitBox
SparkQA commented on issue #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-514749682 **[Test build #108123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108123/tes

[GitHub] [spark] imback82 opened a new pull request #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

2019-07-24 Thread GitBox
imback82 opened a new pull request #25247: [WIP][SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247 ## What changes were proposed in this pull request? Implements the SHOW TABLES logical and physical plans for data source

[GitHub] [spark] gatorsmile closed pull request #25073: [SPARK-28293][SQL] Implement Spark's own GetTableTypesOperation

2019-07-24 Thread GitBox
gatorsmile closed pull request #25073: [SPARK-28293][SQL] Implement Spark's own GetTableTypesOperation URL: https://github.com/apache/spark/pull/25073 This is an automated message from the Apache Git Service. To respond to t

[GitHub] [spark] SparkQA commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

2019-07-24 Thread GitBox
SparkQA commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-514746678 **[Test build #108122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/108122/testReport)** for PR 24881 at comm

[GitHub] [spark] vanzin commented on issue #24962: [SPARK-28149][K8S] Added variable to disable negative DNS caching

2019-07-24 Thread GitBox
vanzin commented on issue #24962: [SPARK-28149][K8S] Added variable to disable negative DNS caching URL: https://github.com/apache/spark/pull/24962#issuecomment-514746301 Parachuting into the conversation: we should not extend the config system to replicate functionality available through

[GitHub] [spark] gatorsmile commented on issue #25073: [SPARK-28293][SQL] Implement Spark's own GetTableTypesOperation

2019-07-24 Thread GitBox
gatorsmile commented on issue #25073: [SPARK-28293][SQL] Implement Spark's own GetTableTypesOperation URL: https://github.com/apache/spark/pull/25073#issuecomment-514745919 SparkGetFunctionsOperations is useful, but I am also not sure about SparkGetTypeInfoOperation. Do it only when somebo

[GitHub] [spark] AmplabJenkins removed a comment on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-514745794 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] AmplabJenkins removed a comment on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

2019-07-24 Thread GitBox
AmplabJenkins removed a comment on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-514745780 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-514745794 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job

[GitHub] [spark] AmplabJenkins commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

2019-07-24 Thread GitBox
AmplabJenkins commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-514745780 Merged build finished. Test PASSed. This is an automated message from th

[GitHub] [spark] dongjoon-hyun commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2019-07-24 Thread GitBox
dongjoon-hyun commented on issue #25238: [WIP][SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25238#issuecomment-514738415 Yep. Thanks! --

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306929621 ## File path: core/src/main/java/org/apache/spark/shuffle/api/ShuffleWriteSupport.java #

[GitHub] [spark] vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

2019-07-24 Thread GitBox
vanzin commented on a change in pull request #25007: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API URL: https://github.com/apache/spark/pull/25007#discussion_r306942702 ## File path: core/src/test/scala/org/apache/spark/shuffle/sort/io/LocalDiskShuffleMapOutputWrite

<    1   2   3   4   5   6   7   8   9   10   >