[GitHub] [spark] AmplabJenkins removed a comment on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#issuecomment-520399654 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520401398 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #25418: [SPARK-28695][SS] Use CaseInsensitiveMap in KafkaSourceProvider to make source param handling more robust

2019-08-12 Thread GitBox
SparkQA commented on issue #25418: [SPARK-28695][SS] Use CaseInsensitiveMap in KafkaSourceProvider to make source param handling more robust URL: https://github.com/apache/spark/pull/25418#issuecomment-520403974 **[Test build #108969 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25418: [SPARK-28695][SS] Use CaseInsensitiveMap in KafkaSourceProvider to make source param handling more robust

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25418: [SPARK-28695][SS] Use CaseInsensitiveMap in KafkaSourceProvider to make source param handling more robust URL: https://github.com/apache/spark/pull/25418#issuecomment-520403206 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
SparkQA commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520409215 **[Test build #108970 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520408532 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520408542 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql'

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql' URL: https://github.com/apache/spark/pull/25360#issuecomment-520424585 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql'

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql' URL: https://github.com/apache/spark/pull/25360#issuecomment-520424573 Merged build finished. Test PASSed.

[GitHub] [spark] cloud-fan commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
cloud-fan commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520426316 makes sense to me, let's fix the build first.

[GitHub] [spark] cloud-fan commented on a change in pull request #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
cloud-fan commented on a change in pull request #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#discussion_r312925637 ## File path: python/pyspark/sql/avro/functions.py ## @@ -69,26 +69,35

[GitHub] [spark] cloud-fan commented on a change in pull request #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
cloud-fan commented on a change in pull request #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#discussion_r312925637 ## File path: python/pyspark/sql/avro/functions.py ## @@ -69,26 +69,35

[GitHub] [spark] AmplabJenkins commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520430600 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520430591 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520430600 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520430591 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520430705 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520430717 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520430705 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520430717 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] srowen commented on issue #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos

2019-08-12 Thread GitBox
srowen commented on issue #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos URL: https://github.com/apache/spark/pull/25412#issuecomment-520433490 While I don't think we want to overcomplicate these examples by showing all the ways it could be used, this is

[GitHub] [spark] SparkQA removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
SparkQA removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520431444 **[Test build #108974 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520444685 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520444685 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520444673 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520444673 Merged build finished. Test PASSed.

[GitHub] [spark] sandeep-katta commented on a change in pull request #22466: [SPARK-25464][SQL] Create Database to the location, only if it is empty or does not exists.

2019-08-12 Thread GitBox
sandeep-katta commented on a change in pull request #22466: [SPARK-25464][SQL] Create Database to the location,only if it is empty or does not exists. URL: https://github.com/apache/spark/pull/22466#discussion_r312963310 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates

2019-08-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates URL: https://github.com/apache/spark/pull/25410#discussion_r312856728 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25414: [SPARK-28688][SQL][TEST] Skip test `read hive materialized view` since Hive 3.0 in VersionsSuite.scala on JDK 11

2019-08-12 Thread GitBox
dongjoon-hyun commented on a change in pull request #25414: [SPARK-28688][SQL][TEST] Skip test `read hive materialized view` since Hive 3.0 in VersionsSuite.scala on JDK 11 URL: https://github.com/apache/spark/pull/25414#discussion_r312857610 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520369110 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
SparkQA commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520369094 **[Test build #108966 has

[GitHub] [spark] AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520369100 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates URL: https://github.com/apache/spark/pull/25410#issuecomment-520380300 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates URL: https://github.com/apache/spark/pull/25410#issuecomment-520380304 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates

2019-08-12 Thread GitBox
SparkQA removed a comment on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates URL: https://github.com/apache/spark/pull/25410#issuecomment-520321258 **[Test build #108957 has

[GitHub] [spark] AmplabJenkins commented on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates URL: https://github.com/apache/spark/pull/25410#issuecomment-520380304 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25410: [SPARK-28690][SQL] Add the `date_part` function for timestamps and dates URL: https://github.com/apache/spark/pull/25410#issuecomment-520380300 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
SparkQA commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#issuecomment-520399290 **[Test build #108968 has

[GitHub] [spark] Udbhav30 commented on a change in pull request #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
Udbhav30 commented on a change in pull request #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#discussion_r312893076 ## File path:

[GitHub] [spark] gengliangwang commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
gengliangwang commented on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520407888 @cloud-fan @HyukjinKwon This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-08-12 Thread GitBox
cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r312906972 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-08-12 Thread GitBox
cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r312916060 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#issuecomment-520421689 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#issuecomment-520421694 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-08-12 Thread GitBox
cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r312920338 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql'

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql' URL: https://github.com/apache/spark/pull/25360#issuecomment-520424573 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql'

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql' URL: https://github.com/apache/spark/pull/25360#issuecomment-520424585 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #25420: [SPARK-28699][Core] Cache an indeterminate RDD could lead to incorrect result while stage rerun

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25420: [SPARK-28699][Core] Cache an indeterminate RDD could lead to incorrect result while stage rerun URL: https://github.com/apache/spark/pull/25420#issuecomment-520443454 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] xuanyuanking commented on a change in pull request #25420: [SPARK-28699][Core] Cache an indeterminate RDD could lead to incorrect result while stage rerun

2019-08-12 Thread GitBox
xuanyuanking commented on a change in pull request #25420: [SPARK-28699][Core] Cache an indeterminate RDD could lead to incorrect result while stage rerun URL: https://github.com/apache/spark/pull/25420#discussion_r312947461 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25420: [SPARK-28699][Core] Cache an indeterminate RDD could lead to incorrect result while stage rerun

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25420: [SPARK-28699][Core] Cache an indeterminate RDD could lead to incorrect result while stage rerun URL: https://github.com/apache/spark/pull/25420#issuecomment-520443446 Merged build finished. Test PASSed.

[GitHub] [spark] gaborgsomogyi commented on issue #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos

2019-08-12 Thread GitBox
gaborgsomogyi commented on issue #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos URL: https://github.com/apache/spark/pull/25412#issuecomment-520443270 @srowen +1 not overcomplicate. Not sure what you mean `this is possibly OK`? OK to give example on a

[GitHub] [spark] juliuszsompolski commented on a change in pull request #25373: [SPARK-28527][SQL][TEST] Directly re-run all the tests in SQLQueryTestSuite via Thrift Server

2019-08-12 Thread GitBox
juliuszsompolski commented on a change in pull request #25373: [SPARK-28527][SQL][TEST] Directly re-run all the tests in SQLQueryTestSuite via Thrift Server URL: https://github.com/apache/spark/pull/25373#discussion_r312850692 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520370252 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan closed pull request #25391: [SPARK-28366][CORE][FOLLOW-UP] Refine logging in driver when loading single large unsplittable file

2019-08-12 Thread GitBox
cloud-fan closed pull request #25391: [SPARK-28366][CORE][FOLLOW-UP] Refine logging in driver when loading single large unsplittable file URL: https://github.com/apache/spark/pull/25391 This is an automated message from the

[GitHub] [spark] sandeep-katta closed pull request #22571: [SPARK-25392][Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page

2019-08-12 Thread GitBox
sandeep-katta closed pull request #22571: [SPARK-25392][Spark Job History]Inconsistent behaviour for pool details in spark web UI and history server page URL: https://github.com/apache/spark/pull/22571 This is an

[GitHub] [spark] sandeep-katta commented on issue #22466: [SPARK-25464][SQL] Create Database to the location, only if it is empty or does not exists.

2019-08-12 Thread GitBox
sandeep-katta commented on issue #22466: [SPARK-25464][SQL] Create Database to the location,only if it is empty or does not exists. URL: https://github.com/apache/spark/pull/22466#issuecomment-520388342 ping @srowen @gatorsmile @ueshin @cloud-fan . Please check now this can be merged to

[GitHub] [spark] gengliangwang opened a new pull request #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
gengliangwang opened a new pull request #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419 ## What changes were proposed in this pull request? The mapping of Spark schema to Avro schema is many-to-many.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520410197 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro`

2019-08-12 Thread GitBox
SparkQA removed a comment on issue #25419: [SPARK-28698][SQL] Allow user-specified output schema in function `to_avro` URL: https://github.com/apache/spark/pull/25419#issuecomment-520409215 **[Test build #108970 has

[GitHub] [spark] abellina commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling

2019-08-12 Thread GitBox
abellina commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling URL: https://github.com/apache/spark/pull/25403#discussion_r312909750 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-08-12 Thread GitBox
cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r312910067 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-08-12 Thread GitBox
cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r312910067 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-08-12 Thread GitBox
cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r312910067 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-08-12 Thread GitBox
cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r312915667 ## File path:

[GitHub] [spark] skonto commented on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql'

2019-08-12 Thread GitBox
skonto commented on issue #25360: [SPARK-28280][PYTHON][SQL][TESTS][FOLLOW-UP] Add UDF cases into group by clause in 'udf-group-by.sql' URL: https://github.com/apache/spark/pull/25360#issuecomment-520423877 @HyukjinKwon done.

[GitHub] [spark] srowen commented on a change in pull request #25344: [WIP][SPARK-28151][SQL] Mapped ByteType to TinyINT for MsSQLServerDialect

2019-08-12 Thread GitBox
srowen commented on a change in pull request #25344: [WIP][SPARK-28151][SQL] Mapped ByteType to TinyINT for MsSQLServerDialect URL: https://github.com/apache/spark/pull/25344#discussion_r312926123 ## File path:

[GitHub] [spark] abellina commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling

2019-08-12 Thread GitBox
abellina commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling URL: https://github.com/apache/spark/pull/25403#discussion_r312937682 ## File path:

[GitHub] [spark] abellina commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling

2019-08-12 Thread GitBox
abellina commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling URL: https://github.com/apache/spark/pull/25403#discussion_r312937740 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #22466: [SPARK-25464][SQL] Create Database to the location, only if it is empty or does not exists.

2019-08-12 Thread GitBox
srowen commented on a change in pull request #22466: [SPARK-25464][SQL] Create Database to the location,only if it is empty or does not exists. URL: https://github.com/apache/spark/pull/22466#discussion_r312950875 ## File path:

[GitHub] [spark] Ngone51 commented on a change in pull request #25409: [SPARK-28414][WEBUI] UI updates to show resource info in Standalone

2019-08-12 Thread GitBox
Ngone51 commented on a change in pull request #25409: [SPARK-28414][WEBUI] UI updates to show resource info in Standalone URL: https://github.com/apache/spark/pull/25409#discussion_r312958930 ## File path: core/src/main/scala/org/apache/spark/deploy/worker/Worker.scala ##

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos

2019-08-12 Thread GitBox
gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos URL: https://github.com/apache/spark/pull/25412#discussion_r312956190 ## File path:

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos

2019-08-12 Thread GitBox
gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos URL: https://github.com/apache/spark/pull/25412#discussion_r312956496 ## File path:

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos

2019-08-12 Thread GitBox
gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos URL: https://github.com/apache/spark/pull/25412#discussion_r312955921 ## File path:

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos

2019-08-12 Thread GitBox
gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] DirectKafkaWordCount support kafka with kerberos URL: https://github.com/apache/spark/pull/25412#discussion_r312956370 ## File path:

[GitHub] [spark] juliuszsompolski commented on a change in pull request #25373: [SPARK-28527][SQL][TEST] Directly re-run all the tests in SQLQueryTestSuite via Thrift Server

2019-08-12 Thread GitBox
juliuszsompolski commented on a change in pull request #25373: [SPARK-28527][SQL][TEST] Directly re-run all the tests in SQLQueryTestSuite via Thrift Server URL: https://github.com/apache/spark/pull/25373#discussion_r312856613 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression

2019-08-12 Thread GitBox
SparkQA removed a comment on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression URL: https://github.com/apache/spark/pull/25416#issuecomment-520326885 **[Test build #108959 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520370252 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520370248 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression URL: https://github.com/apache/spark/pull/25416#issuecomment-520370980 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication .

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25201: [SPARK-28419][SQL] Enable SparkThriftServer support proxy user's authentication . URL: https://github.com/apache/spark/pull/25201#issuecomment-520369110 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression URL: https://github.com/apache/spark/pull/25416#issuecomment-520370980 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression URL: https://github.com/apache/spark/pull/25416#issuecomment-520370988 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25416: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression URL: https://github.com/apache/spark/pull/25416#issuecomment-520370988 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25408: [SPARK-28687][SQL] Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25408: [SPARK-28687][SQL] Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()` URL: https://github.com/apache/spark/pull/25408#issuecomment-520375873 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25408: [SPARK-28687][SQL] Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25408: [SPARK-28687][SQL] Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()` URL: https://github.com/apache/spark/pull/25408#issuecomment-520375873 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25408: [SPARK-28687][SQL] Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25408: [SPARK-28687][SQL] Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()` URL: https://github.com/apache/spark/pull/25408#issuecomment-520375865 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun closed pull request #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+

2019-08-12 Thread GitBox
dongjoon-hyun closed pull request #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+ URL: https://github.com/apache/spark/pull/25414 This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25149: [SPARK-28383][SQL] SHOW CREATE TABLE is not supported on a temporary view

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25149: [SPARK-28383][SQL] SHOW CREATE TABLE is not supported on a temporary view URL: https://github.com/apache/spark/pull/25149#issuecomment-520390406 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25149: [SPARK-28383][SQL] SHOW CREATE TABLE is not supported on a temporary view

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25149: [SPARK-28383][SQL] SHOW CREATE TABLE is not supported on a temporary view URL: https://github.com/apache/spark/pull/25149#issuecomment-520390402 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25149: [SPARK-28383][SQL] SHOW CREATE TABLE is not supported on a temporary view

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25149: [SPARK-28383][SQL] SHOW CREATE TABLE is not supported on a temporary view URL: https://github.com/apache/spark/pull/25149#issuecomment-520390402 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25149: [SPARK-28383][SQL] SHOW CREATE TABLE is not supported on a temporary view

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25149: [SPARK-28383][SQL] SHOW CREATE TABLE is not supported on a temporary view URL: https://github.com/apache/spark/pull/25149#issuecomment-520390406 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+ URL: https://github.com/apache/spark/pull/25414#issuecomment-520398589 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#issuecomment-520398710 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+ URL: https://github.com/apache/spark/pull/25414#issuecomment-520398596 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
AmplabJenkins commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#issuecomment-520398717 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#issuecomment-520398717 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#issuecomment-520398710 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+ URL: https://github.com/apache/spark/pull/25414#issuecomment-520398589 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+

2019-08-12 Thread GitBox
AmplabJenkins removed a comment on issue #25414: [SPARK-28688][SQL][TEST] Skip `VersionsSuite.read hive materialized view` test for HMS 3.0+ on JDK9+ URL: https://github.com/apache/spark/pull/25414#issuecomment-520398596 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] SparkQA commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory

2019-08-12 Thread GitBox
SparkQA commented on issue #25398: [SPARK-28659][SQL] Use data source if convertible in insert overwrite directory URL: https://github.com/apache/spark/pull/25398#issuecomment-520399637 **[Test build #108968 has

  1   2   3   4   5   6   7   8   9   10   >