[GitHub] [spark] AmplabJenkins commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer URL: https://github.com/apache/spark/pull/24382#issuecomment-521608879 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer URL: https://github.com/apache/spark/pull/24382#issuecomment-521608885 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24382: [SPARK-27330][SS] support task abort in foreach writer

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #24382: [SPARK-27330][SS] support task abort in foreach writer URL: https://github.com/apache/spark/pull/24382#issuecomment-521608885 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24382: [SPARK-27330][SS] support task abort in foreach writer

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #24382: [SPARK-27330][SS] support task abort in foreach writer URL: https://github.com/apache/spark/pull/24382#issuecomment-521608879 Merged build finished. Test PASSed. This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-15 Thread GitBox
cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r314292322 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #25430: [SPARK-28540][WEBUI] Document Environment page

2019-08-15 Thread GitBox
srowen commented on a change in pull request #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#discussion_r314323676 ## File path: docs/web-ui.md ## @@ -49,6 +49,50 @@ sizes and using executors for all partitions in an

[GitHub] [spark] SparkQA removed a comment on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter

2019-08-15 Thread GitBox
SparkQA removed a comment on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter URL: https://github.com/apache/spark/pull/25449#issuecomment-521653459 **[Test build #4830 has

[GitHub] [spark] shahidki31 commented on a change in pull request #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available

2019-08-15 Thread GitBox
shahidki31 commented on a change in pull request #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available URL: https://github.com/apache/spark/pull/25460#discussion_r314349801 ## File path:

[GitHub] [spark] SparkQA commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host

2019-08-15 Thread GitBox
SparkQA commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host URL: https://github.com/apache/spark/pull/25299#issuecomment-521674863 **[Test build #4831 has

[GitHub] [spark] dongjoon-hyun commented on issue #25463: [SPARK-28744][SQL][TEST] rename SharedSQLContext to SharedSparkSession

2019-08-15 Thread GitBox
dongjoon-hyun commented on issue #25463: [SPARK-28744][SQL][TEST] rename SharedSQLContext to SharedSparkSession URL: https://github.com/apache/spark/pull/25463#issuecomment-521674923 Retest this please. This is an automated

[GitHub] [spark] MaxGekk commented on a change in pull request #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates

2019-08-15 Thread GitBox
MaxGekk commented on a change in pull request #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates URL: https://github.com/apache/spark/pull/25410#discussion_r314189408 ## File path:

[GitHub] [spark] 19kka commented on issue #25450: [SPARK-23793][SQL]Handle database names in spark.udf.register()

2019-08-15 Thread GitBox
19kka commented on issue #25450: [SPARK-23793][SQL]Handle database names in spark.udf.register() URL: https://github.com/apache/spark/pull/25450#issuecomment-521537674 > Thank you for your first contribution, @19kka . Could you run `dev/scalastyle` and fix the errors? I saw some violation

[GitHub] [spark] AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521541158 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521541147 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521541147 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521541158 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521541153 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521541148 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521541148 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521541153 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-521550690 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-521550680 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

2019-08-15 Thread GitBox
SparkQA commented on issue #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#issuecomment-521551264 **[Test build #109151 has

[GitHub] [spark] cloud-fan commented on issue #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-08-15 Thread GitBox
cloud-fan commented on issue #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#issuecomment-521576807 I mean the Spark avro data source.

[GitHub] [spark] Fokko commented on issue #25451: [SPARK-28728][BUILD] Bump Jackson Databind to 2.9.9.3

2019-08-15 Thread GitBox
Fokko commented on issue #25451: [SPARK-28728][BUILD] Bump Jackson Databind to 2.9.9.3 URL: https://github.com/apache/spark/pull/25451#issuecomment-521586416 Sorry for the late reply, I'm in a different timezone. I've `git cherry-pick -x`'d your commit onto the branch.

[GitHub] [spark] SparkQA commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer

2019-08-15 Thread GitBox
SparkQA commented on issue #24382: [SPARK-27330][SS] support task abort in foreach writer URL: https://github.com/apache/spark/pull/24382#issuecomment-521608476 **[Test build #109152 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109152/testReport)** for

[GitHub] [spark] SparkQA removed a comment on issue #24382: [SPARK-27330][SS] support task abort in foreach writer

2019-08-15 Thread GitBox
SparkQA removed a comment on issue #24382: [SPARK-27330][SS] support task abort in foreach writer URL: https://github.com/apache/spark/pull/24382#issuecomment-521553230 **[Test build #109152 has

[GitHub] [spark] wangyum commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-15 Thread GitBox
wangyum commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-521611355 I did some benchmark. Prepare data: ```scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521616829 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] shahidki31 commented on a change in pull request #22502: [SPARK-25474][SQL] Support `spark.sql.statistics.fallBackToHdfs` in data source tables

2019-08-15 Thread GitBox
shahidki31 commented on a change in pull request #22502: [SPARK-25474][SQL] Support `spark.sql.statistics.fallBackToHdfs` in data source tables URL: https://github.com/apache/spark/pull/22502#discussion_r314297097 ## File path:

[GitHub] [spark] shahidki31 commented on a change in pull request #22502: [SPARK-25474][SQL] Support `spark.sql.statistics.fallBackToHdfs` in data source tables

2019-08-15 Thread GitBox
shahidki31 commented on a change in pull request #22502: [SPARK-25474][SQL] Support `spark.sql.statistics.fallBackToHdfs` in data source tables URL: https://github.com/apache/spark/pull/22502#discussion_r314297097 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #25430: [SPARK-28540][WEBUI] Document Environment page

2019-08-15 Thread GitBox
srowen commented on a change in pull request #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#discussion_r314324097 ## File path: docs/web-ui.md ## @@ -49,6 +49,50 @@ sizes and using executors for all partitions in an

[GitHub] [spark] tgravescs commented on issue #25409: [SPARK-28414][WEBUI] UI updates to show resource info in Standalone

2019-08-15 Thread GitBox
tgravescs commented on issue #25409: [SPARK-28414][WEBUI] UI updates to show resource info in Standalone URL: https://github.com/apache/spark/pull/25409#issuecomment-521669113 Just looking at the screen shots, It would be nice for the worker detailed page to have the free and used

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples

2019-08-15 Thread GitBox
gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples URL: https://github.com/apache/spark/pull/25412#discussion_r314269808 ## File path:

[GitHub] [spark] DylanGuedes commented on issue #25331: [SPARK-27768][SQL] Support Infinity/NaN-related float/double literals case-insensitively

2019-08-15 Thread GitBox
DylanGuedes commented on issue #25331: [SPARK-27768][SQL] Support Infinity/NaN-related float/double literals case-insensitively URL: https://github.com/apache/spark/pull/25331#issuecomment-521617976 Thank you for your answer, @dilipbiswal `numerics` has the following scheme: ```sql

[GitHub] [spark] cloud-fan commented on issue #25463: [SPARK-28744][SQL][TEST] rename SharedSQLContext to SharedSparkSession

2019-08-15 Thread GitBox
cloud-fan commented on issue #25463: [SPARK-28744][SQL][TEST] rename SharedSQLContext to SharedSparkSession URL: https://github.com/apache/spark/pull/25463#issuecomment-521625368 ok to test This is an automated message from

[GitHub] [spark] cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-15 Thread GitBox
cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r314289988 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-15 Thread GitBox
cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r314290254 ## File path:

[GitHub] [spark] cloud-fan commented on issue #25243: [SPARK-28498][SQL][TEST] clear the states of SparkSession after each test

2019-08-15 Thread GitBox
cloud-fan commented on issue #25243: [SPARK-28498][SQL][TEST] clear the states of SparkSession after each test URL: https://github.com/apache/spark/pull/25243#issuecomment-521631419 There are tests that create temp views in `beforeAll`, or set some configs in `beforeAll`. It's not that

[GitHub] [spark] cloud-fan closed pull request #25243: [SPARK-28498][SQL][TEST] clear the states of SparkSession after each test

2019-08-15 Thread GitBox
cloud-fan closed pull request #25243: [SPARK-28498][SQL][TEST] clear the states of SparkSession after each test URL: https://github.com/apache/spark/pull/25243 This is an automated message from the Apache Git Service. To

[GitHub] [spark] cloud-fan commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-08-15 Thread GitBox
cloud-fan commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-521637405 @vanzin I checked the code:

[GitHub] [spark] attilapiros commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host

2019-08-15 Thread GitBox
attilapiros commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host URL: https://github.com/apache/spark/pull/25299#issuecomment-521650177 jenkins retest this please

[GitHub] [spark] SparkQA commented on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter

2019-08-15 Thread GitBox
SparkQA commented on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter URL: https://github.com/apache/spark/pull/25449#issuecomment-521665292 **[Test build #4830 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4830/testReport)**

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples

2019-08-15 Thread GitBox
gaborgsomogyi commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples URL: https://github.com/apache/spark/pull/25412#discussion_r314268725 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
SparkQA removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521541634 **[Test build #109148 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521616825 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521616829 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521616825 Merged build finished. Test FAILed.

[GitHub] [spark] cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-15 Thread GitBox
cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r314291750 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-15 Thread GitBox
cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r314292087 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter URL: https://github.com/apache/spark/pull/25449#issuecomment-521135734 Can one of the admins verify this patch? This

[GitHub] [spark] SparkQA removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

2019-08-15 Thread GitBox
SparkQA removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-521653151 **[Test build #4829 has

[GitHub] [spark] srowen commented on a change in pull request #25344: [WIP][SPARK-28151][SQL] Mapped ByteType to TinyINT for MsSQLServerDialect

2019-08-15 Thread GitBox
srowen commented on a change in pull request #25344: [WIP][SPARK-28151][SQL] Mapped ByteType to TinyINT for MsSQLServerDialect URL: https://github.com/apache/spark/pull/25344#discussion_r314336492 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #24779: [SPARK-27929][SQL] Make percentile function receive frq of double

2019-08-15 Thread GitBox
srowen commented on a change in pull request #24779: [SPARK-27929][SQL] Make percentile function receive frq of double URL: https://github.com/apache/spark/pull/24779#discussion_r314346114 ## File path:

[GitHub] [spark] wangyum commented on a change in pull request #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available

2019-08-15 Thread GitBox
wangyum commented on a change in pull request #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available URL: https://github.com/apache/spark/pull/25460#discussion_r314282305 ## File path:

[GitHub] [spark] cloud-fan commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

2019-08-15 Thread GitBox
cloud-fan commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-521626600 @wangyum do you mean `CommandUtils.getSizeInBytesFallBackToHdfs` is very slow if there are many

[GitHub] [spark] attilapiros commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host

2019-08-15 Thread GitBox
attilapiros commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host URL: https://github.com/apache/spark/pull/25299#issuecomment-521633221 jenkins retest this please

[GitHub] [spark] abellina commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling

2019-08-15 Thread GitBox
abellina commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling URL: https://github.com/apache/spark/pull/25403#discussion_r314310736 ## File path:

[GitHub] [spark] SparkQA commented on issue #25451: [SPARK-28728][BUILD] Bump Jackson Databind to 2.9.9.3

2019-08-15 Thread GitBox
SparkQA commented on issue #25451: [SPARK-28728][BUILD] Bump Jackson Databind to 2.9.9.3 URL: https://github.com/apache/spark/pull/25451#issuecomment-521649568 **[Test build #4828 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4828/testReport)** for PR

[GitHub] [spark] attilapiros commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host

2019-08-15 Thread GitBox
attilapiros commented on issue #25299: [SPARK-27651][Core] Avoid the network when shuffle blocks are fetched from the same host URL: https://github.com/apache/spark/pull/25299#issuecomment-521670791 retest this please.

[GitHub] [spark] srowen commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling

2019-08-15 Thread GitBox
srowen commented on a change in pull request #25403: [SPARK-28679][YARN] changes to setResourceInformation to handle empty resources and reflection error handling URL: https://github.com/apache/spark/pull/25403#discussion_r314346740 ## File path:

[GitHub] [spark] shahidki31 commented on a change in pull request #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available

2019-08-15 Thread GitBox
shahidki31 commented on a change in pull request #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available URL: https://github.com/apache/spark/pull/25460#discussion_r314349801 ## File path:

[GitHub] [spark] shahidki31 commented on a change in pull request #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available

2019-08-15 Thread GitBox
shahidki31 commented on a change in pull request #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available URL: https://github.com/apache/spark/pull/25460#discussion_r314274591 ## File path:

[GitHub] [spark] shahidki31 commented on issue #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available

2019-08-15 Thread GitBox
shahidki31 commented on issue #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available URL: https://github.com/apache/spark/pull/25460#issuecomment-521616299 retest this please This

[GitHub] [spark] SparkQA commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
SparkQA commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521616576 **[Test build #109148 has

[GitHub] [spark] srowen commented on issue #25424: [SPARK-28543][DOCS][WebUI] Document Spark Jobs page

2019-08-15 Thread GitBox
srowen commented on issue #25424: [SPARK-28543][DOCS][WebUI] Document Spark Jobs page URL: https://github.com/apache/spark/pull/25424#issuecomment-521648673 Merged to master This is an automated message from the Apache Git

[GitHub] [spark] srowen closed pull request #25424: [SPARK-28543][DOCS][WebUI] Document Spark Jobs page

2019-08-15 Thread GitBox
srowen closed pull request #25424: [SPARK-28543][DOCS][WebUI] Document Spark Jobs page URL: https://github.com/apache/spark/pull/25424 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

2019-08-15 Thread GitBox
SparkQA commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-521653151 **[Test build #4829 has

[GitHub] [spark] srowen commented on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter

2019-08-15 Thread GitBox
srowen commented on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter URL: https://github.com/apache/spark/pull/25449#issuecomment-521653337 This also needs a JIRA. https://github.com/apache/spark/pull/25429

[GitHub] [spark] AmplabJenkins removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-520309524 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter

2019-08-15 Thread GitBox
SparkQA commented on issue #25449: [PYSPARK] Simpler countByValue using collections' Counter URL: https://github.com/apache/spark/pull/25449#issuecomment-521653459 **[Test build #4830 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4830/testReport)**

[GitHub] [spark] SparkQA commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

2019-08-15 Thread GitBox
SparkQA commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-521660122 **[Test build #4829 has

[GitHub] [spark] cloud-fan commented on issue #25448: [SPARK-28697][SQL] Invalidate Database/Table names starting with underscore

2019-08-15 Thread GitBox
cloud-fan commented on issue #25448: [SPARK-28697][SQL] Invalidate Database/Table names starting with underscore URL: https://github.com/apache/spark/pull/25448#issuecomment-521527717 Wait, does table name starting with `_` work in Spark currently? From SPARK-19059 it seems supported, but

[GitHub] [spark] SparkQA commented on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates

2019-08-15 Thread GitBox
SparkQA commented on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates URL: https://github.com/apache/spark/pull/25410#issuecomment-521532339 **[Test build #109145 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25460: [SPARK-25474][SQL][Followup] fallback to hdfs when relation table stats is not available

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25460: [SPARK-25474][SQL][Followup] fallback to hdfs when relation table stats is not available URL: https://github.com/apache/spark/pull/25460#issuecomment-521535225 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view …

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view … URL: https://github.com/apache/spark/pull/24440#issuecomment-521539522 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521539498 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521539445 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521539223 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521539487 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#issuecomment-521539566 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
SparkQA removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521537900 **[Test build #109147 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs URL: https://github.com/apache/spark/pull/25368#issuecomment-521539472 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view …

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view … URL: https://github.com/apache/spark/pull/24440#issuecomment-521539522 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA removed a comment on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-15 Thread GitBox
SparkQA removed a comment on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#issuecomment-521516999 **[Test build #109142 has

[GitHub] [spark] AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-521539487 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates

2019-08-15 Thread GitBox
SparkQA removed a comment on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates URL: https://github.com/apache/spark/pull/25410#issuecomment-521532339 **[Test build #109145 has

[GitHub] [spark] SparkQA removed a comment on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs

2019-08-15 Thread GitBox
SparkQA removed a comment on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs URL: https://github.com/apache/spark/pull/25368#issuecomment-521525967 **[Test build #109144 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25460: [SPARK-25474][SQL][FOLLOW-UP] fallback to hdfs when relation table stats is not available URL: https://github.com/apache/spark/pull/25460#issuecomment-521539449 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view …

2019-08-15 Thread GitBox
SparkQA removed a comment on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view … URL: https://github.com/apache/spark/pull/24440#issuecomment-521519898 **[Test build #109143 has

[GitHub] [spark] AmplabJenkins commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#issuecomment-521539566 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #25456: [SPARK-28739][SQL] Add a simple cost check for Adaptive Query Execution URL: https://github.com/apache/spark/pull/25456#issuecomment-521539570 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521539217 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates

2019-08-15 Thread GitBox
AmplabJenkins removed a comment on issue #25410: [SPARK-28690][SQL] Add `date_part` function for timestamps/dates URL: https://github.com/apache/spark/pull/25410#issuecomment-521539429 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view …

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view … URL: https://github.com/apache/spark/pull/24440#issuecomment-521539525 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs URL: https://github.com/apache/spark/pull/25368#issuecomment-521539472 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs

2019-08-15 Thread GitBox
SparkQA commented on issue #25368: [SPARK-28635][SQL] create CatalogManager to track registered v2 catalogs URL: https://github.com/apache/spark/pull/25368#issuecomment-521539389 **[Test build #109144 has

[GitHub] [spark] SparkQA commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
SparkQA commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521539394 **[Test build #109147 has

[GitHub] [spark] SparkQA commented on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view …

2019-08-15 Thread GitBox
SparkQA commented on issue #24440: [SPARK-27545] [SQL] Uncache table needs to delete the temporary view … URL: https://github.com/apache/spark/pull/24440#issuecomment-521539388 **[Test build #109143 has

[GitHub] [spark] AmplabJenkins commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly

2019-08-15 Thread GitBox
AmplabJenkins commented on issue #24486: [SPARK-27592][SQL] Set the bucketed data source table SerDe correctly URL: https://github.com/apache/spark/pull/24486#issuecomment-521539448 Test FAILed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   6   7   8   >