[GitHub] [spark] AmplabJenkins commented on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions URL: https://github.com/apache/spark/pull/26441#issuecomment-552684577 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions URL: https://github.com/apache/spark/pull/26441#issuecomment-552684570 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26473: [WIP] Strict parsing of day-time strings to intervals

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26473: [WIP] Strict parsing of day-time strings to intervals URL: https://github.com/apache/spark/pull/26473#issuecomment-552683974 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26473: [WIP] Strict parsing of day-time strings to intervals

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26473: [WIP] Strict parsing of day-time strings to intervals URL: https://github.com/apache/spark/pull/26473#issuecomment-552683968 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26473: [WIP] Strict parsing of day-time strings to intervals

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26473: [WIP] Strict parsing of day-time strings to intervals URL: https://github.com/apache/spark/pull/26473#issuecomment-552683974 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26473: [WIP] Strict parsing of day-time strings to intervals

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26473: [WIP] Strict parsing of day-time strings to intervals URL: https://github.com/apache/spark/pull/26473#issuecomment-552683968 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] rdblue commented on a change in pull request #26425: [SPARK-29789][SQL] should not parse the bucket column name when creating v2 tables

2019-11-11 Thread GitBox
rdblue commented on a change in pull request #26425: [SPARK-29789][SQL] should not parse the bucket column name when creating v2 tables URL: https://github.com/apache/spark/pull/26425#discussion_r344973767 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552683321 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions URL: https://github.com/apache/spark/pull/26441#issuecomment-552616668 **[Test build #113601 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552683312 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26473: [WIP] Strict parsing of day-time strings to intervals

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26473: [WIP] Strict parsing of day-time strings to intervals URL: https://github.com/apache/spark/pull/26473#issuecomment-552615138 **[Test build #113600 has

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552683321 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552683312 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions

2019-11-11 Thread GitBox
SparkQA commented on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions URL: https://github.com/apache/spark/pull/26441#issuecomment-552683298 **[Test build #113601 has

[GitHub] [spark] SparkQA commented on issue #26473: [WIP] Strict parsing of day-time strings to intervals

2019-11-11 Thread GitBox
SparkQA commented on issue #26473: [WIP] Strict parsing of day-time strings to intervals URL: https://github.com/apache/spark/pull/26473#issuecomment-552683167 **[Test build #113600 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113600/testReport)** for

[GitHub] [spark] SparkQA removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552638833 **[Test build #113605 has

[GitHub] [spark] SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552682715 **[Test build #113605 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552679128 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552679117 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552679117 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552679128 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
SparkQA commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552678604 **[Test build #113604 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113604/testReport)** for

[GitHub] [spark] SparkQA removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552629384 **[Test build #113604 has

[GitHub] [spark] ulysses-you commented on a change in pull request #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars

2019-11-11 Thread GitBox
ulysses-you commented on a change in pull request #26462: [SPARK-29833][YARN] Add FileNotFoundException check for spark.yarn.jars URL: https://github.com/apache/spark/pull/26462#discussion_r344967554 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #26474: [WIP][SPARK-29778] pass writer options to saveAsTable in append mode

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26474: [WIP][SPARK-29778] pass writer options to saveAsTable in append mode URL: https://github.com/apache/spark/pull/26474#issuecomment-552676832 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #26474: [WIP][SPARK-29778] pass writer options to saveAsTable in append mode

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26474: [WIP][SPARK-29778] pass writer options to saveAsTable in append mode URL: https://github.com/apache/spark/pull/26474#issuecomment-552676140 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #26474: [WIP][SPARK-29778] pass writer options to saveAsTable in append mode

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26474: [WIP][SPARK-29778] pass writer options to saveAsTable in append mode URL: https://github.com/apache/spark/pull/26474#issuecomment-552676140 Can one of the admins verify this patch?

[GitHub] [spark] SpaceRangerWes opened a new pull request #26474: [WIP][SPARK-29778] pass writer options to saveAsTable in append mode

2019-11-11 Thread GitBox
SpaceRangerWes opened a new pull request #26474: [WIP][SPARK-29778] pass writer options to saveAsTable in append mode URL: https://github.com/apache/spark/pull/26474 ### What changes were proposed in this pull request? ### Why are the changes needed?

[GitHub] [spark] AmplabJenkins removed a comment on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution.

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution. URL: https://github.com/apache/spark/pull/26176#issuecomment-552673267 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution.

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution. URL: https://github.com/apache/spark/pull/26176#issuecomment-552673261 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution.

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution. URL: https://github.com/apache/spark/pull/26176#issuecomment-552673267 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution.

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution. URL: https://github.com/apache/spark/pull/26176#issuecomment-552673261 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution.

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution. URL: https://github.com/apache/spark/pull/26176#issuecomment-552598038 **[Test build #113599 has

[GitHub] [spark] SparkQA commented on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution.

2019-11-11 Thread GitBox
SparkQA commented on issue #26176: [SPARK-29519][SQL] SHOW TBLPROPERTIES should do multi-catalog resolution. URL: https://github.com/apache/spark/pull/26176#issuecomment-552671907 **[Test build #113599 has

[GitHub] [spark] vanzin closed pull request #26397: [SPARK-29755][CORE] Provide @JsonDeserialize for Option[Long] in LogInfo & AttemptInfoWrapper

2019-11-11 Thread GitBox
vanzin closed pull request #26397: [SPARK-29755][CORE] Provide @JsonDeserialize for Option[Long] in LogInfo & AttemptInfoWrapper URL: https://github.com/apache/spark/pull/26397 This is an automated message from the Apache

[GitHub] [spark] vanzin commented on issue #26397: [SPARK-29755][CORE] Provide @JsonDeserialize for Option[Long] in LogInfo & AttemptInfoWrapper

2019-11-11 Thread GitBox
vanzin commented on issue #26397: [SPARK-29755][CORE] Provide @JsonDeserialize for Option[Long] in LogInfo & AttemptInfoWrapper URL: https://github.com/apache/spark/pull/26397#issuecomment-552669794 Merging to master. This

[GitHub] [spark] vanzin closed pull request #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows

2019-11-11 Thread GitBox
vanzin closed pull request #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/26108 This is an automated message from

[GitHub] [spark] vanzin commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows

2019-11-11 Thread GitBox
vanzin commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/26108#issuecomment-552669276 Yes. Merging to master.

[GitHub] [spark] maropu commented on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions

2019-11-11 Thread GitBox
maropu commented on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions URL: https://github.com/apache/spark/pull/26441#issuecomment-552668534 This issue can happen other than the cube aggregate as shown above?

[GitHub] [spark] maropu commented on a change in pull request #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions

2019-11-11 Thread GitBox
maropu commented on a change in pull request #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions URL: https://github.com/apache/spark/pull/26441#discussion_r344958732 ## File path:

[GitHub] [spark] HeartSaVioR commented on issue #26397: [SPARK-29755][CORE] Provide @JsonDeserialize for Option[Long] in LogInfo & AttemptInfoWrapper

2019-11-11 Thread GitBox
HeartSaVioR commented on issue #26397: [SPARK-29755][CORE] Provide @JsonDeserialize for Option[Long] in LogInfo & AttemptInfoWrapper URL: https://github.com/apache/spark/pull/26397#issuecomment-55281 Bump This is an

[GitHub] [spark] HeartSaVioR commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows

2019-11-11 Thread GitBox
HeartSaVioR commented on issue #26108: [SPARK-26154][SS] Streaming left/right outer join should not return outer nulls for already matched rows URL: https://github.com/apache/spark/pull/26108#issuecomment-552666483 Looks like no comment from others so far; shall we consider merging this?

[GitHub] [spark] jiangxb1987 commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-11-11 Thread GitBox
jiangxb1987 commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-552665680 It's fine to just set `freeCores` to 0 for now, since the scheduler

[GitHub] [spark] AmplabJenkins removed a comment on issue #12302: [SPARK-14390][GraphX] Make initialization step in Pregel optional.

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #12302: [SPARK-14390][GraphX] Make initialization step in Pregel optional. URL: https://github.com/apache/spark/pull/12302#issuecomment-531899540 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #12302: [SPARK-14390][GraphX] Make initialization step in Pregel optional.

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #12302: [SPARK-14390][GraphX] Make initialization step in Pregel optional. URL: https://github.com/apache/spark/pull/12302#issuecomment-552664558 Can one of the admins verify this patch? This

[GitHub] [spark] holdenk commented on issue #26440: [WIP][SPARK-20628][CORE] Start to improve Spark decommissioning & preemption support

2019-11-11 Thread GitBox
holdenk commented on issue #26440: [WIP][SPARK-20628][CORE] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-552664508 Ok digging into, looks like while I was updating the PR from 2017 I accidentally broke the message

[GitHub] [spark] srowen commented on a change in pull request #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is enabled

2019-11-11 Thread GitBox
srowen commented on a change in pull request #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is enabled URL: https://github.com/apache/spark/pull/26315#discussion_r344955850 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala

[GitHub] [spark] vanzin commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers

2019-11-11 Thread GitBox
vanzin commented on issue #25964: [SPARK-29287][Core] Add ExecutorConstructed message to tell driver which executor is ready for making offers URL: https://github.com/apache/spark/pull/25964#issuecomment-552661328 Looks ok, but I haven't been following the new resource allocation work, so

[GitHub] [spark] maropu commented on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils

2019-11-11 Thread GitBox
maropu commented on issue #26301: [WIP] [SPARK-29644] [SQL] Corrected ShortType and ByteType mapping to SmallInt and TinyInt in JDBCUtils URL: https://github.com/apache/spark/pull/26301#issuecomment-552659968 still WIP?

[GitHub] [spark] vanzin commented on a change in pull request #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is enabled

2019-11-11 Thread GitBox
vanzin commented on a change in pull request #26315: [SPARK-29152][CORE] Executor Plugin shutdown when dynamic allocation is enabled URL: https://github.com/apache/spark/pull/26315#discussion_r344952210 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala

[GitHub] [spark] dbtsai closed pull request #24541: [SPARK-27646] [SQL] [WIP] Required refactoring for bytecode analysis

2019-11-11 Thread GitBox
dbtsai closed pull request #24541: [SPARK-27646] [SQL] [WIP] Required refactoring for bytecode analysis URL: https://github.com/apache/spark/pull/24541 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] ueshin commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
ueshin commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#discussion_r344934124 ## File path:

[GitHub] [spark] viirya commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
viirya commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552643459 > For those performance reason, Apache Spark already converts Hive table to data source

[GitHub] [spark] dongjoon-hyun closed pull request #26405: [SPARK-29766][sql] Do metrics aggregation asynchronously in SQL listener.

2019-11-11 Thread GitBox
dongjoon-hyun closed pull request #26405: [SPARK-29766][sql] Do metrics aggregation asynchronously in SQL listener. URL: https://github.com/apache/spark/pull/26405 This is an automated message from the Apache Git Service.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26405: [SPARK-29766][sql] Do metrics aggregation asynchronously in SQL listener.

2019-11-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #26405: [SPARK-29766][sql] Do metrics aggregation asynchronously in SQL listener. URL: https://github.com/apache/spark/pull/26405#discussion_r344935511 ## File path:

[GitHub] [spark] ueshin commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
ueshin commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#discussion_r344934124 ## File path:

[GitHub] [spark] ueshin commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
ueshin commented on a change in pull request #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#discussion_r344933856 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
dongjoon-hyun commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552641872 For those performance reason, Apache Spark already converts Hive table to data

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552640918 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552640931 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552640918 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552640931 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] vanzin commented on a change in pull request #26405: [SPARK-29766][sql] Do metrics aggregation asynchronously in SQL listener.

2019-11-11 Thread GitBox
vanzin commented on a change in pull request #26405: [SPARK-29766][sql] Do metrics aggregation asynchronously in SQL listener. URL: https://github.com/apache/spark/pull/26405#discussion_r344934314 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
dongjoon-hyun commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552639139 Thank you for updating, @jiangxb1987 . This

[GitHub] [spark] SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-552638833 **[Test build #113605 has

[GitHub] [spark] dongjoon-hyun commented on issue #26433: [SPARK-29771][K8S] Add configure to limit executor failures

2019-11-11 Thread GitBox
dongjoon-hyun commented on issue #26433: [SPARK-29771][K8S] Add configure to limit executor failures URL: https://github.com/apache/spark/pull/26433#issuecomment-552638443 Also, do you think you can add a test case for this new feature?

[GitHub] [spark] dongjoon-hyun commented on issue #26433: [SPARK-29771][K8S] Add configure to limit executor failures

2019-11-11 Thread GitBox
dongjoon-hyun commented on issue #26433: [SPARK-29771][K8S] Add configure to limit executor failures URL: https://github.com/apache/spark/pull/26433#issuecomment-552638544 cc @holdenk This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552637942 Merged build finished. Test PASSed. This is an

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26433: [SPARK-29771][K8S] Add configure to limit executor failures

2019-11-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #26433: [SPARK-29771][K8S] Add configure to limit executor failures URL: https://github.com/apache/spark/pull/26433#discussion_r344931467 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552637953 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552637942 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
SparkQA removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552626804 **[Test build #113602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113602/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552637953 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
SparkQA commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552637530 **[Test build #113602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113602/testReport)** for PR

[GitHub] [spark] xuanyuanking commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-11-11 Thread GitBox
xuanyuanking commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r344928483 ## File path:

[GitHub] [spark] xuanyuanking commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-11-11 Thread GitBox
xuanyuanking commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r344913872 ## File path: sql/core/src/main/scala/org/apache/spark/sql/streaming/ui/StreamingQueryPage.scala

[GitHub] [spark] xuanyuanking commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-11-11 Thread GitBox
xuanyuanking commented on a change in pull request #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#discussion_r344908636 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SQLTab.scala ## @@

[GitHub] [spark] viirya edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
viirya edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552631299 Another point is, for datasource table scan node, the parallelism is controlled

[GitHub] [spark] viirya edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
viirya edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552627966 > The optimal value for each table is unknown, isn't it? This PR doesn't give

[GitHub] [spark] jiangxb1987 commented on a change in pull request #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-11-11 Thread GitBox
jiangxb1987 commented on a change in pull request #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#discussion_r344925923 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-552631346 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552630895 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-552631005 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552630885 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-552631005 Merged build finished. Test PASSed.

[GitHub] [spark] viirya commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
viirya commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552631299 Another point is, for datasource table scan node, the parallelism can be controlled by

[GitHub] [spark] AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-552631346 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552630885 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
AmplabJenkins commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552630895 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour

2019-11-11 Thread GitBox
SparkQA commented on issue #25728: [SPARK-29020][WIP][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-552629384 **[Test build #113604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113604/testReport)** for

[GitHub] [spark] viirya commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
viirya commented on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552627966 > The optimal value for each table is unknown, isn't it? This PR doesn't give any clue

[GitHub] [spark] SparkQA commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
SparkQA commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-552627908 **[Test build #113603 has

[GitHub] [spark] SparkQA commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema.

2019-11-11 Thread GitBox
SparkQA commented on issue #26118: [SPARK-24915][Python] Fix Row handling with Schema. URL: https://github.com/apache/spark/pull/26118#issuecomment-552626804 **[Test build #113602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/113602/testReport)** for PR

[GitHub] [spark] dongjoon-hyun commented on issue #26433: [SPARK-29771][K8S] Add configure to limit executor failures

2019-11-11 Thread GitBox
dongjoon-hyun commented on issue #26433: [SPARK-29771][K8S] Add configure to limit executor failures URL: https://github.com/apache/spark/pull/26433#issuecomment-552623044 Thank you for updating, @stczwd . This is an

[GitHub] [spark] cozos commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
cozos commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#discussion_r344914942 ## File path:

[GitHub] [spark] cozos commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
cozos commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#discussion_r344914942 ## File path:

[GitHub] [spark] cozos commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-11-11 Thread GitBox
cozos commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#discussion_r344914942 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26471: [SPARK-29850][SQL] sort-merge-join an empty table should not memory leak

2019-11-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #26471: [SPARK-29850][SQL] sort-merge-join an empty table should not memory leak URL: https://github.com/apache/spark/pull/26471#discussion_r344913207 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26471: [SPARK-29850][SQL] sort-merge-join an empty table should not memory leak

2019-11-11 Thread GitBox
dongjoon-hyun commented on a change in pull request #26471: [SPARK-29850][SQL] sort-merge-join an empty table should not memory leak URL: https://github.com/apache/spark/pull/26471#discussion_r344912755 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions

2019-11-11 Thread GitBox
AmplabJenkins removed a comment on issue #26441: [SPARK-29682][SQL] Resolve conflicting references in aggregate expressions URL: https://github.com/apache/spark/pull/26441#issuecomment-552618258 Merged build finished. Test PASSed.

<    1   2   3   4   5   6   7   8   9   >