[GitHub] [spark] imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-04 Thread GitBox
imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363073621 ## File path:

[GitHub] [spark] viirya commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf

2020-01-04 Thread GitBox
viirya commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-570876682 Is the second SQL query wrong (`COL1 > 1` -> `COL1 > 10`) in the PR description?

[GitHub] [spark] SparkQA removed a comment on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf

2020-01-04 Thread GitBox
SparkQA removed a comment on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-570866651 **[Test build #4985 has

[GitHub] [spark] SparkQA commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf

2020-01-04 Thread GitBox
SparkQA commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-570873680 **[Test build #4985 has

[GitHub] [spark] cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-04 Thread GitBox
cloud-fan commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363071473 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode

2020-01-04 Thread GitBox
cloud-fan commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode URL: https://github.com/apache/spark/pull/26933#discussion_r363071095 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode

2020-01-04 Thread GitBox
cloud-fan commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode URL: https://github.com/apache/spark/pull/26933#discussion_r363071095 ## File path:

[GitHub] [spark] SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570868214 **[Test build #116117 has

[GitHub] [spark] cloud-fan commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode

2020-01-04 Thread GitBox
cloud-fan commented on a change in pull request #26933: [SPARK-30292][SQL]Throw Exception when invalid string is cast to numeric type in ANSI mode URL: https://github.com/apache/spark/pull/26933#discussion_r363071095 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570867562 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570867568 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570867568 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570867562 Merged build finished. Test PASSed. This is an

[GitHub] [spark] wangyum closed pull request #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-04 Thread GitBox
wangyum closed pull request #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721 This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf

2020-01-04 Thread GitBox
SparkQA commented on issue #26437: [SPARK-29800][SQL] Rewrite non-correlated subquery use ScalaSubquery to optimize perf URL: https://github.com/apache/spark/pull/26437#issuecomment-570866651 **[Test build #4985 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570859143 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570859142 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570859142 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570859143 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
SparkQA removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570849671 **[Test build #116116 has

[GitHub] [spark] SparkQA commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
SparkQA commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570859057 **[Test build #116116 has

[GitHub] [spark] wzhfy commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-04 Thread GitBox
wzhfy commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#discussion_r363069147 ## File path:

[GitHub] [spark] wzhfy commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-04 Thread GitBox
wzhfy commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#discussion_r363068727 ## File path:

[GitHub] [spark] wzhfy commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-04 Thread GitBox
wzhfy commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#discussion_r363068298 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570849870 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570849865 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570849870 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570849865 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
SparkQA commented on issue #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#issuecomment-570849671 **[Test build #116116 has

[GitHub] [spark] huaxingao commented on a change in pull request #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
huaxingao commented on a change in pull request #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#discussion_r363067570 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27096: SPARK-28148: repartition after join is not optimized away

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27096: SPARK-28148: repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-570842530 Can one of the admins verify this patch? This

[GitHub] [spark] AmplabJenkins commented on issue #27096: SPARK-28148: repartition after join is not optimized away

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27096: SPARK-28148: repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-570843855 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #27096: SPARK-28148: repartition after join is not optimized away

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27096: SPARK-28148: repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096#issuecomment-570842530 Can one of the admins verify this patch? This is an

[GitHub] [spark] bmarcott opened a new pull request #27096: SPARK-28148: repartition after join is not optimized away

2020-01-04 Thread GitBox
bmarcott opened a new pull request #27096: SPARK-28148: repartition after join is not optimized away URL: https://github.com/apache/spark/pull/27096 ### What changes were proposed in this pull request? Extra shuffling was not eliminated after inner joins because they produce

[GitHub] [spark] srowen closed pull request #26891: Fix issue where `newFilesOnly` does nothing

2020-01-04 Thread GitBox
srowen closed pull request #26891: Fix issue where `newFilesOnly` does nothing URL: https://github.com/apache/spark/pull/26891 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] srowen commented on a change in pull request #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints

2020-01-04 Thread GitBox
srowen commented on a change in pull request #27093: [SPARK-30418][ML] Make FM call super class method extractLabeledPoints URL: https://github.com/apache/spark/pull/27093#discussion_r363062505 ## File path:

[GitHub] [spark] srowen closed pull request #22758: [SPARK-25332][SQL] select broadcast join instead of sortMergeJoin for the small size table even query fired via new session/context

2020-01-04 Thread GitBox
srowen closed pull request #22758: [SPARK-25332][SQL] select broadcast join instead of sortMergeJoin for the small size table even query fired via new session/context URL: https://github.com/apache/spark/pull/22758 This

[GitHub] [spark] github-actions[bot] closed pull request #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch

2020-01-04 Thread GitBox
github-actions[bot] closed pull request #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch URL: https://github.com/apache/spark/pull/23008 This is an automated message from the Apache Git Service. To

[GitHub] [spark] github-actions[bot] closed pull request #23104: [SPARK-26138][SQL] Cross join requires push LocalLimit in LimitPushDown rule

2020-01-04 Thread GitBox
github-actions[bot] closed pull request #23104: [SPARK-26138][SQL] Cross join requires push LocalLimit in LimitPushDown rule URL: https://github.com/apache/spark/pull/23104 This is an automated message from the Apache Git

[GitHub] [spark] github-actions[bot] commented on issue #22758: [SPARK-25332][SQL] select broadcast join instead of sortMergeJoin for the small size table even query fired via new session/context

2020-01-04 Thread GitBox
github-actions[bot] commented on issue #22758: [SPARK-25332][SQL] select broadcast join instead of sortMergeJoin for the small size table even query fired via new session/context URL: https://github.com/apache/spark/pull/22758#issuecomment-570831370 We're closing this PR because it

[GitHub] [spark] github-actions[bot] closed pull request #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder

2020-01-04 Thread GitBox
github-actions[bot] closed pull request #24983: [SPARK-27714][SQL][CBO] Support Genetic Algorithm based join reorder URL: https://github.com/apache/spark/pull/24983 This is an automated message from the Apache Git Service.

[GitHub] [spark] github-actions[bot] closed pull request #22964: [SPARK-25963] Optimize generate followed by window

2020-01-04 Thread GitBox
github-actions[bot] closed pull request #22964: [SPARK-25963] Optimize generate followed by window URL: https://github.com/apache/spark/pull/22964 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] github-actions[bot] commented on issue #22905: [SPARK-25894][SQL] Add a ColumnarFileFormat type which returns the column count for a given schema

2020-01-04 Thread GitBox
github-actions[bot] commented on issue #22905: [SPARK-25894][SQL] Add a ColumnarFileFormat type which returns the column count for a given schema URL: https://github.com/apache/spark/pull/22905#issuecomment-570831364 We're closing this PR because it hasn't been updated in a while. This

[GitHub] [spark] github-actions[bot] closed pull request #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories

2020-01-04 Thread GitBox
github-actions[bot] closed pull request #23108: [Spark-25993][SQL][TEST]Add test cases for CREATE EXTERNAL TABLE with subdirectories URL: https://github.com/apache/spark/pull/23108 This is an automated message from the

[GitHub] [spark] github-actions[bot] closed pull request #23042: [SPARK-26070][SQL] add rule for implicit type coercion for decimal(x, 0)

2020-01-04 Thread GitBox
github-actions[bot] closed pull request #23042: [SPARK-26070][SQL] add rule for implicit type coercion for decimal(x,0) URL: https://github.com/apache/spark/pull/23042 This is an automated message from the Apache Git

[GitHub] [spark] github-actions[bot] closed pull request #23094: [SPARK-26077][SQL] Reserved SQL words are not escaped by JDBC writer for table names

2020-01-04 Thread GitBox
github-actions[bot] closed pull request #23094: [SPARK-26077][SQL] Reserved SQL words are not escaped by JDBC writer for table names URL: https://github.com/apache/spark/pull/23094 This is an automated message from the

[GitHub] [spark] github-actions[bot] commented on issue #22957: [SPARK-25951][SQL] Ignore aliases for distributions and orderings

2020-01-04 Thread GitBox
github-actions[bot] commented on issue #22957: [SPARK-25951][SQL] Ignore aliases for distributions and orderings URL: https://github.com/apache/spark/pull/22957#issuecomment-570831353 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of

[GitHub] [spark] github-actions[bot] closed pull request #23074: [SPARK-19798][SQL] Refresh table does not have effect on other sessions than the issuing one

2020-01-04 Thread GitBox
github-actions[bot] closed pull request #23074: [SPARK-19798][SQL] Refresh table does not have effect on other sessions than the issuing one URL: https://github.com/apache/spark/pull/23074 This is an automated message from

[GitHub] [spark] github-actions[bot] commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro

2020-01-04 Thread GitBox
github-actions[bot] commented on issue #22878: [SPARK-25789][SQL] Support for Dataset of Avro URL: https://github.com/apache/spark/pull/22878#issuecomment-570831366 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way.

[GitHub] [spark] github-actions[bot] closed pull request #23032: [WIP][SPARK-26061][SQL][MINOR] Reduce the number of unused UnsafeRowWriters created in whole-stage codegen

2020-01-04 Thread GitBox
github-actions[bot] closed pull request #23032: [WIP][SPARK-26061][SQL][MINOR] Reduce the number of unused UnsafeRowWriters created in whole-stage codegen URL: https://github.com/apache/spark/pull/23032 This is an automated

[GitHub] [spark] github-actions[bot] commented on issue #25795: [WIP][SPARK-29037][Core] Spark gives duplicate result when an application was killed

2020-01-04 Thread GitBox
github-actions[bot] commented on issue #25795: [WIP][SPARK-29037][Core] Spark gives duplicate result when an application was killed URL: https://github.com/apache/spark/pull/25795#issuecomment-570831321 We're closing this PR because it hasn't been updated in a while. This isn't a

[GitHub] [spark] github-actions[bot] commented on issue #22947: [SPARK-24913][SQL] Make AssertNotNull and AssertTrue non-deterministic

2020-01-04 Thread GitBox
github-actions[bot] commented on issue #22947: [SPARK-24913][SQL] Make AssertNotNull and AssertTrue non-deterministic URL: https://github.com/apache/spark/pull/22947#issuecomment-570831356 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the

[GitHub] [spark] github-actions[bot] commented on issue #22774: [SPARK-25780][CORE]Scheduling the tasks which have no higher level locality first

2020-01-04 Thread GitBox
github-actions[bot] commented on issue #22774: [SPARK-25780][CORE]Scheduling the tasks which have no higher level locality first URL: https://github.com/apache/spark/pull/22774#issuecomment-570831368 We're closing this PR because it hasn't been updated in a while. This isn't a judgement

[GitHub] [spark] github-actions[bot] commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty

2020-01-04 Thread GitBox
github-actions[bot] commented on issue #22721: [SPARK-19784][SPARK-25403][SQL] Refresh the table even table stats is empty URL: https://github.com/apache/spark/pull/22721#issuecomment-570831372 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on

[GitHub] [spark] github-actions[bot] commented on issue #22945: [SPARK-24066][SQL]Add new optimization rule to eliminate unnecessary sort by exchanged adjacent Window expressions

2020-01-04 Thread GitBox
github-actions[bot] commented on issue #22945: [SPARK-24066][SQL]Add new optimization rule to eliminate unnecessary sort by exchanged adjacent Window expressions URL: https://github.com/apache/spark/pull/22945#issuecomment-570831361 We're closing this PR because it hasn't been updated in

[GitHub] [spark] fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions

2020-01-04 Thread GitBox
fuwhu commented on a change in pull request #26805: [SPARK-15616][SQL] Add optimizer rule PruneHiveTablePartitions URL: https://github.com/apache/spark/pull/26805#discussion_r363016268 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] [spark] srowen closed pull request #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
srowen closed pull request #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] srowen commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
srowen commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570822844 Merged to master This is an automated message from the Apache Git

[GitHub] [spark] ayudovin commented on issue #27030: [SPARK-30244][SQL][Catalyst] - Emit pre/post events for "Partition" methods in ExternalCatalogWithListener

2020-01-04 Thread GitBox
ayudovin commented on issue #27030: [SPARK-30244][SQL][Catalyst] - Emit pre/post events for "Partition" methods in ExternalCatalogWithListener URL: https://github.com/apache/spark/pull/27030#issuecomment-570820515 @hvanhovell, Could you please review this pull request?

[GitHub] [spark] ayudovin commented on issue #27034: [SPARK-30122][Resource-Manager][Kubernetes] - Allow setting serviceAccountName for executor pods

2020-01-04 Thread GitBox
ayudovin commented on issue #27034: [SPARK-30122][Resource-Manager][Kubernetes] - Allow setting serviceAccountName for executor pods URL: https://github.com/apache/spark/pull/27034#issuecomment-570820424 @liyinan926, Could you please review this pull request?

[GitHub] [spark] huaxingao commented on issue #27094: [SPARK-30419][ML][PySpark] Make IsotonicRegression extend Regressor

2020-01-04 Thread GitBox
huaxingao commented on issue #27094: [SPARK-30419][ML][PySpark] Make IsotonicRegression extend Regressor URL: https://github.com/apache/spark/pull/27094#issuecomment-570819435 I think over. I didn't implement this correctly: the FeaturesType could be Vector too. Even though the Vector

[GitHub] [spark] huaxingao closed pull request #27094: [SPARK-30419][ML][PySpark] Make IsotonicRegression extend Regressor

2020-01-04 Thread GitBox
huaxingao closed pull request #27094: [SPARK-30419][ML][PySpark] Make IsotonicRegression extend Regressor URL: https://github.com/apache/spark/pull/27094 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] AmplabJenkins removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570816944 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570816944 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570816946 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570816946 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
SparkQA removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570799046 **[Test build #116114 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116114/testReport)**

[GitHub] [spark] SparkQA commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
SparkQA commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570816809 **[Test build #116114 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116114/testReport)** for

[GitHub] [spark] superbobry commented on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch

2020-01-04 Thread GitBox
superbobry commented on issue #23008: [SPARK-22674][PYTHON] Removed the namedtuple pickling patch URL: https://github.com/apache/spark/pull/23008#issuecomment-570815761 @HyukjinKwon I think you might still want to merge this eventually. Closing the PR will only make the issue harder to

[GitHub] [spark] srowen commented on a change in pull request #27094: [SPARK-30419][ML][PySpark] Make IsotonicRegression extend Regressor

2020-01-04 Thread GitBox
srowen commented on a change in pull request #27094: [SPARK-30419][ML][PySpark] Make IsotonicRegression extend Regressor URL: https://github.com/apache/spark/pull/27094#discussion_r363051568 ## File path: project/MimaExcludes.scala ## @@ -465,7 +465,15 @@ object

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570813182 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570813182 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570813180 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570813180 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570812994 **[Test build #116115 has

[GitHub] [spark] SparkQA removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
SparkQA removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570801625 **[Test build #116115 has

[GitHub] [spark] erikerlandson commented on a change in pull request #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF

2020-01-04 Thread GitBox
erikerlandson commented on a change in pull request #25024: [SPARK-27296][SQL] Allows Aggregator to be registered as a UDF URL: https://github.com/apache/spark/pull/25024#discussion_r363046965 ## File path:

[GitHub] [spark] amanomer commented on issue #27052: [SPARK-30390][MLLIB] Avoid double caching in mllib.KMeans#runWithWeights.

2020-01-04 Thread GitBox
amanomer commented on issue #27052: [SPARK-30390][MLLIB] Avoid double caching in mllib.KMeans#runWithWeights. URL: https://github.com/apache/spark/pull/27052#issuecomment-570805218 Thanks @srowen This is an automated

[GitHub] [spark] huaxingao commented on a change in pull request #27094: [SPARK-30419][ML][PySpark] Make IsotonicRegression extend Regressor

2020-01-04 Thread GitBox
huaxingao commented on a change in pull request #27094: [SPARK-30419][ML][PySpark] Make IsotonicRegression extend Regressor URL: https://github.com/apache/spark/pull/27094#discussion_r363046502 ## File path: project/MimaExcludes.scala ## @@ -465,7 +465,15 @@ object

[GitHub] [spark] imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework

2020-01-04 Thread GitBox
imback82 commented on a change in pull request #27095: [SPARK-30214][SQL] V2 commands resolves namespaces with new resolution framework URL: https://github.com/apache/spark/pull/27095#discussion_r363023439 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570801735 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570801737 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570801737 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570801735 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks

2020-01-04 Thread GitBox
SparkQA commented on issue #27078: [SPARK-30409][SQL][TESTS] Use `NoOp` datasource in SQL benchmarks URL: https://github.com/apache/spark/pull/27078#issuecomment-570801625 **[Test build #116115 has

[GitHub] [spark] srowen commented on issue #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command

2020-01-04 Thread GitBox
srowen commented on issue #26759: [SPARK-28794][SQL][DOC] Documentation for Create table Command URL: https://github.com/apache/spark/pull/26759#issuecomment-570799515 Ping @PavithraRamachandran This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570799158 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
AmplabJenkins removed a comment on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570799164 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570799158 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
AmplabJenkins commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570799164 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
SparkQA commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570799046 **[Test build #116114 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116114/testReport)** for PR

[GitHub] [spark] srowen commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc

2020-01-04 Thread GitBox
srowen commented on issue #27091: [SPARK-30415][SQL]Improve Readability of SQLConf Doc URL: https://github.com/apache/spark/pull/27091#issuecomment-570798805 Jenkins test this please This is an automated message from the

[GitHub] [spark] srowen commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-04 Thread GitBox
srowen commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#discussion_r363043345 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs

2020-01-04 Thread GitBox
srowen commented on a change in pull request #27079: [SPARK-30410][SQL] Calculating size of table with large number of partitions causes flooding logs URL: https://github.com/apache/spark/pull/27079#discussion_r363043362 ## File path:

[GitHub] [spark] srowen closed pull request #27059: [SPARK-30398][ML] PCA/RegressionMetrics/RowMatrix avoid unnecessary computation

2020-01-04 Thread GitBox
srowen closed pull request #27059: [SPARK-30398][ML] PCA/RegressionMetrics/RowMatrix avoid unnecessary computation URL: https://github.com/apache/spark/pull/27059 This is an automated message from the Apache Git Service. To

[GitHub] [spark] srowen commented on issue #27059: [SPARK-30398][ML] PCA/RegressionMetrics/RowMatrix avoid unnecessary computation

2020-01-04 Thread GitBox
srowen commented on issue #27059: [SPARK-30398][ML] PCA/RegressionMetrics/RowMatrix avoid unnecessary computation URL: https://github.com/apache/spark/pull/27059#issuecomment-570798581 Merged to master This is an automated

[GitHub] [spark] brkyvz commented on issue #26913: [SPARK-29219][SQL] Introduce SupportsCatalogOptions for TableProvider

2020-01-04 Thread GitBox
brkyvz commented on issue #26913: [SPARK-29219][SQL] Introduce SupportsCatalogOptions for TableProvider URL: https://github.com/apache/spark/pull/26913#issuecomment-570798373 @cloud-fan Any more comments on this? Shall we merge this?

[GitHub] [spark] MaxGekk commented on issue #27092: [SPARK-30416][SQL] Log a warning for deprecated SQL config in `set()` and `unset()`

2020-01-04 Thread GitBox
MaxGekk commented on issue #27092: [SPARK-30416][SQL] Log a warning for deprecated SQL config in `set()` and `unset()` URL: https://github.com/apache/spark/pull/27092#issuecomment-570798353 @HyukjinKwon Please, have a look at the PR.

[GitHub] [spark] srowen closed pull request #27052: [SPARK-30390][MLLIB] Avoid double caching in mllib.KMeans#runWithWeights.

2020-01-04 Thread GitBox
srowen closed pull request #27052: [SPARK-30390][MLLIB] Avoid double caching in mllib.KMeans#runWithWeights. URL: https://github.com/apache/spark/pull/27052 This is an automated message from the Apache Git Service. To

[GitHub] [spark] srowen commented on issue #27052: [SPARK-30390][MLLIB] Avoid double caching in mllib.KMeans#runWithWeights.

2020-01-04 Thread GitBox
srowen commented on issue #27052: [SPARK-30390][MLLIB] Avoid double caching in mllib.KMeans#runWithWeights. URL: https://github.com/apache/spark/pull/27052#issuecomment-570797957 We can change this further, but this is an improvement and less of a change than anything else we'd do. I'll

  1   2   >