[GitHub] [spark] BryanCutler edited a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

2019-06-04 Thread GitBox
BryanCutler edited a comment on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-497156929 >this sounds important... Yeah @felixcheung , it could be a nasty problem. I think

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498765873 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24787: [MINOR] [DOC] Avro data source documentation change

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24787: [MINOR] [DOC] Avro data source documentation change URL: https://github.com/apache/spark/pull/24787#issuecomment-498766113 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24787: [MINOR] [DOC] Avro data source documentation change

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24787: [MINOR] [DOC] Avro data source documentation change URL: https://github.com/apache/spark/pull/24787#issuecomment-498766103 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498765860 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24787: [MINOR] [DOC] Avro data source documentation change

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24787: [MINOR] [DOC] Avro data source documentation change URL: https://github.com/apache/spark/pull/24787#issuecomment-498766103 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens

2019-06-04 Thread GitBox
dongjoon-hyun commented on a change in pull request #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens URL: https://github.com/apache/spark/pull/24749#discussion_r290408289 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24787: [MINOR] [DOC] Avro data source documentation change

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24787: [MINOR] [DOC] Avro data source documentation change URL: https://github.com/apache/spark/pull/24787#issuecomment-498766113 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens

2019-06-04 Thread GitBox
dongjoon-hyun commented on a change in pull request #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens URL: https://github.com/apache/spark/pull/24749#discussion_r290408289 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498765860 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498765873 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens

2019-06-04 Thread GitBox
dongjoon-hyun commented on a change in pull request #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens URL: https://github.com/apache/spark/pull/24749#discussion_r290408289 ## File path:

[GitHub] [spark] SparkQA commented on issue #24787: [MINOR] [DOC] Avro data source documentation change

2019-06-04 Thread GitBox
SparkQA commented on issue #24787: [MINOR] [DOC] Avro data source documentation change URL: https://github.com/apache/spark/pull/24787#issuecomment-498765448 **[Test build #106155 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106155/testReport)** for PR

[GitHub] [spark] SparkQA removed a comment on issue #24787: [MINOR] [DOC] Avro data source documentation change

2019-06-04 Thread GitBox
SparkQA removed a comment on issue #24787: [MINOR] [DOC] Avro data source documentation change URL: https://github.com/apache/spark/pull/24787#issuecomment-498695325 **[Test build #106155 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106155/testReport)**

[GitHub] [spark] SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-06-04 Thread GitBox
SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498691252 **[Test build #106154 has

[GitHub] [spark] SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-06-04 Thread GitBox
SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498765231 **[Test build #106154 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106154/testReport)**

[GitHub] [spark] BryanCutler closed pull request #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

2019-06-04 Thread GitBox
BryanCutler closed pull request #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677 This is an automated message from the Apache Git

[GitHub] [spark] BryanCutler commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

2019-06-04 Thread GitBox
BryanCutler commented on issue #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#issuecomment-498761553 merged to master, thanks @dvogelbacher !

[GitHub] [spark] koertkuipers commented on issue #22598: [SPARK-25501][SS] Add kafka delegation token support.

2019-06-04 Thread GitBox
koertkuipers commented on issue #22598: [SPARK-25501][SS] Add kafka delegation token support. URL: https://github.com/apache/spark/pull/22598#issuecomment-498759639 got it. thanks On Tue, Jun 4, 2019, 12:56 Gabor Somogyi wrote: > Since Kafka doesn't support dynamic parameter

[GitHub] [spark] BryanCutler commented on a change in pull request #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

2019-06-04 Thread GitBox
BryanCutler commented on a change in pull request #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#discussion_r290400593 ## File path:

[GitHub] [spark] squito commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

2019-06-04 Thread GitBox
squito commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#issuecomment-498757452 looks good to me other than the comments by marcelo. (some of my

[GitHub] [spark] AmplabJenkins removed a comment on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens URL: https://github.com/apache/spark/pull/24749#issuecomment-498754384 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens URL: https://github.com/apache/spark/pull/24749#issuecomment-498754370 Merged build finished. Test PASSed.

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290394294 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290396681 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/ExecutorData.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290394216 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290393554 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290393911 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala

[GitHub] [spark] rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-06-04 Thread GitBox
rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#discussion_r290396441 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

[GitHub] [spark] gaborgsomogyi commented on issue #22598: [SPARK-25501][SS] Add kafka delegation token support.

2019-06-04 Thread GitBox
gaborgsomogyi commented on issue #22598: [SPARK-25501][SS] Add kafka delegation token support. URL: https://github.com/apache/spark/pull/22598#issuecomment-498754962 Since Kafka doesn't support dynamic parameter settings, yes.

[GitHub] [spark] jzhuge commented on a change in pull request #24768: [SPARK-27919][SQL] Add v2 session catalog

2019-06-04 Thread GitBox
jzhuge commented on a change in pull request #24768: [SPARK-27919][SQL] Add v2 session catalog URL: https://github.com/apache/spark/pull/24768#discussion_r290395282 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/LookupCatalog.scala ## @@ -26,8

[GitHub] [spark] jzhuge commented on a change in pull request #24768: [SPARK-27919][SQL] Add v2 session catalog

2019-06-04 Thread GitBox
jzhuge commented on a change in pull request #24768: [SPARK-27919][SQL] Add v2 session catalog URL: https://github.com/apache/spark/pull/24768#discussion_r290394824 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/V2SessionCatalog.scala

[GitHub] [spark] jzhuge commented on a change in pull request #24768: [SPARK-27919][SQL] Add v2 session catalog

2019-06-04 Thread GitBox
jzhuge commented on a change in pull request #24768: [SPARK-27919][SQL] Add v2 session catalog URL: https://github.com/apache/spark/pull/24768#discussion_r290395352 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalog/v2/LookupCatalog.scala ## @@ -26,8

[GitHub] [spark] AmplabJenkins commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens URL: https://github.com/apache/spark/pull/24749#issuecomment-498754370 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens URL: https://github.com/apache/spark/pull/24749#issuecomment-498754384 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-06-04 Thread GitBox
rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#discussion_r290394163 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLParserSuite.scala

[GitHub] [spark] SparkQA commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens

2019-06-04 Thread GitBox
SparkQA commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens URL: https://github.com/apache/spark/pull/24749#issuecomment-498752125 **[Test build #106160 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498750356 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498750349 Merged build finished. Test FAILed. This is an

[GitHub] [spark] dvogelbacher commented on a change in pull request #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled

2019-06-04 Thread GitBox
dvogelbacher commented on a change in pull request #24677: [SPARK-27805][PYTHON] Propagate SparkExceptions during toPandas with arrow enabled URL: https://github.com/apache/spark/pull/24677#discussion_r290390863 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498750356 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498750349 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
SparkQA removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498714733 **[Test build #106157 has

[GitHub] [spark] SparkQA commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
SparkQA commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498750170 **[Test build #106157 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106157/testReport)**

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290388382 ## File path:

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290388019 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ##

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290379669 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290382028 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290379976 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290378098 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290378957 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290368437 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ## @@

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290372130 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290374423 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290371687 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290371943 ## File path: core/src/main/scala/org/apache/spark/scheduler/ExecutorResourceInfo.scala

[GitHub] [spark] mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
mengxr commented on a change in pull request #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#discussion_r290367644 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ## @@

[GitHub] [spark] rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-06-04 Thread GitBox
rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#discussion_r290388576 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

[GitHub] [spark] SparkQA commented on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution

2019-06-04 Thread GitBox
SparkQA commented on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution URL: https://github.com/apache/spark/pull/24763#issuecomment-498746032 **[Test build #106158 has

[GitHub] [spark] SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-06-04 Thread GitBox
SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-498746025 **[Test build #106159 has

[GitHub] [spark] rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-06-04 Thread GitBox
rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#discussion_r290386152 ## File path:

[GitHub] [spark] rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-06-04 Thread GitBox
rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#discussion_r290385763 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-498745342 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution URL: https://github.com/apache/spark/pull/24763#issuecomment-498745336 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution URL: https://github.com/apache/spark/pull/24763#issuecomment-498745346 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-06-04 Thread GitBox
rdblue commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#discussion_r290385566 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-498745332 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution URL: https://github.com/apache/spark/pull/24763#issuecomment-498745346 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-498745342 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-498745332 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24763: [SPARK-27909][SQL] Do not run analysis inside CTE substitution URL: https://github.com/apache/spark/pull/24763#issuecomment-498745336 Merged build finished. Test PASSed. This is an

[GitHub] [spark] jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-06-04 Thread GitBox
jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-498744620 Rebased and squashed. This is an automated message from

[GitHub] [spark] jzhuge commented on a change in pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-06-04 Thread GitBox
jzhuge commented on a change in pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#discussion_r290383294 ## File path:

[GitHub] [spark] jzhuge commented on a change in pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-06-04 Thread GitBox
jzhuge commented on a change in pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#discussion_r290379810 ## File path:

[GitHub] [spark] gaborgsomogyi commented on issue #24781: [SPARK-27933][SS] Extracting common purge behaviour to the parent StreamExecution

2019-06-04 Thread GitBox
gaborgsomogyi commented on issue #24781: [SPARK-27933][SS] Extracting common purge behaviour to the parent StreamExecution URL: https://github.com/apache/spark/pull/24781#issuecomment-498739979 Yeah, I think it's good. Thanks.

[GitHub] [spark] jzhuge commented on a change in pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-06-04 Thread GitBox
jzhuge commented on a change in pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#discussion_r290379652 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/rules.scala

[GitHub] [spark] dongjoon-hyun closed pull request #24790: [SPARK-27773][FOLLOWUP][DOC] Add numCaughtExceptions metric to monitoring doc

2019-06-04 Thread GitBox
dongjoon-hyun closed pull request #24790: [SPARK-27773][FOLLOWUP][DOC] Add numCaughtExceptions metric to monitoring doc URL: https://github.com/apache/spark/pull/24790 This is an automated message from the Apache Git

[GitHub] [spark] jaceklaskowski commented on issue #24781: [SPARK-27933][SS] Extracting common purge behaviour to the parent StreamExecution

2019-06-04 Thread GitBox
jaceklaskowski commented on issue #24781: [SPARK-27933][SS] Extracting common purge behaviour to the parent StreamExecution URL: https://github.com/apache/spark/pull/24781#issuecomment-498727674 Is this title correct, @gaborgsomogyi ?

[GitHub] [spark] dmatrix commented on a change in pull request #24787: [MINOR] [DOC] Avro data source documentation change

2019-06-04 Thread GitBox
dmatrix commented on a change in pull request #24787: [MINOR] [DOC] Avro data source documentation change URL: https://github.com/apache/spark/pull/24787#discussion_r290364481 ## File path: docs/sql-data-sources-avro.md ## @@ -199,7 +199,7 @@ Data source options of Avro

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-498724747 Merged build finished. Test PASSed.

[GitHub] [spark] tgravescs commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

2019-06-04 Thread GitBox
tgravescs commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-498724815 case class and name changes look good other then nits mentioned, thanks.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-498724763 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-498724763 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-498724747 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
SparkQA commented on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-498723869 **[Test build #106152 has

[GitHub] [spark] SparkQA removed a comment on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-06-04 Thread GitBox
SparkQA removed a comment on issue #24374: [SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-498673293 **[Test build #106152 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498717562 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498717515 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498717562 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498717515 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498689432 Can one of the admins verify this patch? This

[GitHub] [spark] SparkQA commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
SparkQA commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498714733 **[Test build #106157 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106157/testReport)**

[GitHub] [spark] MaxGekk commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
MaxGekk commented on issue #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#issuecomment-498713411 jenkins, retest this, please This is an automated message

[GitHub] [spark] MaxGekk commented on a change in pull request #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
MaxGekk commented on a change in pull request #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#discussion_r290348075 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala

[GitHub] [spark] dongjoon-hyun closed pull request #24789: [SPARK-27942][DOCS][PYTHON] Note that Python 2.7 is deprecated in Spark documentation

2019-06-04 Thread GitBox
dongjoon-hyun closed pull request #24789: [SPARK-27942][DOCS][PYTHON] Note that Python 2.7 is deprecated in Spark documentation URL: https://github.com/apache/spark/pull/24789 This is an automated message from the Apache

[GitHub] [spark] MaxGekk commented on a change in pull request #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression

2019-06-04 Thread GitBox
MaxGekk commented on a change in pull request #24742: [SPARK-27881][SQL] Support CAST (... FORMAT ) expression URL: https://github.com/apache/spark/pull/24742#discussion_r290343235 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #24792: [WIP][SPARK-27943][SQL] Add new feature create table could specify column with default constraint

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24792: [WIP][SPARK-27943][SQL] Add new feature create table could specify column with default constraint URL: https://github.com/apache/spark/pull/24792#issuecomment-498706738 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA removed a comment on issue #24792: [WIP][SPARK-27943][SQL] Add new feature create table could specify column with default constraint

2019-06-04 Thread GitBox
SparkQA removed a comment on issue #24792: [WIP][SPARK-27943][SQL] Add new feature create table could specify column with default constraint URL: https://github.com/apache/spark/pull/24792#issuecomment-498699155 **[Test build #106156 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24792: [WIP][SPARK-27943][SQL] Add new feature create table could specify column with default constraint

2019-06-04 Thread GitBox
AmplabJenkins removed a comment on issue #24792: [WIP][SPARK-27943][SQL] Add new feature create table could specify column with default constraint URL: https://github.com/apache/spark/pull/24792#issuecomment-498706714 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24792: [WIP][SPARK-27943][SQL] Add new feature create table could specify column with default constraint

2019-06-04 Thread GitBox
AmplabJenkins commented on issue #24792: [WIP][SPARK-27943][SQL] Add new feature create table could specify column with default constraint URL: https://github.com/apache/spark/pull/24792#issuecomment-498706738 Test FAILed. Refer to this link for build results (access rights to CI server

<    1   2   3   4   5   6   7   8   9   10   >