[jira] [Commented] (SPARK-36327) Spark sql creates staging dir inside database directory rather than creating inside table directory

[ https://issues.apache.org/jira/browse/SPARK-36327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390851#comment-17390851 ] Senthil Kumar commented on SPARK-36327: --- Hi [~sunchao] Hive is creating .staging directories

[jira] [Created] (SPARK-36370) Avoid using SelectionMixin._builtin_table which is removed in pandas 1.3

Takuya Ueshin created SPARK-36370: - Summary: Avoid using SelectionMixin._builtin_table which is removed in pandas 1.3 Key: SPARK-36370 URL: https://issues.apache.org/jira/browse/SPARK-36370 Project:

[jira] [Created] (SPARK-36369) Fix Index.union to follow pandas 1.3

Takuya Ueshin created SPARK-36369: - Summary: Fix Index.union to follow pandas 1.3 Key: SPARK-36369 URL: https://issues.apache.org/jira/browse/SPARK-36369 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36368) Fix CategoricalOps.astype to follow pandas 1.3

Takuya Ueshin created SPARK-36368: - Summary: Fix CategoricalOps.astype to follow pandas 1.3 Key: SPARK-36368 URL: https://issues.apache.org/jira/browse/SPARK-36368 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36367: -- Issue Type: Umbrella (was: Improvement) > Fix the behavior to follow pandas >= 1.3 >

[jira] [Assigned] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36367: Assignee: Apache Spark > Fix the behavior to follow pandas >= 1.3 >

[jira] [Commented] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390822#comment-17390822 ] Apache Spark commented on SPARK-36367: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36367: Assignee: (was: Apache Spark) > Fix the behavior to follow pandas >= 1.3 >

[jira] [Commented] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390821#comment-17390821 ] Apache Spark commented on SPARK-36367: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

Takuya Ueshin created SPARK-36367: - Summary: Fix the behavior to follow pandas >= 1.3 Key: SPARK-36367 URL: https://issues.apache.org/jira/browse/SPARK-36367 Project: Spark Issue Type:

[jira] [Created] (SPARK-36366) Google Kubernetes Engine authentication fails

Tiago Reis created SPARK-36366: -- Summary: Google Kubernetes Engine authentication fails Key: SPARK-36366 URL: https://issues.apache.org/jira/browse/SPARK-36366 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-36366) Google Kubernetes Engine authentication fails

[ https://issues.apache.org/jira/browse/SPARK-36366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tiago Reis updated SPARK-36366: --- Description: When connecting to a Google Kubernetes Engine, a command {{gcloud container clusters

[jira] [Assigned] (SPARK-36365) Remove old workarounds related to null ordering.

[ https://issues.apache.org/jira/browse/SPARK-36365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36365: Assignee: (was: Apache Spark) > Remove old workarounds related to null ordering. >

[jira] [Assigned] (SPARK-36365) Remove old workarounds related to null ordering.

[ https://issues.apache.org/jira/browse/SPARK-36365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36365: Assignee: Apache Spark > Remove old workarounds related to null ordering. >

[jira] [Commented] (SPARK-36365) Remove old workarounds related to null ordering.

[ https://issues.apache.org/jira/browse/SPARK-36365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390813#comment-17390813 ] Apache Spark commented on SPARK-36365: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-36365) Remove old workarounds related to null ordering.

[ https://issues.apache.org/jira/browse/SPARK-36365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36365: -- Summary: Remove old workarounds related to null ordering. (was: Remove old workarounds

[jira] [Commented] (SPARK-36338) Move distributed-sequence implementation to Scala side

[ https://issues.apache.org/jira/browse/SPARK-36338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390807#comment-17390807 ] Apache Spark commented on SPARK-36338: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36345: Assignee: Dongjoon Hyun > Add mlflow/sklearn to GHA docker image >

[jira] [Resolved] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36345. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33595

[jira] [Created] (SPARK-36365) Remove old workarounds related to ordering.

Takuya Ueshin created SPARK-36365: - Summary: Remove old workarounds related to ordering. Key: SPARK-36365 URL: https://issues.apache.org/jira/browse/SPARK-36365 Project: Spark Issue Type:

[jira] [Created] (SPARK-36364) Move window and aggregate functions to DataTypeOps

Xinrong Meng created SPARK-36364: Summary: Move window and aggregate functions to DataTypeOps Key: SPARK-36364 URL: https://issues.apache.org/jira/browse/SPARK-36364 Project: Spark Issue

[jira] [Resolved] (SPARK-36140) Replace DataTypeOps tests that have operations on different Series

[ https://issues.apache.org/jira/browse/SPARK-36140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-36140. -- Resolution: Done > Replace DataTypeOps tests that have operations on different Series >

[jira] [Assigned] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36345: Assignee: (was: Apache Spark) > Add mlflow/sklearn to GHA docker image >

[jira] [Commented] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390791#comment-17390791 ] Apache Spark commented on SPARK-36345: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390790#comment-17390790 ] Apache Spark commented on SPARK-36345: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36345: Assignee: Apache Spark > Add mlflow/sklearn to GHA docker image >

[jira] [Updated] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-35881: -- Fix Version/s: 3.2.0 > [SQL] AQE does not support columnar execution for the final query

[jira] [Updated] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35881: -- Fix Version/s: (was: 3.2.0) > [SQL] AQE does not support columnar execution for the final

[jira] [Created] (SPARK-36363) AKS SPark UI does not have executor tab showing up

Koushik created SPARK-36363: --- Summary: AKS SPark UI does not have executor tab showing up Key: SPARK-36363 URL: https://issues.apache.org/jira/browse/SPARK-36363 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-35881. --- Fix Version/s: 3.3.0 3.2.0 Resolution: Fixed > [SQL] AQE does not

[jira] [Assigned] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-35881: - Assignee: Andy Grove > [SQL] AQE does not support columnar execution for the final

[jira] [Resolved] (SPARK-36350) Make nanvl work with DataTypeOps

[ https://issues.apache.org/jira/browse/SPARK-36350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36350. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

[jira] [Commented] (SPARK-36362) Omnibus Java code static analyzer warning fixes

[ https://issues.apache.org/jira/browse/SPARK-36362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390705#comment-17390705 ] Apache Spark commented on SPARK-36362: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36362) Omnibus Java code static analyzer warning fixes

[ https://issues.apache.org/jira/browse/SPARK-36362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36362: Assignee: Apache Spark (was: Sean R. Owen) > Omnibus Java code static analyzer warning

[jira] [Assigned] (SPARK-36362) Omnibus Java code static analyzer warning fixes

[ https://issues.apache.org/jira/browse/SPARK-36362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36362: Assignee: Sean R. Owen (was: Apache Spark) > Omnibus Java code static analyzer warning

[jira] [Created] (SPARK-36362) Omnibus Java code static analyzer warning fixes

Sean R. Owen created SPARK-36362: Summary: Omnibus Java code static analyzer warning fixes Key: SPARK-36362 URL: https://issues.apache.org/jira/browse/SPARK-36362 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36358. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33593

[jira] [Assigned] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36358: Assignee: Attila Zsolt Piros (was: Apache Spark) > Upgrade Kubernetes Client Version to

[jira] [Commented] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390627#comment-17390627 ] Apache Spark commented on SPARK-36358: -- User 'attilapiros' has created a pull request for this

[jira] [Commented] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390626#comment-17390626 ] Apache Spark commented on SPARK-36358: -- User 'attilapiros' has created a pull request for this

[jira] [Assigned] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36358: Assignee: Apache Spark (was: Attila Zsolt Piros) > Upgrade Kubernetes Client Version to

[jira] [Assigned] (SPARK-36360) StreamingSource duplicates appName

[ https://issues.apache.org/jira/browse/SPARK-36360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36360: Assignee: Apache Spark > StreamingSource duplicates appName >

[jira] [Assigned] (SPARK-36360) StreamingSource duplicates appName

[ https://issues.apache.org/jira/browse/SPARK-36360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36360: Assignee: (was: Apache Spark) > StreamingSource duplicates appName >

[jira] [Commented] (SPARK-36360) StreamingSource duplicates appName

[ https://issues.apache.org/jira/browse/SPARK-36360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390585#comment-17390585 ] Apache Spark commented on SPARK-36360: -- User 'mrclneumann' has created a pull request for this

[jira] [Resolved] (SPARK-36338) Move distributed-sequence implementation to Scala side

[ https://issues.apache.org/jira/browse/SPARK-36338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36338. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33570

[jira] [Assigned] (SPARK-36338) Move distributed-sequence implementation to Scala side

[ https://issues.apache.org/jira/browse/SPARK-36338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36338: Assignee: Hyukjin Kwon > Move distributed-sequence implementation to Scala side >

[jira] [Assigned] (SPARK-36092) Migrate to GitHub Actions Codecov from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-36092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36092: Assignee: Apache Spark > Migrate to GitHub Actions Codecov from Jenkins >

[jira] [Commented] (SPARK-36092) Migrate to GitHub Actions Codecov from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-36092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390580#comment-17390580 ] Apache Spark commented on SPARK-36092: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36092) Migrate to GitHub Actions Codecov from Jenkins

[ https://issues.apache.org/jira/browse/SPARK-36092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36092: Assignee: (was: Apache Spark) > Migrate to GitHub Actions Codecov from Jenkins >

[jira] [Created] (SPARK-36361) Install coverage in Python 3.9 and PyPy 3 in GitHub Actions image

Hyukjin Kwon created SPARK-36361: Summary: Install coverage in Python 3.9 and PyPy 3 in GitHub Actions image Key: SPARK-36361 URL: https://issues.apache.org/jira/browse/SPARK-36361 Project: Spark

[jira] [Updated] (SPARK-36360) StreamingSource duplicates appName

[ https://issues.apache.org/jira/browse/SPARK-36360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcel Neumann updated SPARK-36360: --- Description: The StreamingSource includes the appName in its sourceName. This is not

[jira] [Created] (SPARK-36360) StreamingSource duplicates appName

Marcel Neumann created SPARK-36360: -- Summary: StreamingSource duplicates appName Key: SPARK-36360 URL: https://issues.apache.org/jira/browse/SPARK-36360 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36359) Coalesce returns the first expression if it is non nullable

[ https://issues.apache.org/jira/browse/SPARK-36359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36359: Assignee: Apache Spark > Coalesce returns the first expression if it is non nullable >

[jira] [Commented] (SPARK-36254) Install mlflow/sklearn in Github Actions CI

[ https://issues.apache.org/jira/browse/SPARK-36254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390538#comment-17390538 ] Apache Spark commented on SPARK-36254: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-36359) Coalesce returns the first expression if it is non nullable

[ https://issues.apache.org/jira/browse/SPARK-36359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390537#comment-17390537 ] Apache Spark commented on SPARK-36359: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36359) Coalesce returns the first expression if it is non nullable

[ https://issues.apache.org/jira/browse/SPARK-36359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36359: Assignee: (was: Apache Spark) > Coalesce returns the first expression if it is non

[jira] [Created] (SPARK-36359) Coalesce returns the first expression if it is non nullable

Yuming Wang created SPARK-36359: --- Summary: Coalesce returns the first expression if it is non nullable Key: SPARK-36359 URL: https://issues.apache.org/jira/browse/SPARK-36359 Project: Spark

[jira] [Updated] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

[ https://issues.apache.org/jira/browse/SPARK-36358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36358: --- Description: This way [Retry HTTP operation in case IOException too (exponential

[jira] [Created] (SPARK-36358) Upgrade Kubernetes Client Version to 5.6.0

Attila Zsolt Piros created SPARK-36358: -- Summary: Upgrade Kubernetes Client Version to 5.6.0 Key: SPARK-36358 URL: https://issues.apache.org/jira/browse/SPARK-36358 Project: Spark Issue

[jira] [Commented] (SPARK-28330) ANSI SQL: Top-level in

[ https://issues.apache.org/jira/browse/SPARK-28330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390508#comment-17390508 ] Alexander Bij commented on SPARK-28330: --- I'm looking forward to this feature!   I noticed it is

[jira] [Assigned] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36346: Assignee: (was: Apache Spark) > Support TimestampNTZ type in Orc file source >

[jira] [Assigned] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36346: Assignee: Apache Spark > Support TimestampNTZ type in Orc file source >

[jira] [Commented] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390506#comment-17390506 ] Apache Spark commented on SPARK-36346: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

[ https://issues.apache.org/jira/browse/SPARK-36357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390504#comment-17390504 ] jiaan.geng commented on SPARK-36357: I'm working on. > Support pushdown Timestamp with local time

[jira] [Created] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

jiaan.geng created SPARK-36357: -- Summary: Support pushdown Timestamp with local time zone for orc Key: SPARK-36357 URL: https://issues.apache.org/jira/browse/SPARK-36357 Project: Spark Issue

[jira] [Updated] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36346: --- Description: As per https://orc.apache.org/docs/types.html, Orc supports both TIMESTAMP_NTZ and

[jira] [Updated] (SPARK-36346) Support TimestampNTZ type in Orc file source

[ https://issues.apache.org/jira/browse/SPARK-36346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36346: --- Description: As per https://orc.apache.org/docs/types.html, Orc supports both TIMESTAMP_NTZ and

[jira] [Created] (SPARK-36356) RemoveRedundantAlias should keep output schema

angerszhu created SPARK-36356: - Summary: RemoveRedundantAlias should keep output schema Key: SPARK-36356 URL: https://issues.apache.org/jira/browse/SPARK-36356 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36353: -- Description: !image-2021-07-30-17-46-59-196.png|width=539,height=220!

[jira] [Commented] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390458#comment-17390458 ] angerszhu commented on SPARK-36353: --- Raise a pr soon > RemoveNoopOperators should keep output schema

[jira] [Updated] (SPARK-36353) RemoveNoopOperators should keep output schema

[ https://issues.apache.org/jira/browse/SPARK-36353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36353: -- Attachment: image-2021-07-30-17-46-59-196.png > RemoveNoopOperators should keep output schema >

[jira] [Commented] (SPARK-36355) NamedExpression add method `withName(newName: String)`

[ https://issues.apache.org/jira/browse/SPARK-36355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390456#comment-17390456 ] Apache Spark commented on SPARK-36355: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36355) NamedExpression add method `withName(newName: String)`

[ https://issues.apache.org/jira/browse/SPARK-36355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36355: Assignee: Apache Spark > NamedExpression add method `withName(newName: String)` >

[jira] [Assigned] (SPARK-36355) NamedExpression add method `withName(newName: String)`

[ https://issues.apache.org/jira/browse/SPARK-36355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36355: Assignee: (was: Apache Spark) > NamedExpression add method `withName(newName:

[jira] [Created] (SPARK-36355) NamedExpression add method `withName(newName: String)`

angerszhu created SPARK-36355: - Summary: NamedExpression add method `withName(newName: String)` Key: SPARK-36355 URL: https://issues.apache.org/jira/browse/SPARK-36355 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36065) date_trunc returns incorrect output

[ https://issues.apache.org/jira/browse/SPARK-36065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390421#comment-17390421 ] Peter Toth commented on SPARK-36065: I think the output is correct as there was a time zone change

[jira] [Commented] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390390#comment-17390390 ] Apache Spark commented on SPARK-36354: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36354: Assignee: Apache Spark > EventLogFileReaders should not complain in case of no event log

[jira] [Assigned] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36354: Assignee: (was: Apache Spark) > EventLogFileReaders should not complain in case of

[jira] [Commented] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

[ https://issues.apache.org/jira/browse/SPARK-36354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390392#comment-17390392 ] Apache Spark commented on SPARK-36354: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-36354) EventLogFileReaders should not complain in case of no event log files

Dongjoon Hyun created SPARK-36354: - Summary: EventLogFileReaders should not complain in case of no event log files Key: SPARK-36354 URL: https://issues.apache.org/jira/browse/SPARK-36354 Project:

[jira] [Commented] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390374#comment-17390374 ] Apache Spark commented on SPARK-35976: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390372#comment-17390372 ] Apache Spark commented on SPARK-35976: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35976: Assignee: Apache Spark > Adjust `astype` method for ExtensionDtype in pandas API on

[jira] [Assigned] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35976: Assignee: (was: Apache Spark) > Adjust `astype` method for ExtensionDtype in pandas

[jira] [Commented] (SPARK-36351) Separate partition filters and data filters in PushDownUtils

[ https://issues.apache.org/jira/browse/SPARK-36351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390364#comment-17390364 ] Apache Spark commented on SPARK-36351: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36351) Separate partition filters and data filters in PushDownUtils

[ https://issues.apache.org/jira/browse/SPARK-36351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36351: Assignee: (was: Apache Spark) > Separate partition filters and data filters in

[jira] [Assigned] (SPARK-36351) Separate partition filters and data filters in PushDownUtils

[ https://issues.apache.org/jira/browse/SPARK-36351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36351: Assignee: Apache Spark > Separate partition filters and data filters in PushDownUtils >

[jira] [Comment Edited] (SPARK-36327) Spark sql creates staging dir inside database directory rather than creating inside table directory

[ https://issues.apache.org/jira/browse/SPARK-36327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390358#comment-17390358 ] Dongjoon Hyun edited comment on SPARK-36327 at 7/30/21, 7:22 AM: - I

[jira] [Commented] (SPARK-36327) Spark sql creates staging dir inside database directory rather than creating inside table directory

[ https://issues.apache.org/jira/browse/SPARK-36327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390358#comment-17390358 ] Dongjoon Hyun commented on SPARK-36327: --- I commented on the PR and looped other review, too. >

[jira] [Resolved] (SPARK-36254) Install mlflow in Github Actions CI

[ https://issues.apache.org/jira/browse/SPARK-36254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36254. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33567

[jira] [Updated] (SPARK-36254) Install mlflow/sklearn in Github Actions CI

[ https://issues.apache.org/jira/browse/SPARK-36254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36254: -- Summary: Install mlflow/sklearn in Github Actions CI (was: Install mlflow in Github Actions

[jira] [Commented] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390341#comment-17390341 ] Dongjoon Hyun commented on SPARK-36345: --- Thank you for reporting. I revised the title and will

[jira] [Assigned] (SPARK-36254) Install mlflow in Github Actions CI

[ https://issues.apache.org/jira/browse/SPARK-36254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36254: - Assignee: Haejoon Lee > Install mlflow in Github Actions CI >

[jira] [Updated] (SPARK-36345) Add mlflow/sklearn to GHA docker image

[ https://issues.apache.org/jira/browse/SPARK-36345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36345: -- Summary: Add mlflow/sklearn to GHA docker image (was: Create docker image that has mlflow

[jira] [Updated] (SPARK-36093) (RemoveRedundantAliases should keep output schema name) The result incorrect if the partition path case is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-36093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36093: -- Summary: (RemoveRedundantAliases should keep output schema name) The result incorrect if the

[jira] [Created] (SPARK-36353) RemoveNoopOperators should keep output schema

angerszhu created SPARK-36353: - Summary: RemoveNoopOperators should keep output schema Key: SPARK-36353 URL: https://issues.apache.org/jira/browse/SPARK-36353 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36352) Spark should check result plan's output schema name

[ https://issues.apache.org/jira/browse/SPARK-36352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390338#comment-17390338 ] angerszhu commented on SPARK-36352: --- RemoveNoopOperators CollapseProject > Spark should check result

[jira] [Commented] (SPARK-36352) Spark should check result plan's output schema name

[ https://issues.apache.org/jira/browse/SPARK-36352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390329#comment-17390329 ] Apache Spark commented on SPARK-36352: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36352) Spark should check result plan's output schema name

[ https://issues.apache.org/jira/browse/SPARK-36352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36352: Assignee: Apache Spark > Spark should check result plan's output schema name >

  1   2   >