[jira] [Updated] (SPARK-38584) Unify the data validation

[ https://issues.apache.org/jira/browse/SPARK-38584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-38584: - Description: 1, input vector validation is missing in most algorithms, when the input dataset c

[jira] [Created] (SPARK-38584) Unify the data validation

zhengruifeng created SPARK-38584: Summary: Unify the data validation Key: SPARK-38584 URL: https://issues.apache.org/jira/browse/SPARK-38584 Project: Spark Issue Type: Improvement C

[jira] [Assigned] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

[ https://issues.apache.org/jira/browse/SPARK-38582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38582: Assignee: (was: Apache Spark) > Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithF

[jira] [Commented] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

[ https://issues.apache.org/jira/browse/SPARK-38582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507996#comment-17507996 ] Apache Spark commented on SPARK-38582: -- User 'dcoliversun' has created a pull reque

[jira] [Commented] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

[ https://issues.apache.org/jira/browse/SPARK-38582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507995#comment-17507995 ] Apache Spark commented on SPARK-38582: -- User 'dcoliversun' has created a pull reque

[jira] [Assigned] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

[ https://issues.apache.org/jira/browse/SPARK-38582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38582: Assignee: Apache Spark > Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` fo

[jira] [Commented] (SPARK-38566) Revert the parser changes for DEFAULT column support

[ https://issues.apache.org/jira/browse/SPARK-38566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507994#comment-17507994 ] Apache Spark commented on SPARK-38566: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-38566) Revert the parser changes for DEFAULT column support

[ https://issues.apache.org/jira/browse/SPARK-38566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507993#comment-17507993 ] Apache Spark commented on SPARK-38566: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-38583) to_timestamp should allow numeric types

Hyukjin Kwon created SPARK-38583: Summary: to_timestamp should allow numeric types Key: SPARK-38583 URL: https://issues.apache.org/jira/browse/SPARK-38583 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-38583) to_timestamp should allow numeric types

[ https://issues.apache.org/jira/browse/SPARK-38583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38583: - Description: SPARK-38240 mistakenly disallowed numeric type at to_timestamp. We should allow it

[jira] [Created] (SPARK-38582) Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern

qian created SPARK-38582: Summary: Introduce `buildEnvVarsWithKV` and `buildEnvVarsWithFieldRef` for `KubernetesUtils` to eliminate duplicate code pattern Key: SPARK-38582 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Resolved] (SPARK-38557) What may be a cause for HDFSMetadataCommitter: Error while fetching MetaData and how to fix or work around this?

[ https://issues.apache.org/jira/browse/SPARK-38557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38557. -- Resolution: Invalid > What may be a cause for HDFSMetadataCommitter: Error while fetching Meta

[jira] [Commented] (SPARK-38557) What may be a cause for HDFSMetadataCommitter: Error while fetching MetaData and how to fix or work around this?

[ https://issues.apache.org/jira/browse/SPARK-38557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507976#comment-17507976 ] Hyukjin Kwon commented on SPARK-38557: -- For questions, we should better interact wi

[jira] [Updated] (SPARK-38578) Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE

[ https://issues.apache.org/jira/browse/SPARK-38578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38578: -- Summary: Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE (was: Avoid unn

[jira] [Updated] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

[ https://issues.apache.org/jira/browse/SPARK-38581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-38581: Issue Type: Documentation (was: Bug) > List of supported pandas APIs for pandas API on Spark docs

[jira] [Commented] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

[ https://issues.apache.org/jira/browse/SPARK-38581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507962#comment-17507962 ] Haejoon Lee commented on SPARK-38581: - I'm working on it > List of supported pandas

[jira] [Created] (SPARK-38581) List of supported pandas APIs for pandas API on Spark docs.

Haejoon Lee created SPARK-38581: --- Summary: List of supported pandas APIs for pandas API on Spark docs. Key: SPARK-38581 URL: https://issues.apache.org/jira/browse/SPARK-38581 Project: Spark Is

[jira] [Commented] (SPARK-38579) Requesting Restful API can cause NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-38579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507958#comment-17507958 ] Apache Spark commented on SPARK-38579: -- User 'yym1995' has created a pull request f

[jira] [Assigned] (SPARK-38579) Requesting Restful API can cause NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-38579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38579: Assignee: Apache Spark > Requesting Restful API can cause NullPointerException >

[jira] [Assigned] (SPARK-38579) Requesting Restful API can cause NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-38579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38579: Assignee: (was: Apache Spark) > Requesting Restful API can cause NullPointerException

[jira] [Resolved] (SPARK-38580) Requesting Restful API can cause NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-38580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yimin Yang resolved SPARK-38580. Resolution: Duplicate > Requesting Restful API can cause NullPointerException > --

[jira] [Created] (SPARK-38580) Requesting Restful API can cause NullPointerException

Yimin Yang created SPARK-38580: -- Summary: Requesting Restful API can cause NullPointerException Key: SPARK-38580 URL: https://issues.apache.org/jira/browse/SPARK-38580 Project: Spark Issue Type:

[jira] [Created] (SPARK-38579) Requesting Restful API can cause NullPointerException

Yimin Yang created SPARK-38579: -- Summary: Requesting Restful API can cause NullPointerException Key: SPARK-38579 URL: https://issues.apache.org/jira/browse/SPARK-38579 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

[ https://issues.apache.org/jira/browse/SPARK-38575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507946#comment-17507946 ] Apache Spark commented on SPARK-38575: -- User 'HyukjinKwon' has created a pull reque

[jira] [Updated] (SPARK-38578) Avoid unnecessary sort in FileFormatWriter if user has specified sort

[ https://issues.apache.org/jira/browse/SPARK-38578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38578: -- Parent: SPARK-37063 Issue Type: Sub-task (was: Improvement) > Avoid unnecessary sort in FileF

[jira] [Created] (SPARK-38578) Avoid unnecessary sort in FileFormatWriter if user has specified sort

XiDuo You created SPARK-38578: - Summary: Avoid unnecessary sort in FileFormatWriter if user has specified sort Key: SPARK-38578 URL: https://issues.apache.org/jira/browse/SPARK-38578 Project: Spark

[jira] [Assigned] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

[ https://issues.apache.org/jira/browse/SPARK-38575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38575: Assignee: Hyukjin Kwon > Duduplicate branch specification in GitHub Actions workflow > --

[jira] [Resolved] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

[ https://issues.apache.org/jira/browse/SPARK-38575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38575. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35882 [https://gi

[jira] [Updated] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38568: Reporter: Yuming Wang (was: Dongjoon Hyun) > Upgrade ZSTD-JNI to 1.5.2-2 > --

[jira] [Commented] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507942#comment-17507942 ] Yuming Wang commented on SPARK-38568: - OK > Upgrade ZSTD-JNI to 1.5.2-2 > -

[jira] [Updated] (SPARK-38577) Interval types are not truncated to the expected endField when creating a DataFrame via Duration

[ https://issues.apache.org/jira/browse/SPARK-38577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chong updated SPARK-38577: -- Description: *Problem:* ANSI interval types are store as long internally. The long value are not truncated t

[jira] [Updated] (SPARK-38520) Overflow occurs when reading ANSI day time interval from CSV file

[ https://issues.apache.org/jira/browse/SPARK-38520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chong updated SPARK-38520: -- Description: *Problem:* Overflow occurs when reading the following positive intervals, the results become to

[jira] [Updated] (SPARK-38520) Overflow occurs when reading ANSI day time interval from CSV file

[ https://issues.apache.org/jira/browse/SPARK-38520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chong updated SPARK-38520: -- Description: *Problem:* Overflow occurs when reading the following positive intervals, the results become to

[jira] [Assigned] (SPARK-38576) Implement `numeric_only` parameter for `DataFrame/Series.rank` to rank numeric columns only

[ https://issues.apache.org/jira/browse/SPARK-38576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38576: Assignee: (was: Apache Spark) > Implement `numeric_only` parameter for `DataFrame/Ser

[jira] [Assigned] (SPARK-38576) Implement `numeric_only` parameter for `DataFrame/Series.rank` to rank numeric columns only

[ https://issues.apache.org/jira/browse/SPARK-38576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38576: Assignee: Apache Spark > Implement `numeric_only` parameter for `DataFrame/Series.rank` t

[jira] [Commented] (SPARK-38576) Implement `numeric_only` parameter for `DataFrame/Series.rank` to rank numeric columns only

[ https://issues.apache.org/jira/browse/SPARK-38576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507931#comment-17507931 ] Apache Spark commented on SPARK-38576: -- User 'xinrong-databricks' has created a pul

[jira] [Commented] (SPARK-38576) Implement `numeric_only` parameter for `DataFrame/Series.rank` to rank numeric columns only

[ https://issues.apache.org/jira/browse/SPARK-38576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507930#comment-17507930 ] Apache Spark commented on SPARK-38576: -- User 'xinrong-databricks' has created a pul

[jira] [Created] (SPARK-38577) Interval types are not truncated to the expected endField when creating a DataFrame via Duration

chong created SPARK-38577: - Summary: Interval types are not truncated to the expected endField when creating a DataFrame via Duration Key: SPARK-38577 URL: https://issues.apache.org/jira/browse/SPARK-38577 Pr

[jira] [Created] (SPARK-38576) Implement `numeric_only` parameter for `DataFrame/Series.rank` to rank numeric columns only

Xinrong Meng created SPARK-38576: Summary: Implement `numeric_only` parameter for `DataFrame/Series.rank` to rank numeric columns only Key: SPARK-38576 URL: https://issues.apache.org/jira/browse/SPARK-38576

[jira] [Resolved] (SPARK-38556) Disable Pandas usage logging for method calls inside @contextmanager functions

[ https://issues.apache.org/jira/browse/SPARK-38556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38556. -- Target Version/s: 3.2.1, 3.3.0 Resolution: Fixed Fixed in https://github.com/apache/

[jira] [Resolved] (SPARK-38441) Support string and bool `regex` in `Series.replace`

[ https://issues.apache.org/jira/browse/SPARK-38441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38441. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35747 [https://gi

[jira] [Assigned] (SPARK-38441) Support string and bool `regex` in `Series.replace`

[ https://issues.apache.org/jira/browse/SPARK-38441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38441: Assignee: Xinrong Meng > Support string and bool `regex` in `Series.replace` > --

[jira] [Resolved] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38572. --- Resolution: Fixed Issue resolved by pull request 35879 [https://github.com/apache/spark/pull

[jira] [Commented] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

[ https://issues.apache.org/jira/browse/SPARK-38575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507921#comment-17507921 ] Apache Spark commented on SPARK-38575: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

[ https://issues.apache.org/jira/browse/SPARK-38575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38575: Assignee: (was: Apache Spark) > Duduplicate branch specification in GitHub Actions wo

[jira] [Assigned] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

[ https://issues.apache.org/jira/browse/SPARK-38575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38575: Assignee: Apache Spark > Duduplicate branch specification in GitHub Actions workflow > --

[jira] [Created] (SPARK-38575) Duduplicate branch specification in GitHub Actions workflow

Hyukjin Kwon created SPARK-38575: Summary: Duduplicate branch specification in GitHub Actions workflow Key: SPARK-38575 URL: https://issues.apache.org/jira/browse/SPARK-38575 Project: Spark

[jira] [Updated] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38568: -- Affects Version/s: 3.4.0 (was: 3.3.0) > Upgrade ZSTD-JNI to 1.5.2-2

[jira] [Commented] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507907#comment-17507907 ] Dongjoon Hyun commented on SPARK-38568: --- Hi, [~yumwang]. When you clone an issue,

[jira] [Commented] (SPARK-36664) Log time spent waiting for cluster resources

[ https://issues.apache.org/jira/browse/SPARK-36664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507899#comment-17507899 ] Apache Spark commented on SPARK-36664: -- User 'holdenk' has created a pull request f

[jira] [Commented] (SPARK-36664) Log time spent waiting for cluster resources

[ https://issues.apache.org/jira/browse/SPARK-36664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507900#comment-17507900 ] Apache Spark commented on SPARK-36664: -- User 'holdenk' has created a pull request f

[jira] [Assigned] (SPARK-38574) Enrich Avro data source documentation

[ https://issues.apache.org/jira/browse/SPARK-38574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38574: Assignee: Apache Spark > Enrich Avro data source documentation >

[jira] [Assigned] (SPARK-38574) Enrich Avro data source documentation

[ https://issues.apache.org/jira/browse/SPARK-38574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38574: Assignee: (was: Apache Spark) > Enrich Avro data source documentation > -

[jira] [Commented] (SPARK-38574) Enrich Avro data source documentation

[ https://issues.apache.org/jira/browse/SPARK-38574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507898#comment-17507898 ] Apache Spark commented on SPARK-38574: -- User 'tianhanhu' has created a pull request

[jira] [Created] (SPARK-38574) Enrich Avro data source documentation

Tianhan Hu created SPARK-38574: -- Summary: Enrich Avro data source documentation Key: SPARK-38574 URL: https://issues.apache.org/jira/browse/SPARK-38574 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-38555) Avoid contention and get or create clientPools quickly in the TransportClientFactory

[ https://issues.apache.org/jira/browse/SPARK-38555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-38555. - Assignee: weixiuli Resolution: Fixed > Avoid contention and get or create

[jira] [Updated] (SPARK-38555) Avoid contention and get or create clientPools quickly in the TransportClientFactory

[ https://issues.apache.org/jira/browse/SPARK-38555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-38555: Fix Version/s: 3.4.0 > Avoid contention and get or create clientPools quickly in

[jira] [Created] (SPARK-38573) Support Partition Level Statistics Collection

Kazuyuki Tanimura created SPARK-38573: - Summary: Support Partition Level Statistics Collection Key: SPARK-38573 URL: https://issues.apache.org/jira/browse/SPARK-38573 Project: Spark Issue

[jira] [Resolved] (SPARK-38545) Upgarde scala-maven-plugin from 4.4.0 to 4.5.6

[ https://issues.apache.org/jira/browse/SPARK-38545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38545. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35841 [https://gi

[jira] [Assigned] (SPARK-38545) Upgarde scala-maven-plugin from 4.4.0 to 4.5.6

[ https://issues.apache.org/jira/browse/SPARK-38545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38545: Assignee: Yang Jie > Upgarde scala-maven-plugin from 4.4.0 to 4.5.6 > ---

[jira] [Commented] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507808#comment-17507808 ] Apache Spark commented on SPARK-38572: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507807#comment-17507807 ] Apache Spark commented on SPARK-38572: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38572: Assignee: Max Gekk (was: Apache Spark) > Setting version to 3.4.0-SNAPSHOT > ---

[jira] [Assigned] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38572: Assignee: Apache Spark (was: Max Gekk) > Setting version to 3.4.0-SNAPSHOT > ---

[jira] [Resolved] (SPARK-38561) Add doc for "Customized Kubernetes Schedulers"

[ https://issues.apache.org/jira/browse/SPARK-38561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-38561. -- Fix Version/s: 3.3.0 Assignee: Yikun Jiang Resolution: Fixed > Add doc for "Cu

[jira] [Updated] (SPARK-38503) Add warn for getAdditionalPreKubernetesResources in executor side

[ https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-38503: - Target Version/s: 3.4.0 > Add warn for getAdditionalPreKubernetesResources in executor side > --

[jira] [Commented] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507780#comment-17507780 ] Max Gekk commented on SPARK-38572: -- FYI, I am working on this. > Setting version to 3.

[jira] [Updated] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38572: - Reporter: Max Gekk (was: Dongjoon Hyun) > Setting version to 3.4.0-SNAPSHOT > -

[jira] [Updated] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38572: - Fix Version/s: 3.4.0 (was: 3.3.0) > Setting version to 3.4.0-SNAPSHOT > -

[jira] [Updated] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38572: - Affects Version/s: 3.4.0 (was: 3.3.0) > Setting version to 3.4.0-SNAPSHOT > -

[jira] [Assigned] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38572: Assignee: Max Gekk (was: Dongjoon Hyun) > Setting version to 3.4.0-SNAPSHOT > --

[jira] [Created] (SPARK-38572) Setting version to 3.4.0-SNAPSHOT

Max Gekk created SPARK-38572: Summary: Setting version to 3.4.0-SNAPSHOT Key: SPARK-38572 URL: https://issues.apache.org/jira/browse/SPARK-38572 Project: Spark Issue Type: Task Componen

[jira] [Updated] (SPARK-38194) Make Yarn memory overhead factor configurable

[ https://issues.apache.org/jira/browse/SPARK-38194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38194: -- Fix Version/s: 3.3.0 (was: 3.4.0) > Make Yarn memory overhead factor co

[jira] [Updated] (SPARK-38194) Make Yarn memory overhead factor configurable

[ https://issues.apache.org/jira/browse/SPARK-38194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38194: -- Fix Version/s: 3.4.0 (was: 3.3.0) > Make Yarn memory overhead factor co

[jira] [Resolved] (SPARK-38194) Make Yarn memory overhead factor configurable

[ https://issues.apache.org/jira/browse/SPARK-38194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-38194. --- Fix Version/s: 3.3.0 Assignee: Adam Binford Resolution: Fixed > Make Yarn me

[jira] [Updated] (SPARK-38571) Week of month from a date is missing in spark3 for return values of 1 to 6

[ https://issues.apache.org/jira/browse/SPARK-38571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Appel updated SPARK-38571: Description: In Spark2 we could use the date_format function with either the W or F flags to comp

[jira] [Created] (SPARK-38571) Week of month from a date is missing in spark3 for return values of 1 to 6

Kevin Appel created SPARK-38571: --- Summary: Week of month from a date is missing in spark3 for return values of 1 to 6 Key: SPARK-38571 URL: https://issues.apache.org/jira/browse/SPARK-38571 Project: Spa

[jira] [Commented] (SPARK-38570) Incorrect DynamicPartitionPruning caused by Literal

[ https://issues.apache.org/jira/browse/SPARK-38570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507626#comment-17507626 ] Apache Spark commented on SPARK-38570: -- User 'mcdull-zhang' has created a pull requ

[jira] [Assigned] (SPARK-38570) Incorrect DynamicPartitionPruning caused by Literal

[ https://issues.apache.org/jira/browse/SPARK-38570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38570: Assignee: Apache Spark > Incorrect DynamicPartitionPruning caused by Literal > --

[jira] [Assigned] (SPARK-38570) Incorrect DynamicPartitionPruning caused by Literal

[ https://issues.apache.org/jira/browse/SPARK-38570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38570: Assignee: (was: Apache Spark) > Incorrect DynamicPartitionPruning caused by Literal >

[jira] [Updated] (SPARK-38570) Incorrect DynamicPartitionPruning caused by Literal

[ https://issues.apache.org/jira/browse/SPARK-38570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mcdull_zhang updated SPARK-38570: - Description: The return value of Literal.references is an empty AttributeSet, so Literal is mis

[jira] [Created] (SPARK-38570) Incorrect DynamicPartitionPruning caused by Literal

mcdull_zhang created SPARK-38570: Summary: Incorrect DynamicPartitionPruning caused by Literal Key: SPARK-38570 URL: https://issues.apache.org/jira/browse/SPARK-38570 Project: Spark Issue Typ

[jira] [Commented] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507585#comment-17507585 ] Apache Spark commented on SPARK-38568: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38568: Assignee: Apache Spark > Upgrade ZSTD-JNI to 1.5.2-2 > --- > >

[jira] [Assigned] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38568: Assignee: (was: Apache Spark) > Upgrade ZSTD-JNI to 1.5.2-2 > ---

[jira] [Commented] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507584#comment-17507584 ] Apache Spark commented on SPARK-38568: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-38569) external top-level directory is problematic for bazel

[ https://issues.apache.org/jira/browse/SPARK-38569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507583#comment-17507583 ] Apache Spark commented on SPARK-38569: -- User 'alkis' has created a pull request for

[jira] [Assigned] (SPARK-38569) external top-level directory is problematic for bazel

[ https://issues.apache.org/jira/browse/SPARK-38569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38569: Assignee: Apache Spark > external top-level directory is problematic for bazel >

[jira] [Assigned] (SPARK-38569) external top-level directory is problematic for bazel

[ https://issues.apache.org/jira/browse/SPARK-38569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38569: Assignee: (was: Apache Spark) > external top-level directory is problematic for bazel

[jira] [Created] (SPARK-38569) external top-level directory is problematic for bazel

Alkis Evlogimenos created SPARK-38569: - Summary: external top-level directory is problematic for bazel Key: SPARK-38569 URL: https://issues.apache.org/jira/browse/SPARK-38569 Project: Spark

[jira] [Created] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

Yuming Wang created SPARK-38568: --- Summary: Upgrade ZSTD-JNI to 1.5.2-2 Key: SPARK-38568 URL: https://issues.apache.org/jira/browse/SPARK-38568 Project: Spark Issue Type: Improvement C

[jira] [Updated] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38568: Fix Version/s: (was: 3.3.0) > Upgrade ZSTD-JNI to 1.5.2-2 > --- > >

[jira] [Assigned] (SPARK-38568) Upgrade ZSTD-JNI to 1.5.2-2

[ https://issues.apache.org/jira/browse/SPARK-38568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38568: --- Assignee: (was: Dongjoon Hyun) > Upgrade ZSTD-JNI to 1.5.2-2 >

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507557#comment-17507557 ] Steve Loughran commented on SPARK-38330: sorry about that. try enabling path sty

[jira] [Assigned] (SPARK-38567) Enable GitHub Action build_and_test on branch-3.3

[ https://issues.apache.org/jira/browse/SPARK-38567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38567: Assignee: Max Gekk > Enable GitHub Action build_and_test on branch-3.3 >

[jira] [Resolved] (SPARK-38567) Enable GitHub Action build_and_test on branch-3.3

[ https://issues.apache.org/jira/browse/SPARK-38567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38567. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35876 [https://gi

[jira] [Assigned] (SPARK-38567) Enable GitHub Action build_and_test on branch-3.3

[ https://issues.apache.org/jira/browse/SPARK-38567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38567: Assignee: Apache Spark > Enable GitHub Action build_and_test on branch-3.3 >

[jira] [Assigned] (SPARK-38567) Enable GitHub Action build_and_test on branch-3.3

[ https://issues.apache.org/jira/browse/SPARK-38567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38567: Assignee: (was: Apache Spark) > Enable GitHub Action build_and_test on branch-3.3 > -

[jira] [Commented] (SPARK-38567) Enable GitHub Action build_and_test on branch-3.3

[ https://issues.apache.org/jira/browse/SPARK-38567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507532#comment-17507532 ] Apache Spark commented on SPARK-38567: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17507528#comment-17507528 ] huangtengfei commented on SPARK-38108: -- I am working on this. Thanks [~maxgekk] >

  1   2   >