[jira] [Commented] (SPARK-40077) Make pyspark.context examples self-contained

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579528#comment-17579528 ] Apache Spark commented on SPARK-40077: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40077) Make pyspark.context examples self-contained

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40077: Assignee: Apache Spark > Make pyspark.context examples self-contained >

[jira] [Assigned] (SPARK-40077) Make pyspark.context examples self-contained

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40077: Assignee: (was: Apache Spark) > Make pyspark.context examples self-contained >

[jira] [Created] (SPARK-40077) Make pyspark.context examples self-contained

2022-08-14 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40077: - Summary: Make pyspark.context examples self-contained Key: SPARK-40077 URL: https://issues.apache.org/jira/browse/SPARK-40077 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40076) Support number-only column names in ORC data sources when orc impl is hive

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579511#comment-17579511 ] Apache Spark commented on SPARK-40076: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Assigned] (SPARK-40076) Support number-only column names in ORC data sources when orc impl is hive

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40076: Assignee: Apache Spark > Support number-only column names in ORC data sources when orc

[jira] [Assigned] (SPARK-40076) Support number-only column names in ORC data sources when orc impl is hive

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40076: Assignee: (was: Apache Spark) > Support number-only column names in ORC data sources

[jira] [Commented] (SPARK-40076) Support number-only column names in ORC data sources when orc impl is hive

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579510#comment-17579510 ] Apache Spark commented on SPARK-40076: -- User 'mcdull-zhang' has created a pull request for this

[jira] [Created] (SPARK-40076) Support number-only column names in ORC data sources when orc impl is hive

2022-08-14 Thread mcdull_zhang (Jira)
mcdull_zhang created SPARK-40076: Summary: Support number-only column names in ORC data sources when orc impl is hive Key: SPARK-40076 URL: https://issues.apache.org/jira/browse/SPARK-40076 Project:

[jira] [Assigned] (SPARK-40075) Refactor kafka010.JsonUtils to use Jackson instead of Json4s

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40075: Assignee: Apache Spark > Refactor kafka010.JsonUtils to use Jackson instead of Json4s >

[jira] [Assigned] (SPARK-40075) Refactor kafka010.JsonUtils to use Jackson instead of Json4s

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40075: Assignee: (was: Apache Spark) > Refactor kafka010.JsonUtils to use Jackson instead

[jira] [Commented] (SPARK-40075) Refactor kafka010.JsonUtils to use Jackson instead of Json4s

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579491#comment-17579491 ] Apache Spark commented on SPARK-40075: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-40075) Refactor kafka010.JsonUtils to use Jackson instead of Json4s

2022-08-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-40075: Summary: Refactor kafka010.JsonUtils to use Jackson instead of Json4s Key: SPARK-40075 URL: https://issues.apache.org/jira/browse/SPARK-40075 Project: Spark Issue

[jira] [Updated] (SPARK-40074) Error while creating dataset in Java spark-3.x using Encoders bean with Dense Vector. (Issue arises when updating spark from 2.4 to 3.x)

2022-08-14 Thread Anuj Gargava (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuj Gargava updated SPARK-40074: - Description: Encountered a compatibility issue while upgrading spark from 2.4 to 3.x (also

[jira] [Updated] (SPARK-40074) Error while creating dataset in Java spark-3.x using Encoders bean with Dense Vector. (Issue arises when updating spark from 2.4 to 3.x)

2022-08-14 Thread Anuj Gargava (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuj Gargava updated SPARK-40074: - Description: Encountered a compatibility issue while upgrading spark from 2.4 to 3.x (also

[jira] [Updated] (SPARK-40074) Error while creating dataset in Java spark-3.x using Encoders bean with Dense Vector. (Issue arises when updating spark from 2.4 to 3.x)

2022-08-14 Thread Anuj Gargava (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuj Gargava updated SPARK-40074: - Description: Encountered a compatibility issue while upgrading spark from 2.4 to 3.x (also

[jira] [Created] (SPARK-40074) Error while creating dataset in Java spark-3.x using Encoders bean with Dense Vector. (Issue arises when updating spark from 2.4 to 3.x)

2022-08-14 Thread Anuj Gargava (Jira)
Anuj Gargava created SPARK-40074: Summary: Error while creating dataset in Java spark-3.x using Encoders bean with Dense Vector. (Issue arises when updating spark from 2.4 to 3.x) Key: SPARK-40074 URL:

[jira] [Assigned] (SPARK-40051) Make pyspark.sql.catalog examples self-contained

2022-08-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40051: Assignee: Hyukjin Kwon > Make pyspark.sql.catalog examples self-contained >

[jira] [Resolved] (SPARK-40051) Make pyspark.sql.catalog examples self-contained

2022-08-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40051. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37490

[jira] [Commented] (SPARK-30628) File source V2: Support partition pruning with subqueries

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579466#comment-17579466 ] Apache Spark commented on SPARK-30628: -- User 'Kimahriman' has created a pull request for this

[jira] [Assigned] (SPARK-30628) File source V2: Support partition pruning with subqueries

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30628: Assignee: (was: Apache Spark) > File source V2: Support partition pruning with

[jira] [Assigned] (SPARK-30628) File source V2: Support partition pruning with subqueries

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30628: Assignee: Apache Spark > File source V2: Support partition pruning with subqueries >

[jira] [Commented] (SPARK-30628) File source V2: Support partition pruning with subqueries

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579465#comment-17579465 ] Apache Spark commented on SPARK-30628: -- User 'Kimahriman' has created a pull request for this

[jira] [Assigned] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

2022-08-14 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40072: Assignee: YUBI LEE Issue Type: Improvement (was: Bug) > MAVEN_OPTS in

[jira] [Resolved] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

2022-08-14 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40072. -- Fix Version/s: 3.4.0 Resolution: Fixed Resolved by

[jira] [Comment Edited] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

2022-08-14 Thread Marcelo Rossini Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579451#comment-17579451 ] Marcelo Rossini Castro edited comment on SPARK-40063 at 8/14/22 10:05 PM:

[jira] [Commented] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

2022-08-14 Thread Marcelo Rossini Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579451#comment-17579451 ] Marcelo Rossini Castro commented on SPARK-40063: I can't really print it because it

[jira] [Updated] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

2022-08-14 Thread Marcelo Rossini Castro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Rossini Castro updated SPARK-40063: --- Description: When using the apply function to apply a function to a

[jira] [Resolved] (SPARK-37599) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests

2022-08-14 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37599. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37376

[jira] [Assigned] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39184: Assignee: Apache Spark > ArrayIndexOutOfBoundsException for some date/time sequences in

[jira] [Assigned] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39184: Assignee: (was: Apache Spark) > ArrayIndexOutOfBoundsException for some date/time

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579429#comment-17579429 ] Apache Spark commented on SPARK-39184: -- User 'bersprockets' has created a pull request for this

[jira] [Updated] (SPARK-40073) Should Use `connector/${moduleName}` instead of `external/${moduleName}`

2022-08-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40073: - Component/s: Build Project Infra PySpark Spark Core

[jira] [Commented] (SPARK-40073) Should Use `connector/${moduleName}` instead of `external/${moduleName}`

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579393#comment-17579393 ] Apache Spark commented on SPARK-40073: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40073) Should Use `connector/${moduleName}` instead of `external/${moduleName}`

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40073: Assignee: (was: Apache Spark) > Should Use `connector/${moduleName}` instead of

[jira] [Assigned] (SPARK-40073) Should Use `connector/${moduleName}` instead of `external/${moduleName}`

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40073: Assignee: Apache Spark > Should Use `connector/${moduleName}` instead of

[jira] [Created] (SPARK-40073) Should Use `connector/${moduleName}` instead of `external/${moduleName}`

2022-08-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-40073: Summary: Should Use `connector/${moduleName}` instead of `external/${moduleName}` Key: SPARK-40073 URL: https://issues.apache.org/jira/browse/SPARK-40073 Project: Spark

[jira] [Resolved] (SPARK-40070) Upgrade Apache ZooKeeper to 3.8.0

2022-08-14 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-40070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen resolved SPARK-40070. - Resolution: Won't Fix > Upgrade Apache ZooKeeper to 3.8.0 >

[jira] [Updated] (SPARK-40009) Add missing doc string info to DataFrame API

2022-08-14 Thread Khalid Mammadov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Khalid Mammadov updated SPARK-40009: Description: Some of the docstrings in Python DataFrame API is not complete, for example

[jira] [Updated] (SPARK-40009) Add missing doc string info to DataFrame API

2022-08-14 Thread Khalid Mammadov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Khalid Mammadov updated SPARK-40009: Summary: Add missing doc string info to DataFrame API (was: Add doc string to DataFrame

[jira] [Commented] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579356#comment-17579356 ] Apache Spark commented on SPARK-40072: -- User 'eubnara' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40072: Assignee: (was: Apache Spark) > MAVEN_OPTS in make-distributions.sh is different

[jira] [Assigned] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40072: Assignee: Apache Spark > MAVEN_OPTS in make-distributions.sh is different from one

[jira] [Commented] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

2022-08-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579355#comment-17579355 ] Apache Spark commented on SPARK-40072: -- User 'eubnara' has created a pull request for this issue:

[jira] [Updated] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

2022-08-14 Thread YUBI LEE (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YUBI LEE updated SPARK-40072: - Description: Building spark with make-distribution.sh is failed with default setting because default

[jira] [Created] (SPARK-40072) MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml

2022-08-14 Thread YUBI LEE (Jira)
YUBI LEE created SPARK-40072: Summary: MAVEN_OPTS in make-distributions.sh is different from one specified in pom.xml Key: SPARK-40072 URL: https://issues.apache.org/jira/browse/SPARK-40072 Project: