[jira] [Commented] (SPARK-44131) Add call_function for Scala API

2023-08-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759408#comment-17759408 ] Xiao Li commented on SPARK-44131: - [https://github.com/apache/spark/pull/41950] reverted the

[jira] [Updated] (SPARK-44131) Add call_function for Scala API

2023-08-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-44131: Summary: Add call_function for Scala API (was: Add call_function and deprecate call_udf for Scala API)

[jira] [Updated] (SPARK-44264) DeepSpeed Distributor

2023-08-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-44264: Summary: DeepSpeed Distributor (was: DeepSpeed Distrobutor) > DeepSpeed Distributor >

[jira] [Updated] (SPARK-43907) Add SQL functions into Scala, Python and R API

2023-08-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-43907: Fix Version/s: 3.5.0 > Add SQL functions into Scala, Python and R API >

[jira] [Updated] (SPARK-41231) Built-in SQL Function Improvement

2023-08-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-41231: Fix Version/s: 3.5.0 > Built-in SQL Function Improvement > - > >

[jira] [Commented] (SPARK-44782) Adjust Pull Request Template to incorporate the ASF Generative Tooling Guidance recommendations

2023-08-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754429#comment-17754429 ] Xiao Li commented on SPARK-44782: - +1 We should update the PR template.  > Adjust Pull Request Template

[jira] [Updated] (SPARK-40576) Support pandas 1.5.x.

2023-03-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-40576: Fix Version/s: 3.4.0 > Support pandas 1.5.x. > - > > Key: SPARK-40576

[jira] [Assigned] (SPARK-40576) Support pandas 1.5.x.

2023-03-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-40576: --- Assignee: Haejoon Lee > Support pandas 1.5.x. > - > > Key:

[jira] [Resolved] (SPARK-41594) Support table-valued generator functions in the FROM clause

2023-03-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-41594. - Fix Version/s: 3.4.0 Assignee: Allison Wang Resolution: Fixed > Support table-valued

[jira] [Resolved] (SPARK-42122) Add built-in table-valued function stack

2023-03-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-42122. - Fix Version/s: 3.4.0 Assignee: Allison Wang Resolution: Fixed > Add built-in

[jira] [Resolved] (SPARK-42120) Add built-in table-valued function json_tuple

2023-03-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-42120. - Fix Version/s: 3.4.0 Assignee: Allison Wang Resolution: Fixed > Add built-in

[jira] [Updated] (SPARK-42702) Support parameterized CTE

2023-03-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-42702: Fix Version/s: 3.4.0 (was: 3.4.1) > Support parameterized CTE >

[jira] [Reopened] (SPARK-16484) Incremental Cardinality estimation operations with Hyperloglog

2023-01-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-16484: - > Incremental Cardinality estimation operations with Hyperloglog >

[jira] [Updated] (SPARK-32082) Project Zen: Improving Python usability

2022-11-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32082: Description: The importance of Python and PySpark has grown radically in the last few years. The number

[jira] [Updated] (SPARK-40309) Introduce sql_conf context manager for pyspark.sql

2022-09-01 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-40309: Labels: release-notes (was: ) > Introduce sql_conf context manager for pyspark.sql >

[jira] [Updated] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-08-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-40149: Priority: Blocker (was: Major) > Star expansion after outer join asymmetrically includes joining key >

[jira] [Updated] (SPARK-40149) Star expansion after outer join asymmetrically includes joining key

2022-08-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-40149: Target Version/s: 3.4.0 > Star expansion after outer join asymmetrically includes joining key >

[jira] [Commented] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-16 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17537829#comment-17537829 ] Xiao Li commented on SPARK-36837: - Since we will bump to Kafka 3.2.0 in Spark 3.4, we can close it as

[jira] [Resolved] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-16 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-36837. - Resolution: Done > Upgrade Kafka to 3.1.0 > -- > > Key: SPARK-36837

[jira] [Updated] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-16 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36837: Labels: (was: releasenotes) > Upgrade Kafka to 3.1.0 > -- > > Key:

[jira] [Resolved] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-16 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-36837. - Resolution: Not A Problem > Upgrade Kafka to 3.1.0 > -- > > Key:

[jira] [Reopened] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-16 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-36837: - > Upgrade Kafka to 3.1.0 > -- > > Key: SPARK-36837 >

[jira] [Reopened] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-16 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-36837: - > Upgrade Kafka to 3.1.0 > -- > > Key: SPARK-36837 >

[jira] [Updated] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-16 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36837: Fix Version/s: (was: 3.3.0) > Upgrade Kafka to 3.1.0 > -- > >

[jira] [Resolved] (SPARK-38384) Improve error messages of ParseException from ANTLR

2022-04-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-38384. - Fix Version/s: 3.3.0 Assignee: Xinyi Yu Resolution: Fixed > Improve error messages of

[jira] [Updated] (SPARK-38781) Error Message Improvements in Spark 3.3

2022-04-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-38781: Summary: Error Message Improvements in Spark 3.3 (was: Improve errors of Spark 3.3) > Error Message

[jira] [Assigned] (SPARK-32268) Bloom Filter Join

2022-03-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-32268: --- Assignee: Yingyi Bu (was: Yuming Wang) > Bloom Filter Join > - > >

[jira] [Resolved] (SPARK-27790) Support ANSI SQL INTERVAL types

2022-03-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27790. - Fix Version/s: 3.3.0 Assignee: Max Gekk (was: Apache Spark) Resolution: Fixed >

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

2022-03-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27790: Labels: release-notes (was: ) > Support ANSI SQL INTERVAL types > --- > >

[jira] [Updated] (SPARK-35781) Support Spark on Apple Silicon on macOS natively on Java 17

2022-03-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-35781: Labels: release-notes (was: ) > Support Spark on Apple Silicon on macOS natively on Java 17 >

[jira] [Updated] (SPARK-38527) Set the minimum Volcano version

2022-03-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-38527: Labels: release-notes (was: ) > Set the minimum Volcano version > --- > >

[jira] [Updated] (SPARK-36371) Support raw string literal

2022-03-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36371: Labels: release-notes (was: ) > Support raw string literal > -- > >

[jira] [Updated] (SPARK-34806) Helper class for batch Dataset.observe()

2022-03-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34806: Labels: release-notes (was: ) > Helper class for batch Dataset.observe() >

[jira] [Updated] (SPARK-37273) Hidden File Metadata Support for Spark SQL

2022-03-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-37273: Labels: release-notes (was: ) > Hidden File Metadata Support for Spark SQL >

[jira] [Commented] (SPARK-37367) Reenable exception test in DDLParserSuite.create view -- basic

2021-11-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448342#comment-17448342 ] Xiao Li commented on SPARK-37367: - [~beliefer] Can you take a look at this?  > Reenable exception test

[jira] [Updated] (SPARK-37367) Reenable exception test in DDLParserSuite.create view -- basic

2021-11-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-37367: Target Version/s: 3.3.0 > Reenable exception test in DDLParserSuite.create view -- basic >

[jira] [Updated] (SPARK-36861) Partition columns are overly eagerly parsed as dates

2021-09-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36861: Target Version/s: 3.3.0 Priority: Blocker (was: Major) > Partition columns are overly

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2021-09-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419557#comment-17419557 ] Xiao Li commented on SPARK-36681: - Can you link the related Jira in Apache Hadoop? > Fail to load

[jira] [Updated] (SPARK-36696) spark.read.parquet loads empty dataset

2021-09-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36696: Target Version/s: 3.2.0 > spark.read.parquet loads empty dataset > --

[jira] [Updated] (SPARK-36696) spark.read.parquet loads empty dataset

2021-09-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36696: Priority: Blocker (was: Major) > spark.read.parquet loads empty dataset >

[jira] [Updated] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

2021-08-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34276: Description: Before the release, we need to double check the unreleased/unresolved JIRAs/PRs of Parquet

[jira] [Commented] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

2021-08-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405878#comment-17405878 ] Xiao Li commented on SPARK-34276: - https://issues.apache.org/jira/browse/PARQUET-2078 Do we have this

[jira] [Updated] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

2021-08-27 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34276: Summary: Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12 (was: Check the

[jira] [Updated] (SPARK-36457) Review and fix issues in API docs

2021-08-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36457: Priority: Blocker (was: Critical) > Review and fix issues in API docs >

[jira] [Updated] (SPARK-36457) Review and fix issues in API docs

2021-08-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36457: Target Version/s: 3.2.0 > Review and fix issues in API docs > - > >

[jira] [Updated] (SPARK-36457) Review and fix issues in API docs

2021-08-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36457: Priority: Blocker (was: Major) > Review and fix issues in API docs > - >

[jira] [Updated] (SPARK-35050) Deprecate Apache Mesos as resource manager

2021-08-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-35050: Labels: release-notes (was: ) > Deprecate Apache Mesos as resource manager >

[jira] [Resolved] (SPARK-29330) Allow users to chose the name of Spark Shuffle service

2021-08-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29330. - Fix Version/s: 3.2.0 Resolution: Duplicate > Allow users to chose the name of Spark Shuffle

[jira] [Updated] (SPARK-34828) YARN Shuffle Service: Support configurability of aux service name and service-specific config overrides

2021-08-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34828: Labels: release-notes (was: ) > YARN Shuffle Service: Support configurability of aux service name and >

[jira] [Updated] (SPARK-32953) Lower memory usage in toPandas with Arrow self_destruct

2021-08-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32953: Description: As described on the mailing list:

[jira] [Updated] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

2021-07-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36034: Priority: Blocker (was: Major) > Incorrect datetime filter when reading Parquet files written in legacy

[jira] [Updated] (SPARK-36034) Incorrect datetime filter when reading Parquet files written in legacy mode

2021-07-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36034: Target Version/s: 3.2.0 > Incorrect datetime filter when reading Parquet files written in legacy mode >

[jira] [Resolved] (SPARK-34745) Unify overflow exception error message of integral types

2021-07-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-34745. - Resolution: Later > Unify overflow exception error message of integral types >

[jira] [Commented] (SPARK-34402) Group exception about data format schema

2021-07-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17378962#comment-17378962 ] Xiao Li commented on SPARK-34402: - [~angerszhuuu] any update? > Group exception about data format

[jira] [Commented] (SPARK-33223) Expose state information on SS UI

2021-04-25 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331657#comment-17331657 ] Xiao Li commented on SPARK-33223: - [~gsomogyi] Could you add the new metrics to the doc?

[jira] [Commented] (SPARK-35097) Add column name to SparkUpgradeException about ancient datetime

2021-04-16 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17323943#comment-17323943 ] Xiao Li commented on SPARK-35097: - Can you help fix this, [~angerszhuuu] ? > Add column name to

[jira] [Commented] (SPARK-28379) Correlated scalar subqueries must be aggregated

2021-03-11 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299908#comment-17299908 ] Xiao Li commented on SPARK-28379: - CC [~allisonwang-db]  > Correlated scalar subqueries must be

[jira] [Updated] (SPARK-34525) Update Spark Create Table DDL Docs

2021-02-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34525: Labels: starter (was: ) > Update Spark Create Table DDL Docs > -- > >

[jira] [Resolved] (SPARK-34459) map_from_arrays() throws UnsupportedOperationException with array of ColumnarMap

2021-02-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-34459. - Resolution: Invalid > map_from_arrays() throws UnsupportedOperationException with array of >

[jira] [Commented] (SPARK-34459) map_from_arrays() throws UnsupportedOperationException with array of ColumnarMap

2021-02-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286299#comment-17286299 ] Xiao Li commented on SPARK-34459: - cc [~beliefer] > map_from_arrays() throws

[jira] [Commented] (SPARK-32883) Stream-stream join improvement

2021-02-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285057#comment-17285057 ] Xiao Li commented on SPARK-32883: -

[jira] [Updated] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-11 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34421: Target Version/s: 3.1.0 > Custom functions can't be used in temporary views with CTEs >

[jira] [Updated] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-11 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34421: Priority: Blocker (was: Major) > Custom functions can't be used in temporary views with CTEs >

[jira] [Resolved] (SPARK-31949) Add spark.default.parallelism in SQLConf for isolated across session

2021-02-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31949. - Resolution: Won't Fix > Add spark.default.parallelism in SQLConf for isolated across session >

[jira] [Commented] (SPARK-34382) ANSI SQL: LATERAL derived table(T491)

2021-02-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280051#comment-17280051 ] Xiao Li commented on SPARK-34382: - reopened. This is a nice SQL feature we can support. This is also

[jira] [Created] (SPARK-34382) ANSI SQL: LATERAL derived table(T491)

2021-02-05 Thread Xiao Li (Jira)
Xiao Li created SPARK-34382: --- Summary: ANSI SQL: LATERAL derived table(T491) Key: SPARK-34382 URL: https://issues.apache.org/jira/browse/SPARK-34382 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-27877) ANSI SQL: LATERAL derived table(T491)

2021-02-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27877: Issue Type: Technical task (was: Sub-task) > ANSI SQL: LATERAL derived table(T491) >

[jira] [Updated] (SPARK-27877) ANSI SQL: LATERAL derived table(T491)

2021-02-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27877: Issue Type: Sub-task (was: Technical task) > ANSI SQL: LATERAL derived table(T491) >

[jira] [Commented] (SPARK-34078) Provide async variants for Dataset APIs

2021-01-11 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263044#comment-17263044 ] Xiao Li commented on SPARK-34078: - A sample PR? or a lightweight design doc? > Provide async variants

[jira] [Commented] (SPARK-33977) Add doc for "'like any' and 'like all' operators"

2021-01-03 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257939#comment-17257939 ] Xiao Li commented on SPARK-33977: - cc [~yumwang] > Add doc for "'like any' and 'like all' operators" >

[jira] [Commented] (SPARK-33977) Add doc for "'like any' and 'like all' operators"

2021-01-03 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257938#comment-17257938 ] Xiao Li commented on SPARK-33977: - https://issues.apache.org/jira/browse/SPARK-30724 is added in 3.1   

[jira] [Created] (SPARK-33977) Add doc for "'like any' and 'like all' operators"

2021-01-03 Thread Xiao Li (Jira)
Xiao Li created SPARK-33977: --- Summary: Add doc for "'like any' and 'like all' operators" Key: SPARK-33977 URL: https://issues.apache.org/jira/browse/SPARK-33977 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33725) Upgrade snappy-java to 1.1.8.2

2020-12-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-33725: Fix Version/s: 3.0.2 > Upgrade snappy-java to 1.1.8.2 > -- > >

[jira] [Created] (SPARK-33694) Auditing the API changes and behavior changes in Spark 3.1

2020-12-07 Thread Xiao Li (Jira)
Xiao Li created SPARK-33694: --- Summary: Auditing the API changes and behavior changes in Spark 3.1 Key: SPARK-33694 URL: https://issues.apache.org/jira/browse/SPARK-33694 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33694) Auditing the API changes and behavior changes in Spark 3.1

2020-12-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-33694: Priority: Blocker (was: Major) > Auditing the API changes and behavior changes in Spark 3.1 >

[jira] [Updated] (SPARK-32991) RESET can clear StaticSQLConfs

2020-12-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32991: Target Version/s: 3.1.0 > RESET can clear StaticSQLConfs > -- > >

[jira] [Updated] (SPARK-32991) RESET can clear StaticSQLConfs

2020-12-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32991: Priority: Blocker (was: Major) > RESET can clear StaticSQLConfs > -- > >

[jira] [Commented] (SPARK-32991) RESET can clear StaticSQLConfs

2020-12-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244675#comment-17244675 ] Xiao Li commented on SPARK-32991: - [~Qin Yao] I reopened the Jira and set it to Blocker, because the

[jira] [Reopened] (SPARK-32991) RESET can clear StaticSQLConfs

2020-12-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-32991: - > RESET can clear StaticSQLConfs > -- > > Key: SPARK-32991 >

[jira] [Created] (SPARK-33674) Show Slowpoke notifications in SBT tests

2020-12-05 Thread Xiao Li (Jira)
Xiao Li created SPARK-33674: --- Summary: Show Slowpoke notifications in SBT tests Key: SPARK-33674 URL: https://issues.apache.org/jira/browse/SPARK-33674 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-33551) Do not use custom shuffle reader for repartition

2020-11-25 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-33551. - Fix Version/s: 3.1.0 Assignee: Wei Xue Resolution: Fixed > Do not use custom shuffle

[jira] [Assigned] (SPARK-32670) Group exception messages in Catalyst Analyzer in one file

2020-11-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-32670: --- Assignee: Xinyi Yu (was: Xiao Li) > Group exception messages in Catalyst Analyzer in one file >

[jira] [Updated] (SPARK-32670) Group exception messages in Catalyst Analyzer in one file

2020-11-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32670: Parent: SPARK-33539 Issue Type: Sub-task (was: Improvement) > Group exception messages in

[jira] [Updated] (SPARK-32862) Left semi stream-stream join

2020-11-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32862: Labels: release-notes (was: ) > Left semi stream-stream join > > >

[jira] [Updated] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

2020-10-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30602: Labels: release-notes (was: ) > SPIP: Support push-based shuffle to improve shuffle efficiency >

[jira] [Updated] (SPARK-32461) Shuffled hash join improvement

2020-10-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32461: Priority: Major (was: Minor) > Shuffled hash join improvement > -- > >

[jira] [Updated] (SPARK-32461) Shuffled hash join improvement

2020-10-22 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32461: Labels: release-notes (was: ) > Shuffled hash join improvement > -- > >

[jira] [Created] (SPARK-33181) SQL Reference: Run SQL on files directly

2020-10-19 Thread Xiao Li (Jira)
Xiao Li created SPARK-33181: --- Summary: SQL Reference: Run SQL on files directly Key: SPARK-33181 URL: https://issues.apache.org/jira/browse/SPARK-33181 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-33181) SQL Reference: Run SQL on files directly

2020-10-19 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-33181: Labels: starter (was: ) > SQL Reference: Run SQL on files directly >

[jira] [Updated] (SPARK-33166) Provide Search Function in Spark docs site

2020-10-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-33166: Target Version/s: 3.1.0 > Provide Search Function in Spark docs site >

[jira] [Commented] (SPARK-33166) Provide Search Function in Spark docs site

2020-10-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215133#comment-17215133 ] Xiao Li commented on SPARK-33166: - cc [~huaxingao] [~dongjoon] > Provide Search Function in Spark docs

[jira] [Created] (SPARK-33166) Provide Search Function in Spark docs site

2020-10-15 Thread Xiao Li (Jira)
Xiao Li created SPARK-33166: --- Summary: Provide Search Function in Spark docs site Key: SPARK-33166 URL: https://issues.apache.org/jira/browse/SPARK-33166 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-33134) Incorrect nested complex JSON fields raise an exception

2020-10-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-33134: Issue Type: Bug (was: Improvement) > Incorrect nested complex JSON fields raise an exception >

[jira] [Resolved] (SPARK-33038) AQE plan string should only display one plan when the initial and the current plan are the same

2020-10-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-33038. - Fix Version/s: 3.1.0 Resolution: Fixed > AQE plan string should only display one plan when the

[jira] [Assigned] (SPARK-33038) AQE plan string should only display one plan when the initial and the current plan are the same

2020-10-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-33038: --- Assignee: Allison Wang > AQE plan string should only display one plan when the initial and the

[jira] [Updated] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

2020-10-03 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31257: Target Version/s: 3.1.0 > Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

[jira] [Commented] (SPARK-32991) RESET can clear StaticSQLConfs

2020-09-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201806#comment-17201806 ] Xiao Li commented on SPARK-32991: - ping [~Qin Yao] [~yumwang] > RESET can clear StaticSQLConfs >

[jira] [Updated] (SPARK-32976) Support column list in INSERT statement

2020-09-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32976: Description: INSERT currently does not support named column lists.   {{INSERT INTO (col1, col2,…)

[jira] [Updated] (SPARK-32976) Support column list in INSERT statement

2020-09-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32976: Description: INSERT currently does not support named column lists.   {{INSERT INTO (col1, col2,…)

[jira] [Commented] (SPARK-32976) Support column list in INSERT statement

2020-09-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200877#comment-17200877 ] Xiao Li commented on SPARK-32976: - [~Qin Yao] Are you interested in this? > Support column list in

  1   2   3   4   5   6   7   8   9   10   >