[jira] [Assigned] (SPARK-44005) Improve error messages for regular Python UDTFs that return non-tuple values

2023-08-07 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44005: - Assignee: Allison Wang > Improve error messages for regular Python UDTFs that return no

[jira] [Created] (SPARK-44701) Skip ClassificationTestsOnConnect when torch is not installed

2023-08-07 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44701: - Summary: Skip ClassificationTestsOnConnect when torch is not installed Key: SPARK-44701 URL: https://issues.apache.org/jira/browse/SPARK-44701 Project: Spark

[jira] [Assigned] (SPARK-44667) Uninstall large ML libraries for non-ML jobs

2023-08-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44667: - Assignee: Ruifeng Zheng > Uninstall large ML libraries for non-ML jobs > --

[jira] [Resolved] (SPARK-44667) Uninstall large ML libraries for non-ML jobs

2023-08-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44667. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42334 [https://

[jira] [Resolved] (SPARK-44666) Uninstall CodeQL/Go/Node in non-container jobs

2023-08-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44666. --- Assignee: Ruifeng Zheng Resolution: Resolved > Uninstall CodeQL/Go/Node in non-contain

[jira] [Commented] (SPARK-44666) Uninstall CodeQL/Go/Node in non-container jobs

2023-08-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750998#comment-17750998 ] Ruifeng Zheng commented on SPARK-44666: --- resolved in https://github.com/apache/spa

[jira] [Created] (SPARK-44667) Uninstall large ML libraries for non-ML jobs

2023-08-03 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44667: - Summary: Uninstall large ML libraries for non-ML jobs Key: SPARK-44667 URL: https://issues.apache.org/jira/browse/SPARK-44667 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-44666) Uninstall CodeQL/Go/Node in non-container jobs

2023-08-03 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44666: - Summary: Uninstall CodeQL/Go/Node in non-container jobs Key: SPARK-44666 URL: https://issues.apache.org/jira/browse/SPARK-44666 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-44619) Free up disk space for container jobs

2023-08-03 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44619. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42253 [https://

[jira] [Updated] (SPARK-44619) Free up disk space for container jobs

2023-08-03 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44619: -- Summary: Free up disk space for container jobs (was: Free up disk space for pyspark container

[jira] [Resolved] (SPARK-44572) Clean up unused installers ASAP

2023-08-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44572. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42292 [https://

[jira] [Assigned] (SPARK-44572) Clean up unused installers ASAP

2023-08-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44572: - Assignee: Ruifeng Zheng > Clean up unused installers ASAP > ---

[jira] [Assigned] (SPARK-44368) Support partition operation on dataframe in Spark Connect Go Client

2023-08-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44368: - Assignee: BoYang > Support partition operation on dataframe in Spark Connect Go Client

[jira] [Resolved] (SPARK-44368) Support partition operation on dataframe in Spark Connect Go Client

2023-08-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44368. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 13 [https://git

[jira] [Updated] (SPARK-44572) Clean up unused installers ASAP

2023-08-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44572: -- Summary: Clean up unused installers ASAP (was: Clean up unused installer ASAP) > Clean up un

[jira] [Updated] (SPARK-44572) Clean up unused installer ASAP

2023-08-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44572: -- Summary: Clean up unused installer ASAP (was: Clean up unused files ASAP) > Clean up unused i

[jira] [Resolved] (SPARK-44602) Make WidenSetOperationTypes retains the Plan_ID_TAG

2023-08-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44602. --- Resolution: Fixed > Make WidenSetOperationTypes retains the Plan_ID_TAG > --

[jira] [Created] (SPARK-44620) Make `ResolvePivot` retain the `Plan_ID_TAG`

2023-08-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44620: - Summary: Make `ResolvePivot` retain the `Plan_ID_TAG` Key: SPARK-44620 URL: https://issues.apache.org/jira/browse/SPARK-44620 Project: Spark Issue Type: Su

[jira] [Assigned] (SPARK-44602) Make WidenSetOperationTypes retains the Plan_ID_TAG

2023-08-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44602: - Assignee: Ruifeng Zheng > Make WidenSetOperationTypes retains the Plan_ID_TAG > ---

[jira] [Resolved] (SPARK-44567) Daily GA for Maven testing

2023-08-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44567. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42203 [https://

[jira] [Assigned] (SPARK-44567) Daily GA for Maven testing

2023-08-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44567: - Assignee: Yang Jie > Daily GA for Maven testing > -- > >

[jira] [Resolved] (SPARK-44618) Free up disk space for non-container jobs

2023-08-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44618. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42241 [https://

[jira] [Assigned] (SPARK-44618) Free up disk space for non-container jobs

2023-08-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44618: - Assignee: Ruifeng Zheng > Free up disk space for non-container jobs > -

[jira] [Updated] (SPARK-44564) Refine the documents with LLM

2023-07-31 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44564: -- Description: Let's first focus on the Documents of *PySpark DataFrame APIs*. *1*, Chose a sub

[jira] [Updated] (SPARK-44619) Free up disk space for pyspark container jobs

2023-07-31 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44619: -- Summary: Free up disk space for pyspark container jobs (was: Free up disk space for container

[jira] [Created] (SPARK-44619) Free up disk space for container jobs

2023-07-31 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44619: - Summary: Free up disk space for container jobs Key: SPARK-44619 URL: https://issues.apache.org/jira/browse/SPARK-44619 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44586) TorchDistributor should install cpu-only Torch for testing

2023-07-31 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44586. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42210 [https://

[jira] [Assigned] (SPARK-44586) TorchDistributor should install cpu-only Torch for testing

2023-07-31 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44586: - Assignee: Ruifeng Zheng > TorchDistributor should install cpu-only Torch for testing >

[jira] [Created] (SPARK-44618) Free up disk space for non-container jobs

2023-07-31 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44618: - Summary: Free up disk space for non-container jobs Key: SPARK-44618 URL: https://issues.apache.org/jira/browse/SPARK-44618 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-44602) Make WidenSetOperationTypes retains the Plan_ID_TAG

2023-07-30 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44602: -- Component/s: Connect > Make WidenSetOperationTypes retains the Plan_ID_TAG > -

[jira] [Created] (SPARK-44602) Make WidenSetOperationTypes retains the Plan_ID_TAG

2023-07-30 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44602: - Summary: Make WidenSetOperationTypes retains the Plan_ID_TAG Key: SPARK-44602 URL: https://issues.apache.org/jira/browse/SPARK-44602 Project: Spark Issue T

[jira] [Resolved] (SPARK-44524) Balancing pyspark-pandas-connect and pyspark-pandas-slow-connect GA testing time

2023-07-30 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44524. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42115 [https://

[jira] [Assigned] (SPARK-44524) Balancing pyspark-pandas-connect and pyspark-pandas-slow-connect GA testing time

2023-07-30 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44524: - Assignee: BingKun Pan > Balancing pyspark-pandas-connect and pyspark-pandas-slow-conne

[jira] [Created] (SPARK-44593) Make `breaking-changes-buf` cancelable

2023-07-28 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44593: - Summary: Make `breaking-changes-buf` cancelable Key: SPARK-44593 URL: https://issues.apache.org/jira/browse/SPARK-44593 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44586) TorchDistributor should install cpu-only Torch for testing

2023-07-28 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44586: - Summary: TorchDistributor should install cpu-only Torch for testing Key: SPARK-44586 URL: https://issues.apache.org/jira/browse/SPARK-44586 Project: Spark

[jira] [Commented] (SPARK-44566) Spark CI Improvement

2023-07-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748101#comment-17748101 ] Ruifeng Zheng commented on SPARK-44566: --- also cc [~panbingkun] [~dongjoon] [~yikun

[jira] [Updated] (SPARK-44566) Spark CI Improvement

2023-07-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44566: -- Description: I have an offline discussion with [~gurwls223] and [~LuciferYang], and we think

[jira] [Created] (SPARK-44572) Clean up unused files ASAP

2023-07-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44572: - Summary: Clean up unused files ASAP Key: SPARK-44572 URL: https://issues.apache.org/jira/browse/SPARK-44572 Project: Spark Issue Type: Sub-task C

[jira] [Updated] (SPARK-44566) Spark CI Improvement

2023-07-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44566: -- Description: I have an offline discussion with [~gurwls223] and [~LuciferYang], and we think

[jira] [Created] (SPARK-44570) Reuse spark build among pyspark-* modules

2023-07-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44570: - Summary: Reuse spark build among pyspark-* modules Key: SPARK-44570 URL: https://issues.apache.org/jira/browse/SPARK-44570 Project: Spark Issue Type: Sub-t

[jira] [Created] (SPARK-44569) Daily GA for Python 3.11

2023-07-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44569: - Summary: Daily GA for Python 3.11 Key: SPARK-44569 URL: https://issues.apache.org/jira/browse/SPARK-44569 Project: Spark Issue Type: Sub-task Com

[jira] [Created] (SPARK-44568) Daily GA for Python 3.10

2023-07-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44568: - Summary: Daily GA for Python 3.10 Key: SPARK-44568 URL: https://issues.apache.org/jira/browse/SPARK-44568 Project: Spark Issue Type: Sub-task Com

[jira] [Created] (SPARK-44567) Daily GA for Maven testing

2023-07-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44567: - Summary: Daily GA for Maven testing Key: SPARK-44567 URL: https://issues.apache.org/jira/browse/SPARK-44567 Project: Spark Issue Type: Sub-task C

[jira] [Created] (SPARK-44566) Spark CI Improvement

2023-07-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44566: - Summary: Spark CI Improvement Key: SPARK-44566 URL: https://issues.apache.org/jira/browse/SPARK-44566 Project: Spark Issue Type: Umbrella Compone

[jira] [Updated] (SPARK-44564) Refine the documents with LLM

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44564: -- Description: Let's first focus on the Documents of *PySpark DataFrame APIs*. *1*, Chose a sub

[jira] [Updated] (SPARK-44564) Refine the documents with LLM

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44564: -- Description: Let's first focus on the Documents of *PySpark DataFrame APIs*. *1*, Chose a sub

[jira] [Updated] (SPARK-44564) Refine the documents with LLM

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44564: -- Description: Let's first focus on the Documents of *PySpark DataFrame APIs*. *1*, Chose a sub

[jira] [Updated] (SPARK-44564) Refine the documents with LLM

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44564: -- Description: Let's first focus on the Documents of *PySpark DataFrame APIs*. *1*, Chose a sub

[jira] [Updated] (SPARK-44564) Refine the documents with LLM

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44564: -- Description: Let's first focus on the Documents of *PySpark DataFrame APIs*. *1*, Chose a sub

[jira] [Updated] (SPARK-44564) Refine the documents with LLM

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44564: -- Description: Let's first focus on the Documents of *PySpark DataFrame APIs*. 1, Chose a subse

[jira] [Updated] (SPARK-44565) Example: Refine the docs for Union, UnionAll and unionByName

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44565: -- Summary: Example: Refine the docs for Union, UnionAll and unionByName (was: Refine the docs f

[jira] [Created] (SPARK-44565) Refine the docs for Union, UnionAll and unionByName

2023-07-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44565: - Summary: Refine the docs for Union, UnionAll and unionByName Key: SPARK-44565 URL: https://issues.apache.org/jira/browse/SPARK-44565 Project: Spark Issue T

[jira] [Updated] (SPARK-44564) Refine the documents with LLM

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44564: -- Description: Let's first focus on the Documents of PySpark DataFrame APIs. 1, Chose a subset

[jira] [Updated] (SPARK-44564) Refine the documents with LLM

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44564: -- Description: Let's first focus on the Documents of PySpark DataFrame APIs. 1, Chose a subset

[jira] [Created] (SPARK-44564) Refine the documents with LLM

2023-07-26 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44564: - Summary: Refine the documents with LLM Key: SPARK-44564 URL: https://issues.apache.org/jira/browse/SPARK-44564 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-43611) Fix unexpected `AnalysisException` from Spark Connect client

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43611. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42086 [https://

[jira] [Assigned] (SPARK-43611) Fix unexpected `AnalysisException` from Spark Connect client

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43611: - Assignee: Ruifeng Zheng > Fix unexpected `AnalysisException` from Spark Connect client

[jira] [Resolved] (SPARK-44553) Ignoring `connect-check-protos` logic in GA testing

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44553. --- Fix Version/s: 3.4.2 Resolution: Fixed Issue resolved by pull request 42166 [https://

[jira] [Assigned] (SPARK-44553) Ignoring `connect-check-protos` logic in GA testing

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44553: - Assignee: BingKun Pan > Ignoring `connect-check-protos` logic in GA testing > -

[jira] [Resolved] (SPARK-44544) Deduplicate run_python_packaging_tests

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44544. --- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-44544) Deduplicate run_python_packaging_tests

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44544: - Assignee: Ruifeng Zheng > Deduplicate run_python_packaging_tests >

[jira] [Updated] (SPARK-44544) Deduplicate run_python_packaging_tests

2023-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44544: -- Summary: Deduplicate run_python_packaging_tests (was: Move python packaging tests to a separa

[jira] [Created] (SPARK-44544) Move python packaging tests to a separate module

2023-07-25 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44544: - Summary: Move python packaging tests to a separate module Key: SPARK-44544 URL: https://issues.apache.org/jira/browse/SPARK-44544 Project: Spark Issue Type

[jira] [Resolved] (SPARK-43602) Rebalance PySpark test suites

2023-07-25 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43602. --- Resolution: Resolved > Rebalance PySpark test suites > - > >

[jira] [Resolved] (SPARK-41231) Built-in SQL Function Improvement

2023-07-19 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41231. --- Resolution: Resolved > Built-in SQL Function Improvement > -

[jira] [Assigned] (SPARK-41231) Built-in SQL Function Improvement

2023-07-19 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41231: - Assignee: Ruifeng Zheng > Built-in SQL Function Improvement > -

[jira] [Assigned] (SPARK-43907) Add SQL functions into Scala, Python and R API

2023-07-19 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43907: - Assignee: Ruifeng Zheng > Add SQL functions into Scala, Python and R API >

[jira] [Resolved] (SPARK-44451) Make built document downloadable

2023-07-18 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44451. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42028 [https://

[jira] [Assigned] (SPARK-44451) Make built document downloadable

2023-07-18 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44451: - Assignee: Ruifeng Zheng > Make built document downloadable > --

[jira] [Created] (SPARK-44451) Make built document downloadable

2023-07-16 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44451: - Summary: Make built document downloadable Key: SPARK-44451 URL: https://issues.apache.org/jira/browse/SPARK-44451 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-44416) Upgrade buf to v1.24.0

2023-07-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44416. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41995 [https://

[jira] [Assigned] (SPARK-44416) Upgrade buf to v1.24.0

2023-07-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44416: - Assignee: Ruifeng Zheng > Upgrade buf to v1.24.0 > -- > >

[jira] [Created] (SPARK-44416) Upgrade buf to v1.24.0

2023-07-13 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44416: - Summary: Upgrade buf to v1.24.0 Key: SPARK-44416 URL: https://issues.apache.org/jira/browse/SPARK-44416 Project: Spark Issue Type: Improvement Co

[jira] [Assigned] (SPARK-41811) Implement SparkSession.sql's string formatter

2023-07-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41811: - Assignee: Ruifeng Zheng > Implement SparkSession.sql's string formatter > -

[jira] [Resolved] (SPARK-41811) Implement SparkSession.sql's string formatter

2023-07-13 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41811. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41980 [https://

[jira] [Updated] (SPARK-44406) DataFrame depending on temp view fail after the view is dropped

2023-07-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44406: -- Summary: DataFrame depending on temp view fail after the view is dropped (was: DataFrame depe

[jira] [Created] (SPARK-44406) DataFrame depending on temp view fail after the view is drop

2023-07-12 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44406: - Summary: DataFrame depending on temp view fail after the view is drop Key: SPARK-44406 URL: https://issues.apache.org/jira/browse/SPARK-44406 Project: Spark

[jira] [Assigned] (SPARK-44397) Expose assertDataFrameEqual in pyspark.testing.utils

2023-07-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44397: - Assignee: Amanda Liu > Expose assertDataFrameEqual in pyspark.testing.utils > -

[jira] [Resolved] (SPARK-44397) Expose assertDataFrameEqual in pyspark.testing.utils

2023-07-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44397. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41967 [https://

[jira] [Comment Edited] (SPARK-43907) Add SQL functions into Scala, Python and R API

2023-07-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742320#comment-17742320 ] Ruifeng Zheng edited comment on SPARK-43907 at 7/12/23 8:45 AM: --

[jira] [Commented] (SPARK-43907) Add SQL functions into Scala, Python and R API

2023-07-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742320#comment-17742320 ] Ruifeng Zheng commented on SPARK-43907: --- I think we have finish the work to add mi

[jira] [Assigned] (SPARK-44349) Add math functions to SparkR

2023-07-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44349: - Assignee: Ruifeng Zheng > Add math functions to SparkR > >

[jira] [Resolved] (SPARK-44349) Add math functions to SparkR

2023-07-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44349. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41914 [https://

[jira] [Resolved] (SPARK-43665) Enable PandasSQLStringFormatter.vformat to work with Spark Connect

2023-07-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43665. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41931 [https://

[jira] [Assigned] (SPARK-43665) Enable PandasSQLStringFormatter.vformat to work with Spark Connect

2023-07-11 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43665: - Assignee: Haejoon Lee > Enable PandasSQLStringFormatter.vformat to work with Spark Conn

[jira] [Resolved] (SPARK-43974) Upgrade buf to v1.23.1

2023-07-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43974. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41469 [https://

[jira] [Resolved] (SPARK-44131) Add call_function and deprecate call_udf for Scala API

2023-07-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44131. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41687 [https://

[jira] [Assigned] (SPARK-44131) Add call_function and deprecate call_udf for Scala API

2023-07-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44131: - Assignee: jiaan.geng > Add call_function and deprecate call_udf for Scala API > ---

[jira] [Created] (SPARK-44349) Add math functions to SparkR

2023-07-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44349: - Summary: Add math functions to SparkR Key: SPARK-44349 URL: https://issues.apache.org/jira/browse/SPARK-44349 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44329) Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python

2023-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44329. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41907 [https://

[jira] [Assigned] (SPARK-44329) Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python

2023-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44329: - Assignee: BingKun Pan > Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt

[jira] [Assigned] (SPARK-44331) Add bitmap functions to Scala and Python

2023-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44331: - Assignee: BingKun Pan > Add bitmap functions to Scala and Python >

[jira] [Resolved] (SPARK-44331) Add bitmap functions to Scala and Python

2023-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44331. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41902 [https://

[jira] [Commented] (SPARK-43907) Add SQL functions into Scala, Python and R API

2023-07-07 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741246#comment-17741246 ] Ruifeng Zheng commented on SPARK-43907: --- [~beliefer][~LuciferYang][~panbingkun][~i

[jira] [Resolved] (SPARK-44327) Add functions any and len to Scala

2023-07-07 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44327. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41886 [https://

[jira] [Assigned] (SPARK-44327) Add functions any and len to Scala

2023-07-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44327: - Assignee: Ruifeng Zheng > Add functions any and len to Scala >

[jira] [Created] (SPARK-44331) Add bitmap functions to Scala and Python

2023-07-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44331: - Summary: Add bitmap functions to Scala and Python Key: SPARK-44331 URL: https://issues.apache.org/jira/browse/SPARK-44331 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-44329) Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python

2023-07-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44329: - Summary: Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python Key: SPARK-44329 URL: https://issues.apache.org/jira/browse/SPARK-44329

[jira] [Created] (SPARK-44327) Add functions any and len to Scala

2023-07-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44327: - Summary: Add functions any and len to Scala Key: SPARK-44327 URL: https://issues.apache.org/jira/browse/SPARK-44327 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-43660) Enable `resample` with Spark Connect

2023-07-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43660. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41877 [https://

<    4   5   6   7   8   9   10   11   12   13   >