[
https://issues.apache.org/jira/browse/SPARK-44541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-44541:
-
Summary: Remove useless function `hasRangeExprAgainstEventTimeCol` from
`UnsupportedOperationChecker` (
Yang Jie created SPARK-44541:
Summary: Remove useless funciton `hasRangeExprAgainstEventTimeCol`
from `UnsupportedOperationChecker`
Key: SPARK-44541
URL: https://issues.apache.org/jira/browse/SPARK-44541
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746697#comment-17746697
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/25/23 5:41 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yiu-Chung Lee updated SPARK-44512:
--
Description:
(In this example the dataset is of type Tuple3, and the columns are named _1,
_2
[
https://issues.apache.org/jira/browse/SPARK-44540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746781#comment-17746781
]
ci-cassandra.apache.org commented on SPARK-44540:
-
User 'yaooqinn' has c
[
https://issues.apache.org/jira/browse/SPARK-44454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746751#comment-17746751
]
ci-cassandra.apache.org commented on SPARK-44454:
-
User 'cxzl25' has cre
[
https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44523.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42126
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44523:
Assignee: Yuming Wang
> Filter's maxRows/maxRowsPerPartition is 0 if condition is FalseLi
Kent Yao created SPARK-44540:
Summary: Remove unused stylesheet and javascript files of
jsonFormatter
Key: SPARK-44540
URL: https://issues.apache.org/jira/browse/SPARK-44540
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-44466.
-
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull re
[
https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-44466:
---
Assignee: Yuming Wang
> Exclude configs starting with SPARK_DRIVER_PREFIX and SPARK_EXECUTO
[
https://issues.apache.org/jira/browse/SPARK-44509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44509.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-44509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44509:
Assignee: Hyukjin Kwon
> Fine grained interrupt in Python Spark Connect
> ---
[
https://issues.apache.org/jira/browse/SPARK-44450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-44450:
-
Assignee: Herman van Hövell
> Make direct Arrow encoding work with SQL/API
> --
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yiu-Chung Lee updated SPARK-44512:
--
Component/s: Optimizer
> dataset.sort.select.write.partitionBy does not return a sorted output
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746697#comment-17746697
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/25/23 1:33 AM:
--
BingKun Pan created SPARK-44539:
---
Summary: Upgrade RoaringBitmap to 0.9.46
Key: SPARK-44539
URL: https://issues.apache.org/jira/browse/SPARK-44539
Project: Spark
Issue Type: Improvement
Herman van Hövell created SPARK-44538:
-
Summary: Remove ToJsonUtil
Key: SPARK-44538
URL: https://issues.apache.org/jira/browse/SPARK-44538
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746697#comment-17746697
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/25/23 1:06 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746697#comment-17746697
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/25/23 1:05 AM:
--
[ https://issues.apache.org/jira/browse/SPARK-44512 ]
Yiu-Chung Lee deleted comment on SPARK-44512:
---
was (Author: JIRAUSER301473):
No. After testing another production data,
spark.sql.optimizer.plannedWrite.enabled=false does not solve the pr
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746697#comment-17746697
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/25/23 1:03 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746715#comment-17746715
]
Yiu-Chung Lee commented on SPARK-44512:
---
No. After testing another production data
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-9.
---
Fix Version/s: 3.5.0
Assignee: Herman van Hövell
Resolution: Fixed
>
BingKun Pan created SPARK-44537:
---
Summary: Upgrade kubernetes-client to 6.8.0
Key: SPARK-44537
URL: https://issues.apache.org/jira/browse/SPARK-44537
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-44486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44486:
Assignee: Xinrong Meng
> Implement PyArrow `self_destruct` feature for `toPandas`
> -
[
https://issues.apache.org/jira/browse/SPARK-44486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44486.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull
BingKun Pan created SPARK-44536:
---
Summary: Upgrade sbt to 1.9.3
Key: SPARK-44536
URL: https://issues.apache.org/jira/browse/SPARK-44536
Project: Spark
Issue Type: Improvement
Componen
Herman van Hövell created SPARK-44535:
-
Summary: Move Streaming API to sql/api
Key: SPARK-44535
URL: https://issues.apache.org/jira/browse/SPARK-44535
Project: Spark
Issue Type: New Featu
[
https://issues.apache.org/jira/browse/SPARK-44500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746705#comment-17746705
]
Pablo Langa Blanco commented on SPARK-44500:
[~jan.chou...@gmail.com] What d
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746697#comment-17746697
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/24/23 11:32 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746697#comment-17746697
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/24/23 11:32 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746697#comment-17746697
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/24/23 11:29 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746697#comment-17746697
]
Yiu-Chung Lee commented on SPARK-44512:
---
Setting {{spark.sql.optimizer.plannedWrit
Dongjoon Hyun created SPARK-44534:
-
Summary: Handle only shuffle files in
KubernetesLocalDiskShuffleExecutorComponents
Key: SPARK-44534
URL: https://issues.apache.org/jira/browse/SPARK-44534
Project:
[
https://issues.apache.org/jira/browse/SPARK-44503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-44503.
---
Fix Version/s: 4.0.0
Assignee: Daniel
Resolution: Fixed
Issue resolved by pu
[
https://issues.apache.org/jira/browse/SPARK-44455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-44455:
--
Assignee: Runyao.Chen
> SHOW CREATE TABLE does not quote identifiers with special cha
[
https://issues.apache.org/jira/browse/SPARK-44516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu updated SPARK-44516:
Summary: Spark Connect Python StreamingQueryListener removeListener method
actually shut down the listener
[
https://issues.apache.org/jira/browse/SPARK-44455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-44455.
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 42034
[https:
Takuya Ueshin created SPARK-44533:
-
Summary: Add support for accumulator, broadcast, and Spark files
in Python UDTF's analyze.
Key: SPARK-44533
URL: https://issues.apache.org/jira/browse/SPARK-44533
P
Herman van Hövell created SPARK-44532:
-
Summary: Move ArrowUtil to sql/api
Key: SPARK-44532
URL: https://issues.apache.org/jira/browse/SPARK-44532
Project: Spark
Issue Type: New Feature
Herman van Hövell created SPARK-44531:
-
Summary: Move encoder inference to sql/api
Key: SPARK-44531
URL: https://issues.apache.org/jira/browse/SPARK-44531
Project: Spark
Issue Type: New F
Herman van Hövell created SPARK-44530:
-
Summary: Move SparkBuildInfo to common/util
Key: SPARK-44530
URL: https://issues.apache.org/jira/browse/SPARK-44530
Project: Spark
Issue Type: New
Holden Karau created SPARK-44529:
Summary: Add a flag to resolve docker tags to hashes at launch time
Key: SPARK-44529
URL: https://issues.apache.org/jira/browse/SPARK-44529
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-44528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Martin Grund updated SPARK-44528:
-
Summary: Spark Connect DataFrame does not allow to add custom instance
attributes and check for
[
https://issues.apache.org/jira/browse/SPARK-44528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Martin Grund updated SPARK-44528:
-
Description:
```
df = spark.range(10)
df._test = 10
assert(hasattr(df, "_test"))
assert(!hasatt
Martin Grund created SPARK-44528:
Summary: Spark Connect DataFrame does not allow to add custom
instance attributes
Key: SPARK-44528
URL: https://issues.apache.org/jira/browse/SPARK-44528
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-44528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Martin Grund updated SPARK-44528:
-
Description:
```
df = spark.range(10)
df._test = 10
```
Treats `df._test` like a column
was:
[
https://issues.apache.org/jira/browse/SPARK-44152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746516#comment-17746516
]
Ramakrishna edited comment on SPARK-44152 at 7/24/23 4:06 PM:
[
https://issues.apache.org/jira/browse/SPARK-44152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746516#comment-17746516
]
Ramakrishna commented on SPARK-44152:
-
Hello [~sdehaes]
It should work if you copy
[
https://issues.apache.org/jira/browse/SPARK-44527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746488#comment-17746488
]
Yuming Wang commented on SPARK-44527:
-
https://github.com/apache/spark/pull/42129
>
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746025#comment-17746025
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/24/23 2:38 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746483#comment-17746483
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/24/23 2:38 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yiu-Chung Lee updated SPARK-44512:
--
Summary: dataset.sort.select.write.partitionBy does not return a sorted
output (was: dataset.
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746483#comment-17746483
]
Yiu-Chung Lee commented on SPARK-44512:
---
After further test, disabling AQE actuall
Yuming Wang created SPARK-44527:
---
Summary: Simplify BinaryComparison if its children contain
ScalarSubquery with empty output
Key: SPARK-44527
URL: https://issues.apache.org/jira/browse/SPARK-44527
Proj
[
https://issues.apache.org/jira/browse/SPARK-44513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-44513:
-
Affects Version/s: 3.4.1
(was: 4.0.0)
> Upgrade snappy-java to 1.1.10
[
https://issues.apache.org/jira/browse/SPARK-44513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-44513:
-
Fix Version/s: (was: 4.0.0)
> Upgrade snappy-java to 1.1.10.3
>
[
https://issues.apache.org/jira/browse/SPARK-44526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-44526:
---
Description:
Hi,
This ticket is meant to understand the work that would be involved in porting
the
[
https://issues.apache.org/jira/browse/SPARK-44526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-44526:
---
Description:
Hi,
This ticket is meant to understand the work that would be involved in porting
the
[
https://issues.apache.org/jira/browse/SPARK-44526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Faiz Halde updated SPARK-44526:
---
Description:
Hi,
This ticket is meant to understand the work that would be involved in porting
the
Faiz Halde created SPARK-44526:
--
Summary: Porting k8s PVC reuse logic to spark standalone
Key: SPARK-44526
URL: https://issues.apache.org/jira/browse/SPARK-44526
Project: Spark
Issue Type: New F
Cheng Pan created SPARK-44525:
-
Summary: Improve error message when Invoke method is not found
Key: SPARK-44525
URL: https://issues.apache.org/jira/browse/SPARK-44525
Project: Spark
Issue Type: I
[
https://issues.apache.org/jira/browse/SPARK-44152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746436#comment-17746436
]
Stijn De Haes commented on SPARK-44152:
---
We are seeing this issue too, the problem
[
https://issues.apache.org/jira/browse/SPARK-44519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-44519.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-44519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-44519:
Assignee: jiaan.geng
> SparkConnectServerUtils generated incorrect parameters for jars
>
[
https://issues.apache.org/jira/browse/SPARK-44521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-44521:
Assignee: Yang Jie
> `SparkConnectServiceSuite` has directory residue after testing
> ---
[
https://issues.apache.org/jira/browse/SPARK-44521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-44521.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-43831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746304#comment-17746304
]
Dongjoon Hyun commented on SPARK-43831:
---
According to the assessment result (up to
[
https://issues.apache.org/jira/browse/SPARK-43831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-43831:
--
Target Version/s: 4.0.0 (was: 3.5.0)
> Build and Run Spark on Java 21
> -
[
https://issues.apache.org/jira/browse/SPARK-44524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746296#comment-17746296
]
ASF GitHub Bot commented on SPARK-44524:
User 'panbingkun' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-44524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746294#comment-17746294
]
ASF GitHub Bot commented on SPARK-44524:
User 'panbingkun' has created a pull re
[
https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-44523:
Summary: Filter's maxRows/maxRowsPerPartition is 0 if condition is
FalseLiteral (was: Filter's ma
[
https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746290#comment-17746290
]
Yuming Wang commented on SPARK-44523:
-
https://github.com/apache/spark/pull/42126
>
[
https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746288#comment-17746288
]
ASF GitHub Bot commented on SPARK-44523:
User 'wangyum' has created a pull reque
BingKun Pan created SPARK-44524:
---
Summary: Add a new test group for pyspark-pandas-slow-connect
module
Key: SPARK-44524
URL: https://issues.apache.org/jira/browse/SPARK-44524
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746286#comment-17746286
]
ASF GitHub Bot commented on SPARK-44523:
User 'wangyum' has created a pull reque
Yuming Wang created SPARK-44523:
---
Summary: Filter's maxRows should be 0 if condition is FalseLiteral
Key: SPARK-44523
URL: https://issues.apache.org/jira/browse/SPARK-44523
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yiu-Chung Lee updated SPARK-44512:
--
Description:
(In this example the dataset is of type Tuple3, and the columns are named _1,
_2
[
https://issues.apache.org/jira/browse/SPARK-44509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746270#comment-17746270
]
GridGain Integration commented on SPARK-44509:
--
User 'HyukjinKwon' has crea
[
https://issues.apache.org/jira/browse/SPARK-44371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng resolved SPARK-44371.
Resolution: Won't Fix
> Define the computing logic through PartitionEvaluator API and use it in
>
[ https://issues.apache.org/jira/browse/SPARK-44371 ]
jiaan.geng deleted comment on SPARK-44371:
was (Author: beliefer):
I'm working on.
> Define the computing logic through PartitionEvaluator API and use it in
> CollectLimitExec, CollectTailE
[
https://issues.apache.org/jira/browse/SPARK-44371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746248#comment-17746248
]
jiaan.geng commented on SPARK-44371:
[~cloud_fan] and I discussed offline, we doesn'
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yiu-Chung Lee updated SPARK-44512:
--
Attachment: (was: Test.java)
> dataset.sort.select.write.partitionBy does not return a sor
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746025#comment-17746025
]
Yiu-Chung Lee edited comment on SPARK-44512 at 7/24/23 7:12 AM:
--
85 matches
Mail list logo
