[
https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43926.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41718
[
https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43926:
-
Assignee: Tengfei Huang
> Add array_agg, array_size, cardinality,
>
[
https://issues.apache.org/jira/browse/SPARK-44259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-44259:
-
Summary: Make `connect-jvm-client` module pass except arrow-related ones in
Java 21 (was: Ignore all
[
https://issues.apache.org/jira/browse/SPARK-44223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738867#comment-17738867
]
Dongjoon Hyun commented on SPARK-44223:
---
+1
> Drop leveldb support
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-44124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738866#comment-17738866
]
Dongjoon Hyun commented on SPARK-44124:
---
Hi, [~cltlfcjin]. We want to align with Apache Hadoop.
>
[
https://issues.apache.org/jira/browse/SPARK-44124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738865#comment-17738865
]
Lantao Jin commented on SPARK-44124:
Hi [~dongjoon], this is Lantao from AWS, we are working on
[
https://issues.apache.org/jira/browse/SPARK-44259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738864#comment-17738864
]
Snoot.io commented on SPARK-44259:
--
User 'LuciferYang' has created a pull request for this issue:
BingKun Pan created SPARK-44260:
---
Summary: Assign names to the error class
_LEGACY_ERROR_TEMP_[1215-1245-2329] & Use checkError() to check Exception in
*CharVarchar*Suite
Key: SPARK-44260
URL:
Yang Jie created SPARK-44259:
Summary: Ignore all Arrow-based connect tests for Java 21
Key: SPARK-44259
URL: https://issues.apache.org/jira/browse/SPARK-44259
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-43974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-43974:
Summary: Upgrade buf to v1.23.0 (was: Upgrade buf to v1.22.0)
> Upgrade buf to v1.23.0
>
[
https://issues.apache.org/jira/browse/SPARK-44090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-44090.
--
Resolution: Duplicate
> Add a Java 21 build task in `build_and_test.yml`
>
Rui Wang created SPARK-44258:
Summary: Move Metadata to sql/api
Key: SPARK-44258
URL: https://issues.apache.org/jira/browse/SPARK-44258
Project: Spark
Issue Type: Sub-task
Components:
[
https://issues.apache.org/jira/browse/SPARK-44257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738838#comment-17738838
]
BingKun Pan commented on SPARK-44257:
-
I work on it
> Update some maven plugins & scalafmt to
BingKun Pan created SPARK-44257:
---
Summary: Update some maven plugins & scalafmt to newest version
Key: SPARK-44257
URL: https://issues.apache.org/jira/browse/SPARK-44257
Project: Spark
Issue
BingKun Pan created SPARK-44256:
---
Summary: Upgrade rocksdbjni to 8.3.2
Key: SPARK-44256
URL: https://issues.apache.org/jira/browse/SPARK-44256
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-44150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44150:
--
Fix Version/s: (was: 3.5.0)
> Explicit Arrow casting for mismatched return type in Arrow
[
https://issues.apache.org/jira/browse/SPARK-44150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reopened SPARK-44150:
---
Assignee: (was: Xinrong Meng)
> Explicit Arrow casting for mismatched return type in
[
https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738807#comment-17738807
]
Lucy Yao commented on SPARK-44252:
--
I'm working on this
> Add error class for the case when loading
[
https://issues.apache.org/jira/browse/SPARK-44248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-44248.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41790
[
https://issues.apache.org/jira/browse/SPARK-44248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-44248:
Assignee: Siying Dong
> Kafka Source v2 should return preferred locations
>
Rui Wang created SPARK-44255:
Summary: Relocate StorageLevel to common/utils
Key: SPARK-44255
URL: https://issues.apache.org/jira/browse/SPARK-44255
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-44255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Wang updated SPARK-44255:
-
Issue Type: Task (was: Bug)
> Relocate StorageLevel to common/utils
>
[
https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-44253:
---
Description:
If the user registers a temporary view from a dataframe created by
[
https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-44253:
---
Description:
If the user registers a temporary view from a dataframe created by
Rui Wang created SPARK-44254:
Summary: Move QueryExecutionErrors to sql/api
Key: SPARK-44254
URL: https://issues.apache.org/jira/browse/SPARK-44254
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-44253:
---
Attachment: 2.png
> Potential memory leak when temp views created from DF created
[
https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-44253:
---
Description:
If the user registers a temporary view from a dataframe created by
Attila Zsolt Piros created SPARK-44253:
--
Summary: Potential memory leak when temp views created from DF
created by structured streaming
Key: SPARK-44253
URL: https://issues.apache.org/jira/browse/SPARK-44253
[
https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-44253:
---
Attachment: 1.png
> Potential memory leak when temp views created from DF created
[
https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lucy Yao updated SPARK-44252:
-
Description:
This is part of
Lucy Yao created SPARK-44252:
Summary: Add error class for the case when loading state from DFS
fails
Key: SPARK-44252
URL: https://issues.apache.org/jira/browse/SPARK-44252
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738762#comment-17738762
]
Bruce Robbins commented on SPARK-44251:
---
This is similar to, but not quite the same as
[
https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins updated SPARK-44251:
--
Summary: Potential for incorrect results or NPE when full outer USING join
has null key value
Bruce Robbins created SPARK-44251:
-
Summary: Potentially incorrect results or NPE when full outer
USING join has null key value
Key: SPARK-44251
URL: https://issues.apache.org/jira/browse/SPARK-44251
Weichen Xu created SPARK-44250:
--
Summary: Implement classification evaluator
Key: SPARK-44250
URL: https://issues.apache.org/jira/browse/SPARK-44250
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu reassigned SPARK-44250:
--
Assignee: Weichen Xu
> Implement classification evaluator
>
Takuya Ueshin created SPARK-44249:
-
Summary: Refactor PythonUDTFRunner to send its return type
separately
Key: SPARK-44249
URL: https://issues.apache.org/jira/browse/SPARK-44249
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng reassigned SPARK-44150:
Assignee: Xinrong Meng
> Explicit Arrow casting for mismatched return type in Arrow
[
https://issues.apache.org/jira/browse/SPARK-44150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng resolved SPARK-44150.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41503
Siying Dong created SPARK-44248:
---
Summary: Kafka Source v2 should return preferred locations
Key: SPARK-44248
URL: https://issues.apache.org/jira/browse/SPARK-44248
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-40176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738718#comment-17738718
]
Ayushi Agarwal edited comment on SPARK-40176 at 6/29/23 6:10 PM:
-
This
[
https://issues.apache.org/jira/browse/SPARK-40176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738718#comment-17738718
]
Ayushi Agarwal commented on SPARK-40176:
This solves this issue partially
[
https://issues.apache.org/jira/browse/SPARK-44247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44247:
--
Description:
According to Apache Arrow release history, 13.0.0 is expected to be released on
[
https://issues.apache.org/jira/browse/SPARK-44247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44247:
--
Description:
According to Apache Arrow release history, 13.0.0 is expected to be released on
[
https://issues.apache.org/jira/browse/SPARK-44247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44247:
--
Description:
According to Apache Arrow release history, 13.0.0 is expected to be released on
Dongjoon Hyun created SPARK-44247:
-
Summary: Upgrade Arrow to 13.0.0
Key: SPARK-44247
URL: https://issues.apache.org/jira/browse/SPARK-44247
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-44199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738673#comment-17738673
]
Ignite TC Bot commented on SPARK-44199:
---
User 'vihangk1' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738669#comment-17738669
]
Ignite TC Bot commented on SPARK-44165:
---
User 'ramon-garcia' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738672#comment-17738672
]
Ignite TC Bot commented on SPARK-44131:
---
User 'beliefer' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738671#comment-17738671
]
Ignite TC Bot commented on SPARK-44200:
---
User 'ueshin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-44195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738668#comment-17738668
]
Ignite TC Bot commented on SPARK-44195:
---
User 'juliuszsompolski' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738670#comment-17738670
]
Ignite TC Bot commented on SPARK-35564:
---
User 'peter-toth' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-43474:
Assignee: Raghu Angadi
> Add support to create DataFrame Reference in Spark connect
>
[
https://issues.apache.org/jira/browse/SPARK-43474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-43474.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41580
[
https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dzcxzl updated SPARK-44240:
---
Description:
{code:java}
set spark.sql.execution.topKSortFallbackThreshold=1;
SELECT min(id) FROM (
[
https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dzcxzl updated SPARK-44240:
---
Description:
{code:java}
set spark.sql.execution.topKSortFallbackThreshold=1;
SELECT min(id) FROM (
[
https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dzcxzl updated SPARK-44240:
---
Description:
{code:java}
set spark.sql.execution.topKSortFallbackThreshold=1;
SELECT min(id) FROM (
[
https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dzcxzl updated SPARK-44240:
---
Attachment: topKSortFallbackThresholdDesc.png
> Setting the topKSortFallbackThreshold value may lead to
[
https://issues.apache.org/jira/browse/SPARK-44227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44227.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41772
[
https://issues.apache.org/jira/browse/SPARK-44208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-44208.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41740
[
https://issues.apache.org/jira/browse/SPARK-44208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-44208:
Assignee: BingKun Pan
> assign clear error class names for some logic that directly uses
Venkata Sai Akhil Gudesa created SPARK-44246:
Summary: Follow-ups for Jar/Classfile Isolation
Key: SPARK-44246
URL: https://issues.apache.org/jira/browse/SPARK-44246
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venkata Sai Akhil Gudesa updated SPARK-44146:
-
Epic Link: SPARK-42554
> Isolate Spark Connect session/artifacts
>
[
https://issues.apache.org/jira/browse/SPARK-44208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-44208:
Description:
include:
* ALL_PARTITION_COLUMNS_NOT_ALLOWED
* INVALID_HIVE_COLUMN_NAME
*
[
https://issues.apache.org/jira/browse/SPARK-44079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-44079:
-
Fix Version/s: 3.4.2
> Json reader crashes when a different schema is present
>
Alice Sayutina created SPARK-44245:
--
Summary: pyspark.sql.dataframe doctests can behave differently
Key: SPARK-44245
URL: https://issues.apache.org/jira/browse/SPARK-44245
Project: Spark
jiaan.geng created SPARK-44244:
--
Summary: Assign names to the error class
_LEGACY_ERROR_TEMP_[2305-2309]
Key: SPARK-44244
URL: https://issues.apache.org/jira/browse/SPARK-44244
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-44169:
Assignee: jiaan.geng
> Assign names to the error class _LEGACY_ERROR_TEMP_[2300-2304]
>
[
https://issues.apache.org/jira/browse/SPARK-44169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-44169.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41719
[
https://issues.apache.org/jira/browse/SPARK-44241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738451#comment-17738451
]
ASF GitHub Bot commented on SPARK-44241:
User 'yaooqinn' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wan Kun updated SPARK-44243:
Summary: Add a parameter to determine the locality of local shuffle reader
(was: Local shuffle reader
Wan Kun created SPARK-44243:
---
Summary: Local shuffle reader should not respect
SHUFFLE_REDUCE_LOCALITY_ENABLE
Key: SPARK-44243
URL: https://issues.apache.org/jira/browse/SPARK-44243
Project: Spark
Nicolas Fraison created SPARK-44242:
---
Summary: Spark job submission failed because Xmx string is
available on one parameter provided into spark.driver.extraJavaOptions
Key: SPARK-44242
URL:
[
https://issues.apache.org/jira/browse/SPARK-44235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang resolved SPARK-44235.
-
Fix Version/s: 3.5.0
Resolution: Fixed
https://github.com/apache/spark-docker/pull/51
>
Kent Yao created SPARK-44241:
Summary: Set io.connectionTimeout/connectionCreationTimeout to
zero or negative will cause executor incessantes cons/destructions
Key: SPARK-44241
URL:
[
https://issues.apache.org/jira/browse/SPARK-44079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-44079:
-
Component/s: SQL
(was: python)
> Json reader crashes when a different schema is
[
https://issues.apache.org/jira/browse/SPARK-44079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-44079.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41662
[
https://issues.apache.org/jira/browse/SPARK-44079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-44079:
Assignee: Jia Fan
> Json reader crashes when a different schema is present
>
78 matches
Mail list logo