[
https://issues.apache.org/jira/browse/SPARK-47373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47373:
-
Assignee: Binjie Yang
> [SQL] Match FileSourceScanLike to get metadata instead of
[
https://issues.apache.org/jira/browse/SPARK-47373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47373.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45491
Wenchen Fan created SPARK-47376:
---
Summary: AssertNotNull should throw USER_RAISED_EXCEPTION error
Key: SPARK-47376
URL: https://issues.apache.org/jira/browse/SPARK-47376
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-46761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-46761.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45420
[
https://issues.apache.org/jira/browse/SPARK-46761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-46761:
Assignee: Robert Joseph Evans
> quoted strings in a JSON path should support ?
[
https://issues.apache.org/jira/browse/SPARK-47375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47375:
---
Labels: pull-request-available (was: )
> Add guidelines for timestamp mapping in
[
https://issues.apache.org/jira/browse/SPARK-47314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47314:
--
Summary: Correct the ExternalSorter#writePartitionedMapOutput method
comment (was: [DOC]
[
https://issues.apache.org/jira/browse/SPARK-47314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47314:
--
Issue Type: Documentation (was: Improvement)
> [DOC] Correct the
[
https://issues.apache.org/jira/browse/SPARK-47374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47374:
---
Labels: pull-request-available (was: )
> Fix connect-repl `usage prompt` & `docs link`
>
[
https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-47342.
--
Resolution: Invalid
The tstz matches specifically to our ltz
> Support TimestampNTZ for DB2
[
https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao updated SPARK-47342:
-
Fix Version/s: (was: 4.0.0)
> Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE
>
[
https://issues.apache.org/jira/browse/SPARK-36718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-36718:
---
Labels: pull-request-available (was: )
> only collapse projects if we don't duplicate
[
https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reopened SPARK-47342:
--
Assignee: (was: Kent Yao)
> Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE
>
BingKun Pan created SPARK-47374:
---
Summary: Fix connect-repl `usage prompt` & `docs link`
Key: SPARK-47374
URL: https://issues.apache.org/jira/browse/SPARK-47374
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-41762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-41762:
---
Labels: pull-request-available (was: )
> Make `Column.__neg__` return the same column name
[
https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825945#comment-17825945
]
Yang Jie commented on SPARK-47369:
--
>From the current Spark code, it appears that the {{Logger}} is
Kent Yao created SPARK-47375:
Summary: Add guidelines for timestamp mapping in
JdbcDialect#getCatalystType
Key: SPARK-47375
URL: https://issues.apache.org/jira/browse/SPARK-47375
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825975#comment-17825975
]
Kent Yao edited comment on SPARK-47342 at 3/13/24 9:19 AM:
---
The db2 tstz
[
https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47378:
---
Labels: pull-request-available (was: )
> Make related Protobuf UT run well in IDE
>
[
https://issues.apache.org/jira/browse/SPARK-47381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ghislain Fourny updated SPARK-47381:
Summary: Spark SQL: select * from t where (false) parsed as subquery/column
alias (was:
BingKun Pan created SPARK-47378:
---
Summary: Make related Protobuf UT run well in IDE
Key: SPARK-47378
URL: https://issues.apache.org/jira/browse/SPARK-47378
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-46654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-46654:
Assignee: BingKun Pan
> df.show() of pyspark displayed different results between Regular Spark
[
https://issues.apache.org/jira/browse/SPARK-46654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-46654.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44665
[
https://issues.apache.org/jira/browse/SPARK-47380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47380:
---
Labels: pull-request-available (was: )
> Validate the spark connect session on server side
Nemanja Boric created SPARK-47380:
-
Summary: Validate the spark connect session on server side
Key: SPARK-47380
URL: https://issues.apache.org/jira/browse/SPARK-47380
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-47381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ghislain Fourny updated SPARK-47381:
Description:
Given the view (input4d47e3f1d26b42eabea312bd9d99ab43):
Ruifeng Zheng created SPARK-47377:
-
Summary: Factor out tests from `SparkConnectSQLTestCase`
Key: SPARK-47377
URL: https://issues.apache.org/jira/browse/SPARK-47377
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-47381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ghislain Fourny updated SPARK-47381:
Description:
Given the view (input4d47e3f1d26b42eabea312bd9d99ab43):
[
https://issues.apache.org/jira/browse/SPARK-46654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826031#comment-17826031
]
Max Gekk commented on SPARK-46654:
--
[~panbingkun][~LuciferYang] How about *to_json*? Does it have
[
https://issues.apache.org/jira/browse/SPARK-47377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47377:
---
Labels: pull-request-available (was: )
> Factor out tests from `SparkConnectSQLTestCase`
>
Milan Stefanovic created SPARK-47379:
Summary: Improve docker jdbc suite test reliability
Key: SPARK-47379
URL: https://issues.apache.org/jira/browse/SPARK-47379
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-47375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-47375:
Assignee: Kent Yao
> Add guidelines for timestamp mapping in JdbcDialect#getCatalystType
>
[
https://issues.apache.org/jira/browse/SPARK-47381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ghislain Fourny updated SPARK-47381:
Description:
Given the view (input4d47e3f1d26b42eabea312bd9d99ab43):
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-47381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ghislain Fourny updated SPARK-47381:
Description:
Given the view (input4d47e3f1d26b42eabea312bd9d99ab43):
{code:java}
[
https://issues.apache.org/jira/browse/SPARK-47381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ghislain Fourny updated SPARK-47381:
Environment:
macOS Sonoma
Spark 3.5.0
Java 11
(but this also happens in GitHub actions,
Serge Rielau created SPARK-47382:
Summary: SPARK_JOB_CANCELLED is mislabeled as a system error
Key: SPARK-47382
URL: https://issues.apache.org/jira/browse/SPARK-47382
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-47369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826810#comment-17826810
]
Neil Ramaswamy commented on SPARK-47369:
[~dongjoon], I will create a minimal Spark repro and
[
https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47378:
-
Assignee: BingKun Pan
> Make the related Protobuf UT run well in IDE
>
[
https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47378.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45498
[
https://issues.apache.org/jira/browse/SPARK-47363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47363:
---
Labels: pull-request-available (was: )
> Initial State without state reader implementation
[
https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826016#comment-17826016
]
Max Gekk commented on SPARK-46810:
--
> Yes I prefer option 1.
After thinking a little more, I prefer
[
https://issues.apache.org/jira/browse/SPARK-47378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-47378:
Summary: Make the related Protobuf UT run well in IDE (was: Make related
Protobuf UT run well in
[
https://issues.apache.org/jira/browse/SPARK-47375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-47375.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45496
Ghislain Fourny created SPARK-47381:
---
Summary: Spark SQL: select * from t where (false) confused with
subquery/column alias
Key: SPARK-47381
URL: https://issues.apache.org/jira/browse/SPARK-47381
[
https://issues.apache.org/jira/browse/SPARK-47381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ghislain Fourny updated SPARK-47381:
Environment:
macOS Sonoma
Spark 3.5.0
Java 11
(but this also happens in GitHub actions)
[
https://issues.apache.org/jira/browse/SPARK-47344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang resolved SPARK-47344.
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45470
[
https://issues.apache.org/jira/browse/SPARK-46913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-46913.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45051
[
https://issues.apache.org/jira/browse/SPARK-47344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gengliang Wang reassigned SPARK-47344:
--
Assignee: Serge Rielau
> Enhance error message for invalid identifiers that need
[
https://issues.apache.org/jira/browse/SPARK-47384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47384:
---
Labels: pull-request-available (was: )
> Upgrade RoaringBitmap to 1.0.5
>
Chenhao Li created SPARK-47385:
--
Summary: Tupled Encoders don't handle Option parameters
Key: SPARK-47385
URL: https://issues.apache.org/jira/browse/SPARK-47385
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenhao Li updated SPARK-47385:
---
Summary: Tupled Encoders fail to handle Option parameters (was: Tupled
Encoders don't handle
[
https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chenhao Li updated SPARK-47385:
---
Summary: Tuple encoder produces wrong results with Option inputs (was:
Tupled Encoders fail to
[
https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47385:
---
Labels: pull-request-available (was: )
> Tuple encoder produces wrong results with Option
Vijay Jangir created SPARK-47386:
Summary: Ability to only ger first match for join when there are
miltiple match
Key: SPARK-47386
URL: https://issues.apache.org/jira/browse/SPARK-47386
Project:
[
https://issues.apache.org/jira/browse/SPARK-47386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vijay Jangir updated SPARK-47386:
-
Summary: Ability to only take first match for join when there are miltiple
match (was: Ability
[
https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826833#comment-17826833
]
Dongjoon Hyun commented on SPARK-46810:
---
Yes, it sounds fine to me because it's Spark 4, Max.
>
[
https://issues.apache.org/jira/browse/SPARK-47273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47273:
---
Labels: pull-request-available (was: )
> Implement python stream writer interface
>
[
https://issues.apache.org/jira/browse/SPARK-41762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-41762:
-
Assignee: Ruifeng Zheng
> Make `Column.__neg__` return the same column name as PySpark
[
https://issues.apache.org/jira/browse/SPARK-41762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-41762.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45493
[
https://issues.apache.org/jira/browse/SPARK-46054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826881#comment-17826881
]
Eric Simmerman commented on SPARK-46054:
Qualytics uses the Spark Operator in our commercial
[
https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47383:
---
Labels: pull-request-available (was: )
> Make the shutdown hook timeout configurable
>
[
https://issues.apache.org/jira/browse/SPARK-47383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rob Reeves updated SPARK-47383:
---
Description:
org.apache.spark.util.ShutdownHookManager is used to register custom shutdown
[
https://issues.apache.org/jira/browse/SPARK-46840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826890#comment-17826890
]
Gideon P commented on SPARK-46840:
--
[~dbatomic] just wanted to let you know that I am working on this,
Rob Reeves created SPARK-47383:
--
Summary: Make the shutdown hook timeout configurable
Key: SPARK-47383
URL: https://issues.apache.org/jira/browse/SPARK-47383
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-47290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47290:
---
Labels: pull-request-available (was: )
> Extend CustomTaskMetric to allow metric values
[
https://issues.apache.org/jira/browse/SPARK-46251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826945#comment-17826945
]
Josh Rosen edited comment on SPARK-46251 at 3/14/24 5:34 AM:
-
FYI, this
[
https://issues.apache.org/jira/browse/SPARK-46251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826945#comment-17826945
]
Josh Rosen commented on SPARK-46251:
FYI, this looks like a duplicate of
67 matches
Mail list logo
