[
https://issues.apache.org/jira/browse/SPARK-39605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manoj Chandrashekar updated SPARK-39605:
Description:
I have a job that infers schema from mongodb and does operations
[
https://issues.apache.org/jira/browse/SPARK-39605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manoj Chandrashekar updated SPARK-39605:
Attachment: image-2022-06-27-11-00-50-119.png
> PySpark df.count() operation
[
https://issues.apache.org/jira/browse/SPARK-39612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhu JunYong updated SPARK-39612:
Environment:
OS: centos stream 8
{code:java}
$ uname -a
Linux thomaszhu1.fyre.ibm.com
Zhu JunYong created SPARK-39612:
---
Summary: The dataframe returned by exceptAll() can no longer
perform operations such as count() or isempty(), or an exception will be
throwed.
Key: SPARK-39612
URL:
[
https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558972#comment-17558972
]
Apache Spark commented on SPARK-39253:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558970#comment-17558970
]
Apache Spark commented on SPARK-39253:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-39253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558971#comment-17558971
]
Apache Spark commented on SPARK-39253:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-39394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558969#comment-17558969
]
Apache Spark commented on SPARK-39394:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-39394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558968#comment-17558968
]
Apache Spark commented on SPARK-39394:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-38934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558967#comment-17558967
]
Lily Kim commented on SPARK-38934:
--
Since our system set the provider as
[
https://issues.apache.org/jira/browse/SPARK-34305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558965#comment-17558965
]
Apache Spark commented on SPARK-34305:
--
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-34305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34305:
Assignee: Max Gekk (was: Apache Spark)
> Unify v1 and v2 ALTER TABLE .. SET SERDE tests
[
https://issues.apache.org/jira/browse/SPARK-34305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558964#comment-17558964
]
Apache Spark commented on SPARK-34305:
--
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-34305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34305:
Assignee: Apache Spark (was: Max Gekk)
> Unify v1 and v2 ALTER TABLE .. SET SERDE tests
[
https://issues.apache.org/jira/browse/SPARK-39515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558950#comment-17558950
]
Yikun Jiang edited comment on SPARK-39515 at 6/27/22 2:13 AM:
--
Maybe we
[
https://issues.apache.org/jira/browse/SPARK-39515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558950#comment-17558950
]
Yikun Jiang edited comment on SPARK-39515 at 6/27/22 2:13 AM:
--
Maybe we
[
https://issues.apache.org/jira/browse/SPARK-39515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558950#comment-17558950
]
Yikun Jiang commented on SPARK-39515:
-
Maybe we could move SPARK-39609 SPARK-39610 SPARK-39611 in a
Yikun Jiang created SPARK-39611:
---
Summary: PySpark support numpy 1.23.X
Key: SPARK-39611
URL: https://issues.apache.org/jira/browse/SPARK-39611
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-39575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-39575:
Assignee: Frank Wong
> ByteBuffer forget to rewind after get in AvroDeserializer
>
[
https://issues.apache.org/jira/browse/SPARK-39575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-39575.
--
Fix Version/s: 3.4.0
3.3.1
3.2.2
Resolution:
Yikun Jiang created SPARK-39610:
---
Summary: Add safe.directory for container based job
Key: SPARK-39610
URL: https://issues.apache.org/jira/browse/SPARK-39610
Project: Spark
Issue Type:
Yikun Jiang created SPARK-39609:
---
Summary: PySpark need to support pypy3.8 to avoid "No module named
'_pickle"
Key: SPARK-39609
URL: https://issues.apache.org/jira/browse/SPARK-39609
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558943#comment-17558943
]
jiaan.geng commented on SPARK-39148:
I'm working on.
> DS V2 aggregate push down can work with
[
https://issues.apache.org/jira/browse/SPARK-39148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-39148:
---
Description:
Currently, DS V2 aggregate push-down cannot work with OFFSET and LIMIT.
If it can work
[
https://issues.apache.org/jira/browse/SPARK-39148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-39148:
---
Description:
Currently, DS V2 aggregate push-down cannot work with OFFSET and LIMIT.
If we can
[
https://issues.apache.org/jira/browse/SPARK-39574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-39574.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 36981
[
https://issues.apache.org/jira/browse/SPARK-39148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-39148:
---
Description:
Currently, DS V2 aggregate push-down cannot work with OFFSET and LIMIT.
If it can
[
https://issues.apache.org/jira/browse/SPARK-39574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-39574:
Assignee: Xinrong Meng
> Better error message when `ps.Index` is used for
[
https://issues.apache.org/jira/browse/SPARK-39148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-39148:
---
Summary: DS V2 aggregate push down can work with OFFSET or LIMIT (was:
Support push down OFFSET
[
https://issues.apache.org/jira/browse/SPARK-39148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng reopened SPARK-39148:
> Support push down OFFSET append LIMIT to JDBC data source V2
>
[ https://issues.apache.org/jira/browse/SPARK-39148 ]
jiaan.geng deleted comment on SPARK-39148:
was (Author: beliefer):
I'm working on.
> Support push down OFFSET append LIMIT to JDBC data source V2
>
[
https://issues.apache.org/jira/browse/SPARK-39148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng resolved SPARK-39148.
Resolution: Duplicate
> Support push down OFFSET append LIMIT to JDBC data source V2
>
Isaac Eliassi created SPARK-39608:
-
Summary: Upgrade to spark 3.3.0 is causing error "Cannot grow
BufferHolder by size -179446840 because the size is negative"
Key: SPARK-39608
URL:
[
https://issues.apache.org/jira/browse/SPARK-38288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558879#comment-17558879
]
SAVIO SALVARINO TELES DE OLIVEIRA commented on SPARK-38288:
---
I have the same
[
https://issues.apache.org/jira/browse/SPARK-39599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-39599:
Assignee: Yang Jie
> Upgrade maven to 3.8.6
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-39599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-39599.
--
Fix Version/s: 3.3.1
3.4.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-39607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558873#comment-17558873
]
Apache Spark commented on SPARK-39607:
--
User 'pan3793' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-39607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39607:
Assignee: Apache Spark
> DataSourceV2: Distribution and ordering support V2 function in
[
https://issues.apache.org/jira/browse/SPARK-39607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558872#comment-17558872
]
Apache Spark commented on SPARK-39607:
--
User 'pan3793' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-39607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39607:
Assignee: (was: Apache Spark)
> DataSourceV2: Distribution and ordering support V2
Cheng Pan created SPARK-39607:
-
Summary: DataSourceV2: Distribution and ordering support V2
function in writing
Key: SPARK-39607
URL: https://issues.apache.org/jira/browse/SPARK-39607
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-39606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39606:
Assignee: (was: Apache Spark)
> Use child stats to estimate order operator
>
[
https://issues.apache.org/jira/browse/SPARK-39606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558867#comment-17558867
]
Apache Spark commented on SPARK-39606:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-39606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39606:
Assignee: Apache Spark
> Use child stats to estimate order operator
>
[
https://issues.apache.org/jira/browse/SPARK-39606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558866#comment-17558866
]
Apache Spark commented on SPARK-39606:
--
User 'wangyum' has created a pull request for this issue:
Yuming Wang created SPARK-39606:
---
Summary: Use child stats to estimate order operator
Key: SPARK-39606
URL: https://issues.apache.org/jira/browse/SPARK-39606
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-39605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-39605:
Fix Version/s: (was: 3.0.1)
> PySpark df.count() operation works fine on DBR 7.3 LTS but
[
https://issues.apache.org/jira/browse/SPARK-39605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-39605:
Target Version/s: (was: 3.2.1)
> PySpark df.count() operation works fine on DBR 7.3 LTS but
[
https://issues.apache.org/jira/browse/SPARK-39605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manoj Chandrashekar updated SPARK-39605:
Description:
I have a job that infers schema from mongodb and does operations
[
https://issues.apache.org/jira/browse/SPARK-39605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manoj Chandrashekar updated SPARK-39605:
Description:
I have a job that infers schema from mongodb and does operations
[
https://issues.apache.org/jira/browse/SPARK-39605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manoj Chandrashekar updated SPARK-39605:
Description:
I have a job that infers schema from mongodb and does operations
Manoj Chandrashekar created SPARK-39605:
---
Summary: PySpark df.count() operation works fine on DBR 7.3 LTS
but fails in DBR 10.4 LTS
Key: SPARK-39605
URL: https://issues.apache.org/jira/browse/SPARK-39605
[
https://issues.apache.org/jira/browse/SPARK-39604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558857#comment-17558857
]
eugene commented on SPARK-39604:
Issued https://github.com/apache/spark/pull/36993 for the ticket.
>
[
https://issues.apache.org/jira/browse/SPARK-39604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39604:
Assignee: (was: Apache Spark)
> Miss UT for DerbyDialet's getCatalystType
>
[
https://issues.apache.org/jira/browse/SPARK-39604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558858#comment-17558858
]
Apache Spark commented on SPARK-39604:
--
User 'Eugene-Mark' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-39604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-39604:
Assignee: Apache Spark
> Miss UT for DerbyDialet's getCatalystType
>
[
https://issues.apache.org/jira/browse/SPARK-39604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558856#comment-17558856
]
Apache Spark commented on SPARK-39604:
--
User 'Eugene-Mark' has created a pull request for this
eugene created SPARK-39604:
--
Summary: Miss UT for DerbyDialet's getCatalystType
Key: SPARK-39604
URL: https://issues.apache.org/jira/browse/SPARK-39604
Project: Spark
Issue Type: Test
58 matches
Mail list logo
