[
https://issues.apache.org/jira/browse/SPARK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-32732:
-
Description: This is to track a TODO item in [Pull
[
https://issues.apache.org/jira/browse/SPARK-32737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32737.
--
Resolution: Invalid
Looks like a question. Please ask questions to mailing list, see also
[
https://issues.apache.org/jira/browse/SPARK-32751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187446#comment-17187446
]
Cheng Su commented on SPARK-32751:
--
Just FYI - will raise a PR in next couple of weeks. Thanks.
> Add
[
https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187445#comment-17187445
]
Hyukjin Kwon commented on SPARK-32742:
--
Please don't specify a blocker which is usually reserved
Cheng Su created SPARK-32751:
Summary: Add code-gen for ObjectHashAggregateExec
Key: SPARK-32751
URL: https://issues.apache.org/jira/browse/SPARK-32751
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-32742:
-
Priority: Major (was: Blocker)
> FileOutputCommitter warns "No Output found for attempt"
>
[
https://issues.apache.org/jira/browse/SPARK-32744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187444#comment-17187444
]
Hyukjin Kwon commented on SPARK-32744:
--
Is it realistic to have 2147483647+ cores? or did I miss
[
https://issues.apache.org/jira/browse/SPARK-32746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187443#comment-17187443
]
Hyukjin Kwon commented on SPARK-32746:
--
[~rahulbhatia], please share your analysis on the logs and
[
https://issues.apache.org/jira/browse/SPARK-32750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187441#comment-17187441
]
Cheng Su commented on SPARK-32750:
--
Just FYI - will raise a PR in next couple of weeks. Thanks.
> Add
Cheng Su created SPARK-32750:
Summary: Add code-gen for SortAggregateExec
Key: SPARK-32750
URL: https://issues.apache.org/jira/browse/SPARK-32750
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-32749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187438#comment-17187438
]
JiangYang commented on SPARK-32749:
---
Im working on.
> Refactor DataFrameStatPerfSuite to use main
[
https://issues.apache.org/jira/browse/SPARK-32749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-32749:
Description:
Yuming Wang created SPARK-32749:
---
Summary: Refactor DataFrameStatPerfSuite to use main method
Key: SPARK-32749
URL: https://issues.apache.org/jira/browse/SPARK-32749
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-32748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32748:
Assignee: (was: Apache Spark)
> Support local property propagation in
[
https://issues.apache.org/jira/browse/SPARK-32748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187436#comment-17187436
]
Apache Spark commented on SPARK-32748:
--
User 'wzhfy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187435#comment-17187435
]
Apache Spark commented on SPARK-32748:
--
User 'wzhfy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32748:
Assignee: Apache Spark
> Support local property propagation in SubqueryBroadcastExec
>
Zhenhua Wang created SPARK-32748:
Summary: Support local property propagation in
SubqueryBroadcastExec
Key: SPARK-32748
URL: https://issues.apache.org/jira/browse/SPARK-32748
Project: Spark
Hyukjin Kwon created SPARK-32747:
Summary: Deduplicate configuration set/unset in
test_sparkSQL_arrow.R
Key: SPARK-32747
URL: https://issues.apache.org/jira/browse/SPARK-32747
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187414#comment-17187414
]
Yuming Wang commented on SPARK-23812:
-
We don’t support {{dfs}}.
{noformat}
scala> spark.sql("dfs
[
https://issues.apache.org/jira/browse/SPARK-32746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rahul Bhatia updated SPARK-32746:
-
Description:
Hi,
I am facing issues in running Pandas UDF on a yarn cluster with multiple
[
https://issues.apache.org/jira/browse/SPARK-32746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rahul Bhatia updated SPARK-32746:
-
Attachment: Screenshot 2020-08-31 at 9.04.07 AM.png
> Not able to run Pandas UDF
>
[
https://issues.apache.org/jira/browse/SPARK-32746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rahul Bhatia updated SPARK-32746:
-
Description:
Hi,
I am facing issues in running Pandas UDF on a yarn cluster with multiple
Rahul Bhatia created SPARK-32746:
Summary: Not able to run Pandas UDF
Key: SPARK-32746
URL: https://issues.apache.org/jira/browse/SPARK-32746
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-32400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187403#comment-17187403
]
Apache Spark commented on SPARK-32400:
--
User 'AngersZh' has created a pull request for this
Holden Karau created SPARK-32745:
Summary: Add an option to reject block migrations when under disk
pressure
Key: SPARK-32745
URL: https://issues.apache.org/jira/browse/SPARK-32745
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32376:
Assignee: Apache Spark (was: L. C. Hsieh)
> Make unionByName null-filling behavior work
[
https://issues.apache.org/jira/browse/SPARK-32376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32376:
Assignee: L. C. Hsieh (was: Apache Spark)
> Make unionByName null-filling behavior work
[
https://issues.apache.org/jira/browse/SPARK-32376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187382#comment-17187382
]
Apache Spark commented on SPARK-32376:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-32719:
Assignee: Fokko Driesprong
> Add Flake8 check for missing imports
>
[
https://issues.apache.org/jira/browse/SPARK-32719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187381#comment-17187381
]
Hyukjin Kwon commented on SPARK-32719:
--
Fixed in https://github.com/apache/spark/pull/29563
> Add
[
https://issues.apache.org/jira/browse/SPARK-32719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32719.
--
Fix Version/s: 3.1.0
Resolution: Fixed
> Add Flake8 check for missing imports
>
Yu Wang created SPARK-32744:
---
Summary: request executor cores with decimal when spark on k8s
Key: SPARK-32744
URL: https://issues.apache.org/jira/browse/SPARK-32744
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-32744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yu Wang updated SPARK-32744:
Attachment: screenshot-1.png
> request executor cores with decimal when spark on k8s
>
[
https://issues.apache.org/jira/browse/SPARK-32744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yu Wang updated SPARK-32744:
Description:
In current spark version which does not support to request executor cores
with decimal
[
https://issues.apache.org/jira/browse/SPARK-32733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-32733:
Assignee: Kent Yao
> Add extended information - arguments/examples/since/notes of
[
https://issues.apache.org/jira/browse/SPARK-32733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-32733.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29577
[
https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187365#comment-17187365
]
Hyukjin Kwon commented on SPARK-32084:
--
Hey [~nchammas], thanks for taking a look. I basically just
[
https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187364#comment-17187364
]
Nicholas Chammas commented on SPARK-32084:
--
Can you share a couple of examples of what you are
[
https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187347#comment-17187347
]
Apache Spark commented on SPARK-32743:
--
User 'ulysses-you' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32743:
Assignee: (was: Apache Spark)
> Add distinct info at UnresolvedFunction toString
>
[
https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32743:
Assignee: Apache Spark
> Add distinct info at UnresolvedFunction toString
>
[
https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187346#comment-17187346
]
Apache Spark commented on SPARK-32743:
--
User 'ulysses-you' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187341#comment-17187341
]
Takeshi Yamamuro commented on SPARK-32743:
--
Please describe more in the description to make
[
https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31511:
--
Affects Version/s: 1.4.1
1.5.2
1.6.3
[
https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187337#comment-17187337
]
Dongjoon Hyun commented on SPARK-31511:
---
Thank you for updating issue type and labeling
[
https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187334#comment-17187334
]
Dongjoon Hyun commented on SPARK-31511:
---
This is backported to branch-3.0 via
[
https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31511:
--
Fix Version/s: 3.0.2
> Make BytesToBytesMap iterator() thread-safe
>
[
https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell updated SPARK-31511:
--
Labels: correctness (was: )
> Make BytesToBytesMap iterator() thread-safe
>
[
https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell updated SPARK-31511:
--
Issue Type: Bug (was: Improvement)
> Make BytesToBytesMap iterator() thread-safe
>
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-32481.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 29552
[
https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-32481:
-
Assignee: Udbhav Agrawal
> Support truncate table to move the data to trash
>
ulysses you created SPARK-32743:
---
Summary: Add distinct info at UnresolvedFunction toString
Key: SPARK-32743
URL: https://issues.apache.org/jira/browse/SPARK-32743
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Luo updated SPARK-32742:
-
Description:
Hi team,
This is my first time to report an issue here.
We submitted and ran the spark
[
https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Luo updated SPARK-32742:
-
Component/s: (was: Spark Submit)
Spark Core
> FileOutputCommitter warns "No Output
[
https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Luo updated SPARK-32742:
-
Priority: Blocker (was: Major)
> FileOutputCommitter warns "No Output found for attempt"
>
Ryan Luo created SPARK-32742:
Summary: FileOutputCommitter warns "No Output found for attempt"
Key: SPARK-32742
URL: https://issues.apache.org/jira/browse/SPARK-32742
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-32677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ulysses you updated SPARK-32677:
Summary: Load function resource before create (was: Cache function
directly after create)
>
[
https://issues.apache.org/jira/browse/SPARK-32739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187202#comment-17187202
]
Takeshi Yamamuro commented on SPARK-32739:
--
Could you fill the description, too?
> support
[
https://issues.apache.org/jira/browse/SPARK-32741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187200#comment-17187200
]
Apache Spark commented on SPARK-32741:
--
User 'maropu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32741:
Assignee: (was: Apache Spark)
> Check if the same ExprId refers to the unique
[
https://issues.apache.org/jira/browse/SPARK-32741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187199#comment-17187199
]
Apache Spark commented on SPARK-32741:
--
User 'maropu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32741:
Assignee: Apache Spark
> Check if the same ExprId refers to the unique attribute in
Takeshi Yamamuro created SPARK-32741:
Summary: Check if the same ExprId refers to the unique attribute
in logical plans
Key: SPARK-32741
URL: https://issues.apache.org/jira/browse/SPARK-32741
[
https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187152#comment-17187152
]
Apache Spark commented on SPARK-32364:
--
User 'karolchmist' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-32740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32740:
Assignee: Apache Spark
> Refactor common partitioning/distribution logic to
[
https://issues.apache.org/jira/browse/SPARK-32740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32740:
Assignee: (was: Apache Spark)
> Refactor common partitioning/distribution logic to
[
https://issues.apache.org/jira/browse/SPARK-32740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187150#comment-17187150
]
Apache Spark commented on SPARK-32740:
--
User 'c21' has created a pull request for this issue:
Cheng Su created SPARK-32740:
Summary: Refactor common partitioning/distribution logic to
BaseAggregateExec
Key: SPARK-32740
URL: https://issues.apache.org/jira/browse/SPARK-32740
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187149#comment-17187149
]
Apache Spark commented on SPARK-32739:
--
User 'wzhfy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-32739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32739:
Assignee: Apache Spark
> support prune right for left semi join in DPP
>
[
https://issues.apache.org/jira/browse/SPARK-32739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-32739:
Assignee: (was: Apache Spark)
> support prune right for left semi join in DPP
>
Zhenhua Wang created SPARK-32739:
Summary: support prune right for left semi join in DPP
Key: SPARK-32739
URL: https://issues.apache.org/jira/browse/SPARK-32739
Project: Spark
Issue Type:
73 matches
Mail list logo