[
https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-24957:
--
Description:
I noticed a bug when doing arithmetic on a dataframe containing decimal
David Vogelbacher created SPARK-24957:
-
Summary: Decimal arithmetic can lead to wrong values using codegen
Key: SPARK-24957
URL: https://issues.apache.org/jira/browse/SPARK-24957
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561277#comment-16561277
]
David Vogelbacher commented on SPARK-24957:
---
[~mgaido] I wasn't able to reproduce the
[
https://issues.apache.org/jira/browse/SPARK-24957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561277#comment-16561277
]
David Vogelbacher edited comment on SPARK-24957 at 7/29/18 9:55 PM:
[
https://issues.apache.org/jira/browse/SPARK-12911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556470#comment-16556470
]
David Vogelbacher commented on SPARK-12911:
---
Hey [~hyukjin.kwon] [~sdicocco][~a1ray], I just
[
https://issues.apache.org/jira/browse/SPARK-24983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-24983:
--
Description:
I noticed that writing a spark job that includes many sequential
David Vogelbacher created SPARK-24983:
-
Summary: Collapsing multiple project statements with dependent
When-Otherwise statements on the same column can OOM the driver
Key: SPARK-24983
URL:
[
https://issues.apache.org/jira/browse/SPARK-24934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558360#comment-16558360
]
David Vogelbacher commented on SPARK-24934:
---
Thanks for opening and making the pr
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391709#comment-16391709
]
David Vogelbacher commented on SPARK-23598:
---
[~mgaido] {{HashAggregateExec}} calls
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391709#comment-16391709
]
David Vogelbacher edited comment on SPARK-23598 at 3/8/18 6:41 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389745#comment-16389745
]
David Vogelbacher commented on SPARK-23598:
---
[~hvanhovell] unfortunately, I can't extract any
[
https://issues.apache.org/jira/browse/SPARK-23825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23825:
--
Description:
We currently request {{spark.{driver,executor}.memory}} as memory from
David Vogelbacher created SPARK-23825:
-
Summary: [K8s] Spark pods should request memory + memoryOverhead
as resources
Key: SPARK-23825
URL: https://issues.apache.org/jira/browse/SPARK-23825
[
https://issues.apache.org/jira/browse/SPARK-23825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23825:
--
Description:
We currently request {{spark.[driver,executor].memory}} as memory from
[
https://issues.apache.org/jira/browse/SPARK-23825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419857#comment-16419857
]
David Vogelbacher commented on SPARK-23825:
---
Will make a PR shortly, cc [~mcheah]
> [K8s]
[
https://issues.apache.org/jira/browse/SPARK-23825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419950#comment-16419950
]
David Vogelbacher commented on SPARK-23825:
---
addressed by
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using
David Vogelbacher created SPARK-23598:
-
Summary: WholeStageCodegen can lead to IllegalAccessError calling
append for HashAggregateExec
Key: SPARK-23598
URL: https://issues.apache.org/jira/browse/SPARK-23598
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using
[
https://issues.apache.org/jira/browse/SPARK-23598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-23598:
--
Description:
Got the following stacktrace for a large QueryPlan using
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-24437:
--
Attachment: Screen Shot 2018-11-01 at 10.38.30 AM.png
> Memory leak in
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671686#comment-16671686
]
David Vogelbacher commented on SPARK-24437:
---
Hey [~mgaido], I am seeing something similar in
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671686#comment-16671686
]
David Vogelbacher edited comment on SPARK-24437 at 11/1/18 2:43 PM:
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675690#comment-16675690
]
David Vogelbacher commented on SPARK-24437:
---
[~eyalfa] the cached relations only really take
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679253#comment-16679253
]
David Vogelbacher commented on SPARK-24437:
---
[~eyalfa] There might be hundreds of cached
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679768#comment-16679768
]
David Vogelbacher commented on SPARK-24437:
---
Thanks for the explanations! I will look into the
[
https://issues.apache.org/jira/browse/SPARK-26423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-26423:
--
Description:
If an executor disconnects we currently only disable it in the
David Vogelbacher created SPARK-26423:
-
Summary: [K8s] Make sure that disconnected executors eventually
get deleted
Key: SPARK-26423
URL: https://issues.apache.org/jira/browse/SPARK-26423
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750674#comment-16750674
]
David Vogelbacher commented on SPARK-24437:
---
[~DaveDeCaprio] I have not tested it yet but
David Vogelbacher created SPARK-27805:
-
Summary: toPandas does not propagate SparkExceptions with arrow
enabled
Key: SPARK-27805
URL: https://issues.apache.org/jira/browse/SPARK-27805
Project:
David Vogelbacher created SPARK-27778:
-
Summary: toPandas with arrow enabled fails for DF with no partition
Key: SPARK-27778
URL: https://issues.apache.org/jira/browse/SPARK-27778
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843987#comment-16843987
]
David Vogelbacher commented on SPARK-27778:
---
I will make a pr for this shortly.
> toPandas
[
https://issues.apache.org/jira/browse/SPARK-27778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-27778:
--
Summary: toPandas with arrow enabled fails for DF with no partitions (was:
toPandas
[
https://issues.apache.org/jira/browse/SPARK-28761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-28761:
--
Description:
Spark has a setting {{spark.driver.maxResultSize}}, see
David Vogelbacher created SPARK-28761:
-
Summary: spark.driver.maxResultSize only applies to compressed data
Key: SPARK-28761
URL: https://issues.apache.org/jira/browse/SPARK-28761
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-28761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-28761:
--
Description:
Spark has a setting {{spark.driver.maxResultSize}}, see
David Vogelbacher created SPARK-39746:
-
Summary: Binary array operations can be faster if one side is a
constant
Key: SPARK-39746
URL: https://issues.apache.org/jira/browse/SPARK-39746
Project:
[
https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-39885:
--
Description:
{{array_contains([0.0], -0.0)}} will return true.
[
https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-39885:
--
Description:
{{array_contains([0.0], -0.0)}} will return true.
David Vogelbacher created SPARK-39885:
-
Summary: Behavior differs between array_overlap and array_contains
for negative 0.0
Key: SPARK-39885
URL: https://issues.apache.org/jira/browse/SPARK-39885
[
https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-39885:
--
Summary: Behavior differs between arrays_overlap and array_contains for
negative 0.0
[
https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Vogelbacher updated SPARK-39885:
--
Description:
{{array_contains([0.0], -0.0)}} will return true.
45 matches
Mail list logo
