[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246811#comment-16246811
]
Marcelo Vanzin commented on SPARK-18838:
I actually did a backport to our internal branches,
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246804#comment-16246804
]
Anthony Truchet commented on SPARK-18838:
-
Agreed but at the same time this is "almost" a bug
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246783#comment-16246783
]
Marcelo Vanzin commented on SPARK-18838:
It's kind of an intrusive change to backport to a
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234891#comment-16234891
]
Anthony Truchet commented on SPARK-18838:
-
I'm interested to work on a backport for Spark 2.2 we
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186062#comment-16186062
]
Marcelo Vanzin commented on SPARK-18838:
Not really. You could try to backport the patch (not
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185856#comment-16185856
]
Shahbaz Hussain commented on SPARK-18838:
-
Is there a work around to get it working before spark
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173900#comment-16173900
]
Apache Spark commented on SPARK-18838:
--
User 'vanzin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163695#comment-16163695
]
Apache Spark commented on SPARK-18838:
--
User 'vanzin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137365#comment-16137365
]
Marcelo Vanzin commented on SPARK-18838:
[~milesc] after cleaning up a lot of noise from your
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129149#comment-16129149
]
Miles Crawford commented on SPARK-18838:
[~imranr] and [~vanzin] Here is your log:
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126402#comment-16126402
]
Miles Crawford commented on SPARK-18838:
[~imranr] We do runs tens of thousands of tasks per
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126030#comment-16126030
]
Jason Dunkelberger commented on SPARK-18838:
I just realized I have diverged from the
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126022#comment-16126022
]
Jason Dunkelberger commented on SPARK-18838:
It's been about a week now, and we've have had
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119275#comment-16119275
]
Imran Rashid commented on SPARK-18838:
--
+1 to Marcelo's request for logs from cases where listener
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119265#comment-16119265
]
Li Yuanjian commented on SPARK-18838:
-
I'm facing the same problem with [~milesc]
{quote}
We do not
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116930#comment-16116930
]
Jason Dunkelberger commented on SPARK-18838:
Thanks for your quick outline [~vanzin]. It
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116922#comment-16116922
]
Marcelo Vanzin commented on SPARK-18838:
I'd like to see something that backs your assertion that
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116916#comment-16116916
]
Miles Crawford commented on SPARK-18838:
Can I get specific direction on the logs you'd like to
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116903#comment-16116903
]
Marcelo Vanzin commented on SPARK-18838:
I'd be interested in seeing logs from an application not
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116896#comment-16116896
]
Miles Crawford commented on SPARK-18838:
We do not use dynamic allocation, and our applications
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116892#comment-16116892
]
Marcelo Vanzin commented on SPARK-18838:
bq. although that is guaranteed to happen when the wrong
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116886#comment-16116886
]
Miles Crawford commented on SPARK-18838:
This seems to be the core issue for a large number of
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16115147#comment-16115147
]
Jason Dunkelberger commented on SPARK-18838:
I saw a couple of PRs to the same effect, but
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16115139#comment-16115139
]
Marcelo Vanzin commented on SPARK-18838:
I think the main issue with a blocking bus is that you'd
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16115129#comment-16115129
]
Jason Dunkelberger commented on SPARK-18838:
I cut a PR here which just makes this queue
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113067#comment-16113067
]
Miles Crawford commented on SPARK-18838:
We have disabled our eventlog listener, which is
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084169#comment-16084169
]
Arun Achuthan commented on SPARK-18838:
---
We are facing an issue where randomly some jobs are stuck
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075600#comment-16075600
]
Anthony Truchet commented on SPARK-18838:
-
Hello,
We (Criteo Predictive Search team with
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051109#comment-16051109
]
Marcelo Vanzin commented on SPARK-18838:
bq. If we're careful in performance optimization of
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051097#comment-16051097
]
Marcelo Vanzin commented on SPARK-18838:
[~sitalke...@gmail.com] I requested your PR be closed.
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16046957#comment-16046957
]
Sital Kedia commented on SPARK-18838:
-
[~joshrosen] - The PR for my change to multi-thread the event
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16044827#comment-16044827
]
Apache Spark commented on SPARK-18838:
--
User 'bOOm-X' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032788#comment-16032788
]
Antoine PRANG commented on SPARK-18838:
---
Hi,
Can someone take a look at my pull request ?
> High
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024690#comment-16024690
]
Antoine PRANG commented on SPARK-18838:
---
[~joshrosen]
I uploaded the new timings and new version of
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017560#comment-16017560
]
Antoine PRANG commented on SPARK-18838:
---
[~mathieude]]: Yep, I introduced a blocking strategy for
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017528#comment-16017528
]
Mathieu D commented on SPARK-18838:
---
I'm not very familiar with this part of Spark, but I'd like to
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017120#comment-16017120
]
Antoine PRANG commented on SPARK-18838:
---
[~joshrosen] I uploaded the timings I get. I put some
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016664#comment-16016664
]
Ruslan Dautkhanov commented on SPARK-18838:
---
my 2 cents. Would be nice to explore idea of
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016663#comment-16016663
]
Josh Rosen commented on SPARK-18838:
[~bOOmX], do you have CPU-time profiling within each of those
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016579#comment-16016579
]
Antoine PRANG commented on SPARK-18838:
---
[~joshrosen][~sitalke...@gmail.com] I have measured the
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016217#comment-16016217
]
Sital Kedia commented on SPARK-18838:
-
[~joshrosen] - >> Alternatively, we could use two queues, one
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013317#comment-16013317
]
Josh Rosen commented on SPARK-18838:
I think that SPARK-20776 /
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012813#comment-16012813
]
Apache Spark commented on SPARK-18838:
--
User 'bOOm-X' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932238#comment-15932238
]
Danny Ruchman commented on SPARK-18838:
---
Hi,
We also have an issue where we query huge amount of
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15753535#comment-15753535
]
Sital Kedia commented on SPARK-18838:
-
cc - [~kayousterhout]
> High latency of event processing for
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750217#comment-15750217
]
Sital Kedia commented on SPARK-18838:
-
[~zsxwing] - Its not only the ExecutorAllocationManager, other
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750209#comment-15750209
]
Apache Spark commented on SPARK-18838:
--
User 'sitalkedia' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746217#comment-15746217
]
Shixiong Zhu commented on SPARK-18838:
--
[~sitalke...@gmail.com] Instead of your proposal, I prefer
[
https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744086#comment-15744086
]
Sital Kedia commented on SPARK-18838:
-
[~rxin], [~zsxwing] - Any thoughts on this?
> High latency
49 matches
Mail list logo
