[jira] [Commented] (SPARK-22805) Use aliases for StorageLevel in event logs

2017-12-18 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16294727#comment-16294727 ] Anthony Truchet commented on SPARK-22805: - As I understand it does not break any standard use and

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-11-09 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246804#comment-16246804 ] Anthony Truchet commented on SPARK-18838: - Agreed but at the same time this is "almost" a bug

[jira] [Comment Edited] (SPARK-18838) High latency of event processing for large jobs

2017-11-01 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234891#comment-16234891 ] Anthony Truchet edited comment on SPARK-18838 at 11/1/17 10:42 PM: --- I'm

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-11-01 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234891#comment-16234891 ] Anthony Truchet commented on SPARK-18838: - I'm interested to work on a backport for Spark 2.2 we

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-07-05 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075600#comment-16075600 ] Anthony Truchet commented on SPARK-18838: - Hello, We (Criteo Predictive Search team with

[jira] [Commented] (SPARK-18612) Leaked broadcasted variable Mllib

2016-11-28 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702446#comment-15702446 ] Anthony Truchet commented on SPARK-18612: - See related: *

[jira] [Created] (SPARK-18612) Leaked broadcasted variable Mllib

2016-11-28 Thread Anthony Truchet (JIRA)
Anthony Truchet created SPARK-18612: --- Summary: Leaked broadcasted variable Mllib Key: SPARK-18612 URL: https://issues.apache.org/jira/browse/SPARK-18612 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-16 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670795#comment-15670795 ] Anthony Truchet commented on SPARK-18471: - Sure. But in our use case we do want to aggregate on a

[jira] [Created] (SPARK-18471) In treeAggregate, generate (big) zeros instead of sending them.

2016-11-16 Thread Anthony Truchet (JIRA)
Anthony Truchet created SPARK-18471: --- Summary: In treeAggregate, generate (big) zeros instead of sending them. Key: SPARK-18471 URL: https://issues.apache.org/jira/browse/SPARK-18471 Project: Spark

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-21 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387342#comment-15387342 ] Anthony Truchet commented on SPARK-16440: - Regarding the try finally: we are computing numerous

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-19 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384118#comment-15384118 ] Anthony Truchet commented on SPARK-16440: - I will, as well as putting this is a try finally to

[jira] [Comment Edited] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-19 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383967#comment-15383967 ] Anthony Truchet edited comment on SPARK-16440 at 7/19/16 11:21 AM: ---

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-19 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383967#comment-15383967 ] Anthony Truchet commented on SPARK-16440: - Thanks for such a quick fix [~srowen] : I was off-line

[jira] [Commented] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-08 Thread Anthony Truchet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367615#comment-15367615 ] Anthony Truchet commented on SPARK-16440: - Hello Spark developers, I'm preparing a patch for

[jira] [Created] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-08 Thread Anthony Truchet (JIRA)
Anthony Truchet created SPARK-16440: --- Summary: Undeleted broadcast variables in Word2Vec causing OoM for long runs Key: SPARK-16440 URL: https://issues.apache.org/jira/browse/SPARK-16440 Project: