[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2018-01-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345615#comment-16345615 ] Marcelo Vanzin commented on SPARK-18085: If you want the short and dirty description: these

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2018-01-29 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344339#comment-16344339 ] Alex Bozarth commented on SPARK-18085: -- [~vanzin] since this is complete and going into 2.3 I was

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-13 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164187#comment-16164187 ] jincheng commented on SPARK-18085: -- Well done! In fact , shs-ng/HEAD performs better than shs-ng/m9,

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163585#comment-16163585 ] Marcelo Vanzin commented on SPARK-18085: I filed SPARK-21987 for the event log issue (lest we

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158997#comment-16158997 ] Marcelo Vanzin commented on SPARK-18085: [~jincheng] that is caused by SPARK-17701. The bug is

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158865#comment-16158865 ] Marcelo Vanzin commented on SPARK-18085: Do you really mean fixed, as in you're not seeing it

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-08 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158247#comment-16158247 ] jincheng commented on SPARK-18085: -- {code:java}

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-07 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156784#comment-16156784 ] jincheng commented on SPARK-18085: -- thanks. it was ok! > SPIP: Better History Server scalability for

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154363#comment-16154363 ] Marcelo Vanzin commented on SPARK-18085: That should be fixed if you sync to my repo's

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154336#comment-16154336 ] Marcelo Vanzin commented on SPARK-18085: Ok I think I was able to reproduce that locally. >

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-09-04 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16152409#comment-16152409 ] jincheng commented on SPARK-18085: -- *{color:red}Here is a picture of how it looks{color}*

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-08-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148093#comment-16148093 ] Marcelo Vanzin commented on SPARK-18085: [~jincheng] do you have code that can reproduce that?

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-08-24 Thread jincheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141091#comment-16141091 ] jincheng commented on SPARK-18085: -- it is really a good idea to speed up history server with levelDB. I

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-08-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16125922#comment-16125922 ] Marcelo Vanzin commented on SPARK-18085: If your only problem is how fast to load a 100g event

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-08-13 Thread duyanghao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16125150#comment-16125150 ] duyanghao commented on SPARK-18085: --- [~vanzin] so what you mean is that your project has done nothing

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124731#comment-16124731 ] Marcelo Vanzin commented on SPARK-18085: [~duyanghao] that should all be explained in the

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-08-11 Thread duyanghao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124421#comment-16124421 ] duyanghao commented on SPARK-18085: --- [~vanzin] Could you have a summary of your progress(solved

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-07-17 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16090042#comment-16090042 ] Marcelo Vanzin commented on SPARK-18085:  > SPIP: Better History Server scalability for many /

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-07-16 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16089332#comment-16089332 ] Reynold Xin commented on SPARK-18085: - [~vanzin] That's actually not true anymore. It was re-licensed

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-07-15 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088758#comment-16088758 ] Marcelo Vanzin commented on SPARK-18085: Just for historical purposes, since it's mentioned in

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-07-12 Thread Ye Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084451#comment-16084451 ] Ye Zhou commented on SPARK-18085: - I want to add my own testing experience with the codes from the HEAD

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-07-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084369#comment-16084369 ] Marcelo Vanzin commented on SPARK-18085: [~kanjilal] the code is pretty much all written at this

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-07-12 Thread Saikat Kanjilal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084361#comment-16084361 ] Saikat Kanjilal commented on SPARK-18085: - [~vanzin] I would be interested in helping with this,

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-07-12 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084277#comment-16084277 ] Reynold Xin commented on SPARK-18085: - You should email dev@ to notify the list about a new SPIP.