Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

2017-08-21 Thread Sangjin Lee
Thanks Rohith for that update! Sounds good. Let us know when that testing is complete too. On Sat, Aug 19, 2017 at 3:34 AM, Rohith Sharma K S < rohithsharm...@apache.org> wrote: > Hi Sangjin > > Thanks for bringing this point. > We did similar exercise with current YARN-5355 branch today. Tests

Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

2017-08-19 Thread Rohith Sharma K S
Hi Sangjin Thanks for bringing this point. We did similar exercise with current YARN-5355 branch today. Tests are validated against default configuration and timeline server v.1.5 as well. All YARN major features such as RM HA/Restart/work-preserving-restart, NM restart, scheduling, sample

Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

2017-08-18 Thread Sangjin Lee
Kudos to Vrushali and the team for getting ready for this large and important feature! I know a huge team effort went into this. I look forward to seeing this merged. I'd like to ask one piece of due diligence. Could you please inspect rigorously to ensure that when disabled Timeline Service v.2

Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

2017-08-16 Thread Andrew Wang
Great, thanks Vrushali! Sounds good to me. I have a few procedural release notes comments I'll put on YARN-5355, to make sure we advertise this to our users appropriately. On Wed, Aug 16, 2017 at 11:32 AM, Vrushali Channapattan < vrushal...@gmail.com> wrote: > Hi Andrew, > > Thanks for your

Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

2017-08-16 Thread Vrushali Channapattan
Hi Andrew, Thanks for your response! There have been no changes to existing APIs since alpha1. We at Twitter have tested the feature to demonstrate it works at what we consider moderate scale but this did not include the security related testing. The security testing is in progress at present

Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

2017-08-16 Thread Andrew Wang
Hi Vrushali, Glad to hear this major dev milestone is nearing completion! Repeating my request on other merge [DISCUSS] threads, could you comment on testing and API stability of this merge? Our timeline for beta1 is about a month out, so there's not much time to fix things beforehand. Looking

Re: [DISCUSS] Merging YARN-5355 (Timeline Service v.2) to trunk

2017-08-16 Thread Vrushali Channapattan
Looks like some of the hyperlinks appear messed up, my apologies, resending the same email with hopefully better looking content: Hi All, I'd like to open a discussion for merging Timeline Service v2 (YARN-5355) to trunk in a few weeks. We have previously completed one merge onto trunk [1] and