Re: [DISCUSS] YARN-5079 : Native YARN framework layer for services and Apache Slider

2016-07-18 Thread Gour Saha
The API layer effort as in https://issues.apache.org/jira/browse/YARN-4793 is REST, defined in swagger format (the first draft version is uploaded to YARN-4793). Proposal is to source control this as the entry point for the APIs. The server side stubs (Java) will be generated from this definition,

Re: [DISCUSS] YARN-5079 : Native YARN framework layer for services and Apache Slider

2016-07-18 Thread Tsuyoshi Ozawa
+1, >From user's point of view, the high-level resource management API without any additional dependency is much comfortable than using low-level APIs. I believe the way should increase YARN applications including long-running services. From developer's point of view, the integration make YARN

Re: [DISCUSS] YARN-5079 : Native YARN framework layer for services and Apache Slider

2016-07-18 Thread Arun Suresh
+1 It is definitely a step in the right direction and it's about time YARN recognizes services as first-class citizens. I would also like to see this effort encompass not just services but also general long-lived applications such as say storm/heron topologies, samza and possibly support for

Re: [DISCUSS] YARN-5079 : Native YARN framework layer for services and Apache Slider

2016-07-18 Thread Sangjin Lee
+1. It would be great if it becomes the default way for services to run on YARN. That would also make it easier to make YARN features support services better. As you mentioned, there would be a lot of logistics to work out, and we'll need to talk about them in more detail as they come up.

[jira] [Created] (YARN-5400) Light cleanup in ZKRMStateStore

2016-07-18 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-5400: -- Summary: Light cleanup in ZKRMStateStore Key: YARN-5400 URL: https://issues.apache.org/jira/browse/YARN-5400 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-5399) Add configuration to remember ad-hoc queues upon configuration reload

2016-07-18 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-5399: Summary: Add configuration to remember ad-hoc queues upon configuration reload Key: YARN-5399 URL: https://issues.apache.org/jira/browse/YARN-5399 Project: Hadoop YARN

[jira] [Created] (YARN-5398) Standardize whitespace trimming and splitting in FairScheduler code

2016-07-18 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-5398: Summary: Standardize whitespace trimming and splitting in FairScheduler code Key: YARN-5398 URL: https://issues.apache.org/jira/browse/YARN-5398 Project: Hadoop YARN

[jira] [Created] (YARN-5397) [Umbrella] Usability improvements in FairScheduler

2016-07-18 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-5397: Summary: [Umbrella] Usability improvements in FairScheduler Key: YARN-5397 URL: https://issues.apache.org/jira/browse/YARN-5397 Project: Hadoop YARN Issue Type:

Re: [DISCUSS] YARN-5079 : Native YARN framework layer for services and Apache Slider

2016-07-18 Thread Gour Saha
+1 forwarding from the discussion in Slider DL Note: On the Slider side, we plan to create a branch corresponding to this YARN branch. In this, we intend to remove all the pieces which will move to the YARN branch (Slider core, AM, client). We will retain the Agent and app-packages which will

[jira] [Created] (YARN-5396) YARN large file broadcast service

2016-07-18 Thread Zhiyuan Yang (JIRA)
Zhiyuan Yang created YARN-5396: -- Summary: YARN large file broadcast service Key: YARN-5396 URL: https://issues.apache.org/jira/browse/YARN-5396 Project: Hadoop YARN Issue Type: New Feature

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-07-18 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/98/ No changes -1 overall The following subsystems voted -1: asflicense unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint

[jira] [Created] (YARN-5395) All node are Lost in sls test for big cluster

2016-07-18 Thread sandflee (JIRA)
sandflee created YARN-5395: -- Summary: All node are Lost in sls test for big cluster Key: YARN-5395 URL: https://issues.apache.org/jira/browse/YARN-5395 Project: Hadoop YARN Issue Type: Improvement