[jira] [Resolved] (YARN-6067) Applications API Service HA

[ https://issues.apache.org/jira/browse/YARN-6067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved YARN-6067. - Resolution: Duplicate > Applications API Service HA > --- > > Key:

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 ( non-binding) -Built from the source -Installed 3 Node HA cluster and a pseudo cluster -Verified through hdfs shell commands -Verified HDFS router federation -Ran sample jobs like pi,Slive --Brahma Reddy On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh wrote: > Hi

Changing the JSON Serializer

Looks like our REST endpoints return malformed JSON for any DAO that includes a Map.  That includes: * the resourceSecondsMap and preemptedResourceSecondsMap entries in all the GET /apps/* endpoints, * the operationsInfo entry in the GET /scheduler endpoint for capacity scheduler, * the

[jira] [Created] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

Miklos Szegedi created YARN-7506: Summary: Overhaul the design of the Linux container-executor regarding Docker and future runtimes Key: YARN-7506 URL: https://issues.apache.org/jira/browse/YARN-7506

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (non-binding) Deployed in a cluster with 48 nodes and 8 subclusters: - YARN federation - HDFS Router-based federation - Yarn UI 2 Executed a few Pi job using both HDFS and YARN federation. Everything worked correctly. The YARN UI 2 showed the jobs, etc. On Wed, Nov 15, 2017 at 2:05

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (binding) Verified source tarball. Checksum and signature match, built from source, ran some unit tests. Skimmed NOTICE/LICENSE. -C On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh wrote: > Hi Folks, > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be

Re: [DISCUSS] A final minor release off branch-2?

> From recent classpath isolation work, I was surprised to find out that many of our downstream projects (HBase, Tez, etc.) are still consuming many non-public, server side APIs of Hadoop, not saying the projects/products outside of hadoop ecosystem. Our API compatibility test does not (and should

Re: [DISCUSS] A final minor release off branch-2?

On 11/15/17 10:34 AM, Andrew Wang wrote: Hi Junping, On Wed, Nov 15, 2017 at 1:37 AM, Junping Du wrote: 3. Beside incompatibilities, there is also possible to have performance regressions (lower throughput, higher latency, slower job running, bigger memory footprint or

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (non-binding) 1. Built from source. 2. Deployed to pseudo node cluster 3. Ran sample jobs. Regards, Kuhu On Wed, Nov 15, 2017 at 1:07 PM, Eric Badger wrote: > +1 (non-binding) > > - Verified all hashes and checksums > - Built from source on macOS 10.12.6, Java

[jira] [Created] (YARN-7503) Configurable heap size / JVM opts in service AM

Jonathan Hung created YARN-7503: --- Summary: Configurable heap size / JVM opts in service AM Key: YARN-7503 URL: https://issues.apache.org/jira/browse/YARN-7503 Project: Hadoop YARN Issue Type:

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (non-binding) - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino wrote: > +1 (binding) > > On Nov 15, 2017 8:23

[jira] [Created] (YARN-7502) Nodemanager restart docs should describe nodemanager supervised property

Jason Lowe created YARN-7502: Summary: Nodemanager restart docs should describe nodemanager supervised property Key: YARN-7502 URL: https://issues.apache.org/jira/browse/YARN-7502 Project: Hadoop YARN

Re: [DISCUSS] A final minor release off branch-2?

Hi Junping, On Wed, Nov 15, 2017 at 1:37 AM, Junping Du wrote: > Thanks Vinod to bring up this discussion, which is just in time. > > I agree with most responses that option C is not a good choice as our > community bandwidth is precious and we should focus on very limited

Re: [YARN-6483] Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

Hello Juan Will take a look at it. Lets continue discussion on the JIRA Cheers -Arun On Wed, Nov 15, 2017 at 10:25 AM, Juan Rodríguez Hortalá < juan.rodriguez.hort...@gmail.com> wrote: > Hi, > > Does someone have any thoughts on this proposal? > > Thanks, > > Juan > > On Sun, Nov 12, 2017 at

Re: [YARN-6483] Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

Hi, Does someone have any thoughts on this proposal? Thanks, Juan On Sun, Nov 12, 2017 at 5:27 PM, Juan Rodríguez Hortalá < juan.rodriguez.hort...@gmail.com> wrote: > Hi, > > I have submitted a pull request https://github.com/apache/hadoop/pull/289 > for

[jira] [Resolved] (YARN-7414) FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight()

[ https://issues.apache.org/jira/browse/YARN-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-7414. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (binding) On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" wrote: > +1 (non-binding) > > I built from source on Mac OS X 10.13.1 Java 1.8.0_111 > > - Deployed on a single node cluster. > - Deployed a ViewFS cluster with two hdfs mount points. > - Performed basic sanity

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (non-binding) I built from source on Mac OS X 10.13.1 Java 1.8.0_111 - Deployed on a single node cluster. - Deployed a ViewFS cluster with two hdfs mount points. - Performed basic sanity checks. - Performed DFS operations(put, ls, mkdir, touch) Thanks, Mukul > On 14-Nov-2017, at 5:40 AM,

[jira] [Created] (YARN-7501) Capacity Scheduler Intra-queue preemption should have a "dead zone" around user limit

Eric Payne created YARN-7501: Summary: Capacity Scheduler Intra-queue preemption should have a "dead zone" around user limit Key: YARN-7501 URL: https://issues.apache.org/jira/browse/YARN-7501 Project:

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1. Built from source. - Deployed a 2-node non-secure cluster. - Ran a few sample MR jobs with ATSv2 enabled. Also verified job submission across RM and NM restarts. - Tested ATSv2 with HBase as backend.Checked few of the REST endpoints. - Verified new YARN UI and accessed a few pages.

[jira] [Created] (YARN-7500) LogAggregation DeletionService should consider completedTime for long running jobs

Prabhu Joseph created YARN-7500: --- Summary: LogAggregation DeletionService should consider completedTime for long running jobs Key: YARN-7500 URL: https://issues.apache.org/jira/browse/YARN-7500

Re: [DISCUSS] A final minor release off branch-2?

Thanks Vinod to bring up this discussion, which is just in time. I agree with most responses that option C is not a good choice as our community bandwidth is precious and we should focus on very limited mainstream branches to develop, test and deployment. Of course, we should still follow

[jira] [Created] (YARN-7499) Layout changes to Application details page

Vasudevan Skm created YARN-7499: --- Summary: Layout changes to Application details page Key: YARN-7499 URL: https://issues.apache.org/jira/browse/YARN-7499 Project: Hadoop YARN Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (binding) Built from source. - Tested few cases in an HA cluster and tried to do failover by using rmadmin commands etc. This seems works fine including submitting apps. - I also tested many MR apps and all are running fine w/o any issues. - Majorly tested below feature sanity

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1(binding) * Downloaded source and verified for checksum. Built from source and deployed RM HA Non-Secure cluster along with Atsv2 and yarn-ui enabled! * Tested for ** RM HA/Restart/Work-preserving restart and NM work preserving restart scenarios ** Application priority and