[jira] [Created] (YARN-10540) Node page is broken in YARN UI1 and UI2 including RMWebService api for nodes

2020-12-19 Thread Sunil G (Jira)
Sunil G created YARN-10540: -- Summary: Node page is broken in YARN UI1 and UI2 including RMWebService api for nodes Key: YARN-10540 URL: https://issues.apache.org/jira/browse/YARN-10540 Project: Hadoop YARN

[jira] [Created] (YARN-10247) Application priority queue ACLs are not respected

2020-04-28 Thread Sunil G (Jira)
Sunil G created YARN-10247: -- Summary: Application priority queue ACLs are not respected Key: YARN-10247 URL: https://issues.apache.org/jira/browse/YARN-10247 Project: Hadoop YARN Issue Type: Task

[jira] [Created] (YARN-10154) CS Dynamic Queues cannot be configured with absolute resources

2020-02-20 Thread Sunil G (Jira)
Sunil G created YARN-10154: -- Summary: CS Dynamic Queues cannot be configured with absolute resources Key: YARN-10154 URL: https://issues.apache.org/jira/browse/YARN-10154 Project: Hadoop YARN

Re: [ANNOUNCE] Eric Badger is now a committer!

2019-03-06 Thread Sunil G
Hearty Congratulations Eric! - Sunil On Tue, Mar 5, 2019 at 10:50 PM Eric Payne wrote: > It is my pleasure to announce that Eric Badger has accepted an invitation > to become a Hadoop Core committer. > > Congratulations, Eric! This is well-deserved! > > -Eric Payne >

Re: [VOTE] Release Apache Hadoop 3.1.2 - RC1

2019-02-05 Thread Sunil G
t):1" > > I think we are probably due for an overall review of LICENSE and NOTICE. I > saw some idiosyncrasies there but nothing that looked like a blocker. > > On Mon, Jan 28, 2019 at 10:20 PM Sunil G wrote: > >> Hi Folks, >> >> On behalf of Wangda

Re: [VOTE] Propose to start new Hadoop sub project "submarine"

2019-02-01 Thread Sunil G
+1 . Thanks Wangda. - Sunil On Sat, Feb 2, 2019 at 3:54 AM Wangda Tan wrote: > Hi all, > > According to positive feedbacks from the thread [1] > > This is vote thread to start a new subproject named "hadoop-submarine" > which follows the release process already established for ozone. > > The

Re: [DISCUSS] Making submarine to different release model like Ozone

2019-01-31 Thread Sunil G
+1 from me on this. ML/DL is one of the fast growing areas and a runtime on YARN helps customers to have ML/DL workloads to run on same cluster where the ETL or other traditional big data workloads ingest or mine data. Faster release cadence can pace up the development for Submarine and more agile

[VOTE] Release Apache Hadoop 3.1.2 - RC1

2019-01-28 Thread Sunil G
Hi Folks, On behalf of Wangda, we have an RC1 for Apache Hadoop 3.1.2. The artifacts are available here: http://home.apache.org/~sunilg/hadoop-3.1.2-RC1/ The RC tag in git is release-3.1.2-RC1: https://github.com/apache/hadoop/commits/release-3.1.2-RC1 The maven artifacts are available via

[ANNOUNCE] Apache Hadoop 3.2.0 release

2019-01-22 Thread Sunil G
Greetings all, It gives me great pleasure to announce that the Apache Hadoop community has voted to release Apache Hadoop 3.2.0. Apache Hadoop 3.2.0 is the first release of Apache Hadoop 3.2 line for the year 2019, which includes 1092 fixes since previous Hadoop 3.1.0 release. Of these fixes:

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

2019-01-16 Thread Sunil G
Thanks everyone for helping to vote this release! With 7 binding votes, 10 non-binding votes and no veto, this vote stands passed, I'm going to work on staging the release. Thanks, Sunil On Tue, Jan 15, 2019 at 9:59 PM Weiwei Yang wrote: > +1 (binding) > > - Setup a cluster, run

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

2019-01-15 Thread Sunil G
ces [1] >>> 4. Executed basic HDFS commands >>> 5. Executed basic yarn example jobs >>> >>> Marton >>> >>> [1]: FTR: resources: >>> https://github.com/flokkr/k8s/tree/master/examples/hadoop , generator: >>> https://github.com

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

2019-01-12 Thread Sunil G
harder >> to work with hadoop packages; beacuse of the missing source attachments. >> >> example artifact which misses the sources: >> >> https://repository.apache.org/content/repositories/orgapachehadoop-1178/org/apache/hadoop/hadoop-mapreduce-client-core/3.2.0/ >> >> ch

[VOTE] Release Apache Hadoop 3.2.0 - RC1

2019-01-08 Thread Sunil G
Hi folks, Thanks to all of you who helped in this release [1] and for helping to vote for RC0. I have created second release candidate (RC1) for Apache Hadoop 3.2.0. Artifacts for this RC are available here: http://home.apache.org/~sunilg/hadoop-3.2.0-RC1/ RC tag in git is

Re: Hadoop 3.2 Release Plan proposal

2019-01-06 Thread Sunil G
Hi Folks, Given all blockers are closed now, I am planning to do RC1 tomorrow. branch-3.2.0 remains closed for commit. Please let me know if any issues are missed. Thanks, Sunil G On Tue, Nov 13, 2018 at 8:11 PM Sunil G wrote: > Hi Folks, > > All blockers are closed by las

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-29 Thread Sunil G
ases. For > example, when I change > yarn.scheduler.capacity.root.default.disable_preemption, it doesn't take > effect unless I restart the RM. > > I am still investigating, but I thought I should bring this up asap. > > Thanks, > -Eric > > > > > On Friday, No

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-28 Thread Sunil G
.default.disable_preemption, it doesn't take > effect unless I restart the RM. > > I am still investigating, but I thought I should bring this up asap. > > Thanks, > -Eric > > > > > On Friday, November 23, 2018, 6:07:04 AM CST, Sunil G > wrote: > > > >

[VOTE] Release Apache Hadoop 3.2.0 - RC0

2018-11-23 Thread Sunil G
Hi folks, Thanks to all contributors who helped in this release [1]. I have created first release candidate (RC0) for Apache Hadoop 3.2.0. Artifacts for this RC are available here: http://home.apache.org/~sunilg/hadoop-3.2.0-RC0/ RC tag in git is release-3.2.0-RC0. The maven artifacts

Re: Hadoop 3.2 Release Plan proposal

2018-11-13 Thread Sunil G
: > Another thing is that I see a bunch of jiras under HDFS-8707, which don't > have the Fix Version field listing 3.2, some have it just empty. > This means they will not be populated into release notes. > > Thanks, > --Konstantin > > On Thu, Oct 25, 2018 at 7:59 AM Sunil G wrote:

Re: Run Distributed TensorFlow on YARN

2018-11-06 Thread Sunil G
Hi Robert {Submarine} project helps to run Distributed Tensorflow on top of YARN with ease. YARN-8220 was an early attempt to do the same with some scripts etc, but Submarine will help to avoid all such custom scripts etc, and rather can simply

3.2.0 branch is closed for commits

2018-11-05 Thread Sunil G
Hi All, All blockers are closed for 3.2.0 as of now and RC is getting prepared. Hence 3.2.0 branch closed for commits. Please use branch-3.2 for any commit and set fixed version as 3.2.1 Thanks, Sunil

Re: Hadoop 3.2 Release Plan proposal

2018-10-25 Thread Sunil G
with this feature. > > Thanks, > --Konstantin > > On Mon, Oct 22, 2018 at 5:01 AM Steve Loughran > wrote: > >> its in. >> >> good catch! >> >> On 20 Oct 2018, at 01:35, Wei-Chiu Chuang > weic...@cloudera.com>> wrote: >> >> Thanks Suni

Re: Hadoop 3.2 Release Plan proposal

2018-10-18 Thread Sunil G
Hi Folks, As we previously communicated for 3.2.0 release, we have delayed due to few blockers in our gate. I just cut branch-3.2.0 for release purpose. branch-3.2 will be open for all bug fixes. - Sunil On Tue, Oct 16, 2018 at 8:59 AM Sunil G wrote: > Hi Folks, > > We are now cl

Re: Hadoop 3.2 Release Plan proposal

2018-10-15 Thread Sunil G
, 2018 at 11:43 PM Jonathan Bender wrote: > Hello, were there any updates around the 3.2.0 RC timing? All I see in the > current blockers are related to the new Submarine subproject, wasn't sure > if that is what is holding things up. > > Cheers, > Jon > > On Tue, Oct 2, 2018 at

Re: Hadoop 3.2 Release Plan proposal

2018-10-02 Thread Sunil G
t; > thanks > - Robert > > On Tue, Oct 2, 2018 at 11:44 AM Aaron Fabbri > wrote: > >> Trunk is not building for me.. Did you miss a 3.2.0-SNAPSHOT in the >> top-level pom.xml? >> >> >> On Tue, Oct 2, 2018 at 10:16 AM Sunil G wrote: >> >> >

Re: Hadoop 3.2 Release Plan proposal

2018-10-02 Thread Sunil G
Hi All As mentioned in earlier mail, I have cut branch-3.2 and reset trunk to 3.3.0-SNAPSHOT. I will share the RC details sooner once all necessary patches are pulled into branch-3.2. Thank You - Sunil On Mon, Sep 24, 2018 at 2:00 PM Sunil G wrote: > Hi All > > We are now down to

Re: Hadoop 3.2 Release Plan proposal

2018-09-24 Thread Sunil G
Hi All We are now down to the last Blocker and HADOOP-15407 is merged to trunk. Thanks for the support. *Plan for RC* 3.2 branch cut and reset trunk : *25th Tuesday* RC0 for 3.2: *28th Friday* Thank You Sunil On Mon, Sep 17, 2018 at 3:21 PM Sunil G wrote: > Hi All > > We are

Re: Hadoop 3.2 Release Plan proposal

2018-09-17 Thread Sunil G
Hi All We are down to 3 Blockers and 4 Critical now. Thanks all of you for helping in this. I am following up on these tickets, once its closed we will cut the 3.2 branch. Thanks Sunil Govindan On Wed, Sep 12, 2018 at 5:10 PM Sunil G wrote: > Hi All, > > Inline with the ori

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

2018-09-12 Thread Sunil G
Thanks Sean YARN-8768 is raised and we will get this in very soon. - Sunil On Wed, Sep 12, 2018 at 9:16 PM Sean Mackrory wrote: > `mvn install` fails on trunk right now due to javadoc error in yarn-api. Is > that related? If so, can we revert or fix ASAP please? > > On Wed, Sep 12, 2018 at

Re: Hadoop 3.2 Release Plan proposal

2018-09-12 Thread Sunil G
them to get in by Code Freeze date. [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, Critical) AND resolution = Unresolved AND "Target Version/s" = 3.2.0 ORDER BY priority DESC Thanks, Sunil On Thu, Aug 30, 2018 at 9:59 PM Sunil G wrote: > Hi All, > &

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

2018-09-06 Thread Sunil G
+1 for the merge. - Sunil On Wed, Sep 5, 2018 at 6:01 PM Naganarasimha Garla < naganarasimha...@apache.org> wrote: > Hi All, > Thanks for feedback folks, based on the positive response starting > a Vote thread for merging YARN-3409 to master. > > Regards, > + Naga & Sunil > > On Wed,

Re: [Discuss] Merge discussion for Node attribute support feature YARN-3409

2018-09-04 Thread Sunil G
+1 for merge. Quickly checked all basic test runs in the branch - Add/replace/remove of attributes work good. - scheduler can now handle attribute based placement constraints. - tested DS shell with various constructs like java=1.8, python!=3, AND/OR constraints etc. - Documentation on attributes

Re: HADOOP-14163 proposal for new hadoop.apache.org

2018-09-02 Thread Sunil G
+1. Looks really good. - Sunil On Mon, Sep 3, 2018 at 10:51 AM Vinayakumar B wrote: > +1, New site looks great. > > Just one nit in README > '--refresh' flag for hugo server no longer available. > > -Vinay > > On Mon, 3 Sep 2018, 10:21 am Shashikant Banerjee, < > sbaner...@hortonworks.com> >

Re: Hadoop 3.2 Release Plan proposal

2018-08-30 Thread Sunil G
Sunil On Tue, Aug 14, 2018 at 10:30 PM Sunil G wrote: > Hi All, > > Thanks for the feedbacks. Inline with earlier communication dated 17th > July 2018, I would like to provide some updates. > > We are approaching previously proposed feature freeze date (Aug 21, about > 7

Re: Hadoop 3.2 Release Plan proposal

2018-08-14 Thread Sunil G
ot;Target Version/s" = 3.2.0 ORDER BY priority DESC Thanks, Sunil On Fri, Jul 20, 2018 at 8:03 AM Sunil G wrote: > Thanks Subru for the thoughts. > One of the main reason for a major release is to push out critical > features with a faster cadence to the users. If we are pulling mo

Re: jira permission in the YARN tracker

2018-08-10 Thread Sunil G
Hi Sean I added your name in jira committer list so that you can have the permissions. - Sunil On Fri, Aug 10, 2018 at 8:14 PM Sean Busbey wrote: > Can someone please give me whatever role permissions are needed in the > YARN tracker so that I can alter fix versions? (I'm a Hadoop committer.)

Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0

2018-08-07 Thread Sunil G
Thanks Wangda for the initiative. +1 for this RC. I have tested this RC built from source file. - Also ran few MR apps and verified both new YARN UI and old RM UI. - Tested Application priority and timeout - Inter Queue and Intra Queue Preemption cases were also verified - Tested

Re: Hadoop 3.2 Release Plan proposal

2018-07-19 Thread Sunil G
sent in 3.0 etc. > > Additionally AFAIK 3.x has not been deployed in any major production > setting so the cost of adding features should be minimal. > > Thoughts? > > -Subru > > On Thu, Jul 19, 2018 at 12:31 AM, Sunil G wrote: > > > Thanks Steve, Aaron, Wangda f

Re: Hadoop 3.2 Release Plan proposal

2018-07-19 Thread Sunil G
n Wed, Jul 18, 2018 at 6:20 PM Aaron Fabbri > wrote: > >> On Tue, Jul 17, 2018 at 7:21 PM Steve Loughran >> wrote: >> >> > >> > >> > On 16 Jul 2018, at 23:45, Sunil G > > sun...@apache.org>> wrote: >> > >> > I would al

Hadoop 3.2 Release Plan proposal

2018-07-17 Thread Sunil G
Hi All, To continue a faster cadence of releases to accommodate more features, we could plan a Hadoop 3.2 release around August end. To start the process sooner, and to establish a timeline, I propose to target Hadoop 3.2.0 release by August end 2018. (About 1.5 months from now). I would

Re: [VOTE] reset/force push to clean up inadvertent merge commit pushed to trunk

2018-07-06 Thread Sunil G
Thanks. These patches are now restored. - Sunil On Fri, Jul 6, 2018 at 11:14 AM Vinod Kumar Vavilapalli wrote: > +1 > > Thanks > +Vinod > > > On Jul 6, 2018, at 11:12 AM, Sunil G wrote: > > I just checked. YARN-7556 and YARN-7451 can be cherry-picked. &g

Re: [VOTE] reset/force push to clean up inadvertent merge commit pushed to trunk

2018-07-06 Thread Sunil G
I just checked. YARN-7556 and YARN-7451 can be cherry-picked. I cherry-picked in my local and compiled. Things are good. I can push this now which will restore trunk to its original. I can do this if there are no objection. - Sunil On Fri, Jul 6, 2018 at 11:10 AM Arpit Agarwal wrote: >

Re: [VOTE] reset/force push to clean up inadvertent merge commit pushed to trunk

2018-07-06 Thread Sunil G
Yes these patches can be cherry-picked. git cherry-pick 17262470246232d0f0651d627a4961e55b1efe6a git cherry-pick 99febe7fd50c31c0f5dd40fa7f376f2c1f64f8c3 I will try this now and will compile. - Sunil On Fri, Jul 6, 2018 at 10:59 AM Giovanni Matteo Fumarola < giovanni.fumar...@gmail.com>

Re: [VOTE] reset/force push to clean up inadvertent merge commit pushed to trunk

2018-07-05 Thread Sunil G
+1 for this. - Sunil On Thu, Jul 5, 2018 at 2:37 PM Subru Krishnan wrote: > Folks, > > There was a merge commit accidentally pushed to trunk, you can find the > details in the mail thread [1]. > > I have raised an INFRA ticket [2] to reset/force push to clean up trunk. > > Can we have a quick

Re: Merge branch commit in trunk by mistake

2018-07-05 Thread Sunil G
I just see that this is reverted. commit 39ad98903a5f042573b97a2e5438bc57af7cc7a1 (origin/trunk, origin/HEAD) Author: Anu Engineer Date: Thu Jul 5 12:22:18 2018 -0700 Revert "Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk" This reverts commit

Re: Why are some Jenkins builds failing in Yarn-UI

2018-07-05 Thread Sunil G
Hi Steve I was recently looking into this failure and this is due to a repo hosting problem. It seems Bower team has deprecated old registry url https://bower.herokuapp.com and need to change registry url to https://registry.bower.io. YARN-8457 addressed this problem is backported till

[jira] [Created] (YARN-8293) In YARN Services UI, "User Name for service" should be completely removed in secure clusters

2018-05-15 Thread Sunil G (JIRA)
Sunil G created YARN-8293: - Summary: In YARN Services UI, "User Name for service" should be completely removed in secure clusters Key: YARN-8293 URL: https://issues.apache.org/jira/browse/YARN-8293

Re: [VOTE] Release Apache Hadoop 2.8.4 (RC0)

2018-05-14 Thread Sunil G
+1 (binding) 1. Build package from src 2. Ran few MR jobs and verified checked App Priority cases 3. Node Label basic functions are ok. Thanks Sunil On Tue, May 8, 2018 at 11:11 PM 俊平堵 wrote: > Hi all, > I've created the first release candidate (RC0) for Apache

Re: Apache Hadoop 3.1.1 release plan

2018-05-10 Thread Sunil G
Thanks Brahma. Yes, Billie is reviewing YARN-8265 and I am helping in YARN-8236. - Sunil On Thu, May 10, 2018 at 2:25 PM Brahma Reddy Battula < brahmareddy.batt...@huawei.com> wrote: > Thanks Wangda Tan for driving the 3.1.1 release.Yes,This can be better > addition to 3.1 line release for

[jira] [Created] (YARN-8260) [UI2] Per-application tracking URL is no longer available in YARN UI2

2018-05-08 Thread Sunil G (JIRA)
Sunil G created YARN-8260: - Summary: [UI2] Per-application tracking URL is no longer available in YARN UI2 Key: YARN-8260 URL: https://issues.apache.org/jira/browse/YARN-8260 Project: Hadoop YARN

[jira] [Created] (YARN-8258) [UI2] New UI webappcontext should inherit all filters from default context

2018-05-08 Thread Sunil G (JIRA)
Sunil G created YARN-8258: - Summary: [UI2] New UI webappcontext should inherit all filters from default context Key: YARN-8258 URL: https://issues.apache.org/jira/browse/YARN-8258 Project: Hadoop YARN

[jira] [Created] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-04 Thread Sunil G (JIRA)
Sunil G created YARN-8249: - Summary: Few REST api's in RMWebServices are missing static user check Key: YARN-8249 URL: https://issues.apache.org/jira/browse/YARN-8249 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8239) [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI

2018-05-01 Thread Sunil G (JIRA)
Sunil G created YARN-8239: - Summary: [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI Key: YARN-8239 URL: https://issues.apache.org/jira/browse/YARN-8239 Project

[jira] [Created] (YARN-8238) [Umbrella] YARN deep learning framework examples to run on native service

2018-04-30 Thread Sunil G (JIRA)
Sunil G created YARN-8238: - Summary: [Umbrella] YARN deep learning framework examples to run on native service Key: YARN-8238 URL: https://issues.apache.org/jira/browse/YARN-8238 Project: Hadoop YARN

[jira] [Created] (YARN-8237) mxnet yarn spec file to add to native service examples

2018-04-30 Thread Sunil G (JIRA)
Sunil G created YARN-8237: - Summary: mxnet yarn spec file to add to native service examples Key: YARN-8237 URL: https://issues.apache.org/jira/browse/YARN-8237 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-8236) Invalid kerberos principal file name cause NPE in native service

2018-04-29 Thread Sunil G (JIRA)
Sunil G created YARN-8236: - Summary: Invalid kerberos principal file name cause NPE in native service Key: YARN-8236 URL: https://issues.apache.org/jira/browse/YARN-8236 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8221) RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps

2018-04-26 Thread Sunil G (JIRA)
Sunil G created YARN-8221: - Summary: RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps Key: YARN-8221 URL: https://issues.apache.org/jira/browse/YARN-8221 Project: Hadoop YARN

[jira] [Created] (YARN-8220) Tensorflow yarn spec file to add to native service examples

2018-04-26 Thread Sunil G (JIRA)
Sunil G created YARN-8220: - Summary: Tensorflow yarn spec file to add to native service examples Key: YARN-8220 URL: https://issues.apache.org/jira/browse/YARN-8220 Project: Hadoop YARN Issue Type

[jira] [Resolved] (YARN-7956) [UI2] Avoid duplicating Components link under Services//Components

2018-04-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7956. --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.1 3.2.0 > [

[jira] [Created] (YARN-8189) [UI2] Nodes page column headers are half truncated

2018-04-20 Thread Sunil G (JIRA)
Sunil G created YARN-8189: - Summary: [UI2] Nodes page column headers are half truncated Key: YARN-8189 URL: https://issues.apache.org/jira/browse/YARN-8189 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-8125) YARNUIV2 does not failover from standby to active endpoint like previous YARN UI

2018-04-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-8125. --- Resolution: Not A Problem Pls reopen if there is still issue. > YARNUIV2 does not failover from stan

[jira] [Created] (YARN-8171) [UI2] AM Node link from attempt page should not redirect to new tab

2018-04-17 Thread Sunil G (JIRA)
Sunil G created YARN-8171: - Summary: [UI2] AM Node link from attempt page should not redirect to new tab Key: YARN-8171 URL: https://issues.apache.org/jira/browse/YARN-8171 Project: Hadoop YARN

[jira] [Created] (YARN-8119) [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX

2018-04-05 Thread Sunil G (JIRA)
Sunil G created YARN-8119: - Summary: [UI2] Timeline Server address' url scheme should be removed while accessing via KNOX Key: YARN-8119 URL: https://issues.apache.org/jira/browse/YARN-8119 Project: Hadoop

[jira] [Created] (YARN-8115) [UI2] URL data like nodeHTTPAddress must be encoded in UI before using for NM/ATS

2018-04-04 Thread Sunil G (JIRA)
Sunil G created YARN-8115: - Summary: [UI2] URL data like nodeHTTPAddress must be encoded in UI before using for NM/ATS Key: YARN-8115 URL: https://issues.apache.org/jira/browse/YARN-8115 Project: Hadoop YARN

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-02 Thread Sunil G
+1 (binding) On Mon 2 Apr, 2018, 12:24 Sunil G, <sun...@apache.org> wrote: > Thanks Wangda for initiating the release. > > I tested this RC built from source file. > > >- Tested MR apps (sleep, wc) and verified both new YARN UI and old RM >UI. >

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-02 Thread Sunil G
Thanks Wangda for initiating the release. I tested this RC built from source file. - Tested MR apps (sleep, wc) and verified both new YARN UI and old RM UI. - Below feature sanity is done - Application priority - Application timeout - Intra Queue preemption with priority

[jira] [Created] (YARN-8068) Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish

2018-03-23 Thread Sunil G (JIRA)
Sunil G created YARN-8068: - Summary: Upgrading apps from Hadoop 2.7 based clients to 2.8+ cause NPE in app timeline publish Key: YARN-8068 URL: https://issues.apache.org/jira/browse/YARN-8068 Project: Hadoop

[jira] [Created] (YARN-8040) [UI2] yarn new ui web-app does not respect current pathname for REST api

2018-03-16 Thread Sunil G (JIRA)
Sunil G created YARN-8040: - Summary: [UI2] yarn new ui web-app does not respect current pathname for REST api Key: YARN-8040 URL: https://issues.apache.org/jira/browse/YARN-8040 Project: Hadoop YARN

[jira] [Created] (YARN-7993) [UI2] yarn-service page need to consider ServiceState to show stop/delete buttons

2018-03-01 Thread Sunil G (JIRA)
Sunil G created YARN-7993: - Summary: [UI2] yarn-service page need to consider ServiceState to show stop/delete buttons Key: YARN-7993 URL: https://issues.apache.org/jira/browse/YARN-7993 Project: Hadoop YARN

[jira] [Created] (YARN-7912) While launching Native Service app from UI, consider service owner name from user.name query parameter

2018-02-08 Thread Sunil G (JIRA)
Sunil G created YARN-7912: - Summary: While launching Native Service app from UI, consider service owner name from user.name query parameter Key: YARN-7912 URL: https://issues.apache.org/jira/browse/YARN-7912

[jira] [Resolved] (YARN-7770) Support for setting application priority for Distributed Shell jobs

2018-02-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7770. --- Resolution: Not A Bug > Support for setting application priority for Distributed Shell j

[jira] [Resolved] (YARN-7832) Logs page does not work for Running applications

2018-02-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7832. --- Resolution: Not A Problem Thanks [~yeshavora] for confirming, This is working fine with Combine System Metric

[jira] [Created] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-01-31 Thread Sunil G (JIRA)
Sunil G created YARN-7866: - Summary: [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit Key: YARN-7866 URL: https://issues.apache.org/jira/browse/YARN-7866 Project

[jira] [Resolved] (YARN-7802) [UI2] Application regex search did not work properly with app name

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7802. --- Resolution: Fixed Hadoop Flags: Reviewed Thanks [~Sreenath] > [UI2] Application regex search

[jira] [Created] (YARN-7863) Modify placement constraints to support node attributes

2018-01-30 Thread Sunil G (JIRA)
Sunil G created YARN-7863: - Summary: Modify placement constraints to support node attributes Key: YARN-7863 URL: https://issues.apache.org/jira/browse/YARN-7863 Project: Hadoop YARN Issue Type: Sub

[jira] [Created] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-30 Thread Sunil G (JIRA)
Sunil G created YARN-7862: - Summary: YARN native service REST endpoint needs user.name as query param Key: YARN-7862 URL: https://issues.apache.org/jira/browse/YARN-7862 Project: Hadoop YARN Issue

[jira] [Created] (YARN-7861) [UI2] Logs page shows duplicated containers with ATS

2018-01-30 Thread Sunil G (JIRA)
Sunil G created YARN-7861: - Summary: [UI2] Logs page shows duplicated containers with ATS Key: YARN-7861 URL: https://issues.apache.org/jira/browse/YARN-7861 Project: Hadoop YARN Issue Type: Bug

Re: [VOTE] Merge YARN-6592 feature branch to trunk

2018-01-26 Thread Sunil G
+1 - Sunil On Fri, Jan 26, 2018 at 8:58 PM Arun Suresh wrote: > Hello yarn-dev@ > > Based on the positive feedback from the DISCUSS thread [1], I'd like to > start a formal vote to merge YARN-6592 [2] to trunk. The vote will run for > 5 days, and will end Jan 31 7:30AM

Re: [DISCUSS] Merge YARN-6592 to trunk

2018-01-25 Thread Sunil G
+1. Thanks Arun. I did manual testing for check affinity and anti-affinity features with placement allocator. Also checked SLS to see any performance regression, and there are not much difference as Arun mentioned. Thanks all the folks for working on this. Kudos! - Sunil On Fri, Jan 26, 2018

[jira] [Created] (YARN-7795) Fix jenkins issues of YARN-6592 branch

2018-01-23 Thread Sunil G (JIRA)
Sunil G created YARN-7795: - Summary: Fix jenkins issues of YARN-6592 branch Key: YARN-7795 URL: https://issues.apache.org/jira/browse/YARN-7795 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-7794) SLSRunner is not loading timeline service jars causing failure

2018-01-23 Thread Sunil G (JIRA)
Sunil G created YARN-7794: - Summary: SLSRunner is not loading timeline service jars causing failure Key: YARN-7794 URL: https://issues.apache.org/jira/browse/YARN-7794 Project: Hadoop YARN Issue

[jira] [Created] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
Sunil G created YARN-7792: - Summary: Merge work for YARN-6592 Key: YARN-7792 URL: https://issues.apache.org/jira/browse/YARN-7792 Project: Hadoop YARN Issue Type: Sub-task Reporter

[jira] [Created] (YARN-7753) [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2

2018-01-15 Thread Sunil G (JIRA)
Sunil G created YARN-7753: - Summary: [UI2] Application logs has to be pulled from ATS 1.5 instead of ATS2 Key: YARN-7753 URL: https://issues.apache.org/jira/browse/YARN-7753 Project: Hadoop YARN

[jira] [Created] (YARN-7699) queueUsagePercentage is coming as INF for getApp REST api call

2018-01-04 Thread Sunil G (JIRA)
Sunil G created YARN-7699: - Summary: queueUsagePercentage is coming as INF for getApp REST api call Key: YARN-7699 URL: https://issues.apache.org/jira/browse/YARN-7699 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-7684) The Total Memory and VCores display in the yarn UI is not correct with labeled node

2018-01-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7684. --- Resolution: Won't Fix This is already covered in 2.8+ version. YARN-4484 could be backported to 2.7 as needed

[jira] [Created] (YARN-7666) Introduce scheduler specific environment variable support in ASC for better scheduling placement configurations

2017-12-18 Thread Sunil G (JIRA)
Sunil G created YARN-7666: - Summary: Introduce scheduler specific environment variable support in ASC for better scheduling placement configurations Key: YARN-7666 URL: https://issues.apache.org/jira/browse/YARN-7666

Re: Apache YARN Committers & Contributors Meetup #5

2017-12-14 Thread Sunil G
-Hadoop-Meetups/events/245123037/ Thanks once again to all folks who joined. We will plan a Bug Bash in same timeline when Meetup #5 is going to happen at CA. Warm Regards, Sunil G On Sat, Dec 2, 2017 at 3:55 AM Daniel Templeton <dan...@cloudera.com> wrote: > And thanks to Vinod we

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread Sunil G
TestCapacitySchedulerPerf#testUserLimitThroughputForTwoResources. Results are a bit off w.r.t 2.8 (~5% less). I will open a ticket and investigate by doing more tests to see if its to be addressed or not. - Sunil G On Sat, Dec 9, 2017 at 2:01 AM Andrew Wang <andrew.w...@cloudera.com> wrote: &g

[jira] [Created] (YARN-7651) branch-2 application master (MR) cannot run in 3.1 cluster

2017-12-13 Thread Sunil G (JIRA)
Sunil G created YARN-7651: - Summary: branch-2 application master (MR) cannot run in 3.1 cluster Key: YARN-7651 URL: https://issues.apache.org/jira/browse/YARN-7651 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-7650) Queue link in old RM UI is not working correctly when node labels are enabled

2017-12-13 Thread Sunil G (JIRA)
Sunil G created YARN-7650: - Summary: Queue link in old RM UI is not working correctly when node labels are enabled Key: YARN-7650 URL: https://issues.apache.org/jira/browse/YARN-7650 Project: Hadoop YARN

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

2017-12-13 Thread Sunil G
NodeLabel scenarios. - Added some labels to couple of nodes - Verified old UI for labels - Submitted apps to labelled cluster and it works fine. - Also performed few cli commands related to nodelabel - Test basic HA cases Thanks Sunil G On Tue, Dec 5, 2017 at 3:28 PM

[jira] [Created] (YARN-7640) Retrospect to enable CORS related configs by default in YARN

2017-12-12 Thread Sunil G (JIRA)
Sunil G created YARN-7640: - Summary: Retrospect to enable CORS related configs by default in YARN Key: YARN-7640 URL: https://issues.apache.org/jira/browse/YARN-7640 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-7637) GPU volume creation command fails when work preserving is disabled at NM

2017-12-11 Thread Sunil G (JIRA)
Sunil G created YARN-7637: - Summary: GPU volume creation command fails when work preserving is disabled at NM Key: YARN-7637 URL: https://issues.apache.org/jira/browse/YARN-7637 Project: Hadoop YARN

[jira] [Created] (YARN-7635) TestRMWebServicesSchedulerActivities fails in trunk

2017-12-09 Thread Sunil G (JIRA)
Sunil G created YARN-7635: - Summary: TestRMWebServicesSchedulerActivities fails in trunk Key: YARN-7635 URL: https://issues.apache.org/jira/browse/YARN-7635 Project: Hadoop YARN Issue Type: Bug

Re: [VOTE] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-12-07 Thread Sunil G
Thank You all. We merged the branch to trunk and updated jiras accordingly. Thanks everyone who helped in this feature. - Sunil and Wangda On Thu, Dec 7, 2017 at 10:13 PM Sunil G <sun...@apache.org> wrote: > And lastly +1 (binding) from myself. > Vote passes with 6 (

Re: [VOTE] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-12-07 Thread Sunil G
.org> wrote: > >> +1 >> >> On Nov 30, 2017 7:26 AM, "Sunil G" <sun...@apache.org> wrote: >> >> > Hi All, >> > >> > >> > Based on the discussion at [1], I'd like to start a vote to merge >> feature >> >

[jira] [Resolved] (YARN-7092) Render application specific log under application tab in new YARN UI

2017-12-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7092. --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Thanks [~akhilpb] for working

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-30 Thread Sunil G
00, Rohith Sharma K S < >> rohithsharm...@apache.org>, wrote: >> +1, thanks Sunil for working on this feature! >> >> -Rohith Sharma K S >> >> On 24 November 2017 at 23:19, Sunil G <sun...@apache.org> wrote: >> >> Hi All, >>

[VOTE] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Sunil G
Hi All, Based on the discussion at [1], I'd like to start a vote to merge feature branch YARN-5881 to trunk. Vote will run for 7 days, ending Wednesday Dec 6 at 6:00PM PDT. This branch adds support to configure queue capacity as absolute resource in capacity scheduler. This will help admins

Re: [DISCUSS] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-11-29 Thread Sunil G
any more even though it has pending resources. > > Thanks,Eric > > > From: Sunil G <sun...@apache.org> > To: "yarn-dev@hadoop.apache.org" <yarn-dev@hadoop.apache.org>; Hadoop > Common <common-...@hadoop.apache.org>; Hdfs-dev < > hdfs-...@h

[jira] [Created] (YARN-7573) Gpu Information page could be empty for nodes without GPU

2017-11-28 Thread Sunil G (JIRA)
Sunil G created YARN-7573: - Summary: Gpu Information page could be empty for nodes without GPU Key: YARN-7573 URL: https://issues.apache.org/jira/browse/YARN-7573 Project: Hadoop YARN Issue Type

  1   2   3   >