[jira] [Comment Edited] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010758#comment-17010758 ] Peter Bacsko edited comment on YARN-9698 at 1/8/20 3:21 PM: [~brahmareddy] the whole umbrella definitely won't be ready in the near future. However, we have some pending JIRAs which are possible candidates for 3.3.0: YARN-9879 - multiple leaf queues w/ same name YARN-9892 - support DRF on queue level YARN-10067 - dry run for the FS-CS tool YARN-9866 - CS queue mapping bugfix YARN-9868 - CS queue mapping bugfix Could you wait until these JIRAs are committed to trunk? What's the timeline for 3.3.0? was (Author: pbacsko): [~brahmareddy] the whole umbrella will definitely won't be ready in the near future. However, we have some pending JIRAs which are possible candidates for 3.3.0: YARN-9879 - multiple leaf queues w/ same name YARN-9892 - support DRF on queue level YARN-10067 - dry run for the FS-CS tool YARN-9866 - CS queue mapping bugfix YARN-9868 - CS queue mapping bugfix Could you wait until these JIRAs are committed to trunk? What's the timeline for 3.3.0? > [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler > > > Key: YARN-9698 > URL: https://issues.apache.org/jira/browse/YARN-9698 > Project: Hadoop YARN > Issue Type: Improvement > Components: capacity scheduler >Reporter: Weiwei Yang >Priority: Major > Labels: fs2cs > Attachments: FS-CS Migration.pdf > > > We see some users want to migrate from Fair Scheduler to Capacity Scheduler, > this Jira is created as an umbrella to track all related efforts for the > migration, the scope contains > * Bug fixes > * Add missing features > * Migration tools that help to generate CS configs based on FS, validate > configs etc > * Documents > this is part of CS component, the purpose is to make the migration process > smooth. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010758#comment-17010758 ] Peter Bacsko edited comment on YARN-9698 at 1/8/20 3:14 PM: [~brahmareddy] the whole umbrella will definitely won't be ready in the near future. However, we have some pending JIRAs which are possible candidates for 3.3.0: YARN-9879 - multiple leaf queues w/ same name YARN-9892 - support DRF on queue level YARN-10067 - dry run for the FS-CS tool YARN-9866 - CS queue mapping bugfix YARN-9868 - CS queue mapping bugfix Could you wait until these JIRAs are committed to trunk? What's the timeline for 3.3.0? was (Author: pbacsko): [~brahmareddy] the whole umbrella will definitely won't be ready in the near future. However, we have pending JIRAs which are possible candidates for 3.3.0: YARN-9879 - multiple leaf queues w/ same name YARN-9892 - support DRF on queue level YARN-10067 - dry run for the FS-CS tool YARN-9866 - CS queue mapping bugfix YARN-9868 - CS queue mapping bugfix Could you wait until these JIRAs are committed to trunk? What's the timeline for 3.3.0? > [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler > > > Key: YARN-9698 > URL: https://issues.apache.org/jira/browse/YARN-9698 > Project: Hadoop YARN > Issue Type: Improvement > Components: capacity scheduler >Reporter: Weiwei Yang >Priority: Major > Labels: fs2cs > Attachments: FS-CS Migration.pdf > > > We see some users want to migrate from Fair Scheduler to Capacity Scheduler, > this Jira is created as an umbrella to track all related efforts for the > migration, the scope contains > * Bug fixes > * Add missing features > * Migration tools that help to generate CS configs based on FS, validate > configs etc > * Documents > this is part of CS component, the purpose is to make the migration process > smooth. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010315#comment-17010315 ] Brahma Reddy Battula edited comment on YARN-9698 at 1/8/20 4:53 AM: [~cheersyang] I am planning for 3.3.0 Release( will share th plan on mailing list),This feature is marked to 3.3.0 release, can you guys update the plan..? was (Author: brahmareddy): [~cheersyang] I am planning for 3.3.0 Release,This feature is marked to 3.3.0 release, can you guys update the plan..? > [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler > > > Key: YARN-9698 > URL: https://issues.apache.org/jira/browse/YARN-9698 > Project: Hadoop YARN > Issue Type: Improvement > Components: capacity scheduler >Reporter: Weiwei Yang >Priority: Major > Labels: fs2cs > Attachments: FS-CS Migration.pdf > > > We see some users want to migrate from Fair Scheduler to Capacity Scheduler, > this Jira is created as an umbrella to track all related efforts for the > migration, the scope contains > * Bug fixes > * Add missing features > * Migration tools that help to generate CS configs based on FS, validate > configs etc > * Documents > this is part of CS component, the purpose is to make the migration process > smooth. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894910#comment-16894910 ] zhoukang edited comment on YARN-9698 at 7/29/19 3:51 AM: - Just a new feature [~wangda] We have implemented in our inner version was (Author: cane): Just a new feature [~wangda] > [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler > > > Key: YARN-9698 > URL: https://issues.apache.org/jira/browse/YARN-9698 > Project: Hadoop YARN > Issue Type: Improvement > Components: capacity scheduler >Reporter: Weiwei Yang >Priority: Major > Labels: fs2cs > > We see some users want to migrate from Fair Scheduler to Capacity Scheduler, > this Jira is created as an umbrella to track all related efforts for the > migration, the scope contains > * Bug fixes > * Add missing features > * Migration tools that help to generate CS configs based on FS, validate > configs etc > * Documents > this is part of CS component, the purpose is to make the migration process > smooth. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler
[
https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893744#comment-16893744
]
zhoukang edited comment on YARN-9698 at 7/26/19 11:37 AM:
--
How about the idea that support ACL proxy user in CapacityScheduler.
Explanation: submit an app use command as below
{code:java}
./bin/yarn jar ~/workspace/yarn/Test3.1/wordcount-1.0-SNAPSHOT.jar
com.xxx.xxx.WordCount -Dmapred.job.queue.name=user@default /tmp/input.dat
/tmp/output
{code}
[~cheersyang]
was (Author: cane):
How about the idea that support ACL proxy user in CapacityScheduler.
Explanation: submit an app use command below
{code:java}
./bin/yarn jar ~/workspace/yarn/Test3.1/wordcount-1.0-SNAPSHOT.jar
com.xxx.xxx.WordCount -Dmapred.job.queue.name=user@default /tmp/input.dat
/tmp/output
{code}
[~cheersyang]
> [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler
>
>
> Key: YARN-9698
> URL: https://issues.apache.org/jira/browse/YARN-9698
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
>Reporter: Weiwei Yang
>Priority: Major
> Labels: fs2cs
>
> We see some users want to migrate from Fair Scheduler to Capacity Scheduler,
> this Jira is created as an umbrella to track all related efforts for the
> migration, the scope contains
> * Bug fixes
> * Add missing features
> * Migration tools that help to generate CS configs based on FS, validate
> configs etc
> * Documents
> this is part of CS component, the purpose is to make the migration process
> smooth.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
