[jira] [Comment Edited] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206825#comment-16206825 ] Yufei Gu edited comment on YARN-4859 at 10/17/17 12:58 AM: --- [~asuresh], thanks for the explanation. I tested either drf and fair policy. Both works. The trick is to set reservation-request vcores to zero for fair policy queues. This is due to the reservation calculation is based on steady fair share, whose vcores always be zero for fair policy queues. We could do some improvement, like ignoring the vcores if the request is for fair policy queues. Probably create another JIRA for this. [~subru], I tested creating reservation and submitting a job with the reservation id, it works without YARN-7311. We still need to fix the "root.root" queue issue though. But "root.root" queue issue should be considered as a reservation bug, neither a blocker. Therefore, we can close this one. Besides that, YARN-7311 should be considered as a blocker. Could you spare time to review it? Thanks. was (Author: yufeigu): [~asuresh], thanks for the explanation. I tested either drf and fair policy. Both works. The trick is to set reservation-request vcores to zero for fair policy queues. This is due to the reservation calculation is based on steady fair share, whose vcores always be zero for fair policy queues. We could do some improvement, like ignoring the vcores if the request is for fair policy queues. Probably create another JIRA for this. [~subru], I tested creating reservation and submitting a job with the reservation id, it works without YARN-7311. We still need to fix the "root.root" queue issue though. I'll post the patch later. Besides that, YARN-7311 should be considered as a blocker as well. Could you spare time to review it? Thanks. > [Bug] Unable to submit a job to a reservation when using FairScheduler > -- > > Key: YARN-4859 > URL: https://issues.apache.org/jira/browse/YARN-4859 > Project: Hadoop YARN > Issue Type: Sub-task > Components: fairscheduler >Reporter: Subru Krishnan >Assignee: Yufei Gu >Priority: Blocker > Attachments: Screen Shot 2017-10-16 at 17.27.48.png > > > Jobs submitted to a reservation get stuck at scheduled stage when using > FairScheduler. I came across this when working on YARN-4827 (documentation > for configuring ReservationSystem for FairScheduler) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206521#comment-16206521 ] Arun Suresh edited comment on YARN-4859 at 10/16/17 8:05 PM: - Sorry to chime in late [~yufeigu], but If you are testing this, please note: I don't know if it is documented anywhere, but reservations will only work in FS queues which are configured with DRF policy (alteast this was the case when I testing this last year) was (Author: asuresh): Sorry to chime in late [~yufeigu], but If you are testing this, please note: I don't know if it is documented anywhere, but reservations will work in FS queues which are configured with DRF policy (alteast this was the case when I testing this last year) > [Bug] Unable to submit a job to a reservation when using FairScheduler > -- > > Key: YARN-4859 > URL: https://issues.apache.org/jira/browse/YARN-4859 > Project: Hadoop YARN > Issue Type: Sub-task > Components: fairscheduler >Reporter: Subru Krishnan >Assignee: Yufei Gu >Priority: Blocker > > Jobs submitted to a reservation get stuck at scheduled stage when using > FairScheduler. I came across this when working on YARN-4827 (documentation > for configuring ReservationSystem for FairScheduler) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202837#comment-16202837 ] Yufei Gu edited comment on YARN-4859 at 10/13/17 12:03 AM: --- [~subru], I found a bug in reservation system for FS and post patch in YARN-7311. The bug may prevent users from submit/update/list reservation for FS as long as they use short queue name. It is a small change. Could you please have a look at it? Is that the same issue you met? was (Author: yufeigu): [~subru], I found a bug in reservation system for FS and post patch in YARN-7311. It is a small change. Could you please have a look at it? Is that the same issue you met? > [Bug] Unable to submit a job to a reservation when using FairScheduler > -- > > Key: YARN-4859 > URL: https://issues.apache.org/jira/browse/YARN-4859 > Project: Hadoop YARN > Issue Type: Sub-task > Components: fairscheduler >Reporter: Subru Krishnan >Assignee: Yufei Gu >Priority: Blocker > > Jobs submitted to a reservation get stuck at scheduled stage when using > FairScheduler. I came across this when working on YARN-4827 (documentation > for configuring ReservationSystem for FairScheduler) -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
