[ 
https://issues.apache.org/jira/browse/HADOOP-12916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiaoyu Yao updated HADOOP-12916:
--------------------------------
    Attachment: HADOOP-12916.00.patch

Attach a patch that 
1) Separate the scheduler interface and implementation from FCQ
2) Allow DecayRpcScheduler to collect window based per priority level response 
time metrics. 
3) Allow optional backoff based on per priority level response time target 
based backoff. 
4) Additional unit test for response time target based backoff. 
5) Additional unit test to ensure backward compatibility for current FCQ 
deployment

With this refactor, the FCQ is purely a weighted priority call queue and the 
DecayRpcScheduler is a fairness scheduler based on the callers' call count. The 
weight priority call queue can be plugged with other priority based scheduler 
for Qos. 

> Allow different Hadoop IPC Call Queue throttling policies with FCQ/BackOff
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-12916
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12916
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: ipc
>            Reporter: Xiaoyu Yao
>            Assignee: Xiaoyu Yao
>         Attachments: HADOOP-12916.00.patch
>
>
> Currently back off policy from HADOOP-10597 is hard coded to base on whether 
> call queue is full. This ticket is open to allow flexible back off policies 
> such as moving average of response time in RPC calls of different priorities. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to