[ 
https://issues.apache.org/jira/browse/KUDU-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mostafa Mokhtar updated KUDU-2355:
----------------------------------
    Summary: Uneven assignment of work across Maintenance Mgr threads  (was: 
Uneven assignment of work across )

> Uneven assignment of work across Maintenance Mgr threads
> --------------------------------------------------------
>
>                 Key: KUDU-2355
>                 URL: https://issues.apache.org/jira/browse/KUDU-2355
>             Project: Kudu
>          Issue Type: Bug
>    Affects Versions: 1.8.0
>            Reporter: Mostafa Mokhtar
>            Priority: Major
>
> While running inserts into a Kudu table I noticed that there is an uneven 
> assignment of work across maintenance threads, this reduces scalability of 
> the maintenance as more threads won't always mean better throughput. 
> |Thread name||        Cumulative User CPU(s)||        Cumulative Kernel 
> CPU(s)        ||Cumulative IO-wait(s)|
> |MaintenanceMgr [worker]-59102|       3410.94|        352.07| 866.71|
> |MaintenanceMgr [worker]-59101|       3056.77|        319.32| 794.1|
> |MaintenanceMgr [worker]-59100|       2924.29|        300.35| 831.66|
> |MaintenanceMgr [worker]-59099|       3021.22|        307.3| 783.84|
> |MaintenanceMgr [worker]-59098|       2174.47|        216.55| 716|
> |MaintenanceMgr [worker]-59097|       3240.47|        335.55| 846.99|
> |MaintenanceMgr [worker]-59096|       2206.57|        218.63| 752.62|
> |MaintenanceMgr [worker]-59095|       2112.76|        210.93| 720.67|
> Snapshot from top
> {code}
>    PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>  59102 kudu      20   0 25.3g  15g  11m R 105.0  6.1  64:42.20 MaintenanceMgr
>  59097 kudu      20   0 25.3g  15g  11m R 101.7  6.1  61:15.90 MaintenanceMgr
>  59096 kudu      20   0 25.3g  15g  11m R 98.4  6.1  42:12.19 MaintenanceMgr
>  59098 kudu      20   0 25.3g  15g  11m R 98.4  6.1  41:53.22 MaintenanceMgr
>  59100 kudu      20   0 25.3g  15g  11m D 36.1  6.1  55:49.99 MaintenanceMgr
>  59095 kudu      20   0 25.3g  15g  11m D 29.5  6.1  40:34.79 MaintenanceMgr
>  59099 kudu      20   0 25.3g  15g  11m D  0.0  6.1  57:28.81 MaintenanceMgr
>  59101 kudu      20   0 25.3g  15g  11m D  0.0  6.1  58:03.63 MaintenanceMgr
> {code}
> This was found using 
> kudu 1.8.0-SNAPSHOT (rev e70c5ee0d6d598ba53d002ebfc7f81bb2ceda404)
> server uuid bd4cc6fdd79d4ebc8a4def27004b011d



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to