[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: (was: subtask1.3.patch)
> Refactor to make CallQueue pluggable
>
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: (was: subtask1.4.patch)
> Refactor to make CallQueue pluggable
>
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: HADOOP-10278-atomicref.patch
Sure thing, patch updated with atomicref version
Potential
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890056#comment-13890056
]
Chris Li commented on HADOOP-10278:
---
[~daryn]
Implemented and benchmarked it. All aro
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13889798#comment-13889798
]
Chris Li commented on HADOOP-10278:
---
That's an interesting thought, I do like that it
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: HADOOP-10278.patch
Uploaded HADOOP-10278.patch
Removes whitespace at end of lines
> Ref
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: subtask1.5.patch
Patch generated with
git format-patch trunk --stdout --no-prefix --ign
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: subtask1.4.patch
Removed redundant methods on CallQueue
> Refactor to make CallQueue plu
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13888374#comment-13888374
]
Chris Li commented on HADOOP-10278:
---
Sounds good, I'll update the patch
> Refactor to
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13888305#comment-13888305
]
Chris Li commented on HADOOP-10278:
---
I've done so for flexibility–the later patch
htt
[
https://issues.apache.org/jira/browse/HADOOP-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10285:
--
Status: Patch Available (was: Open)
> Allow CallQueue impls to be swapped at runtime (part 2: admin
[
https://issues.apache.org/jira/browse/HADOOP-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10285:
--
Attachment: subtask3_admin_interface.patch
Users can swap the queue by running
hadoop dfsadmin -refr
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13884803#comment-13884803
]
Chris Li commented on HADOOP-10278:
---
I've uploaded a patch for https://issues.apache.o
[
https://issues.apache.org/jira/browse/HADOOP-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10285:
--
Summary: Allow CallQueue impls to be swapped at runtime (part 2: admin
interface) Depends on: subtask
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: (was: subtask1.2.patch)
> Refactor to make CallQueue pluggable
>
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: (was: subtask1.patch)
> Refactor to make CallQueue pluggable
> --
[
https://issues.apache.org/jira/browse/HADOOP-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10302:
--
Status: Patch Available (was: Open)
> Allow CallQueue impls to be swapped at runtime (part 1: intern
[
https://issues.apache.org/jira/browse/HADOOP-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10302:
--
Summary: Allow CallQueue impls to be swapped at runtime (part 1: internals)
Depends on: subtask1 (wa
[
https://issues.apache.org/jira/browse/HADOOP-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10302:
--
Attachment: (was: subtask2_runtime_swap_internal.patch)
> Allow CallQueue impls to be swapped at
[
https://issues.apache.org/jira/browse/HADOOP-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10302:
--
Attachment: subtask2_runtime_swap_internal.patch
> Allow CallQueue impls to be swapped at runtime (pa
[
https://issues.apache.org/jira/browse/HADOOP-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10302:
--
Attachment: subtask2_runtime_swap_internal.patch
Depends on subtask1
Swapping is done through the re
[
https://issues.apache.org/jira/browse/HADOOP-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10302:
--
Description:
We wish to swap the active call queue during runtime in order to do performance
tuning
[
https://issues.apache.org/jira/browse/HADOOP-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10285:
--
Summary: Allow CallQueue impls to be swapped at runtime (part 2: admin
interface) (was: Allow CallQu
Chris Li created HADOOP-10302:
-
Summary: Allow CallQueue impls to be swapped at runtime (part 1:
internals)
Key: HADOOP-10302
URL: https://issues.apache.org/jira/browse/HADOOP-10302
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10285:
--
Description:
We wish to swap the active call queue during runtime in order to do performance
tuning
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13884720#comment-13884720
]
Chris Li commented on HADOOP-10278:
---
Thanks for checking it out.
1. In a later patch
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13884494#comment-13884494
]
Chris Li commented on HADOOP-10278:
---
Hi [~daryn],
Could you take a look please?
Than
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: subtask1.3.patch
> Refactor to make CallQueue pluggable
> ---
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: subtask1.2.patch
Update tests to fix javac warnings
> Refactor to make CallQueue pluggab
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881614#comment-13881614
]
Chris Li commented on HADOOP-9640:
--
I've uploaded the first of the patches to
https://i
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: subtask1.patch
As per [~daryn]'s suggestions, this patch retains the original interface o
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881571#comment-13881571
]
Chris Li commented on HADOOP-9640:
--
[~daryn]
Thanks for your feedback.
Some points of
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: (was: subtask_refactor_callqueue2.patch)
> Refactor to make CallQueue pluggable
> ---
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: (was: subtask_refactor_callqueue.patch)
> Refactor to make CallQueue pluggable
>
[
https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10281:
--
Attachment: subtask4_scheduler.patch
The scheduler assigns schedulables a priority level based the pa
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: (was: subtask_refactor_callqueue3.patch)
> Refactor to make CallQueue pluggable
> ---
[
https://issues.apache.org/jira/browse/HADOOP-10280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10280:
--
Attachment: subtask3_schedulable_identities.patch
Allow Schedulables to be queried for identity, whic
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: subtask_refactor_callqueue3.patch
This version doesn't include an irrelevant test
> Refa
[
https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10279:
--
Status: Patch Available (was: Open)
> Create multiplexer, a requirement for the fair queue
> ---
[
https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10279:
--
Attachment: subtask2_add_mux.patch
Depends on subtask1: This multiplexer enables takers of the FairCa
Chris Li created HADOOP-10286:
-
Summary: Allow RPCCallBenchmark to benchmark calls by different
users
Key: HADOOP-10286
URL: https://issues.apache.org/jira/browse/HADOOP-10286
Project: Hadoop Common
Chris Li created HADOOP-10284:
-
Summary: Add metrics to the HistoryRpcScheduler
Key: HADOOP-10284
URL: https://issues.apache.org/jira/browse/HADOOP-10284
Project: Hadoop Common
Issue Type: Sub-ta
Chris Li created HADOOP-10285:
-
Summary: Allow CallQueue impls to be swapped at runtime
Key: HADOOP-10285
URL: https://issues.apache.org/jira/browse/HADOOP-10285
Project: Hadoop Common
Issue Type
Chris Li created HADOOP-10283:
-
Summary: Add metrics to the FairCallQueue
Key: HADOOP-10283
URL: https://issues.apache.org/jira/browse/HADOOP-10283
Project: Hadoop Common
Issue Type: Sub-task
Chris Li created HADOOP-10282:
-
Summary: Create a FairCallQueue: a multi-level call queue which
schedules incoming calls and multiplexes outgoing calls
Key: HADOOP-10282
URL: https://issues.apache.org/jira/browse/HADO
Chris Li created HADOOP-10281:
-
Summary: Create a scheduler, which assigns schedulables a priority
level
Key: HADOOP-10281
URL: https://issues.apache.org/jira/browse/HADOOP-10281
Project: Hadoop Common
Chris Li created HADOOP-10280:
-
Summary: Make Schedulables return a configurable identity of user
or group
Key: HADOOP-10280
URL: https://issues.apache.org/jira/browse/HADOOP-10280
Project: Hadoop Common
Chris Li created HADOOP-10279:
-
Summary: Create multiplexer, a requirement for the fair queue
Key: HADOOP-10279
URL: https://issues.apache.org/jira/browse/HADOOP-10279
Project: Hadoop Common
Issu
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: subtask_refactor_callqueue2.patch
This version has the unit tests and doesn't accidentall
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: (was: subtask_refactor_callqueue2.patch)
> Refactor to make CallQueue pluggable
> ---
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: subtask_refactor_callqueue2.patch
This version has the unit tests
> Refactor to make Cal
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Attachment: subtask_refactor_callqueue.patch
> Refactor to make CallQueue pluggable
> ---
[
https://issues.apache.org/jira/browse/HADOOP-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-10278:
--
Status: Patch Available (was: Open)
> Refactor to make CallQueue pluggable
> ---
Chris Li created HADOOP-10278:
-
Summary: Refactor to make CallQueue pluggable
Key: HADOOP-10278
URL: https://issues.apache.org/jira/browse/HADOOP-10278
Project: Hadoop Common
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881465#comment-13881465
]
Chris Li commented on HADOOP-9640:
--
[~kihwal] In the first 6 versions of this patch, thi
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: faircallqueue7_with_runtime_swapping.patch
Attached preview of patch that enables swapping t
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13868553#comment-13868553
]
Chris Li commented on HADOOP-9640:
--
I'd like to get people's thoughts on a new feature:
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: faircallqueue6.patch
Uploaded new patch that adds configurable Call identity used for schedu
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13844743#comment-13844743
]
Chris Li commented on HADOOP-9640:
--
bq. Add a new configuration in common called "hadoop
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: faircallqueue5.patch
Updated patch to target trunk
> RPC Congestion Control with FairCallQu
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: faircallqueue4.patch
Added new version
> RPC Congestion Control with FairCallQueue
> --
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: faircallqueue3.patch
Update patch to target latest trunk
> RPC Congestion Control with Fair
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: faircallqueue2.patch
[~daryn] Definitely, this new patch is pluggable so that it defaults to
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: MinorityMajorityPerformance.pdf
Uploaded preview of performance with 2 users–one normal and
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Summary: RPC Congestion Control with FairCallQueue (was: RPC Congestion
Control)
> RPC Congestion Cont
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Description:
Several production Hadoop cluster incidents occurred where the Namenode was
overloaded and
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13838507#comment-13838507
]
Chris Li commented on HADOOP-9640:
--
Thanks for the look, Andrew.
bq. Parsing the MapRed
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: NN-denial-of-service-updated-plan.pdf
Updated design doc. New design could be described as F
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: (was: Screen Shot 2013-11-18 at 2.54.19 PM.png)
> RPC Congestion Control
> -
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: Screen Shot 2013-11-18 at 2.54.19 PM.png
Performance on my dev machine.
> RPC Congestion Co
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Attachment: faircallqueue.patch
Combats congestion via RPC-level priority
> RPC Congestion Control
> --
[
https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Li updated HADOOP-9640:
-
Labels: hdfs qos rpc (was: )
Target Version/s: 3.0.0
Affects Version/s: 3.0.0
201 - 272 of 272 matches
Mail list logo