[jira] [Assigned] (HADOOP-12382) Add Documentation for FairCallQueue

2015-09-10 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li reassigned HADOOP-12382: - Assignee: Chris Li (was: Ajith S) > Add Documentation for FairCallQueue >

[jira] [Commented] (HADOOP-12382) Add Documentation for FairCallQueue

2015-09-08 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735624#comment-14735624 ] Chris Li commented on HADOOP-12382: --- I can do this, sometime later this week. I've assembled various

[jira] [Commented] (HADOOP-9640) RPC Congestion Control with FairCallQueue

2015-09-04 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731185#comment-14731185 ] Chris Li commented on HADOOP-9640: -- [~ajithshetty] Sure, what did you have in mind? > RPC Congestion

[jira] [Commented] (HADOOP-12189) CallQueueManager may drop elements from the queue sometimes when calling swapQueue

2015-07-09 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621175#comment-14621175 ] Chris Li commented on HADOOP-12189: --- Great, couple more minor things: Can we update

[jira] [Commented] (HADOOP-12189) CallQueueManager may drop elements from the queue sometimes when calling swapQueue

2015-07-09 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621482#comment-14621482 ] Chris Li commented on HADOOP-12189: --- Looks good to me. +1 CallQueueManager may drop

[jira] [Commented] (HADOOP-12189) CallQueueManager may drop elements from the queue sometimes when calling swapQueue

2015-07-08 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619255#comment-14619255 ] Chris Li commented on HADOOP-12189: --- [~arpitagarwal] I think [~zxu] encountered unit

[jira] [Commented] (HADOOP-12189) CallQueueManager may drop elements from the queue sometimes when calling swapQueue

2015-07-07 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617345#comment-14617345 ] Chris Li commented on HADOOP-12189: --- That's a significant performance hit! I think we

[jira] [Commented] (HADOOP-12189) CallQueueManager may drop elements from the queue sometimes when calling swapQueue

2015-07-06 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1461#comment-1461 ] Chris Li commented on HADOOP-12189: --- [~zxu] One of the design decisions of queue

[jira] [Commented] (HADOOP-12189) CallQueueManager may drop elements from the queue sometimes when calling swapQueue

2015-07-06 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615900#comment-14615900 ] Chris Li commented on HADOOP-12189: --- Hi [~zxu], I see, it's a synchronized map, so its

[jira] [Commented] (HADOOP-12189) CallQueueManager may drop elements from the queue sometimes when calling swapQueue

2015-07-06 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616102#comment-14616102 ] Chris Li commented on HADOOP-12189: --- Wait, did the throughput drop from 437k/300ms to

[jira] [Updated] (HADOOP-11238) Update the NameNode's Group Cache in the background when possible

2014-12-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Attachment: HADOOP-11238.003.patch Re-attaching patch to re-trigger build (no changes were made)

[jira] [Commented] (HADOOP-11238) Update the NameNode's Group Cache in the background when possible

2014-12-09 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240225#comment-14240225 ] Chris Li commented on HADOOP-11238: --- [~benoyantony] good catch, I fixed that in this

[jira] [Updated] (HADOOP-11238) Update the NameNode's Group Cache in the background when possible

2014-12-09 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Attachment: HADOOP-11238.003.patch Update the NameNode's Group Cache in the background when possible

[jira] [Updated] (HADOOP-11238) Group Cache should not cause namenode pause

2014-12-05 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Summary: Group Cache should not cause namenode pause (was: Group cache expiry causes namenode

[jira] [Updated] (HADOOP-11238) Group Cache should not cause namenode pause

2014-12-05 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Description: This patch prevents the namenode from pausing during group cache expiry when getGroups

[jira] [Updated] (HADOOP-11238) Group Cache should not cause namenode pause

2014-12-05 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Description: This patch addresses an issue where the namenode pauses during group resolution by only

[jira] [Commented] (HADOOP-11238) Group Cache should not cause namenode pause

2014-12-05 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14236035#comment-14236035 ] Chris Li commented on HADOOP-11238: --- [~benoyantony] I trimmed the length on line 63

[jira] [Updated] (HADOOP-11238) Group Cache should not cause namenode pause

2014-12-05 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Attachment: HADOOP-11238.patch Group Cache should not cause namenode pause

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-11-19 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218307#comment-14218307 ] Chris Li commented on HADOOP-10597: --- Ah okay, thanks for clarifying, makes sense now

[jira] [Created] (HADOOP-11299) Selective Group Cache Refresh

2014-11-12 Thread Chris Li (JIRA)
Chris Li created HADOOP-11299: - Summary: Selective Group Cache Refresh Key: HADOOP-11299 URL: https://issues.apache.org/jira/browse/HADOOP-11299 Project: Hadoop Common Issue Type: New Feature

[jira] [Commented] (HADOOP-11238) Group cache expiry causes namenode slowdown

2014-11-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207107#comment-14207107 ] Chris Li commented on HADOOP-11238: --- Sure: This patch addresses the issue by only

[jira] [Commented] (HADOOP-11238) Group cache expiry causes namenode slowdown

2014-11-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207110#comment-14207110 ] Chris Li commented on HADOOP-11238: --- Hmm, that test passes on my local machine so it

[jira] [Updated] (HADOOP-11238) Group cache expiry causes namenode slowdown

2014-11-10 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Status: Patch Available (was: Open) Group cache expiry causes namenode slowdown

[jira] [Updated] (HADOOP-11238) Group cache expiry causes namenode slowdown

2014-11-10 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Attachment: HADOOP-11238.patch Uploading patch Group cache expiry causes namenode slowdown

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-11-06 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201000#comment-14201000 ] Chris Li commented on HADOOP-10597: --- Cool. I think this is a good feature to have.

[jira] [Resolved] (HADOOP-10284) Add metrics to the HistoryRpcScheduler

2014-11-06 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li resolved HADOOP-10284. --- Resolution: Not a Problem Assignee: Chris Li Resolved in HADOOP-10281 Add metrics to the

[jira] [Resolved] (HADOOP-10283) Make Scheduler and Multiplexer swappable

2014-11-06 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li resolved HADOOP-10283. --- Resolution: Not a Problem Resolved in HADOOP-10282 Make Scheduler and Multiplexer swappable

[jira] [Assigned] (HADOOP-10302) Allow CallQueue impls to be swapped at runtime (part 1: internals) Depends on: subtask1

2014-11-06 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li reassigned HADOOP-10302: - Assignee: Chris Li Allow CallQueue impls to be swapped at runtime (part 1: internals) Depends

[jira] [Updated] (HADOOP-11238) Group cache expiry causes namenode slowdown

2014-10-28 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Description: Our namenode pauses for 12-60 seconds several times every hour or so. During these

[jira] [Updated] (HADOOP-11238) Group cache expiry causes namenode slowdown

2014-10-28 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Description: Our namenode pauses for 12-60 seconds several times every hour. During these pauses, no

[jira] [Created] (HADOOP-11238) Group cache expiry causes namenode slowdown

2014-10-27 Thread Chris Li (JIRA)
Chris Li created HADOOP-11238: - Summary: Group cache expiry causes namenode slowdown Key: HADOOP-11238 URL: https://issues.apache.org/jira/browse/HADOOP-11238 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-11238) Group cache expiry causes namenode slowdown

2014-10-27 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-11238: -- Description: Our namenode pauses for 12-60 seconds several times every hour or so. During these

[jira] [Assigned] (HADOOP-11238) Group cache expiry causes namenode slowdown

2014-10-27 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li reassigned HADOOP-11238: - Assignee: Chris Li Group cache expiry causes namenode slowdown

[jira] [Updated] (HADOOP-9640) RPC Congestion Control with FairCallQueue

2014-10-20 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-9640: - Description: For an easy-to-read summary see:

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-10-13 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169689#comment-14169689 ] Chris Li commented on HADOOP-10597: --- Hi [~mingma], thanks for adding some numbers. If

[jira] [Updated] (HADOOP-10283) Make Scheduler and Multiplexer swappable

2014-08-22 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10283: -- Description: Currently the FairCallQueue uses the DecayRpcScheduler RoundRobinMultiplexer, this

[jira] [Commented] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-08-22 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107703#comment-14107703 ] Chris Li commented on HADOOP-10282: --- Thanks! Up next some minor patches:

[jira] [Updated] (HADOOP-10286) Allow RPCCallBenchmark to benchmark calls by different users

2014-08-22 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10286: -- Priority: Minor (was: Major) Allow RPCCallBenchmark to benchmark calls by different users

[jira] [Updated] (HADOOP-10286) Allow RPCCallBenchmark to benchmark calls by different users

2014-08-22 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10286: -- Status: Open (was: Patch Available) Canceling patch so I can add better metrics: 50th percentile,

[jira] [Updated] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-08-21 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10282: -- Attachment: HADOOP-10282.patch Hopefully this fixes the unchecked assignment warnings Create a

[jira] [Updated] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-08-19 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10282: -- Status: Patch Available (was: Open) Create a FairCallQueue: a multi-level call queue which

[jira] [Updated] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-08-19 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10282: -- Attachment: HADOOP-10282.patch Hi [~arpitagarwal] sorry for the delay, I wanted to fix up the tests

[jira] [Commented] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-08-18 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101320#comment-14101320 ] Chris Li commented on HADOOP-10282: --- I think you're right, that doc was from an older

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Attachment: HADOOP-10281-preview.patch My bad, I didn't want CI picking this file up; here it is

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Attachment: HADOOP-10281.patch Removed the HistoryRpcSchedulerMXBean Create a scheduler, which

[jira] [Commented] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094983#comment-14094983 ] Chris Li commented on HADOOP-10281: --- Awesome, thanks Arpit! The next stage of this

[jira] [Commented] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093229#comment-14093229 ] Chris Li commented on HADOOP-10281: --- Hi [~arpitagarwal] that's correct. It's not very

[jira] [Commented] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093300#comment-14093300 ] Chris Li commented on HADOOP-10281: --- I didn't record it, but I can if you're

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Attachment: HADOOP-10281.patch Create a scheduler, which assigns schedulables a priority level

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Status: Patch Available (was: Open) Create a scheduler, which assigns schedulables a priority

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Attachment: (was: HADOOP-10281-preview.patch) Create a scheduler, which assigns schedulables a

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Description: The Scheduler decides which sub-queue to assign a given Call. It implements a single

[jira] [Commented] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-04 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085687#comment-14085687 ] Chris Li commented on HADOOP-10281: --- Sorry for the delay, I completed tests at scale

[jira] [Commented] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-08-04 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085690#comment-14085690 ] Chris Li commented on HADOOP-10281: --- Also regarding the spikes in above data: spikes

[jira] [Commented] (HADOOP-10811) Allow classes to be reloaded at runtime

2014-07-22 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070602#comment-14070602 ] Chris Li commented on HADOOP-10811: --- One thing worth discussing is also whether or not

[jira] [Commented] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-07-15 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061779#comment-14061779 ] Chris Li commented on HADOOP-10281: --- Hey guys, sorry for the delay, was on vacation,

[jira] [Created] (HADOOP-10825) Refactor class creation logic in Configuration into nested class

2014-07-15 Thread Chris Li (JIRA)
Chris Li created HADOOP-10825: - Summary: Refactor class creation logic in Configuration into nested class Key: HADOOP-10825 URL: https://issues.apache.org/jira/browse/HADOOP-10825 Project: Hadoop Common

[jira] [Created] (HADOOP-10828) Allow user to reload classes

2014-07-15 Thread Chris Li (JIRA)
Chris Li created HADOOP-10828: - Summary: Allow user to reload classes Key: HADOOP-10828 URL: https://issues.apache.org/jira/browse/HADOOP-10828 Project: Hadoop Common Issue Type: Sub-task

[jira] [Updated] (HADOOP-10828) Allow user to reload classes

2014-07-15 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10828: -- Description: This patch should allow reloading classes at runtime. The software will maintain a set

[jira] [Updated] (HADOOP-10825) Refactor class creation logic in Configuration into nested class

2014-07-15 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10825: -- Status: Patch Available (was: Open) Refactor class creation logic in Configuration into nested

[jira] [Updated] (HADOOP-10825) Refactor class creation logic in Configuration into nested class

2014-07-15 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10825: -- Attachment: HADOOP-10811-10825.patch Refactor class creation logic in Configuration into nested

[jira] [Updated] (HADOOP-10828) Allow user to reload classes

2014-07-15 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10828: -- Attachment: HADOOP-10811-10828-preview.patch First a disclaimer: not knowledgable enough in java

[jira] [Commented] (HADOOP-10825) Refactor class creation logic in Configuration into nested class

2014-07-15 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061995#comment-14061995 ] Chris Li commented on HADOOP-10825: --- Build failures should be unrelated Refactor

[jira] [Created] (HADOOP-10811) Allow classes to be reloaded at runtime

2014-07-09 Thread Chris Li (JIRA)
Chris Li created HADOOP-10811: - Summary: Allow classes to be reloaded at runtime Key: HADOOP-10811 URL: https://issues.apache.org/jira/browse/HADOOP-10811 Project: Hadoop Common Issue Type: New

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-06-30 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Attachment: HADOOP-10281-preview.patch Hi [~arpitagarwal], I've attached a preview of a new

[jira] [Updated] (HADOOP-10279) Create multiplexer, a requirement for the fair queue

2014-06-18 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10279: -- Attachment: HADOOP-10279.patch Thanks for the feedback Arpit. Uploaded new patch with the changes

[jira] [Updated] (HADOOP-10279) Create multiplexer, a requirement for the fair queue

2014-06-18 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10279: -- Attachment: HADOOP-10279.patch Create multiplexer, a requirement for the fair queue

[jira] [Updated] (HADOOP-10279) Create multiplexer, a requirement for the fair queue

2014-06-18 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10279: -- Attachment: (was: HADOOP-10279.patch) Create multiplexer, a requirement for the fair queue

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-06-18 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Attachment: HADOOP-10281.patch Hi Arpit, I agree on #1; I've had this idea sitting around in my

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-06-18 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Attachment: HADOOP-10281.patch Create a scheduler, which assigns schedulables a priority level

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-06-18 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Attachment: (was: HADOOP-10281.patch) Create a scheduler, which assigns schedulables a priority

[jira] [Updated] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-06-18 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10282: -- Attachment: HADOOP-10282.patch Hi Arpit, 1. LinkedBlockingQueue will be on by default, this can be

[jira] [Commented] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-06-16 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032938#comment-14032938 ] Chris Li commented on HADOOP-10282: --- Hi Arapit, Check out HADOOP-10278, which allows

[jira] [Commented] (HADOOP-10279) Create multiplexer, a requirement for the fair queue

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030236#comment-14030236 ] Chris Li commented on HADOOP-10279: --- Hi Arapit, sorry for the lack of context; the mux

[jira] [Commented] (HADOOP-10279) Create multiplexer, a requirement for the fair queue

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030242#comment-14030242 ] Chris Li commented on HADOOP-10279: --- I'll put a writeup in HADOOP-10282 and let you

[jira] [Updated] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10282: -- Description: The FairCallQueue ensures quality of service by altering the order of RPC calls

[jira] [Updated] (HADOOP-10279) Create multiplexer, a requirement for the fair queue

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10279: -- Description: The Multiplexer helps the FairCallQueue decide which of its internal sub-queues to

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Description: The Scheduler decides which sub-queue to assign a given Call. Create a scheduler,

[jira] [Updated] (HADOOP-10279) Create multiplexer, a requirement for the fair queue

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10279: -- Description: The Multiplexer helps the FairCallQueue decide which of its internal sub-queues to

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Description: The Scheduler decides which sub-queue to assign a given Call. It implements a single

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Description: The Scheduler decides which sub-queue to assign a given Call. It implements a single

[jira] [Assigned] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li reassigned HADOOP-10282: - Assignee: Chris Li Create a FairCallQueue: a multi-level call queue which schedules incoming

[jira] [Assigned] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li reassigned HADOOP-10281: - Assignee: Chris Li Create a scheduler, which assigns schedulables a priority level

[jira] [Commented] (HADOOP-10279) Create multiplexer, a requirement for the fair queue

2014-06-12 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030257#comment-14030257 ] Chris Li commented on HADOOP-10279: --- Added comments to and linked all 3 parts of the

[jira] [Updated] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-06-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10376: -- Attachment: HADOOP-10376.patch Ah oops, I accidentally reverted that change with git on my end.

[jira] [Created] (HADOOP-10685) Move RefreshCallQueue from its own protocol to the GenericRefreshProto

2014-06-11 Thread Chris Li (JIRA)
Chris Li created HADOOP-10685: - Summary: Move RefreshCallQueue from its own protocol to the GenericRefreshProto Key: HADOOP-10685 URL: https://issues.apache.org/jira/browse/HADOOP-10685 Project: Hadoop

[jira] [Commented] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-06-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028731#comment-14028731 ] Chris Li commented on HADOOP-10376: --- Thanks for reviewing! I think the next step is

[jira] [Updated] (HADOOP-10685) Migrate Standalone Refresh Protocols to the GenericRefreshProto

2014-06-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10685: -- Summary: Migrate Standalone Refresh Protocols to the GenericRefreshProto (was: Move

[jira] [Updated] (HADOOP-10685) Migrate Standalone Refresh Protocols to the GenericRefreshProto

2014-06-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10685: -- Description: Now that we have a GenericRefreshProtocol, we should migrate existing protocols

[jira] [Commented] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-06-11 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028751#comment-14028751 ] Chris Li commented on HADOOP-10376: --- Hmm, how about duplicating the functionality,

[jira] [Updated] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-06-10 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10376: -- Attachment: HADOOP-10376.patch [~benoyantony] good catch, made mutators synchronized. Also on name,

[jira] [Updated] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-06-09 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10376: -- Attachment: HADOOP-10376.patch Uploaded new patch. I decided to add support for multi registration

[jira] [Commented] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-06-05 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019478#comment-14019478 ] Chris Li commented on HADOOP-10376: --- Hi Arapit, If we make this feature namenode

[jira] [Commented] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-06-02 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015884#comment-14015884 ] Chris Li commented on HADOOP-10376: --- Hi Arapit, thanks for the suggestions. Optional

[jira] [Updated] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-05-28 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10376: -- Attachment: HADOOP-10376.patch Updated patch with support for many handlers mapping to a single

[jira] [Updated] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-05-27 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10376: -- Attachment: HADOOP-10376.patch Hi [~arpitagarwal], sounds good. I went ahead and uploaded a patch.

[jira] [Commented] (HADOOP-9640) RPC Congestion Control with FairCallQueue

2014-05-02 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988113#comment-13988113 ] Chris Li commented on HADOOP-9640: -- Uploaded patches to HADOOP-10279, HADOOP-10281, and

[jira] [Updated] (HADOOP-10279) Create multiplexer, a requirement for the fair queue

2014-05-01 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10279: -- Attachment: HADOOP-10279.patch Upload latest version of patch for reference Create multiplexer, a

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

2014-05-01 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10281: -- Attachment: HADOOP-10281.patch Upload latest version for reference Create a scheduler, which

[jira] [Updated] (HADOOP-10282) Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls

2014-05-01 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Li updated HADOOP-10282: -- Attachment: HADOOP-10282.patch Update with latest version of the FCQ to get preliminary feedback

  1   2   3   >