[jira] [Commented] (HADOOP-12077) Provide a multi-URI replication Inode for ViewFs

2017-08-07 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16117109#comment-16117109 ] Ming Ma commented on HADOOP-12077: -- There are couple fixes either we need or have been committed in

[jira] [Commented] (HADOOP-10597) RPC Server signals backoff to clients when all request queues are full

2016-10-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620110#comment-15620110 ] Ming Ma commented on HADOOP-10597: -- [~zhz] that sounds good. Thank you. > RPC Server signals backoff

[jira] [Commented] (HADOOP-13031) Rack-aware read bytes stats should be managed by HFDS specific StorageStatistics

2016-08-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413681#comment-15413681 ] Ming Ma commented on HADOOP-13031: -- [~liuml07], any update on this? Given no values are defined for

[jira] [Commented] (HADOOP-13189) FairCallQueue makes callQueue larger than the configured capacity.

2016-06-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332608#comment-15332608 ] Ming Ma commented on HADOOP-13189: -- Sounds good. [~shv] please go ahead and thank you. > FairCallQueue

[jira] [Commented] (HADOOP-13189) FairCallQueue makes callQueue larger than the configured capacity.

2016-06-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330927#comment-15330927 ] Ming Ma commented on HADOOP-13189: -- [~shv], the reason I asked is refreshCallQueue should switch to the

[jira] [Commented] (HADOOP-13189) FairCallQueue makes callQueue larger than the configured capacity.

2016-06-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325511#comment-15325511 ] Ming Ma commented on HADOOP-13189: -- Thanks Konstantin. Did you use

[jira] [Commented] (HADOOP-12910) Add new FileSystem API to support asynchronous method calls

2016-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323214#comment-15323214 ] Ming Ma commented on HADOOP-12910: -- The community has added support for classloader isolation so that

[jira] [Commented] (HADOOP-13189) FairCallQueue makes callQueue larger than the configured capacity.

2016-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322007#comment-15322007 ] Ming Ma commented on HADOOP-13189: -- Thanks [~shv], [~redvine]. That seems reasonable. Although in

[jira] [Commented] (HADOOP-13031) Refactor rack-aware counters from FileSystemStorageStatistics to HFDS specific StorageStatistics

2016-06-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317565#comment-15317565 ] Ming Ma commented on HADOOP-13031: -- Thanks [~liuml07]. Do you have a MAPREDUCE jira to consume any

[jira] [Commented] (HADOOP-13065) Add a new interface for retrieving FS and FC Statistics

2016-05-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289689#comment-15289689 ] Ming Ma commented on HADOOP-13065: -- [~liuml07] [~cmccabe], yeah the perf could be an issue. Regarding

[jira] [Commented] (HADOOP-13065) Add a new interface for retrieving FS and FC Statistics

2016-05-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284969#comment-15284969 ] Ming Ma commented on HADOOP-13065: -- A minor note, given HDFS-9579 is only available in release 2.9

[jira] [Commented] (HADOOP-13029) Have FairCallQueue try all lower priority sub queues before backoff

2016-04-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252286#comment-15252286 ] Ming Ma commented on HADOOP-13029: -- Thanks [~daryn]! Here is the issue we had that motivates this jira,

[jira] [Created] (HADOOP-13029) Have FairCallQueue try all lower priority sub queues before backoff

2016-04-15 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-13029: Summary: Have FairCallQueue try all lower priority sub queues before backoff Key: HADOOP-13029 URL: https://issues.apache.org/jira/browse/HADOOP-13029 Project: Hadoop Common

[jira] [Updated] (HADOOP-12789) log classpath of ApplicationClassLoader at INFO level

2016-03-07 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-12789: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.5 2.7.3

[jira] [Commented] (HADOOP-12326) Implement ChecksumFileSystem#getFileChecksum equivalent to HDFS for easy check

2016-02-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145849#comment-15145849 ] Ming Ma commented on HADOOP-12326: -- Thanks [~jira.shegalov] for this useful feature. * To compare

[jira] [Updated] (HADOOP-12440) TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down

2015-09-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-12440: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) +1.

[jira] [Commented] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2015-09-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908821#comment-14908821 ] Ming Ma commented on HADOOP-11295: -- Good catch [~xiaochen]! Please go ahead to attach your patch in a

[jira] [Commented] (HADOOP-10598) Support configurable RPC fair share

2015-09-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734965#comment-14734965 ] Ming Ma commented on HADOOP-10598: -- Thanks, [~zhangyongxyz]. You are welcome to take it over. Couple

[jira] [Commented] (HADOOP-12250) Enable RPC Congestion control by default

2015-07-17 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632180#comment-14632180 ] Ming Ma commented on HADOOP-12250: -- [~arpitagarwal]. That sounds good. * Are you going

[jira] [Commented] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606514#comment-14606514 ] Ming Ma commented on HADOOP-12107: -- Also thanks for [~walter.k.su] and [~sandyr] for

[jira] [Updated] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-12107: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) long

[jira] [Commented] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606509#comment-14606509 ] Ming Ma commented on HADOOP-12107: -- I have committed this to trunk and branch-2. Thanks

[jira] [Commented] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598388#comment-14598388 ] Ming Ma commented on HADOOP-12107: -- Thanks [~sjlee0]. Latest patch LGTM. [~cmccabe],

[jira] [Commented] (HADOOP-12107) long running apps may have a huge number of StatisticsData instances under FileSystem

2015-06-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596117#comment-14596117 ] Ming Ma commented on HADOOP-12107: -- Thanks, [~sjlee0], great find. It overall looks

[jira] [Commented] (HADOOP-11924) Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init

2015-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541172#comment-14541172 ] Ming Ma commented on HADOOP-11924: -- Thanks [~jira.shegalov] for the suggestion and

[jira] [Commented] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14540072#comment-14540072 ] Ming Ma commented on HADOOP-11916: -- Thanks [~jira.shegalov] for the good point. Sorry

[jira] [Created] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-11916: Summary: TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug Key: HADOOP-11916 URL: https://issues.apache.org/jira/browse/HADOOP-11916 Project: Hadoop

[jira] [Updated] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11916: - Description: The test fails with the below exception. It turns out there is a JVM bug for MAC,

[jira] [Updated] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11916: - Status: Patch Available (was: Open) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a

[jira] [Updated] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11916: - Attachment: HADOOP-11916.patch Attach a patch to skip the test on MAC.

[jira] [Commented] (HADOOP-11916) TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug

2015-05-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527927#comment-14527927 ] Ming Ma commented on HADOOP-11916: -- Thanks [~ozawa].

[jira] [Commented] (HADOOP-10597) RPC Server signals backoff to clients when all request queues are full

2015-04-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1451#comment-1451 ] Ming Ma commented on HADOOP-10597: -- I have updated the release note. Thanks for your

[jira] [Updated] (HADOOP-10597) RPC Server signals backoff to clients when all request queues are full

2015-04-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Release Note: This change introduces a new configuration key used by RPC server to decide whether to

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-04-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-6.patch Here is the updated patch with Steve's suggestion. Thanks, Steve and

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-04-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-5.patch Updated patch based on Arpit's suggestion of removing the server side

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-03-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358142#comment-14358142 ] Ming Ma commented on HADOOP-10597: -- bq. Did you use the same trigger on the server in

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-03-05 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349649#comment-14349649 ] Ming Ma commented on HADOOP-10597: -- Thanks, [~arpitagarwal]. We have been using no

[jira] [Commented] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2015-02-17 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325108#comment-14325108 ] Ming Ma commented on HADOOP-11295: -- Thanks, Gera, Sangjin, Daryn and Kihwal. RPC

[jira] [Commented] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2015-02-17 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14324504#comment-14324504 ] Ming Ma commented on HADOOP-11000: -- Thanks, Sangjin, Vinay and Chris.

[jira] [Commented] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2015-02-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306746#comment-14306746 ] Ming Ma commented on HADOOP-11295: -- Thanks, [~daryn]. Yes, we can change the shutdown

[jira] [Updated] (HADOOP-10668) TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails

2015-01-20 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10668: - Attachment: HADOOP-10668-2.patch Thanks, Chris. Sorry, I didn't update {{TestZKFailoverController}}

[jira] [Commented] (HADOOP-10668) TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails

2015-01-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278974#comment-14278974 ] Ming Ma commented on HADOOP-10668: -- Anyone has time to review this? It has been

[jira] [Updated] (HADOOP-10668) TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails

2015-01-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10668: - Assignee: Ming Ma Status: Patch Available (was: Open)

[jira] [Updated] (HADOOP-10668) TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails

2015-01-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10668: - Attachment: HADOOP-10668.patch It appears the check whether a node is in the right state could be the

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2015-01-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-4.patch Thanks, [~ste...@apache.org]! Here is the new patch with your

[jira] [Commented] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2015-01-05 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265054#comment-14265054 ] Ming Ma commented on HADOOP-11295: -- Thanks, [~jira.shegalov]! Good idea to use

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-12-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-3.patch Rebased for trunk and address Chris' comments. Appreciate if

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-12-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Attachment: HADOOP-11295-3.patch Thanks [~jira.shegalov] and [~sjlee0]. Here is the updated patch to

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-12-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Attachment: HADOOP-11295-2.patch Rebased for trunk. Appreciate any input. RPC Server Reader thread

[jira] [Commented] (HADOOP-11252) RPC client write does not time out by default

2014-12-01 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14229964#comment-14229964 ] Ming Ma commented on HADOOP-11252: -- Thanks, [~wilfreds]. Yes, it should cover all the

[jira] [Created] (HADOOP-11305) RM might not start if the machine was hard shutdown and FileSystemRMStateStore was used

2014-11-13 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-11305: Summary: RM might not start if the machine was hard shutdown and FileSystemRMStateStore was used Key: HADOOP-11305 URL: https://issues.apache.org/jira/browse/HADOOP-11305

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-11-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Attachment: HADOOP-11295.patch The fix is to interrupt the reader threads when RPC Server is stopped.

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-11-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Assignee: Ming Ma Status: Patch Available (was: Open) RPC Server Reader thread can't shutdown

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-11-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208955#comment-14208955 ] Ming Ma commented on HADOOP-10597: -- Thanks, Chris. The backoff retry policy is defined

[jira] [Commented] (HADOOP-11252) RPC client write does not time out by default

2014-11-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206707#comment-14206707 ] Ming Ma commented on HADOOP-11252: -- [~wilfreds], are you working on this? If not, I can

[jira] [Updated] (HADOOP-11295) RPC Reader thread can't be shutdowned if RPCCallQueue is full

2014-11-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Description: If RPC server is asked to stop when RPCCallQueue is full, {{reader.join()}} will just

[jira] [Updated] (HADOOP-11295) RPC Server Reader thread can't shutdown if RPCCallQueue is full

2014-11-11 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11295: - Summary: RPC Server Reader thread can't shutdown if RPCCallQueue is full (was: RPC Reader thread can't

[jira] [Commented] (HADOOP-11252) RPC client write does not time out by default

2014-11-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205152#comment-14205152 ] Ming Ma commented on HADOOP-11252: -- Should we use another name other than

[jira] [Created] (HADOOP-11295) RPC Reader thread can't be shutdowned if RPCCallQueue is full

2014-11-10 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-11295: Summary: RPC Reader thread can't be shutdowned if RPCCallQueue is full Key: HADOOP-11295 URL: https://issues.apache.org/jira/browse/HADOOP-11295 Project: Hadoop Common

[jira] [Commented] (HADOOP-11252) RPC client write does not time out by default

2014-10-31 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191944#comment-14191944 ] Ming Ma commented on HADOOP-11252: -- Agree with Wilfred that we should fix it in

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-10-14 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14171966#comment-14171966 ] Ming Ma commented on HADOOP-10597: -- Thanks, Chris. 1. The first two experiments belong

[jira] [Commented] (HADOOP-10376) Refactor refresh*Protocols into a single generic refreshConfigProtocol

2014-10-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167400#comment-14167400 ] Ming Ma commented on HADOOP-10376: -- Interesting work. There is

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-09-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: MoreRPCClientBackoffEvaluation.pdf Here are some more evaluation results to compare FIFO

[jira] [Created] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2014-08-25 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-11000: Summary: HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING Key: HADOOP-11000 URL: https://issues.apache.org/jira/browse/HADOOP-11000

[jira] [Updated] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2014-08-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11000: - Attachment: HADOOP-11000.patch Here is the draft patch. 1. Catch HealthCheckFailedException properly.

[jira] [Updated] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2014-08-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11000: - Assignee: Ming Ma Status: Patch Available (was: Open) HAServiceProtocol's health state is

[jira] [Updated] (HADOOP-11000) HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING

2014-08-25 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-11000: - Attachment: HADOOP-11000-2.patch Thanks, Sangjin. Here is the updated patch. HAServiceProtocol's

[jira] [Commented] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-07-31 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081950#comment-14081950 ] Ming Ma commented on HADOOP-10597: -- Thanks, Jing and Arpit. 1. In the current

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-07-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597-2.patch RPCClientBackoffDesignAndEvaluation.pdf [~lohit]

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-07-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Status: Patch Available (was: Open) Evaluate if we can have RPC client back off when server is under

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673-6.patch Thanks, Tsuyoshi. [~lohit] asked a good question how the increase of

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673-4.patch Updates with unit test. Update rpc metrics when the call throws an

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673-5.patch Thanks, Tsuyoshi. Here is the updated patch that makes the variables

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673-2.patch Thanks, Gera. Here is the updated patch. For RpcMetrics, it doesn't

[jira] [Created] (HADOOP-10673) Update rpc metrics when the call throw an exception

2014-06-09 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10673: Summary: Update rpc metrics when the call throw an exception Key: HADOOP-10673 URL: https://issues.apache.org/jira/browse/HADOOP-10673 Project: Hadoop Common Issue

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throw an exception

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Attachment: HADOOP-10673.patch The patch updates the existing rpc metrics in the case of exception.

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throw an exception

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Status: Patch Available (was: Open) Update rpc metrics when the call throw an exception

[jira] [Updated] (HADOOP-10673) Update rpc metrics when the call throws an exception

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10673: - Summary: Update rpc metrics when the call throws an exception (was: Update rpc metrics when the call

[jira] [Updated] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10657: - Attachment: HADOOP-10657-2.patch Thanks, Jing. Yeah, it isn't necessary in this case. New patch

[jira] [Updated] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10657: - Attachment: HADOOP-10657.patch Here is the patch. Have RetryInvocationHandler log failover attempt

[jira] [Updated] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10657: - Status: Patch Available (was: Open) Have RetryInvocationHandler log failover attempt at INFO level

[jira] [Moved] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma moved HDFS-6477 to HADOOP-10657: Key: HADOOP-10657 (was: HDFS-6477) Project: Hadoop Common (was: Hadoop

[jira] [Updated] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-06-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10597: - Attachment: HADOOP-10597.patch Steve, thanks for the suggestions. Yes, it is useful to have server

[jira] [Assigned] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-06-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reassigned HADOOP-10597: Assignee: Ming Ma Evaluate if we can have RPC client back off when server is under heavy load

[jira] [Assigned] (HADOOP-10657) Have RetryInvocationHandler log failover attempt at INFO level

2014-06-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reassigned HADOOP-10657: Assignee: Ming Ma Have RetryInvocationHandler log failover attempt at INFO level

[jira] [Commented] (HADOOP-9640) RPC Congestion Control with FairCallQueue

2014-05-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14002801#comment-14002801 ] Ming Ma commented on HADOOP-9640: - Sorry, there was a typo about, I meant thousands of

[jira] [Created] (HADOOP-10598) Support configurable RPC fair share

2014-05-13 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10598: Summary: Support configurable RPC fair share Key: HADOOP-10598 URL: https://issues.apache.org/jira/browse/HADOOP-10598 Project: Hadoop Common Issue Type: Sub-task

[jira] [Created] (HADOOP-10597) Evaluate if we can have RPC client back off when server is under heavy load

2014-05-12 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10597: Summary: Evaluate if we can have RPC client back off when server is under heavy load Key: HADOOP-10597 URL: https://issues.apache.org/jira/browse/HADOOP-10597 Project:

[jira] [Created] (HADOOP-10599) Support prioritization of DN RPCs over client RPCs

2014-05-12 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10599: Summary: Support prioritization of DN RPCs over client RPCs Key: HADOOP-10599 URL: https://issues.apache.org/jira/browse/HADOOP-10599 Project: Hadoop Common Issue

[jira] [Commented] (HADOOP-9640) RPC Congestion Control with FairCallQueue

2014-05-05 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990308#comment-13990308 ] Ming Ma commented on HADOOP-9640: - Thanks, Chris. 1. The current approach drops call

[jira] [Commented] (HADOOP-9640) RPC Congestion Control with FairCallQueue

2014-04-23 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977949#comment-13977949 ] Ming Ma commented on HADOOP-9640: - Nice work. Some high-level comments, 1. At some

[jira] [Created] (HADOOP-10157) move doRead method from IPC Listener class to IPC Reader class

2013-12-10 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10157: Summary: move doRead method from IPC Listener class to IPC Reader class Key: HADOOP-10157 URL: https://issues.apache.org/jira/browse/HADOOP-10157 Project: Hadoop Common

[jira] [Updated] (HADOOP-10106) Incorrect thread name in RPC log messages

2013-12-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10106: - Attachment: hadoop_10106_trunk_2.patch ok. I have opened a new jira

[jira] [Commented] (HADOOP-10106) Incorrect thread name in RPC log messages

2013-12-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841989#comment-13841989 ] Ming Ma commented on HADOOP-10106: -- Thanks, Sanjay. Moving doRead from Listener class

[jira] [Created] (HADOOP-10125) no need to process RPC request if the client connection has been dropped

2013-11-22 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10125: Summary: no need to process RPC request if the client connection has been dropped Key: HADOOP-10125 URL: https://issues.apache.org/jira/browse/HADOOP-10125 Project: Hadoop

[jira] [Updated] (HADOOP-10125) no need to process RPC request if the client connection has been dropped

2013-11-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10125: - Attachment: hadoop_10125_trunk.patch Here is the patch. no need to process RPC request if the client

[jira] [Updated] (HADOOP-10125) no need to process RPC request if the client connection has been dropped

2013-11-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10125: - Status: Patch Available (was: Open) no need to process RPC request if the client connection has been

[jira] [Updated] (HADOOP-10106) Incorrect thread name in RPC log messages

2013-11-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10106: - Status: Open (was: Patch Available) Incorrect thread name in RPC log messages

[jira] [Updated] (HADOOP-10106) Incorrect thread name in RPC log messages

2013-11-18 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HADOOP-10106: - Fix Version/s: (was: 2.2.1) (was: 3.0.0) Affects Version/s:

[jira] [Created] (HADOOP-10106) Incorrect thread name RPC log message

2013-11-15 Thread Ming Ma (JIRA)
Ming Ma created HADOOP-10106: Summary: Incorrect thread name RPC log message Key: HADOOP-10106 URL: https://issues.apache.org/jira/browse/HADOOP-10106 Project: Hadoop Common Issue Type: Bug

  1   2   >