[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[
https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157416#comment-14157416
]
Jonathan Hsieh commented on HBASE-7509:
---
I believe this can be closed. Reopen if I am wrong.
When using hadoop 2.4 we should just need to include the configs from the
HDFS-5776 release notes in the hbase-site.xml file:
{quote}
This feature is off by default. To enable this feature, set
codedfs.client.hedged.read.threadpool.size/code to a positive number. The
threadpool size is how many threads to dedicate to the running of these
'hedged', concurrent reads in your client.
Then set codedfs.client.hedged.read.threshold.millis/code to the number of
milliseconds to wait before starting up a 'hedged' read. For example, if you
set this property to 10, then if a read has not returned within 10
milliseconds, we will start up a new read against a different block replica.
This feature emits new metrics:
+ hedgedReadOps
+ hedgeReadOpsWin -- how many times the hedged read 'beat' the original read
+ hedgedReadOpsInCurThread -- how many times we went to do a hedged read but we
had to run it in the current thread because
dfs.client.hedged.read.threadpool.size was at a maximum.
{quote}
Enable RS to query a secondary datanode in parallel, if the primary takes too
long
--
Key: HBASE-7509
URL: https://issues.apache.org/jira/browse/HBASE-7509
Project: HBase
Issue Type: Improvement
Reporter: Amitanand Aiyer
Assignee: Amitanand Aiyer
Priority: Critical
Attachments: quorumDiffs.tgz
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[ https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872509#comment-13872509 ] Liyin Tang commented on HBASE-7509: --- I guess Amitanand probably have a diff for 89-fb, but not for trunk yet. But thanks Liang for following up ! Enable RS to query a secondary datanode in parallel, if the primary takes too long -- Key: HBASE-7509 URL: https://issues.apache.org/jira/browse/HBASE-7509 Project: HBase Issue Type: Improvement Reporter: Amitanand Aiyer Assignee: Liang Xie Priority: Critical Attachments: quorumDiffs.tgz -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[ https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873008#comment-13873008 ] Liang Xie commented on HBASE-7509: -- [~liyin], sorry for assign to myself directly, reassign to Amitanand now. Original i just want to avoid more than one guys working on this at the same time, i don't care all this stuff, just want to make this feature go into HDFS/HBase trunk asap:) Enable RS to query a secondary datanode in parallel, if the primary takes too long -- Key: HBASE-7509 URL: https://issues.apache.org/jira/browse/HBASE-7509 Project: HBase Issue Type: Improvement Reporter: Amitanand Aiyer Assignee: Amitanand Aiyer Priority: Critical Attachments: quorumDiffs.tgz -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[ https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873019#comment-13873019 ] Liyin Tang commented on HBASE-7509: --- [~xieliang007], actually I think it makes more sense to assign the JIRA to you, considering you are the one actively working on diff towards the HBase-trunk. Enable RS to query a secondary datanode in parallel, if the primary takes too long -- Key: HBASE-7509 URL: https://issues.apache.org/jira/browse/HBASE-7509 Project: HBase Issue Type: Improvement Reporter: Amitanand Aiyer Assignee: Amitanand Aiyer Priority: Critical Attachments: quorumDiffs.tgz -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[ https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13871605#comment-13871605 ] Liang Xie commented on HBASE-7509: -- Hi [~amitanand], i just assigned it to myself, please feel free to reassign back if you are working on it right now:) I have made a patch on hdfs side yesterday, hopefully will make the hbase side stuff today, will put the test result in current jira(probably need one or two days). Enable RS to query a secondary datanode in parallel, if the primary takes too long -- Key: HBASE-7509 URL: https://issues.apache.org/jira/browse/HBASE-7509 Project: HBase Issue Type: Improvement Reporter: Amitanand Aiyer Assignee: Liang Xie Priority: Critical Attachments: quorumDiffs.tgz -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[ https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13631890#comment-13631890 ] Ted Yu commented on HBASE-7509: --- Thanks for the attachment, Amit. I searched HDFS JIRAs for the quorum (parallel) read feature but didn't seem to find such. Do you know the JIRA number ? Enable RS to query a secondary datanode in parallel, if the primary takes too long -- Key: HBASE-7509 URL: https://issues.apache.org/jira/browse/HBASE-7509 Project: HBase Issue Type: Improvement Reporter: Amitanand Aiyer Priority: Minor Attachments: quorumDiffs.tgz -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[ https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13631910#comment-13631910 ] Amitanand Aiyer commented on HBASE-7509: [~ted_yu] I don't think we have a HDFS jira for this. Enable RS to query a secondary datanode in parallel, if the primary takes too long -- Key: HBASE-7509 URL: https://issues.apache.org/jira/browse/HBASE-7509 Project: HBase Issue Type: Improvement Reporter: Amitanand Aiyer Priority: Minor Attachments: quorumDiffs.tgz -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[
https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13631155#comment-13631155
]
stack commented on HBASE-7509:
--
[~amitanand] On 0.89fb branch, I cannot find this commit. I see something w/
same hbase issue number but it is for something else:
{code}
4 commit 88fe803235d500cb5bafa626d437013d5361a588
3 Author: Liyin Tang li...@apache.org
2 Date: Thu Mar 21 18:53:07 2013 +
1
0 [89-fb] [HBASE-7509] Export quorum metrics from HRegionServer
1
2 Author: aaiyer
3
4 Summary:
5 DFSClient metrics are disbled to save CPU usage.
6 This diff will expoet the required quorum Read Metrics
7 from HRegionServer
{code}
Any chance of seeing what you folks did on this one?
Enable RS to query a secondary datanode in parallel, if the primary takes too
long
--
Key: HBASE-7509
URL: https://issues.apache.org/jira/browse/HBASE-7509
Project: HBase
Issue Type: Improvement
Reporter: Amitanand Aiyer
Priority: Minor
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[ https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13631200#comment-13631200 ] Amitanand Aiyer commented on HBASE-7509: [~ted_yu], [~saint@gmail.com] I just uploaded a tar file. It has the diffs from both hbase and hdfs sides. Enable RS to query a secondary datanode in parallel, if the primary takes too long -- Key: HBASE-7509 URL: https://issues.apache.org/jira/browse/HBASE-7509 Project: HBase Issue Type: Improvement Reporter: Amitanand Aiyer Priority: Minor Attachments: quorumDiffs.tgz -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7509) Enable RS to query a secondary datanode in parallel, if the primary takes too long
[ https://issues.apache.org/jira/browse/HBASE-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13630876#comment-13630876 ] Ted Yu commented on HBASE-7509: --- @Amit: Can you attach your patch here ? Thanks Enable RS to query a secondary datanode in parallel, if the primary takes too long -- Key: HBASE-7509 URL: https://issues.apache.org/jira/browse/HBASE-7509 Project: HBase Issue Type: Improvement Reporter: Amitanand Aiyer Priority: Minor -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
