[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983338#comment-14983338 ] stack commented on HBASE-14540: --- Bumping threads to 100 bumps the write throughput only slightly. Threads

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983356#comment-14983356 ] stack commented on HBASE-14540: --- What was the loading like [~jleach] > Write Ahead Log Batching

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-30 Thread John Leach (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983350#comment-14983350 ] John Leach commented on HBASE-14540: I did it on Cloudera 5.4.1 for my test... > Write Ahead Log

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983704#comment-14983704 ] Hadoop QA commented on HBASE-14540: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983720#comment-14983720 ] Hadoop QA commented on HBASE-14540: --- {color:red}-1 overall{color}. Here are the results of testing the

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-02 Thread John Leach (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941155#comment-14941155 ] John Leach commented on HBASE-14540: I did not run this on HBase based benchmarks but I did run this

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-02 Thread John Leach (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941327#comment-14941327 ] John Leach commented on HBASE-14540: Good point... Probably not a good idea then. > Write Ahead

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-02 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941276#comment-14941276 ] Elliott Clark commented on HBASE-14540: --- This will negative impact the average response time since

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-02 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941338#comment-14941338 ] Elliott Clark commented on HBASE-14540: --- I think something like this could really add throughput

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-02 Thread John Leach (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941346#comment-14941346 ] John Leach commented on HBASE-14540: Clearly, I think we should make it configurable. The problem

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-02 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941280#comment-14941280 ] stack commented on HBASE-14540: --- Lets get it in as an option. Let me try a WALPE workload against it. >

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-02 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941319#comment-14941319 ] Elliott Clark commented on HBASE-14540: --- So right now I have clusters with less than 1ms average

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-02 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941335#comment-14941335 ] Elliott Clark commented on HBASE-14540: --- To expand a bit more this is the classic throughput vs

[jira] [Commented] (HBASE-14540) Write Ahead Log Batching Optimization

2015-10-02 Thread John Leach (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941309#comment-14941309 ] John Leach commented on HBASE-14540: Elliott, that is what I intuitively thought as well for a long