[jira] [Created] (HBASE-17157) Increase the default mergeable threshold for mob compaction

2016-11-21 Thread Jingcheng Du (JIRA)
Jingcheng Du created HBASE-17157: Summary: Increase the default mergeable threshold for mob compaction Key: HBASE-17157 URL: https://issues.apache.org/jira/browse/HBASE-17157 Project: HBase

Re: Use experience and performance data of offheap from Alibaba online cluster

2016-11-21 Thread Yu Li
Good point Jingcheng, something I had a feeling some of you might ask (smile). I'd say it's because of some historical reason and we had some concerns for issues like HBASE-16195. But yes will consider enabling the pool since already passed 11/11 and not so many eyes on our cluster, before

RE: Use experience and performance data of offheap from Alibaba online cluster

2016-11-21 Thread Du, Jingcheng
Thanks Yu. You disabled the MSLAB pool in the running, why did you choose to disable it? I compared the performance with and without MSLAB pool once before, the GC pause can be improved if the MSLAB pool was enabled (I used G1GC at that time). Maybe the pool can help in your case? Regards,

Re: Use experience and performance data of offheap from Alibaba online cluster

2016-11-21 Thread Yu Li
bq. If it were not "confidential" might you mention why there is such a large (several orders of magnitude) explosion of end user queries to backend ones? For index building and online machine learning system, there're more information recorded after each visit/trade, such as user query/click

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-11-21 Thread Vladimir Rodionov
>> I have spent a good bit of time reviewing and testing this feature. I would >> like my review and concerns addressed and I'd like it to be clear how; >> either explicit follow-on issues, pointers to where in the patch or doc my >> remarks have been catered to, etc. Until then, I am against

Re: Use experience and performance data of offheap from Alibaba online cluster

2016-11-21 Thread Yu Li
Ok, let me elaborate our settings on GC/heapsize per Nick required in former email (smile): For on heap: export HBASE_REGIONSERVER_OPTS="-Xmx43008m -Xms43008m -Xmn8192m -XX:SurvivorRatio=3 -XX:MaxTenuringThreshold=15 -Xss256k -XX:+UseParNewGC -XX:+PrintPromotionFailure

[jira] [Created] (HBASE-17156) Restore usage command output formatting is off

2016-11-21 Thread Vladimir Rodionov (JIRA)
Vladimir Rodionov created HBASE-17156: - Summary: Restore usage command output formatting is off Key: HBASE-17156 URL: https://issues.apache.org/jira/browse/HBASE-17156 Project: HBase

Successful: hbase.apache.org HTML Checker

2016-11-21 Thread Apache Jenkins Server
Successful If successful, the HTML and link-checking report for http://hbase.apache.org is available at https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/70/artifact/link_report/index.html. If failed, see https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/70/console.

[jira] [Created] (HBASE-17155) Unify table list output across backup/ set commands

2016-11-21 Thread Vladimir Rodionov (JIRA)
Vladimir Rodionov created HBASE-17155: - Summary: Unify table list output across backup/ set commands Key: HBASE-17155 URL: https://issues.apache.org/jira/browse/HBASE-17155 Project: HBase

[jira] [Created] (HBASE-17154) Backup progress command usage small fix

2016-11-21 Thread Vladimir Rodionov (JIRA)
Vladimir Rodionov created HBASE-17154: - Summary: Backup progress command usage small fix Key: HBASE-17154 URL: https://issues.apache.org/jira/browse/HBASE-17154 Project: HBase Issue

[jira] [Created] (HBASE-17153) Add FavoredNode checks to hbck -checkFavoredNodes

2016-11-21 Thread Thiruvel Thirumoolan (JIRA)
Thiruvel Thirumoolan created HBASE-17153: Summary: Add FavoredNode checks to hbck -checkFavoredNodes Key: HBASE-17153 URL: https://issues.apache.org/jira/browse/HBASE-17153 Project: HBase

Re: HBASE 2.0 release progress

2016-11-21 Thread Thiruvel Thirumoolan
We would like to add the favored node enhancements as part of  https://issues.apache.org/jira/browse/HBASE-15531 to 2.0. Most of the code should be new, there will be very less code changes to Master/AM etc. -Thiruvel On Monday, November 14, 2016, 10:06:49 PM PST, Anoop John

Re: HBASE 2.0 release progress

2016-11-21 Thread Francis Liu
Late to respond to this but I'd like to get "Split Meta" HBASE-11165 into HBase 2.0 as well. We've been running with a version of it internally. I'll start putting up patches soon. On Friday, November 11, 2016 5:15 PM, Stephen Jiang wrote: Hello, fellow HBASE

[jira] [Created] (HBASE-17152) Use new HFile API to open reader w/o block cache being created

2016-11-21 Thread Vladimir Rodionov (JIRA)
Vladimir Rodionov created HBASE-17152: - Summary: Use new HFile API to open reader w/o block cache being created Key: HBASE-17152 URL: https://issues.apache.org/jira/browse/HBASE-17152 Project:

[jira] [Created] (HBASE-17151) New API to create HFile.Reader without instantiating block cache

2016-11-21 Thread Vladimir Rodionov (JIRA)
Vladimir Rodionov created HBASE-17151: - Summary: New API to create HFile.Reader without instantiating block cache Key: HBASE-17151 URL: https://issues.apache.org/jira/browse/HBASE-17151 Project:

[jira] [Created] (HBASE-17150) Verify restore logic (remote/local cluster)

2016-11-21 Thread Vladimir Rodionov (JIRA)
Vladimir Rodionov created HBASE-17150: - Summary: Verify restore logic (remote/local cluster) Key: HBASE-17150 URL: https://issues.apache.org/jira/browse/HBASE-17150 Project: HBase Issue

[jira] [Created] (HBASE-17149) Procedure v2 - Fix nonce submission

2016-11-21 Thread Matteo Bertozzi (JIRA)
Matteo Bertozzi created HBASE-17149: --- Summary: Procedure v2 - Fix nonce submission Key: HBASE-17149 URL: https://issues.apache.org/jira/browse/HBASE-17149 Project: HBase Issue Type:

[jira] [Created] (HBASE-17148) Procedure v2 - add bulk proc submit

2016-11-21 Thread Matteo Bertozzi (JIRA)
Matteo Bertozzi created HBASE-17148: --- Summary: Procedure v2 - add bulk proc submit Key: HBASE-17148 URL: https://issues.apache.org/jira/browse/HBASE-17148 Project: HBase Issue Type:

Re: [DISCUSS] breaking apart runtime dependencies for services and tools (was [DISCUSSION])

2016-11-21 Thread Sean Busbey
I think most of the work comes from knowing which of our dependencies are truly needed by what at runtime. An easy first pass would be to ensure junit is a dependency for the integration-tests component and then make that module and its dependencies go into a different directory than our normal

[jira] [Created] (HBASE-17147) Reduce logging in BackupLogCleaner

2016-11-21 Thread Vladimir Rodionov (JIRA)
Vladimir Rodionov created HBASE-17147: - Summary: Reduce logging in BackupLogCleaner Key: HBASE-17147 URL: https://issues.apache.org/jira/browse/HBASE-17147 Project: HBase Issue Type: Bug

Re: [DISCUSS] hbase-spark module in branch-1 and branch-2

2016-11-21 Thread Devaraj Das
Hi Sean, I did a quick check with someone from the Spark team here and his opinion was that the hbase-spark module as it currently stands can be used by downstream users to do basic stuff and to try some simple things out, etc. The integration is improving. I think we should get what we have in

[jira] [Created] (HBASE-17146) Reconsider rpc timeout calculation in backup restore operation

2016-11-21 Thread Vladimir Rodionov (JIRA)
Vladimir Rodionov created HBASE-17146: - Summary: Reconsider rpc timeout calculation in backup restore operation Key: HBASE-17146 URL: https://issues.apache.org/jira/browse/HBASE-17146 Project:

Re: [DISCUSS] breaking apart runtime dependencies for services and tools (was [DISCUSSION])

2016-11-21 Thread Stack
Sounds good to me Jan and Sean. How much work we talking and what sort of movement? Thanks, S On Mon, Nov 21, 2016 at 8:57 AM, Sean Busbey wrote: > In particular, does anyone have a problem with us restructuring our > assembly so that we break out the dependencies needed for

[DISCUSS] breaking apart runtime dependencies for services and tools (was [DISCUSSION])

2016-11-21 Thread Sean Busbey
In particular, does anyone have a problem with us restructuring our assembly so that we break out the dependencies needed for runtime of our service processes and those needed for particular tools (like the IT tests in the case of junit). 2.0 seems like a good time to introduce this kind of

[jira] [Created] (HBASE-17145) Backport hbase-6721 fixes to 1.1.x

2016-11-21 Thread Vinay varma (JIRA)
Vinay varma created HBASE-17145: --- Summary: Backport hbase-6721 fixes to 1.1.x Key: HBASE-17145 URL: https://issues.apache.org/jira/browse/HBASE-17145 Project: HBase Issue Type: Improvement

[jira] [Resolved] (HBASE-17137) TestFromClientSide#testClientScannerIsResetWhenScanThrowsIOException fails in branch-1

2016-11-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-17137. Resolution: Duplicate Covered by addendum to HBASE-17118 >

Failure: HBase Generate Website

2016-11-21 Thread Apache Jenkins Server
Build status: Failure If successful, the website and docs have been generated. To update the live site, follow the instructions below. If failed, skip to the bottom of this email. Use the following commands to download the patch and apply it to a clean branch based on origin/asf-site. If you

[jira] [Created] (HBASE-17144) Possible offheap read ByteBuffers leak

2016-11-21 Thread binlijin (JIRA)
binlijin created HBASE-17144: Summary: Possible offheap read ByteBuffers leak Key: HBASE-17144 URL: https://issues.apache.org/jira/browse/HBASE-17144 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-17143) Scan improvement

2016-11-21 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-17143: - Summary: Scan improvement Key: HBASE-17143 URL: https://issues.apache.org/jira/browse/HBASE-17143 Project: HBase Issue Type: Umbrella Components:

[jira] [Created] (HBASE-17142) Implement multi get

2016-11-21 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-17142: - Summary: Implement multi get Key: HBASE-17142 URL: https://issues.apache.org/jira/browse/HBASE-17142 Project: HBase Issue Type: Sub-task Components:

[jira] [Created] (HBASE-17141) Introduce a more user-friendly implementation of AsyncTable

2016-11-21 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-17141: - Summary: Introduce a more user-friendly implementation of AsyncTable Key: HBASE-17141 URL: https://issues.apache.org/jira/browse/HBASE-17141 Project: HBase Issue

[DISCUSSION]

2016-11-21 Thread Jan Hentschel
Hi, Sean Busbey and I had a quick chat about HBASE-16555 and HBASE-12909 covering needed dependencies for running the tests. Currently JUnit is declared as a compile dependency in the parent POM. Both tickets try to change it to test scope. Sean and I try to create a list seperating

[jira] [Created] (HBASE-17140) Throw RegionOfflineException directly when request for a disabled table

2016-11-21 Thread Guanghao Zhang (JIRA)
Guanghao Zhang created HBASE-17140: -- Summary: Throw RegionOfflineException directly when request for a disabled table Key: HBASE-17140 URL: https://issues.apache.org/jira/browse/HBASE-17140 Project:

[jira] [Created] (HBASE-17139) Remove sweep tool related configs from hbase-default.xml

2016-11-21 Thread Anoop Sam John (JIRA)
Anoop Sam John created HBASE-17139: -- Summary: Remove sweep tool related configs from hbase-default.xml Key: HBASE-17139 URL: https://issues.apache.org/jira/browse/HBASE-17139 Project: HBase