Two kinds of data inconsistency

2014-05-27 Thread 冯宏华
Not sure whether there already had similar discussion on it, sorry for re-raising if yes. 1. data inconsistency between master and peer clusters: a). write a keyvalue KV1 at a specific coordinate (row, cf, col, ts) with value V1 to master cluster A, and since there is active scanner while

[jira] [Created] (HBASE-11255) Negative request num in region load

2014-05-27 Thread Liu Shaohui (JIRA)
Liu Shaohui created HBASE-11255: --- Summary: Negative request num in region load Key: HBASE-11255 URL: https://issues.apache.org/jira/browse/HBASE-11255 Project: HBase Issue Type: Bug

[jira] [Resolved] (HBASE-11234) FastDiffDeltaEncoder#getFirstKeyInBlock returns wrong result

2014-05-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-11234. Resolution: Fixed FastDiffDeltaEncoder#getFirstKeyInBlock returns wrong result

[jira] [Created] (HBASE-11256) [Visibility Controller] Enhance IntegrationTestWithCellVisibilityLoadAndVerify to verify delete behaviour

2014-05-27 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created HBASE-11256: -- Summary: [Visibility Controller] Enhance IntegrationTestWithCellVisibilityLoadAndVerify to verify delete behaviour Key: HBASE-11256 URL:

Re: [VOTE] The 2nd HBase 0.98.3 release candidate (RC1) is available, vote closing 6/1/2014

2014-05-27 Thread Stack
+1 Downloaded, checked hash, checked doc. Loaded data into standaalone mode. Checked it made it. Checked UI. All seems fine. Put it up on my little test cluster and ran my blockcache loadings (I had to copy in hadoop 2.4.x libs). It started fine over data written by trunk. Seems fine. No

[jira] [Created] (HBASE-11257) [0.89-fb] Remove the timestamp from the annotation of Put

2014-05-27 Thread Gaurav Menghani (JIRA)
Gaurav Menghani created HBASE-11257: --- Summary: [0.89-fb] Remove the timestamp from the annotation of Put Key: HBASE-11257 URL: https://issues.apache.org/jira/browse/HBASE-11257 Project: HBase

Re: Two kinds of data inconsistency

2014-05-27 Thread Ted Yu
Unification of mvcc and seqId would pave way for solving such inconsistencies. See HBASE-8763 Cheers On Tue, May 27, 2014 at 3:16 AM, 冯宏华 fenghong...@xiaomi.com wrote: Not sure whether there already had similar discussion on it, sorry for re-raising if yes. 1. data inconsistency between

Re: [VOTE] The 2nd HBase 0.98.3 release candidate (RC1) is available, vote closing 6/1/2014

2014-05-27 Thread Jesse Yates
Downloaded, checked signature, poked around with a mini-cluster + shell, ui looks good, built against phoenix. +1 --- Jesse Yates @jesse_yates jyates.github.com On Tue, May 27, 2014 at 10:09 AM, Anoop John anoop.hb...@gmail.com wrote: +1 Downloaded, checked signature, ran

Re: Two kinds of data inconsistency

2014-05-27 Thread Jeffrey Zhong
Yes, that's one of HBASE-8763 intention. The issues could happen when region moves and we bump up memstore readpoint which would cause the scanner returns inconsistent data as well. One solution is that we could keep mvcc number around but it can't cover all cases such as in replication data

Gathering opinions and recommendations

2014-05-27 Thread Vladimir Rodionov
Hi, all We are planning to upgrade HBase 0.94.6/Hadoop2.0 to either 0.96.2/Hadoop2.4 or to 0.98.2/Hadoop2.4. But I have a concern ... The 'stable' is still 0.94.19? Does it mean that both 0.96. and 0.98 are not recommended for production yet? And which one should we take 0.96 or 0.98? I know

Re: [VOTE] The 1st hbase 0.94.20 release candidate is available for download

2014-05-27 Thread Stack
+1 Checked hash. Layout looks good (did we mean to get rid of the security folder?) Docs look good. Simple PE tests on standalone seem to do the right thing. St.Ack On Fri, May 23, 2014 at 10:35 PM, lars hofhansl la...@apache.org wrote: Just to make you folks work over the long

Re: Gathering opinions and recommendations

2014-05-27 Thread Michael Segel
Isn’t HDP 2.1 shipping 0.98.x ? On May 27, 2014, at 8:36 PM, Vladimir Rodionov vrodio...@carrieriq.com wrote: Hi, all We are planning to upgrade HBase 0.94.6/Hadoop2.0 to either 0.96.2/Hadoop2.4 or to 0.98.2/Hadoop2.4. But I have a concern ... The 'stable' is still 0.94.19? Does it mean

Re: Gathering opinions and recommendations

2014-05-27 Thread Jean-Marc Spaggiari
And so is CDH5.0.1. Vladimir, I will say go with 0.98 instead of 0.96 since 0.98 will get more fixes/features. But test your applications with it first. JM 2014-05-27 16:10 GMT-04:00 Michael Segel michael_se...@hotmail.com: Isn’t HDP 2.1 shipping 0.98.x ? On May 27, 2014, at 8:36 PM,

Re: [VOTE] The 2nd HBase 0.98.3 release candidate (RC1) is available, vote closing 6/1/2014

2014-05-27 Thread Jean-Marc Spaggiari
I tried the test suite 3 times and 3 times failed on this: Results : Failed tests: testCacheOnWriteEvictOnClose(org.apache.hadoop.hbase.regionserver.TestStoreFile) Tests in error: testScannerSelection[0](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange)

[jira] [Created] (HBASE-11258) [0.89-fb] Pull in Integration Tests from open source 0.96/trunk

2014-05-27 Thread Elliott Clark (JIRA)
Elliott Clark created HBASE-11258: - Summary: [0.89-fb] Pull in Integration Tests from open source 0.96/trunk Key: HBASE-11258 URL: https://issues.apache.org/jira/browse/HBASE-11258 Project: HBase

Re: [VOTE] The 2nd HBase 0.98.3 release candidate (RC1) is available, vote closing 6/1/2014

2014-05-27 Thread Ted Yu
These tests passed locally (on MacBook). Cheers On Tue, May 27, 2014 at 1:30 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: I tried the test suite 3 times and 3 times failed on this: Results : Failed tests:

Re: Gathering opinions and recommendations

2014-05-27 Thread Enis Söztutar
Inlined. 2014-05-27 16:10 GMT-04:00 Michael Segel michael_se...@hotmail.com: Isn’t HDP 2.1 shipping 0.98.x ? Yes. One more question: future upgrade from 0.96 - 1.0 and 0.98 - 1.0? Rolling or not? 0.96 - 1.0 probably won't be supported unless there is explicit interest and work for

Re: Gathering opinions and recommendations

2014-05-27 Thread Stack
The 'stable' is still 0.94.19? Lets fix this. 0.98.3 becomes new 'stable'? On Tue, May 27, 2014 at 2:40 PM, Enis Söztutar e...@apache.org wrote: Inlined. ... One more question: future upgrade from 0.96 - 1.0 and 0.98 - 1.0? Rolling or not? 0.96 - 1.0 probably won't be supported

Re: Gathering opinions and recommendations

2014-05-27 Thread Demai Ni
Enis, for customer already on 0.96, can they rolling restart to 0.98, and then from 0.98 rolling to 1.0? Demai On Tue, May 27, 2014 at 2:40 PM, Enis Söztutar e...@apache.org wrote: Inlined. 2014-05-27 16:10 GMT-04:00 Michael Segel michael_se...@hotmail.com: Isn’t HDP 2.1 shipping

Re: [VOTE] The 1st hbase 0.94.20 release candidate is available for download

2014-05-27 Thread lars hofhansl
Thanks Stack. The security folder is still there on purpose. I just changed the pom to always pull the secure files into the build (not just for the secure target). -- Lars From: Stack st...@duboce.net To: HBase Dev List dev@hbase.apache.org; lars hofhansl

Re: Gathering opinions and recommendations

2014-05-27 Thread Stack
On Tue, May 27, 2014 at 2:59 PM, Enis Söztutar enis@gmail.com wrote: On Tue, May 27, 2014 at 2:47 PM, Demai Ni nid...@gmail.com wrote: Enis, for customer already on 0.96, can they rolling restart to 0.98, and then from 0.98 rolling to 1.0? I think that should work. Agree that

[jira] [Created] (HBASE-11259) Compression.java different compressions load system classpath differently causing errors

2014-05-27 Thread Enoch Hsu (JIRA)
Enoch Hsu created HBASE-11259: - Summary: Compression.java different compressions load system classpath differently causing errors Key: HBASE-11259 URL: https://issues.apache.org/jira/browse/HBASE-11259

Re: Gathering opinions and recommendations

2014-05-27 Thread Demai Ni
Stack and Enis, thanks. We may eventually come out a way to get customers directly from 0.96 to 1.0, although probably just wrap two-rolling-start (96-98, 98-1.0) into one command. will report back if it works. Demai On Tue, May 27, 2014 at 3:26 PM, Stack st...@duboce.net wrote: On Tue, May

Re: Gathering opinions and recommendations

2014-05-27 Thread Vladimir Rodionov
Thanks, everyone I think we will go with 0.98.2 -Vladimir On Tue, May 27, 2014 at 3:41 PM, Demai Ni nid...@gmail.com wrote: Stack and Enis, thanks. We may eventually come out a way to get customers directly from 0.96 to 1.0, although probably just wrap two-rolling-start (96-98, 98-1.0)

[jira] [Created] (HBASE-11260) hbase-default.xml refers to hbase.regionserver.global.memstore.upperLimit which is deprecated

2014-05-27 Thread Ted Yu (JIRA)
Ted Yu created HBASE-11260: -- Summary: hbase-default.xml refers to hbase.regionserver.global.memstore.upperLimit which is deprecated Key: HBASE-11260 URL: https://issues.apache.org/jira/browse/HBASE-11260

Re: [DISCUSSION] Update on HBASE-10070 / Merge into trunk

2014-05-27 Thread Enis Söztutar
Agreed with Devaraj. I do not think that these changes will destabilize the code base much. All of the code committed to branch has been unit tested and integration tests, both specific to region replicas and others have been running for some time. Specifically, various large scale data ingestion

Re: [VOTE] The 2nd HBase 0.98.3 release candidate (RC1) is available, vote closing 6/1/2014

2014-05-27 Thread Andrew Purtell
I ran the unit test suite 25 times on JDK 7 and did not see this. I am currently doing the same on JDK 6. No unit test failures so far. On Tue, May 27, 2014 at 1:30 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: I tried the test suite 3 times and 3 times failed on this: Results :

[jira] [Created] (HBASE-11261) Handle splitting of regions that have region_replication greater than one

2014-05-27 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-11261: --- Summary: Handle splitting of regions that have region_replication greater than one Key: HBASE-11261 URL: https://issues.apache.org/jira/browse/HBASE-11261 Project:

[jira] [Resolved] (HBASE-11250) Document: CLONE - Fix jersey serialization/deserialization of json objects

2014-05-27 Thread Misty Stanley-Jones (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones resolved HBASE-11250. - Resolution: Fixed Document: CLONE - Fix jersey serialization/deserialization

[jira] [Resolved] (HBASE-6139) Add troubleshooting section for CentOS 6.2 page allocation failure issue

2014-05-27 Thread Misty Stanley-Jones (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones resolved HBASE-6139. Resolution: Won't Fix Centos 6.2 is very very old now. I don't think this info is

[jira] [Resolved] (HBASE-9729) mvn site fails without install first

2014-05-27 Thread Misty Stanley-Jones (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones resolved HBASE-9729. Resolution: Cannot Reproduce Assignee: Misty Stanley-Jones I can't reproduce

[jira] [Resolved] (HBASE-8100) Wiki Thrift Documentation For Scan Methods

2014-05-27 Thread Misty Stanley-Jones (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones resolved HBASE-8100. Resolution: Cannot Reproduce This seems to have been fixed some time since

[jira] [Resolved] (HBASE-3696) No durability when running with LocalFileSystem

2014-05-27 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-3696. -- Resolution: Implemented Resolving as implemented by HBASE-11218 (which should go in soon) at least for

[jira] [Resolved] (HBASE-6575) Add SPM for HBase to Ref Guide

2014-05-27 Thread Misty Stanley-Jones (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones resolved HBASE-6575. Resolution: Fixed Add SPM for HBase to Ref Guide --