[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-11 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357860#comment-14357860
 ] 

Hudson commented on HBASE-13063:


SUCCESS: Integrated in HBase-TRUNK #6244 (See 
[https://builds.apache.org/job/HBase-TRUNK/6244/])
HBASE-13063 Allow to turn off memstore replication for region replicas - 
ADDENDUM for turning of primary flush tigger when this is enabled (enis: rev 
c938267db3bfe95908f97397f64ffc50933e4343)
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/HTableDescriptor.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionReplicaUtil.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/util/ServerRegionReplicaUtil.java


 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch, hbase-13063-addendum.patch, hbase-13063-addendum.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-11 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357869#comment-14357869
 ] 

Hudson commented on HBASE-13063:


SUCCESS: Integrated in HBase-1.1 #281 (See 
[https://builds.apache.org/job/HBase-1.1/281/])
HBASE-13063 Allow to turn off memstore replication for region replicas - 
ADDENDUM for turning of primary flush tigger when this is enabled (enis: rev 
0f892c23ecb7520d218fdddaa49ff69e6eb09152)
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/util/ServerRegionReplicaUtil.java
* 
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionReplicaUtil.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/HTableDescriptor.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java


 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch, hbase-13063-addendum.patch, hbase-13063-addendum.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-11 Thread Matteo Bertozzi (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356524#comment-14356524
 ] 

Matteo Bertozzi commented on HBASE-13063:
-

[~enis] +1 addendum looks good to me

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch, hbase-13063-addendum.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-10 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354796#comment-14354796
 ] 

Hudson commented on HBASE-13063:


FAILURE: Integrated in HBase-1.1 #270 (See 
[https://builds.apache.org/job/HBase-1.1/270/])
HBASE-13063 Allow to turn off memstore replication for region replicas 
(matteo.bertozzi: rev eb2193afa0d266063b705d8743a940a06a5c2e9f)
* hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/ReplicationEndpoint.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALEdit.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/HTableDescriptor.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSourceManager.java


 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-10 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354856#comment-14354856
 ] 

Hudson commented on HBASE-13063:


SUCCESS: Integrated in HBase-TRUNK #6234 (See 
[https://builds.apache.org/job/HBase-TRUNK/6234/])
HBASE-13063 Allow to turn off memstore replication for region replicas 
(matteo.bertozzi: rev cbf03787ea04da8d1c2ceef8fbb4ccbabb7d67ed)
* hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/HTableDescriptor.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/ReplicationEndpoint.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/WALEdit.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSourceManager.java


 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-10 Thread Enis Soztutar (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356188#comment-14356188
 ] 

Enis Soztutar commented on HBASE-13063:
---

The test succeeds run 20 times. 

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch, hbase-13063-addendum.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-10 Thread stack (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355545#comment-14355545
 ] 

stack commented on HBASE-13063:
---

Failing on trunk [~mbertozzi]? 
https://builds.apache.org/job/HBase-TRUNK/6236/testReport/
https://builds.apache.org/job/HBase-TRUNK/6235/

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-10 Thread Matteo Bertozzi (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355929#comment-14355929
 ] 

Matteo Bertozzi commented on HBASE-13063:
-

[~stack] first run and pre-commit hook didn't fail 
https://builds.apache.org/job/HBase-TRUNK/6234/ - locally it seems to work, let 
me see if I'm missing something.

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-06 Thread Enis Soztutar (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351226#comment-14351226
 ] 

Enis Soztutar commented on HBASE-13063:
---

We can also document this in the book. There is a section for region replicas 
already with all config options. 

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-06 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350925#comment-14350925
 ] 

Hadoop QA commented on HBASE-13063:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12703106/HBASE-13063-v2.patch
  against master branch at commit 6d4a4a48fe90b889c39e3ed42448fc7597a46973.
  ATTACHMENT ID: 12703106

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 6 new 
or modified tests.

{color:green}+1 hadoop versions{color}. The patch compiles with all 
supported hadoop versions (2.4.1 2.5.2 2.6.0)

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 checkstyle{color}.  The applied patch does not increase the 
total number of checkstyle errors

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

{color:red}-1 site{color}.  The patch appears to cause mvn site goal to 
fail.

{color:green}+1 core tests{color}.  The patch passed unit tests in .

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Checkstyle Errors: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//artifact/patchprocess/checkstyle-aggregate.html

  Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13122//console

This message is automatically generated.

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch, HBASE-13063-v2.patch, 
 HBASE-13063-v2.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-02 Thread Enis Soztutar (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14343952#comment-14343952
 ] 

Enis Soztutar commented on HBASE-13063:
---

+1 with two nits. 

1. You can increment the skipped edits counter for all edits that are skipped. 
We do this in many places and helps with debugging, etc. 
2. The ordering between checking the memstore replication state and isMetaEdit 
can be reversed. I think it boils down to whether we expect most of the tables 
will have it disabled or enabled. 

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)



[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-03-02 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14343033#comment-14343033
 ] 

Hadoop QA commented on HBASE-13063:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12701832/HBASE-13063-v1.patch
  against master branch at commit 4fb6f91cbad7d9b3c18f897ee3a4f70dc7c21595.
  ATTACHMENT ID: 12701832

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 6 new 
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all 
supported hadoop versions (2.4.1 2.5.2 2.6.0)

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 checkstyle{color}.  The applied patch does not increase the 
total number of checkstyle errors

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
 

 {color:red}-1 core zombie tests{color}.  There are 1 zombie test(s):   
at 
org.apache.hadoop.hbase.regionserver.wal.TestLogRollPeriod.testNoEdits(TestLogRollPeriod.java:78)

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
Checkstyle Errors: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//artifact/patchprocess/checkstyle-aggregate.html

  Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/13033//console

This message is automatically generated.

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1-branch-1.patch, 
 HBASE-13063-v1.patch, HBASE-13063-v1.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA

[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-02-24 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14335066#comment-14335066
 ] 

Hadoop QA commented on HBASE-13063:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12700503/HBASE-13063-v1.patch
  against master branch at commit 977d65a81cc86d3d970878f74e11a7e1869de7f3.
  ATTACHMENT ID: 12700503

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 6 new 
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all 
supported hadoop versions (2.4.1 2.5.2 2.6.0)

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:red}-1 checkstyle{color}.  The applied patch generated 
1937 checkstyle errors (more than the master's current 1936 errors).

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   org.apache.hadoop.hbase.client.TestShell

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Checkstyle Errors: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//artifact/patchprocess/checkstyle-aggregate.html

Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12950//console

This message is automatically generated.

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v1.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-02-23 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14333256#comment-14333256
 ] 

Hadoop QA commented on HBASE-13063:
---

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12700160/HBASE-13063-v0.patch
  against master branch at commit 6a4bca86e2b4dba2140f9886a6d4e9b59916a5a7.
  ATTACHMENT ID: 12700160

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 6 new 
or modified tests.
{color:green}+1 hadoop versions{color}. The patch compiles with all 
supported hadoop versions (2.4.1 2.5.2 2.6.0)

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:red}-1 checkstyle{color}.  The applied patch generated 
1937 checkstyle errors (more than the master's current 1936 errors).

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 lineLengths{color}.  The patch does not introduce lines 
longer than 100

  {color:green}+1 site{color}.  The mvn site goal succeeds with this patch.

 {color:red}-1 core tests{color}.  The patch failed these unit tests:
   
org.apache.hadoop.hbase.coprocessor.TestRowProcessorEndpoint
  
org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint

 {color:red}-1 core zombie tests{color}.  There are 1 zombie test(s):   
at 
org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable.testForCheckingIfEnableAndDisableWorksFineAfterSwitch(TestMasterRestartAfterDisablingTable.java:70)

Test results: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-examples.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-annotations.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-rest.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-client.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-thrift.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-protocol.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Checkstyle Errors: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//artifact/patchprocess/checkstyle-aggregate.html

Console output: 
https://builds.apache.org/job/PreCommit-HBASE-Build/12939//console

This message is automatically generated.

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v0.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but 

[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-02-23 Thread Enis Soztutar (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334125#comment-14334125
 ] 

Enis Soztutar commented on HBASE-13063:
---

I like this. We can in turn get rid of the store file refresher chore and just 
rely on this for read-only tables, etc. 
Shall we pass FSTableDescriptors directly instead of server, then passing the 
server than casting to HRS? Related, will lookup of a table's attribute too 
costly for every edit? For table enabled / disable information we use guave 
cache for caching up the lookup up to 5 seconds. 



 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch, HBASE-13063-v0.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-02-18 Thread Srikanth Srungarapu (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326502#comment-14326502
 ] 

Srikanth Srungarapu commented on HBASE-13063:
-

Don't you think we should be setting the default flag to false?
{code} public static final boolean DEFAULT_REGION_MEMSTORE_REPLICATION = true; 
{code}
May be a good idea to initialize with null as you are checking for null in 
requiresReplication?
{code} private HRegionServer rsServerHost {code}
Also, it would be a good idea to ad LOG statement saying whether memstore 
replication is enabled/disabled.



 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HBASE-13063) Allow to turn off memstore replication for region replicas

2015-02-18 Thread Matteo Bertozzi (JIRA)

[ 
https://issues.apache.org/jira/browse/HBASE-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326573#comment-14326573
 ] 

Matteo Bertozzi commented on HBASE-13063:
-

{quote}Don't you think we should be setting the default flag to false?{quote}
nah, in theory you expect the replica to be quite up to date. 
this flag is just if your client can stay behind a lot and it is aware of 
that.

{quote} May be a good idea to initialize with null as you are checking for null 
in requiresReplication?{quote}
sure.. I'll add that. but null is the default value 
http://docs.oracle.com/javase/specs/jls/se7/html/jls-4.html#jls-4.12.5

{quote}Also, it would be a good idea to ad LOG statement saying whether 
memstore replication is enabled/disabled.{quote}
since we don't have a sink object for each table, it will require adding a set 
or something to print the log only once. not sure if it is worth.

 Allow to turn off memstore replication for region replicas
 --

 Key: HBASE-13063
 URL: https://issues.apache.org/jira/browse/HBASE-13063
 Project: HBase
  Issue Type: New Feature
  Components: regionserver, Replication
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13063-v0.patch


 HBASE-11568 allows to use replication to send wal edits from the primary to 
 the replicas.
 sometimes the memstore replication is not required, so it will be nice have a 
 flag to disable it.
 the result will be more or less the same to what we have in phase-1, but with 
 the row-level consistency provided by the flush edit transfered via 
 replication to refresh the hfiles.
 create 't1', 'f', {REGION_REPLICATION = 2, REGION_MEMSTORE_REPLICATION = 
 false}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)