hbase git commit: HBASE-20737 (addendum) put collection into ArrayList instead of addAll function -- RetriesExhaustedWithDetailsException.java

2018-06-19 Thread chia7712
Repository: hbase
Updated Branches:
  refs/heads/master c08eff67a -> d23a517b6


HBASE-20737 (addendum) put collection into ArrayList instead of addAll function 
-- RetriesExhaustedWithDetailsException.java

Signed-off-by: Chia-Ping Tsai 


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/d23a517b
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/d23a517b
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/d23a517b

Branch: refs/heads/master
Commit: d23a517b6129a90f69062b7558bc777a4b76bf8f
Parents: c08eff6
Author: taiynlee 
Authored: Tue Jun 19 08:42:47 2018 +
Committer: Chia-Ping Tsai 
Committed: Wed Jun 20 14:41:36 2018 +0800

--
 .../hadoop/hbase/client/RetriesExhaustedWithDetailsException.java | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/d23a517b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
--
diff --git 
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
 
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
index 0cce728..ecbada9 100644
--- 
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
+++ 
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
@@ -117,8 +117,7 @@ extends RetriesExhaustedException {
 String s = getDesc(classifyExs(exceptions));
 StringBuilder addrs = new StringBuilder(s);
 addrs.append("servers with issues: ");
-Set uniqAddr = new HashSet<>();
-uniqAddr.addAll(hostnamePort);
+Set uniqAddr = new HashSet<>(hostnamePort);
 
 for (String addr : uniqAddr) {
   addrs.append(addr).append(", ");



hbase git commit: HBASE-20737 (addendum) put collection into ArrayList instead of addAll function -- RetriesExhaustedWithDetailsException.java

2018-06-19 Thread chia7712
Repository: hbase
Updated Branches:
  refs/heads/branch-2 83969b0da -> 8aabe36a4


HBASE-20737 (addendum) put collection into ArrayList instead of addAll function 
-- RetriesExhaustedWithDetailsException.java

Signed-off-by: Chia-Ping Tsai 


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/8aabe36a
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/8aabe36a
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/8aabe36a

Branch: refs/heads/branch-2
Commit: 8aabe36a49800ebf81486930d314441e132ca084
Parents: 83969b0
Author: taiynlee 
Authored: Tue Jun 19 08:42:47 2018 +
Committer: Chia-Ping Tsai 
Committed: Wed Jun 20 14:46:04 2018 +0800

--
 .../hadoop/hbase/client/RetriesExhaustedWithDetailsException.java | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/8aabe36a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
--
diff --git 
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
 
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
index 0cce728..ecbada9 100644
--- 
a/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
+++ 
b/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
@@ -117,8 +117,7 @@ extends RetriesExhaustedException {
 String s = getDesc(classifyExs(exceptions));
 StringBuilder addrs = new StringBuilder(s);
 addrs.append("servers with issues: ");
-Set uniqAddr = new HashSet<>();
-uniqAddr.addAll(hostnamePort);
+Set uniqAddr = new HashSet<>(hostnamePort);
 
 for (String addr : uniqAddr) {
   addrs.append(addr).append(", ");



hbase git commit: HBASE-20742 Always create WAL directory for region server

2018-06-19 Thread zhangduo
Repository: hbase
Updated Branches:
  refs/heads/branch-2 9eeb50182 -> 83969b0da


HBASE-20742 Always create WAL directory for region server


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/83969b0d
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/83969b0d
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/83969b0d

Branch: refs/heads/branch-2
Commit: 83969b0da104bc7e785272f23e375307baefb012
Parents: 9eeb501
Author: zhangduo 
Authored: Fri Jun 15 22:44:44 2018 +0800
Committer: zhangduo 
Committed: Wed Jun 20 14:21:28 2018 +0800

--
 .../hbase/regionserver/HRegionServer.java   |   5 +
 .../TestRegionServerCrashDisableWAL.java| 106 +++
 2 files changed, 111 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/83969b0d/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
--
diff --git 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
index f3db9ab..4cca2c5 100644
--- 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
+++ 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
@@ -1794,6 +1794,11 @@ public class HRegionServer extends HasThread implements
   throw new RegionServerRunningException(
   "Region server has already created directory at " + 
this.serverName.toString());
 }
+// Always create wal directory as now we need this when master restarts to 
find out the live
+// region servers.
+if (!this.walFs.mkdirs(logDir)) {
+  throw new IOException("Can not create wal directory " + logDir);
+}
 // Instantiate replication if replication enabled. Pass it the log 
directories.
 createNewReplicationInstance(conf, this, this.walFs, logDir, oldLogDir,
   factory.getWALProvider());

http://git-wip-us.apache.org/repos/asf/hbase/blob/83969b0d/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerCrashDisableWAL.java
--
diff --git 
a/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerCrashDisableWAL.java
 
b/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerCrashDisableWAL.java
new file mode 100644
index 000..c4571ac
--- /dev/null
+++ 
b/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerCrashDisableWAL.java
@@ -0,0 +1,106 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.hadoop.hbase.regionserver;
+
+import static org.junit.Assert.assertEquals;
+
+import java.io.IOException;
+import org.apache.hadoop.hbase.HBaseClassTestRule;
+import org.apache.hadoop.hbase.HBaseTestingUtility;
+import org.apache.hadoop.hbase.TableName;
+import org.apache.hadoop.hbase.client.Get;
+import org.apache.hadoop.hbase.client.Put;
+import org.apache.hadoop.hbase.client.Table;
+import org.apache.hadoop.hbase.master.HMaster;
+import org.apache.hadoop.hbase.master.ServerManager;
+import org.apache.hadoop.hbase.testclassification.MediumTests;
+import org.apache.hadoop.hbase.testclassification.RegionServerTests;
+import org.apache.hadoop.hbase.util.Bytes;
+import org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread;
+import org.junit.AfterClass;
+import org.junit.BeforeClass;
+import org.junit.ClassRule;
+import org.junit.Test;
+import org.junit.experimental.categories.Category;
+
+/**
+ * Testcase for HBASE-20742
+ */
+@Category({ RegionServerTests.class, MediumTests.class })
+public class TestRegionServerCrashDisableWAL {
+
+  @ClassRule
+  public static final HBaseClassTestRule CLASS_RULE =
+HBaseClassTestRule.forClass(TestRegionServerCrashDisableWAL.class);
+
+  private static final HBaseTestingUtility UTIL = new HBaseTestingUtility();
+
+  private static TableName TABLE_NAM

hbase git commit: HBASE-20742 Always create WAL directory for region server

2018-06-19 Thread zhangduo
Repository: hbase
Updated Branches:
  refs/heads/master 9101fc246 -> c08eff67a


HBASE-20742 Always create WAL directory for region server


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/c08eff67
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/c08eff67
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/c08eff67

Branch: refs/heads/master
Commit: c08eff67afd8ac696c45a383077d4a42fed85ba2
Parents: 9101fc2
Author: zhangduo 
Authored: Fri Jun 15 22:44:44 2018 +0800
Committer: zhangduo 
Committed: Wed Jun 20 14:21:23 2018 +0800

--
 .../hbase/regionserver/HRegionServer.java   |   5 +
 .../TestRegionServerCrashDisableWAL.java| 106 +++
 2 files changed, 111 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/c08eff67/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
--
diff --git 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
index db7052e..1ca76ed 100644
--- 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
+++ 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
@@ -1813,6 +1813,11 @@ public class HRegionServer extends HasThread implements
   throw new RegionServerRunningException(
   "Region server has already created directory at " + 
this.serverName.toString());
 }
+// Always create wal directory as now we need this when master restarts to 
find out the live
+// region servers.
+if (!this.walFs.mkdirs(logDir)) {
+  throw new IOException("Can not create wal directory " + logDir);
+}
 // Instantiate replication if replication enabled. Pass it the log 
directories.
 createNewReplicationInstance(conf, this, this.walFs, logDir, oldLogDir,
   factory.getWALProvider());

http://git-wip-us.apache.org/repos/asf/hbase/blob/c08eff67/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerCrashDisableWAL.java
--
diff --git 
a/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerCrashDisableWAL.java
 
b/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerCrashDisableWAL.java
new file mode 100644
index 000..c4571ac
--- /dev/null
+++ 
b/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerCrashDisableWAL.java
@@ -0,0 +1,106 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.hadoop.hbase.regionserver;
+
+import static org.junit.Assert.assertEquals;
+
+import java.io.IOException;
+import org.apache.hadoop.hbase.HBaseClassTestRule;
+import org.apache.hadoop.hbase.HBaseTestingUtility;
+import org.apache.hadoop.hbase.TableName;
+import org.apache.hadoop.hbase.client.Get;
+import org.apache.hadoop.hbase.client.Put;
+import org.apache.hadoop.hbase.client.Table;
+import org.apache.hadoop.hbase.master.HMaster;
+import org.apache.hadoop.hbase.master.ServerManager;
+import org.apache.hadoop.hbase.testclassification.MediumTests;
+import org.apache.hadoop.hbase.testclassification.RegionServerTests;
+import org.apache.hadoop.hbase.util.Bytes;
+import org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread;
+import org.junit.AfterClass;
+import org.junit.BeforeClass;
+import org.junit.ClassRule;
+import org.junit.Test;
+import org.junit.experimental.categories.Category;
+
+/**
+ * Testcase for HBASE-20742
+ */
+@Category({ RegionServerTests.class, MediumTests.class })
+public class TestRegionServerCrashDisableWAL {
+
+  @ClassRule
+  public static final HBaseClassTestRule CLASS_RULE =
+HBaseClassTestRule.forClass(TestRegionServerCrashDisableWAL.class);
+
+  private static final HBaseTestingUtility UTIL = new HBaseTestingUtility();
+
+  private static TableName TABLE_NAME = 

[51/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.


Project: http://git-wip-us.apache.org/repos/asf/hbase-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase-site/commit/65565d77
Tree: http://git-wip-us.apache.org/repos/asf/hbase-site/tree/65565d77
Diff: http://git-wip-us.apache.org/repos/asf/hbase-site/diff/65565d77

Branch: refs/heads/asf-site
Commit: 65565d77b57883970178f38f7446391ea9094d0a
Parents: 6304145
Author: jenkins 
Authored: Wed Jun 20 04:24:54 2018 +
Committer: jenkins 
Committed: Wed Jun 20 04:24:54 2018 +

--
 acid-semantics.html | 4 +-
 apache_hbase_reference_guide.pdf| 57222 -
 book.html   |  1775 +-
 bulk-loads.html | 4 +-
 checkstyle-aggregate.html   | 22582 ---
 checkstyle.rss  |38 +-
 coc.html| 4 +-
 dependencies.html   | 4 +-
 dependency-convergence.html | 4 +-
 dependency-info.html| 4 +-
 dependency-management.html  | 4 +-
 devapidocs/allclasses-frame.html| 1 +
 devapidocs/allclasses-noframe.html  | 1 +
 devapidocs/constant-values.html |49 +-
 devapidocs/deprecated-list.html |97 +-
 devapidocs/index-all.html   |   422 +-
 ...aTableAccessor.ReplicationBarrierResult.html |18 +-
 .../apache/hadoop/hbase/MetaTableAccessor.html  |84 +-
 .../org/apache/hadoop/hbase/ScheduledChore.html | 2 +-
 .../hadoop/hbase/backup/package-tree.html   | 4 +-
 .../hbase/class-use/PleaseHoldException.html| 4 +-
 .../hbase/class-use/RegionStateListener.html|35 -
 .../hadoop/hbase/class-use/ScheduledChore.html  | 4 +
 .../hadoop/hbase/class-use/ServerName.html  |   202 +-
 .../hadoop/hbase/class-use/TableName.html   |18 +-
 .../hbase/client/class-use/RegionInfo.html  |36 +-
 .../hadoop/hbase/client/package-tree.html   |26 +-
 .../hadoop/hbase/filter/package-tree.html   | 6 +-
 .../hadoop/hbase/io/hfile/package-tree.html | 6 +-
 .../apache/hadoop/hbase/ipc/package-tree.html   | 2 +-
 .../hadoop/hbase/mapreduce/package-tree.html| 2 +-
 ...talogJanitor.SplitParentFirstComparator.html | 8 +-
 .../hadoop/hbase/master/CatalogJanitor.html |18 +-
 .../master/HMaster.InitializationMonitor.html   |20 +-
 .../master/HMaster.MasterStoppedException.html  | 4 +-
 .../hbase/master/HMaster.RedirectServlet.html   |12 +-
 .../org/apache/hadoop/hbase/master/HMaster.html |   864 +-
 .../master/HMasterCommandLine.LocalHMaster.html | 2 +-
 .../hbase/master/MasterMetaBootstrap.html   |75 +-
 .../hadoop/hbase/master/MasterServices.html |   118 +-
 .../hadoop/hbase/master/MasterWalManager.html   |   106 +-
 .../hbase/master/RegionServerTracker.html   |62 +-
 .../ServerManager.FlushedSequenceIdFlusher.html |   302 +
 .../hadoop/hbase/master/ServerManager.html  |   613 +-
 .../SnapshotOfRegionAssignmentFromMeta.html | 4 +-
 ...signmentManager.RegionInTransitionChore.html | 6 +-
 ...ssignmentManager.RegionInTransitionStat.html |40 +-
 .../master/assignment/AssignmentManager.html|   799 +-
 .../master/assignment/RegionStateStore.html |42 +-
 .../assignment/RegionTransitionProcedure.html   |14 +-
 .../hbase/master/class-use/MasterServices.html  | 4 +-
 .../master/class-use/RegionState.State.html |12 +-
 .../ServerManager.FlushedSequenceIdFlusher.html |   165 +
 .../normalizer/class-use/RegionNormalizer.html  |48 -
 .../hbase/master/normalizer/package-use.html|23 -
 .../hadoop/hbase/master/package-summary.html|19 +-
 .../hadoop/hbase/master/package-tree.html   | 5 +-
 .../apache/hadoop/hbase/master/package-use.html |26 +-
 .../AbstractStateMachineTableProcedure.html |22 +-
 .../hbase/master/procedure/FairQueue.html   | 4 +-
 .../master/procedure/InitMetaProcedure.html |   700 +
 .../procedure/MasterDDLOperationHelper.html | 4 +-
 ...ocedureEnv.MasterProcedureStoreListener.html |10 +-
 ...asterProcedureEnv.WALStoreLeaseRecovery.html |10 +-
 .../master/procedure/MasterProcedureEnv.html|68 +-
 .../procedure/MasterProcedureScheduler.html |   176 +-
 ...etaProcedureInterface.MetaOperationType.html | 8 +-
 .../procedure/MetaProcedureInterface.html   |26 +-
 .../hbase/master/procedure/MetaQueue.html   |29 +-
 .../master/procedure/RecoverMetaProcedure.html  |   137 +-
 .../hbase/master/procedure/SchemaLocking.html   |40 +-
 .../master/procedure/ServerCrashProcedure.html  |84 +-
 .../procedure/TableProcedureInterface.ht

[37/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/SnapshotOfRegionAssignmentFromMeta.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/SnapshotOfRegionAssignmentFromMeta.html
 
b/devapidocs/org/apache/hadoop/hbase/master/SnapshotOfRegionAssignmentFromMeta.html
index fc41962..be987ae 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/SnapshotOfRegionAssignmentFromMeta.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/SnapshotOfRegionAssignmentFromMeta.html
@@ -49,7 +49,7 @@ var activeTableTab = "activeTableTab";
 
 
 
-Prev Class
+Prev Class
 Next Class
 
 
@@ -680,7 +680,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 
-Prev Class
+Prev Class
 Next Class
 
 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
 
b/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
index b252c30..ffe8371 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
@@ -127,7 +127,7 @@ var activeTableTab = "activeTableTab";
 
 
 
-private static class AssignmentManager.RegionInTransitionChore
+private static class AssignmentManager.RegionInTransitionChore
 extends ProcedureInMemoryChore
 
 
@@ -240,7 +240,7 @@ extends 
 
 RegionInTransitionChore
-public RegionInTransitionChore(int timeoutMsec)
+public RegionInTransitionChore(int timeoutMsec)
 
 
 
@@ -257,7 +257,7 @@ extends 
 
 periodicExecute
-protected void periodicExecute(MasterProcedureEnv env)
+protected void periodicExecute(MasterProcedureEnv env)
 
 Specified by:
 periodicExecute in
 class ProcedureInMemoryChore

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
 
b/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
index ee10f5b..e04edb3 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
@@ -113,7 +113,7 @@ var activeTableTab = "activeTableTab";
 
 
 
-public static class AssignmentManager.RegionInTransitionStat
+public static class AssignmentManager.RegionInTransitionStat
 extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true";
 title="class or interface in java.lang">Object
 
 
@@ -266,7 +266,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 ritThreshold
-private final int ritThreshold
+private final int ritThreshold
 
 
 
@@ -275,7 +275,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 ritsOverThreshold
-private https://docs.oracle.com/javase/8/docs/api/java/util/HashMap.html?is-external=true";
 title="class or interface in java.util">HashMapString,RegionState> ritsOverThreshold
+private https://docs.oracle.com/javase/8/docs/api/java/util/HashMap.html?is-external=true";
 title="class or interface in java.util">HashMapString,RegionState> ritsOverThreshold
 
 
 
@@ -284,7 +284,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 statTimestamp
-private long statTimestamp
+private long statTimestamp
 
 
 
@@ -293,7 +293,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 oldestRITTime
-private long oldestRITTime
+private long oldestRITTime
 
 
 
@@ -302,7 +302,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 totalRITsTwiceThreshold
-private int totalRITsTwiceThreshold
+private int totalRITsTwiceThreshold
 
 
 
@@ -311,7 +311,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 totalRITs
-private int totalRITs
+private int totalRITs
 
 
 
@@ -328,7 +328,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 RegionInTransitionStat
-public RegionInTransitionStat(org.a

[44/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
 
b/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
index 3d89242..8c5430c 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
@@ -113,7 +113,7 @@ var activeTableTab = "activeTableTab";
 
 
 
-public static final class MetaTableAccessor.ReplicationBarrierResult
+public static final class MetaTableAccessor.ReplicationBarrierResult
 extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true";
 title="class or interface in java.lang">Object
 
 
@@ -223,7 +223,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 barriers
-private final long[] barriers
+private final long[] barriers
 
 
 
@@ -232,7 +232,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 state
-private final RegionState.State state
+private final RegionState.State state
 
 
 
@@ -241,7 +241,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 parentRegionNames
-private final https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List parentRegionNames
+private final https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List parentRegionNames
 
 
 
@@ -258,7 +258,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 ReplicationBarrierResult
-public ReplicationBarrierResult(long[] barriers,
+public ReplicationBarrierResult(long[] barriers,
 RegionState.State state,
 https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in 
java.util">List parentRegionNames)
 
@@ -277,7 +277,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 getBarriers
-public long[] getBarriers()
+public long[] getBarriers()
 
 
 
@@ -286,7 +286,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 getState
-public RegionState.State getState()
+public RegionState.State getState()
 
 
 
@@ -295,7 +295,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 getParentRegionNames
-public https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List getParentRegionNames()
+public https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List getParentRegionNames()
 
 
 
@@ -304,7 +304,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 toString
-public https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String toString()
+public https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String toString()
 
 Overrides:
 https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#toString--";
 title="class or interface in java.lang">toString in 
class https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true";
 title="class or interface in java.lang">Object

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.html
--
diff --git a/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.html 
b/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.html
index 9090907..7196891 100644
--- a/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.html
+++ b/devapidocs/org/apache/hadoop/hbase/MetaTableAccessor.html
@@ -2329,7 +2329,7 @@ public static 
 
 deleteFromMetaTable
-private static void deleteFromMetaTable(Connection connection,
+private static void deleteFromMetaTable(Connection connection,
 Delete d)
  throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true";
 title="class or interface in java.io">IOException
 Delete the passed d from the 
hbase:meta table.
@@ -2348,7 +2348,7 @@ public static 
 
 deleteFromMetaTable
-private static void deleteFromMetaTable(Connection connection,
+private static void deleteFromMetaTable(Connection connection,
 https://docs.oracle.com/javase/8/docs/api/java/uti

[45/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/index-all.html
--
diff --git a/devapidocs/index-all.html b/devapidocs/index-all.html
index c9237ca..4b64e1b 100644
--- a/devapidocs/index-all.html
+++ b/devapidocs/index-all.html
@@ -782,8 +782,12 @@
  
 acquireLock(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.procedure.CreateTableProcedure
  
-acquireLock(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.procedure.RecoverMetaProcedure
+acquireLock(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.procedure.InitMetaProcedure
  
+acquireLock(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.procedure.RecoverMetaProcedure
+
+Deprecated.
+ 
 acquireLock(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure
  
 acquireLock(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.replication.AbstractPeerProcedure
@@ -4686,6 +4690,8 @@
  
 await()
 - Method in class org.apache.hadoop.hbase.client.locking.EntityLock
  
+await()
 - Method in class org.apache.hadoop.hbase.master.procedure.InitMetaProcedure
+ 
 await()
 - Method in class org.apache.hadoop.hbase.master.procedure.ProcedurePrepareLatch
  
 await()
 - Method in class org.apache.hadoop.hbase.master.procedure.ProcedurePrepareLatch.CompatibilityLatch
@@ -10431,10 +10437,6 @@
 
 Throws an IOException back out if one is currently 
stored.
 
-checkFailoverCleanupCompleted(RegionInfo)
 - Method in class org.apache.hadoop.hbase.master.assignment.AssignmentManager
-
-Used to check if the failover cleanup is done.
-
 checkFamilies(Collection)
 - Method in class org.apache.hadoop.hbase.regionserver.HRegion
 
 Check the collection of families for validity.
@@ -10630,6 +10632,10 @@
 
 checkLowReplicationInterval
 - Variable in class org.apache.hadoop.hbase.regionserver.LogRoller
  
+checkMetaLoaded(RegionInfo)
 - Method in class org.apache.hadoop.hbase.master.assignment.AssignmentManager
+
+Used to check if the meta loading is done.
+
 checkMetaOnly
 - Variable in class org.apache.hadoop.hbase.util.HBaseFsck
  
 checkMetaRegion()
 - Method in class org.apache.hadoop.hbase.util.HBaseFsck
@@ -11140,6 +11146,8 @@
  
 chore()
 - Method in class org.apache.hadoop.hbase.master.normalizer.RegionNormalizerChore
  
+chore()
 - Method in class org.apache.hadoop.hbase.master.ServerManager.FlushedSequenceIdFlusher
+ 
 chore()
 - Method in class org.apache.hadoop.hbase.master.SplitLogManager.TimeoutMonitor
  
 chore()
 - Method in class org.apache.hadoop.hbase.quotas.FileSystemUtilizationChore
@@ -15590,12 +15598,16 @@
  
 completeWithNextStartRow(byte[],
 boolean) - Method in class org.apache.hadoop.hbase.client.AsyncScanSingleRegionRpcRetryingCaller
  
+completionCleanup(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.procedure.InitMetaProcedure
+ 
 completionCleanup(Procedure)
 - Method in class org.apache.hadoop.hbase.master.procedure.MasterProcedureScheduler
  
 completionCleanup(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.procedure.ModifyTableProcedure
  
 completionCleanup(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.procedure.RecoverMetaProcedure
- 
+
+Deprecated.
+ 
 completionCleanup(MasterProcedureEnv)
 - Method in class org.apache.hadoop.hbase.master.procedure.TruncateTableProcedure
  
 completionCleanup(TEnvironment)
 - Method in class org.apache.hadoop.hbase.procedure2.Procedure
@@ -20112,6 +20124,8 @@
 
 Exposed for hooking with unit tests.
 
+createProcedureExecutor()
 - Method in class org.apache.hadoop.hbase.master.HMaster
+ 
 createProtobufOutput()
 - Method in class org.apache.hadoop.hbase.rest.model.CellModel
  
 createProtobufOutput()
 - Method in class org.apache.hadoop.hbase.rest.model.CellSetModel
@@ -25188,12 +25202,16 @@
  
 deserializeStateData(ProcedureStateSerializer)
 - Method in class org.apache.hadoop.hbase.master.procedure.EnableTableProcedure
  
+deserializeStateData(ProcedureStateSerializer)
 - Method in class org.apache.hadoop.hbase.master.procedure.InitMetaProcedure
+ 
 deserializeStateData(ProcedureStateSerializer)
 - Method in class org.apache.hadoop.hbase.master.procedure.ModifyNamespaceProcedure
  
 deserializeStateData(ProcedureStateSerializer)
 - Method in class org.apache.hadoop.hbase.master.procedure.ModifyTableProcedure
  
 deserializeStateData(ProcedureStateSerializer)
 - Method in class org.apache.hadoop.hbase.master.procedure.RecoverMetaProcedure
- 
+
+Deprecated.
+ 
 deserializeStateData(ProcedureStateSerializer)
 - Method in class org.apache.hadoop.hbase.master.procedure.ReopenTableRegionsProcedure
  
 deserializeStateData(ProcedureStateSerializer)
 - Method in class org.apache.hadoop.hbase.master.procedure.RestoreSnapshotProcedure
@@ -26839,8 +26857,6 @@
 
 Enable the given Constraint.
 
-enableCrashedServerProcess

[39/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/MasterWalManager.html
--
diff --git a/devapidocs/org/apache/hadoop/hbase/master/MasterWalManager.html 
b/devapidocs/org/apache/hadoop/hbase/master/MasterWalManager.html
index fd9825b..3462352 100644
--- a/devapidocs/org/apache/hadoop/hbase/master/MasterWalManager.html
+++ b/devapidocs/org/apache/hadoop/hbase/master/MasterWalManager.html
@@ -18,8 +18,8 @@
 catch(err) {
 }
 //-->
-var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10};
-var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],8:["t4","Concrete Methods"]};
+var methods = 
{"i0":10,"i1":42,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],8:["t4","Concrete Methods"],32:["t6","Deprecated Methods"]};
 var altColor = "altColor";
 var rowColor = "rowColor";
 var tableTab = "tableTab";
@@ -110,7 +110,7 @@ var activeTableTab = "activeTableTab";
 
 
 @InterfaceAudience.Private
-public class MasterWalManager
+public class MasterWalManager
 extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true";
 title="class or interface in java.lang">Object
 This class abstracts a bunch of operations the HMaster needs
  when splitting log files e.g. finding log files, dirs etc.
@@ -213,7 +213,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 Method Summary
 
-All Methods Instance Methods Concrete Methods 
+All Methods Instance Methods Concrete Methods Deprecated Methods 
 
 Modifier and Type
 Method and Description
@@ -227,7 +227,12 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set
 getFailedServersFromLogFolders()
-Inspect the log directory to find dead servers which need 
recovery work
+Deprecated. 
+With proc-v2, we can 
record the crash server with procedure store, so do not need
+ to scan the wal directory to find out the splitting wal directory 
any more. Leave
+ it here only because RecoverMetaProcedure(which is 
also deprecated) uses
+ it.
+
 
 
 
@@ -235,47 +240,51 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 getFileSystem() 
 
 
+https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set
+getLiveServersFromWALDir() 
+
+
 private https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in 
java.util">List
 getLogDirs(https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set serverNames) 
 
-
+
 (package private) 
org.apache.hadoop.fs.Path
 getOldLogDir()
 Get the directory where old logs go
 
 
-
+
 (package private) SplitLogManager
 getSplitLogManager() 
 
-
+
 void
 splitLog(ServerName serverName) 
 
-
+
 void
 splitLog(https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set serverNames) 
 
-
+
 void
 splitLog(https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set serverNames,
 org.apache.hadoop.fs.PathFilter filter)
 This method is the base split method that splits WAL files 
matching a filter.
 
 
-
+
 void
 splitMetaLog(ServerName serverName)
 Specialized method to handle the splitting for meta 
WAL
 
 
-
+
 void
 splitMetaLog(https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set serverNames)
 Specialized method to handle the splitting for meta 
WAL
 
 
-
+
 void
 stop() 
 
@@ -307,7 +316,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 LOG
-private static final org.slf4j.Logger LOG
+private static final org.slf4j.Logger LOG
 
 
 
@@ -316,7 +325,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 META_FILTER
-static final org.apache.hadoop.fs.PathFilter META_FILTER
+static final org.apache.hadoop.fs.PathFilter META_FILTER
 
 
 
@@ -325,7 +334,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 NON_META_FILTER
-static final org.apache.hadoop.fs.PathFilter NON_META_FILTER
+static final org.apache.hadoop.fs.PathFilter NON_META_FILTER
 
 
 
@@ -334,7 +343,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 metricsMasterFilesystem
-private final MetricsMasterFileSystem metricsMasterFilesystem
+private final M

[46/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/checkstyle.rss
--
diff --git a/checkstyle.rss b/checkstyle.rss
index 9434310..21d7a7a 100644
--- a/checkstyle.rss
+++ b/checkstyle.rss
@@ -25,8 +25,8 @@ under the License.
 en-us
 ©2007 - 2018 The Apache Software Foundation
 
-  File: 3640,
- Errors: 16189,
+  File: 3641,
+ Errors: 16171,
  Warnings: 0,
  Infos: 0
   
@@ -69,7 +69,7 @@ under the License.
   0
 
 
-  1
+  0
 
   
   
@@ -8301,7 +8301,7 @@ under the License.
   0
 
 
-  10
+  8
 
   
   
@@ -15203,7 +15203,7 @@ under the License.
   0
 
 
-  7
+  4
 
   
   
@@ -17695,7 +17695,7 @@ under the License.
   0
 
 
-  32
+  31
 
   
   
@@ -19604,6 +19604,20 @@ under the License.
   
   
 
+  http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.master.procedure.InitMetaProcedure.java";>org/apache/hadoop/hbase/master/procedure/InitMetaProcedure.java
+
+
+  0
+
+
+  0
+
+
+  0
+
+  
+  
+
   http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.replication.ReplicationQueueInfo.java";>org/apache/hadoop/hbase/replication/ReplicationQueueInfo.java
 
 
@@ -22581,7 +22595,7 @@ under the License.
   0
 
 
-  1
+  0
 
   
   
@@ -24975,7 +24989,7 @@ under the License.
   0
 
 
-  2
+  0
 
   
   
@@ -31513,7 +31527,7 @@ under the License.
   0
 
 
-  22
+  19
 
   
   
@@ -33025,7 +33039,7 @@ under the License.
   0
 
 
-  3
+  1
 
   
   
@@ -39633,7 +39647,7 @@ under the License.
   0
 
 
-  3
+  2
 
   
   
@@ -45961,7 +45975,7 @@ under the License.
   0
 
 
-  3
+  1
 
   
   

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/coc.html
--
diff --git a/coc.html b/coc.html
index 900172c..0cbde73 100644
--- a/coc.html
+++ b/coc.html
@@ -7,7 +7,7 @@
   
 
 
-
+
 
 Apache HBase – 
   Code of Conduct Policy
@@ -375,7 +375,7 @@ email to mailto:priv...@hbase.apache.org";>the priv
 https://www.apache.org/";>The Apache Software 
Foundation.
 All rights reserved.  
 
-  Last Published: 
2018-06-19
+  Last Published: 
2018-06-20
 
 
 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/dependencies.html
--
diff --git a/dependencies.html b/dependencies.html
index 98d3638..d7892ca 100644
--- a/dependencies.html
+++ b/dependencies.html
@@ -7,7 +7,7 @@
   
 
 
-
+
 
 Apache HBase – Project Dependencies
 
@@ -440,7 +440,7 @@
 https://www.apache.org/";>The Apache Software 
Foundation.
 All rights reserved.  
 
-  Last Published: 
2018-06-19
+  Last Published: 
2018-06-20
 
 
 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/dependency-convergence.html
--
diff --git a/dependency-convergence.html b/dependency-convergence.html
index 65ec4f1..5b0ac2c 100644
--- a/dependency-convergence.html
+++ b/depende

[41/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/HMaster.html
--
diff --git a/devapidocs/org/apache/hadoop/hbase/master/HMaster.html 
b/devapidocs/org/apache/hadoop/hbase/master/HMaster.html
index c6822d1..2405d9a 100644
--- a/devapidocs/org/apache/hadoop/hbase/master/HMaster.html
+++ b/devapidocs/org/apache/hadoop/hbase/master/HMaster.html
@@ -18,7 +18,7 @@
 catch(err) {
 }
 //-->
-var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":9,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":9,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":9,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10,"i52":10,"i53":10,"i54":10,"i55":10,"i56":10,"i57":10,"i58":10,"i59":10,"i60":10,"i61":10,"i62":9,"i63":10,"i64":10,"i65":10,"i66":10,"i67":10,"i68":10,"i69":10,"i70":10,"i71":10,"i72":10,"i73":10,"i74":10,"i75":10,"i76":10,"i77":10,"i78":10,"i79":10,"i80":10,"i81":10,"i82":10,"i83":10,"i84":10,"i85":10,"i86":10,"i87":10,"i88":10,"i89":10,"i90":10,"i91":10,"i92":10,"i93":10,"i94":10,"i95":10,"i96":10,"i97":10,"i98":10,"i99":10,"i100":10,"i101":10,"i102":10,"i103":10,"i104":10,"i105":10,"i106":10,"i107":10,"i108":10,"i109"
 
:10,"i110":10,"i111":10,"i112":10,"i113":10,"i114":10,"i115":10,"i116":10,"i117":10,"i118":10,"i119":10,"i120":9,"i121":10,"i122":10,"i123":10,"i124":10,"i125":10,"i126":10,"i127":10,"i128":10,"i129":10,"i130":10,"i131":10,"i132":10,"i133":10,"i134":9,"i135":10,"i136":10,"i137":10,"i138":10,"i139":10,"i140":10,"i141":10,"i142":10,"i143":10,"i144":10,"i145":10,"i146":10,"i147":10,"i148":10,"i149":10,"i150":10,"i151":10,"i152":10,"i153":10,"i154":10,"i155":10,"i156":10,"i157":10,"i158":10,"i159":10,"i160":10,"i161":10,"i162":10,"i163":10,"i164":10,"i165":10,"i166":10,"i167":10,"i168":10,"i169":10,"i170":10,"i171":10,"i172":9};
+var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":9,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":9,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":9,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10,"i52":10,"i53":10,"i54":10,"i55":10,"i56":10,"i57":10,"i58":10,"i59":10,"i60":10,"i61":10,"i62":10,"i63":9,"i64":10,"i65":10,"i66":10,"i67":10,"i68":10,"i69":10,"i70":10,"i71":10,"i72":10,"i73":10,"i74":10,"i75":10,"i76":10,"i77":10,"i78":10,"i79":10,"i80":10,"i81":10,"i82":10,"i83":10,"i84":10,"i85":10,"i86":10,"i87":10,"i88":10,"i89":10,"i90":10,"i91":10,"i92":10,"i93":10,"i94":10,"i95":10,"i96":10,"i97":10,"i98":10,"i99":10,"i100":10,"i101":10,"i102":10,"i103":10,"i104":10,"i105":10,"i106":10,"i107":10,"i108":10,"i109"
 
:10,"i110":10,"i111":10,"i112":10,"i113":10,"i114":10,"i115":10,"i116":10,"i117":10,"i118":10,"i119":10,"i120":9,"i121":10,"i122":10,"i123":10,"i124":10,"i125":10,"i126":10,"i127":10,"i128":10,"i129":10,"i130":10,"i131":10,"i132":10,"i133":9,"i134":10,"i135":10,"i136":10,"i137":10,"i138":10,"i139":10,"i140":10,"i141":10,"i142":10,"i143":10,"i144":10,"i145":10,"i146":10,"i147":10,"i148":10,"i149":10,"i150":10,"i151":10,"i152":10,"i153":10,"i154":10,"i155":10,"i156":10,"i157":10,"i158":10,"i159":10,"i160":10,"i161":10,"i162":10,"i163":10,"i164":10,"i165":10,"i166":10,"i167":10,"i168":10,"i169":9};
 var tabs = {65535:["t0","All Methods"],1:["t1","Static 
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
 var altColor = "altColor";
 var rowColor = "rowColor";
@@ -128,7 +128,7 @@ var activeTableTab = "activeTableTab";
 
 
 @InterfaceAudience.LimitedPrivate(value="Tools")
-public class HMaster
+public class HMaster
 extends HRegionServer
 implements MasterServices
 HMaster is the "master server" for HBase. An HBase cluster 
has one active
@@ -422,42 +422,38 @@ implements rsFatals 
 
 
-private ProcedureEvent
-serverCrashProcessingEnabled 
-
-
 private ServerManager
 serverManager 
 
-
+
 (package private) boolean
 serviceStarted 
 
-
+
 (package private) SnapshotManager
 snapshotManager 
 
-
+
 private SnapshotQuotaObserverChore
 snapshotQuotaChore 
 
-
+
 private SpaceQuotaSnapshotNotifier
 spaceQuotaSnapshotNotifier 
 
-
+
 private SplitOrMergeTracker
 splitOrMergeTracker 
 
-
+
 private long
 splitPlanCount 
 
-
+
 private TableStateManager
 tableStateManager 
 
-
+
 private MasterWalManager
 walManager 
 
@@ -649,27 +645,31 @@ implements 
+private void
+createProcedureExecutor() 
+
+
 private SpaceQuotaSnapshotNotifier
 createQuotaSnapshotNotifier() 
 
-
+
 protected RSRpcServices
 createRpcSer

[38/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/ServerManager.html
--
diff --git a/devapidocs/org/apache/hadoop/hbase/master/ServerManager.html 
b/devapidocs/org/apache/hadoop/hbase/master/ServerManager.html
index 2d0d7ff..d0b6408 100644
--- a/devapidocs/org/apache/hadoop/hbase/master/ServerManager.html
+++ b/devapidocs/org/apache/hadoop/hbase/master/ServerManager.html
@@ -18,7 +18,7 @@
 catch(err) {
 }
 //-->
-var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":9,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10};
+var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":9,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10};
 var tabs = {65535:["t0","All Methods"],1:["t1","Static 
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
 var altColor = "altColor";
 var rowColor = "rowColor";
@@ -50,7 +50,7 @@ var activeTableTab = "activeTableTab";
 
 
 Prev Class
-Next Class
+Next Class
 
 
 Frames
@@ -74,7 +74,7 @@ var activeTableTab = "activeTableTab";
 
 
 Summary: 
-Nested | 
+Nested | 
 Field | 
 Constr | 
 Method
@@ -110,7 +110,7 @@ var activeTableTab = "activeTableTab";
 
 
 @InterfaceAudience.Private
-public class ServerManager
+public class ServerManager
 extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true";
 title="class or interface in java.lang">Object
 The ServerManager class manages info about region servers.
  
@@ -138,6 +138,25 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 
+
+
+
+
+
+Nested Class Summary
+
+Nested Classes 
+
+Modifier and Type
+Class and Description
+
+
+private class 
+ServerManager.FlushedSequenceIdFlusher 
+
+
+
+
 
 
 
@@ -169,47 +188,72 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 
+private ServerManager.FlushedSequenceIdFlusher
+flushedSeqIdFlusher 
+
+
+static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String
+FLUSHEDSEQUENCEID_FLUSHER_INTERVAL 
+
+
+static int
+FLUSHEDSEQUENCEID_FLUSHER_INTERVAL_DEFAULT 
+
+
 private https://docs.oracle.com/javase/8/docs/api/java/util/concurrent/ConcurrentNavigableMap.html?is-external=true";
 title="class or interface in 
java.util.concurrent">ConcurrentNavigableMapLong>
 flushedSequenceIdByRegion
 The last flushed sequence id for a region.
 
 
+
+private boolean
+isFlushSeqIdPersistInProgress 
+
 
+private static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String
+LAST_FLUSHED_SEQ_ID_FILE
+File on hdfs to store last flushed sequence id of 
regions
+
+
+
 private https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List
 listeners
 Listeners that are called on server events.
 
 
-
+
 private static org.slf4j.Logger
 LOG 
 
-
+
 private MasterServices
 master 
 
-
+
 private long
 maxSkew 
 
-
+
 private https://docs.oracle.com/javase/8/docs/api/java/util/concurrent/ConcurrentNavigableMap.html?is-external=true";
 title="class or interface in 
java.util.concurrent">ConcurrentNavigableMap
 onlineServers
 Map of registered servers to their current load
 
 
-
-private https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set
-queuedDeadServers
-Set of region servers which are dead but not processed 
immediately.
+
+static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String
+PERSIST_FLUSHEDSEQUENCEID
+see HBASE-20727
+ if set to true, flushedSequenceIdByRegion and storeFlushedSequenceIdsByRegion
+ will be persisted to HDFS and loaded when master restart to speed up log 
split
 
 
+
+static boolean
+PERSIST_FLUSHEDSEQUENCEID_DEFAULT 
+
 
-private https://docs.oracle.com/javase/8/docs/api/java/util/Map.html?is-external=true";
 title="class or 

[31/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.MetaOperationType.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.MetaOperationType.html
 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.MetaOperationType.html
index 376bec0..5e09558 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.MetaOperationType.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.MetaOperationType.html
@@ -122,7 +122,7 @@ var activeTableTab = "activeTableTab";
 
 
 
-public static enum MetaProcedureInterface.MetaOperationType
+public static enum MetaProcedureInterface.MetaOperationType
 extends https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true";
 title="class or interface in java.lang">Enum
 
 
@@ -207,7 +207,7 @@ the order they are declared.
 
 
 RECOVER
-public static final MetaProcedureInterface.MetaOperationType
 RECOVER
+public static final MetaProcedureInterface.MetaOperationType
 RECOVER
 
 
 
@@ -224,7 +224,7 @@ the order they are declared.
 
 
 values
-public static MetaProcedureInterface.MetaOperationType[] values()
+public static MetaProcedureInterface.MetaOperationType[] values()
 Returns an array containing the constants of this enum 
type, in
 the order they are declared.  This method may be used to iterate
 over the constants as follows:
@@ -244,7 +244,7 @@ for (MetaProcedureInterface.MetaOperationType c : 
MetaProcedureInterface.MetaOpe
 
 
 valueOf
-public static MetaProcedureInterface.MetaOperationType valueOf(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String name)
+public static MetaProcedureInterface.MetaOperationType valueOf(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String name)
 Returns the enum constant of this type with the specified 
name.
 The string must match exactly an identifier used to declare an
 enum constant in this type.  (Extraneous whitespace characters are 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.html
 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.html
index 46d47b9..c9e23ab 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaProcedureInterface.html
@@ -18,8 +18,8 @@
 catch(err) {
 }
 //-->
-var methods = {"i0":18};
-var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],16:["t5","Default Methods"]};
+var methods = {"i0":50};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],16:["t5","Default Methods"],32:["t6","Deprecated Methods"]};
 var altColor = "altColor";
 var rowColor = "rowColor";
 var tableTab = "tableTab";
@@ -104,9 +104,14 @@ var activeTableTab = "activeTableTab";
 RecoverMetaProcedure
 
 
+Deprecated. 
+only used for RecoverMetaProcedure.
 Should be removed along with
+ RecoverMetaProcedure.
+
 
-@InterfaceAudience.Private
-public interface MetaProcedureInterface
+https://docs.oracle.com/javase/8/docs/api/java/lang/Deprecated.html?is-external=true";
 title="class or interface in java.lang">@Deprecated
+ @InterfaceAudience.Private
+public interface MetaProcedureInterface
 
 
 
@@ -127,7 +132,9 @@ public interface 
 static class 
-MetaProcedureInterface.MetaOperationType 
+MetaProcedureInterface.MetaOperationType
+Deprecated. 
+ 
 
 
 
@@ -139,14 +146,16 @@ public interface 
-All Methods Instance Methods Default Methods 
+All Methods Instance Methods Default Methods Deprecated Methods 
 
 Modifier and Type
 Method and Description
 
 
 default MetaProcedureInterface.MetaOperationType
-getMetaOperationType() 
+getMetaOperationType()
+Deprecated. 
+ 
 
 
 
@@ -169,7 +178,8 @@ public interface 
 
 getMetaOperationType
-default MetaProcedureInterface.MetaOperationType getMetaOperationType()
+default MetaProcedureInterface.MetaOperationType getMetaOperationType()
+Deprecated. 
 
 
 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaQueue.html
--
diff --git a/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaQueue.html 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/MetaQueue.html
index 7b0ca22..2beef2b 100644
--- a/devapidocs/org/apache/hadoop/hbase/master/procedur

[34/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/InitMetaProcedure.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/InitMetaProcedure.html 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/InitMetaProcedure.html
new file mode 100644
index 000..2f903de
--- /dev/null
+++ b/devapidocs/org/apache/hadoop/hbase/master/procedure/InitMetaProcedure.html
@@ -0,0 +1,700 @@
+http://www.w3.org/TR/html4/loose.dtd";>
+
+
+
+
+
+InitMetaProcedure (Apache HBase 3.0.0-SNAPSHOT API)
+
+
+
+
+
+var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Use
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+Prev Class
+Next Class
+
+
+Frames
+No Frames
+
+
+All Classes
+
+
+
+
+
+
+
+Summary: 
+Nested | 
+Field | 
+Constr | 
+Method
+
+
+Detail: 
+Field | 
+Constr | 
+Method
+
+
+
+
+
+
+
+
+org.apache.hadoop.hbase.master.procedure
+Class InitMetaProcedure
+
+
+
+https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true";
 title="class or interface in java.lang">java.lang.Object
+
+
+org.apache.hadoop.hbase.procedure2.Procedure
+
+
+org.apache.hadoop.hbase.procedure2.StateMachineProcedure
+
+
+org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure
+
+
+org.apache.hadoop.hbase.master.procedure.InitMetaProcedure
+
+
+
+
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true";
 title="class or interface in java.lang">Comparable>, TableProcedureInterface
+
+
+
+@InterfaceAudience.Private
+public class InitMetaProcedure
+extends AbstractStateMachineTableProcedure
+This procedure is used to initialize meta table for a new 
hbase deploy. It will just schedule an
+ AssignProcedure to 
assign meta.
+
+
+
+
+
+
+
+
+
+
+
+Nested Class Summary
+
+
+
+
+Nested classes/interfaces inherited from 
class org.apache.hadoop.hbase.procedure2.StateMachineProcedure
+StateMachineProcedure.Flow
+
+
+
+
+
+Nested classes/interfaces inherited from 
class org.apache.hadoop.hbase.procedure2.Procedure
+Procedure.LockState
+
+
+
+
+
+Nested classes/interfaces inherited from 
interface org.apache.hadoop.hbase.master.procedure.TableProcedureInterface
+TableProcedureInterface.TableOperationType
+
+
+
+
+
+
+
+
+Field Summary
+
+Fields 
+
+Modifier and Type
+Field and Description
+
+
+private https://docs.oracle.com/javase/8/docs/api/java/util/concurrent/CountDownLatch.html?is-external=true";
 title="class or interface in 
java.util.concurrent">CountDownLatch
+latch 
+
+
+
+
+
+
+Fields inherited from class org.apache.hadoop.hbase.procedure2.Procedure
+NO_PROC_ID,
 NO_TIMEOUT
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors 
+
+Constructor and Description
+
+
+InitMetaProcedure() 
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All Methods Instance Methods Concrete Methods 
+
+Modifier and Type
+Method and Description
+
+
+protected Procedure.LockState
+acquireLock(MasterProcedureEnv env)
+The user should override this method if they need a lock on 
an Entity.
+
+
+
+void
+await() 
+
+
+protected void
+completionCleanup(MasterProcedureEnv env)
+Called when the procedure is marked as completed (success 
or rollback).
+
+
+
+protected void
+deserializeStateData(ProcedureStateSerializer serializer)
+Called on store load to allow the user to decode the 
previously serialized
+ state.
+
+
+
+protected StateMachineProcedure.Flow
+executeFromState(MasterProcedureEnv env,
+
org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.InitMetaState state)
+called to perform a single step of the specified 'state' of 
the procedure
+
+
+
+protected 
org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.InitMetaState
+getInitialState()
+Return the initial state object that will be used for the 
first call to 

[17/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.Visitor.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.Visitor.html 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.Visitor.html
index fea2b5a..c7a6cc4 100644
--- a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.Visitor.html
+++ b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.Visitor.html
@@ -1354,816 +1354,824 @@
 1346   */
 1347  public static void 
putsToMetaTable(final Connection connection, final List ps)
 1348  throws IOException {
-1349try (Table t = 
getMetaHTable(connection)) {
-1350  debugLogMutations(ps);
-1351  t.put(ps);
-1352}
-1353  }
-1354
-1355  /**
-1356   * Delete the passed 
d from the hbase:meta 
table.
-1357   * @param connection connection we're 
using
-1358   * @param d Delete to add to 
hbase:meta
-1359   */
-1360  private static void 
deleteFromMetaTable(final Connection connection, final Delete d)
-1361  throws IOException {
-1362List dels = new 
ArrayList<>(1);
-1363dels.add(d);
-1364deleteFromMetaTable(connection, 
dels);
-1365  }
-1366
-1367  /**
-1368   * Delete the passed 
deletes from the hbase:meta 
table.
-1369   * @param connection connection we're 
using
-1370   * @param deletes Deletes to add to 
hbase:meta  This list should support #remove.
-1371   */
-1372  private static void 
deleteFromMetaTable(final Connection connection, final List 
deletes)
-1373  throws IOException {
-1374try (Table t = 
getMetaHTable(connection)) {
-1375  debugLogMutations(deletes);
-1376  t.delete(deletes);
-1377}
-1378  }
-1379
-1380  /**
-1381   * Deletes some replica columns 
corresponding to replicas for the passed rows
-1382   * @param metaRows rows in 
hbase:meta
-1383   * @param replicaIndexToDeleteFrom the 
replica ID we would start deleting from
-1384   * @param numReplicasToRemove how many 
replicas to remove
-1385   * @param connection connection we're 
using to access meta table
-1386   */
-1387  public static void 
removeRegionReplicasFromMeta(Set metaRows,
-1388int replicaIndexToDeleteFrom, int 
numReplicasToRemove, Connection connection)
-1389  throws IOException {
-1390int absoluteIndex = 
replicaIndexToDeleteFrom + numReplicasToRemove;
-1391for (byte[] row : metaRows) {
-1392  long now = 
EnvironmentEdgeManager.currentTime();
-1393  Delete deleteReplicaLocations = 
new Delete(row);
-1394  for (int i = 
replicaIndexToDeleteFrom; i < absoluteIndex; i++) {
-1395
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1396  getServerColumn(i), now);
-1397
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1398  getSeqNumColumn(i), now);
-1399
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1400  getStartCodeColumn(i), now);
-1401  }
-1402  deleteFromMetaTable(connection, 
deleteReplicaLocations);
-1403}
-1404  }
-1405
-1406  /**
-1407   * Execute the passed 
mutations against hbase:meta 
table.
-1408   * @param connection connection we're 
using
-1409   * @param mutations Puts and Deletes 
to execute on hbase:meta
-1410   * @throws IOException
-1411   */
-1412  public static void 
mutateMetaTable(final Connection connection,
-1413 
final List mutations)
-1414throws IOException {
-1415Table t = 
getMetaHTable(connection);
-1416try {
-1417  debugLogMutations(mutations);
-1418  t.batch(mutations, null);
-1419} catch (InterruptedException e) {
-1420  InterruptedIOException ie = new 
InterruptedIOException(e.getMessage());
-1421  ie.initCause(e);
-1422  throw ie;
-1423} finally {
-1424  t.close();
-1425}
-1426  }
-1427
-1428  private static void 
addRegionStateToPut(Put put, RegionState.State state) throws IOException {
-1429
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-1430.setRow(put.getRow())
-1431
.setFamily(HConstants.CATALOG_FAMILY)
-1432
.setQualifier(getRegionStateColumn())
-1433
.setTimestamp(put.getTimestamp())
-1434.setType(Cell.Type.Put)
-1435
.setValue(Bytes.toBytes(state.name()))
-1436.build());
-1437  }
-1438
-1439  /**
-1440   * Adds daughter region infos to 
hbase:meta row for the specified region. Note that this does not
-1441   * add its daughter's as different 
rows, but adds information about the daughters in the same row
-1442   * as the parent. Use
-1443   * {@link #splitRegion(Connection, 
RegionInfo, long, RegionInfo, RegionInfo, ServerName, int)}
-1444   * if you want to do that.
-1445   * @param connection connection we're 
using
-1446   * @param regionInfo

[43/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/class-use/ServerName.html
--
diff --git a/devapidocs/org/apache/hadoop/hbase/class-use/ServerName.html 
b/devapidocs/org/apache/hadoop/hbase/class-use/ServerName.html
index 97d7f19..844e600 100644
--- a/devapidocs/org/apache/hadoop/hbase/class-use/ServerName.html
+++ b/devapidocs/org/apache/hadoop/hbase/class-use/ServerName.html
@@ -3195,27 +3195,14 @@ Input/OutputFormats, a table indexing MapReduce job, 
and utility methods.
 
 
 private https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set
-ServerManager.queuedDeadServers
-Set of region servers which are dead but not processed 
immediately.
-
-
-
-private https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set
 RegionServerTracker.regionServers 
 
-
+
 private https://docs.oracle.com/javase/8/docs/api/java/util/Map.html?is-external=true";
 title="class or interface in java.util">Map
 SnapshotOfRegionAssignmentFromMeta.regionToRegionServerMap
 the region to region server map
 
 
-
-private https://docs.oracle.com/javase/8/docs/api/java/util/Map.html?is-external=true";
 title="class or interface in java.util">MapBoolean>
-ServerManager.requeuedDeadServers
-Set of region servers which are dead and submitted to 
ServerShutdownHandler to process but not
- fully processed immediately.
-
-
 
 private https://docs.oracle.com/javase/8/docs/api/java/util/Map.html?is-external=true";
 title="class or interface in java.util">Map
 ServerManager.rsAdmins
@@ -3335,29 +3322,34 @@ Input/OutputFormats, a table indexing MapReduce job, 
and utility methods.
 HMaster.getBackupMasters() 
 
 
-(package private) https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set
-ServerManager.getDeadNotExpiredServers() 
-
-
 protected https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">ListLong>>
 ClusterStatusPublisher.getDeadServers(long since)
 Get the servers which died since a given timestamp.
 
 
-
+
 https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List
 ServerManager.getDrainingServersList() 
 
-
+
 https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set
 MasterWalManager.getFailedServersFromLogFolders()
-Inspect the log directory to find dead servers which need 
recovery work
+Deprecated. 
+With proc-v2, we can 
record the crash server with procedure store, so do not need
+ to scan the wal directory to find out the splitting wal directory 
any more. Leave
+ it here only because RecoverMetaProcedure(which is 
also deprecated) uses
+ it.
+
 
 
-
+
 static https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List
 RegionPlacementMaintainer.getFavoredNodeList(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in 
java.lang">String favoredNodesStr) 
 
+
+https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set
+MasterWalManager.getLiveServersFromWALDir() 
+
 
 https://docs.oracle.com/javase/8/docs/api/java/util/Map.html?is-external=true";
 title="class or interface in java.util">Map
 ServerManager.getOnlineServers() 
@@ -3518,7 +3510,9 @@ Input/OutputFormats, a table indexing MapReduce job, and 
utility methods.
 
 
 boolean
-ServerManager.expireServer(ServerName serverName) 
+ServerManager.expireServer(ServerName serverName)
+Expire the passed server.
+
 
 
 private ServerName
@@ -3683,93 +3677,88 @@ Input/OutputFormats, a table indexing MapReduce job, 
and utility methods.
 
 
 void
-ServerManager.processDeadServer(ServerName serverName,
- boolean shouldSplitWal) 
-
-
-void
 HMaster.recommissionRegionServer(ServerName server,
 https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in 
java.util">List encodedRegionNames)
 Remove decommission marker (previously called 'draining'

[40/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/HMasterCommandLine.LocalHMaster.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/HMasterCommandLine.LocalHMaster.html
 
b/devapidocs/org/apache/hadoop/hbase/master/HMasterCommandLine.LocalHMaster.html
index 2d56475..75a99c7 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/HMasterCommandLine.LocalHMaster.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/HMasterCommandLine.LocalHMaster.html
@@ -247,7 +247,7 @@ extends 
 
 Methods inherited from class org.apache.hadoop.hbase.master.HMaster
-abort,
 abortProcedure,
 addColumn,
 addReplicationPeer,
 balance,
 balance,
 balanceSwitch,
 canCreateBaseZNode, canUpdateTableDescriptor,
 checkIfShouldMoveSystemRegionAsync,
 checkInitialized,
 checkServiceStarted,
 checkTableModifiable,
 configureInfoServer,
 constructMaster,
 createMetaBootstrap,
 createNamespace,
 createRpcServices,
 createServerManager,
 createSystemTable,
 createTable,
 decommissionRegionSer
 vers, decorateMasterConfiguration,
 deleteColumn,
 deleteNamespace,
 deleteTable,
 disableReplicationPeer,
 disableTable,
 enableReplicationPeer, enableTable,
 getAssignmentManager,
 getAverageLoad,
 getCatalogJanitor,
 getClientIdAuditPrefix,
 getClusterMetrics,
 getClusterMetrics,
 getClusterMetricsWi
 thoutCoprocessor, getClusterMetricsWithoutCoprocessor,
 getClusterSchema,
 getDumpServlet,
 getFavoredNodesManager,
 getHFileCleaner,
 getInitializedEvent,
 getLastMajorCompactionTimestamp,
 getLastMajorCompactionTimestampForRegion,
 getLoadBalancer,
 getLoadBalancerClassName,
 getLoadedCoprocessors,
 getLockManager,
 getLocks,
 getLogCleaner,
 getMasterActiveTime,
 getMasterCoprocessorHost,
 getMasterCoprocessors,
 getMasterFileSystem,
 getMasterFinishedInitializationTime,
 getMasterMetrics,
 getMasterProcedureExecutor,
 getMasterProcedureManagerHost,
 getMasterQuotaManager,
 getMasterRpcServices,
 getMasterStartTime,
 getMasterWalManager,
 getMergePlanCount,
 getMetaTableObserver,
 getMobCompactionState,
 getNamespace,
 getNamespaces,
 getNumWALFiles,
 getProcedures, getProcessName,
 getQuotaObserverChore,
 getRegionNormalizer,
 getRegionNormalizerTracker,
 getRegionServerFatalLogBuffer,
 getRegionServerInfoPort,
 getRegionServerVersion,
 getRemoteInetAddress,
 getReplicationPeerConfig,
 getReplicationPeerManager,
 getServerCrashProcessingEnabledEvent,
 getServerManager,
 getServerName,
 getSnapshotManager,
 getSnapshotQuotaObserverChore,
 getSpaceQuotaSnapshotNotifier,
 getSplitOrMergeTracker,
 getSplitPlanCount,
 getTableDescriptors,
 getTableRegionForRow,
 getTableStateManager,
 getUseThisHostnameInstead,
 
 getWalProcedureStore, getZooKeeper,
 initClusterSchemaService,
 initializeZKBasedSystemTrackers,
 isActiveMaster,
 isBalancerOn,
 isCatalogJanitorEnabled,
 isCleanerChoreEnabled,
 isInitialized,
 isInMaintenanceMode, isNormalizerOn,
 isServerCrashProcessingEnabled,
 isSplitOrMergeEnabled,
 listDecommissionedRegionServers,
 listReplicationPeers,
 listTableDescriptors,
 listTableDescriptorsByNamespace,
 listTableNames,
 listTableNamesByNamespace,
 login,
 main,
 mergeRegions,
 modifyColumn,
 modifyNamespace,
 modifyTable,
 move,
 normalizeRegions,
 recommissionRegionServer,
 recoverMeta,
 registerService,
 remoteProcedureCompleted,
 remoteProcedureFailed,
 removeReplicationPeer,
 reportMobCompactionEnd,
 reportMobCompactionStart,
 requestMobCompaction,
 restoreSnapshot,
 setCatalogJanitorEnabled,
 setInitialized,
 setServerCrashProcessingEnabled,
 shutdown,
 splitRegion,
 stop,
 stopMaster,
 stopServiceThreads,
 truncateTable,
 updateConfigurationForSpaceQuotaObserver,
 updateReplicationPeerConfig,
 waitForMasterActive
+abort,
 abortProcedure,
 addColumn,
 addReplicationPeer,
 balance,
 balance,
 balanceSwitch,
 canCreateBaseZNode, canUpdateTableDescriptor,
 checkIfShouldMoveSystemRegionAsync,
 checkInitialized,
 checkServiceStarted,
 checkTableModifiable,
 configureInfoServer,
 constructMaster,
 createMetaBootstrap,
 createNamespace,
 createRpcServices,
 createServerManager,
 createSystemTable,
 createTable,
 decommissionRegionSer
 vers, decorateMasterConfiguration,
 deleteColumn,
 deleteNamespace,
 deleteTable,
 disableReplicationPeer,
 disableTable,
 enableReplicationPeer, enableTable,
 getAssignmentManager,
 getAverageLoad,
 getCatalogJanitor,
 getClientIdAuditPrefix,
 getClusterMetrics,
 getClusterMetrics,
 getClusterMetricsWi
 thoutCoprocessor, getClusterMetricsWithoutCoprocessor,
 getClusterSchema,
 getDumpServlet,
 getFavoredNodesManager,
 getHFileCleaner,
 getInitializedEvent,
 getLastMajorCompactionTimestamp,
 getLastMajorCompactionTimestampForRegion,
 getLoadBalancer,
 getLoadBalancerClassName,
 getLoadedCoprocessors,
 getLockManager,
 getLocks,
 getLogCleaner,
 getMasterActiveTime,
 getMasterCoprocessorHost,
 getMasterCoprocessors,
 getMasterFileSystem,
 getMasterFinishedInitializationTime,
 get

[24/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CloseableVisitor.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CloseableVisitor.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CloseableVisitor.html
index fea2b5a..c7a6cc4 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CloseableVisitor.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CloseableVisitor.html
@@ -1354,816 +1354,824 @@
 1346   */
 1347  public static void 
putsToMetaTable(final Connection connection, final List ps)
 1348  throws IOException {
-1349try (Table t = 
getMetaHTable(connection)) {
-1350  debugLogMutations(ps);
-1351  t.put(ps);
-1352}
-1353  }
-1354
-1355  /**
-1356   * Delete the passed 
d from the hbase:meta 
table.
-1357   * @param connection connection we're 
using
-1358   * @param d Delete to add to 
hbase:meta
-1359   */
-1360  private static void 
deleteFromMetaTable(final Connection connection, final Delete d)
-1361  throws IOException {
-1362List dels = new 
ArrayList<>(1);
-1363dels.add(d);
-1364deleteFromMetaTable(connection, 
dels);
-1365  }
-1366
-1367  /**
-1368   * Delete the passed 
deletes from the hbase:meta 
table.
-1369   * @param connection connection we're 
using
-1370   * @param deletes Deletes to add to 
hbase:meta  This list should support #remove.
-1371   */
-1372  private static void 
deleteFromMetaTable(final Connection connection, final List 
deletes)
-1373  throws IOException {
-1374try (Table t = 
getMetaHTable(connection)) {
-1375  debugLogMutations(deletes);
-1376  t.delete(deletes);
-1377}
-1378  }
-1379
-1380  /**
-1381   * Deletes some replica columns 
corresponding to replicas for the passed rows
-1382   * @param metaRows rows in 
hbase:meta
-1383   * @param replicaIndexToDeleteFrom the 
replica ID we would start deleting from
-1384   * @param numReplicasToRemove how many 
replicas to remove
-1385   * @param connection connection we're 
using to access meta table
-1386   */
-1387  public static void 
removeRegionReplicasFromMeta(Set metaRows,
-1388int replicaIndexToDeleteFrom, int 
numReplicasToRemove, Connection connection)
-1389  throws IOException {
-1390int absoluteIndex = 
replicaIndexToDeleteFrom + numReplicasToRemove;
-1391for (byte[] row : metaRows) {
-1392  long now = 
EnvironmentEdgeManager.currentTime();
-1393  Delete deleteReplicaLocations = 
new Delete(row);
-1394  for (int i = 
replicaIndexToDeleteFrom; i < absoluteIndex; i++) {
-1395
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1396  getServerColumn(i), now);
-1397
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1398  getSeqNumColumn(i), now);
-1399
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1400  getStartCodeColumn(i), now);
-1401  }
-1402  deleteFromMetaTable(connection, 
deleteReplicaLocations);
-1403}
-1404  }
-1405
-1406  /**
-1407   * Execute the passed 
mutations against hbase:meta 
table.
-1408   * @param connection connection we're 
using
-1409   * @param mutations Puts and Deletes 
to execute on hbase:meta
-1410   * @throws IOException
-1411   */
-1412  public static void 
mutateMetaTable(final Connection connection,
-1413 
final List mutations)
-1414throws IOException {
-1415Table t = 
getMetaHTable(connection);
-1416try {
-1417  debugLogMutations(mutations);
-1418  t.batch(mutations, null);
-1419} catch (InterruptedException e) {
-1420  InterruptedIOException ie = new 
InterruptedIOException(e.getMessage());
-1421  ie.initCause(e);
-1422  throw ie;
-1423} finally {
-1424  t.close();
-1425}
-1426  }
-1427
-1428  private static void 
addRegionStateToPut(Put put, RegionState.State state) throws IOException {
-1429
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-1430.setRow(put.getRow())
-1431
.setFamily(HConstants.CATALOG_FAMILY)
-1432
.setQualifier(getRegionStateColumn())
-1433
.setTimestamp(put.getTimestamp())
-1434.setType(Cell.Type.Put)
-1435
.setValue(Bytes.toBytes(state.name()))
-1436.build());
-1437  }
-1438
-1439  /**
-1440   * Adds daughter region infos to 
hbase:meta row for the specified region. Note that this does not
-1441   * add its daughter's as different 
rows, but adds information about the daughters in the same row
-1442   * as the parent. Use
-1443   * {@link #splitRegion(Connection, 
RegionInfo, long, RegionInfo, RegionInfo, ServerName, int)}
-1444   * if you want to do that.
-1445   * @param connection con

[49/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/book.html
--
diff --git a/book.html b/book.html
index 0566e2e..ba28ae9 100644
--- a/book.html
+++ b/book.html
@@ -349,6 +349,8 @@
 197. Client Modifications
 198. Tracing from HBase Shell
 Appendix N: 0.95 RPC Specification
+Appendix O: Known 
Incompatibilities Among HBase Versions
+199. HBase 2.0 Incompatible 
Changes
 
 
 
@@ -38590,6 +38592,1777 @@ The server will return cellblocks compressed using 
this same compressor as long
 
 
 
+
+Appendix O: Known 
Incompatibilities Among HBase Versions
+
+
+
+
+
+199. HBase 2.0 Incompatible 
Changes
+
+
+This appendix describes incompatible changes from earlier versions of HBase 
against HBase 2.0.
+This list is not meant to be wholly encompassing of all possible 
incompatibilities.
+Instead, this content is intended to give insight into some obvious 
incompatibilities which most
+users will face coming from HBase 1.x releases.
+
+
+199.1. List of Major Changes 
for HBase 2.0
+
+
+
+HBASE-1912- HBCK is a HBase database checking tool for capturing the 
inconsistency. As an HBase administrator, you should not use HBase version 1.0  
hbck tool to check the HBase 2.0 database. Doing so will break the database and 
throw an exception error.
+
+
+HBASE-16189 and HBASE-18945- You cannot open the HBase 2.0 hfiles through 
HBase 1.0 version.  If you are an admin or an HBase user who is using HBase 
version 1.x, you must first do a rolling upgrade to the latest version of HBase 
1.x and then upgrade to HBase 2.0.
+
+
+HBASE-18240 - Changed the ReplicationEndpoint Interface. It also introduces 
a new hbase-third party 1.0 that packages all the third party utilities, which 
are expected to run in the hbase cluster.
+
+
+
+
+
+199.2. Coprocessor API changes
+
+
+
+HBASE-16769 - Deprecated PB references from MasterObserver and 
RegionServerObserver.
+
+
+HBASE-17312 - [JDK8] Use default method for Observer Coprocessors. The 
interface classes of BaseMasterAndRegionObserver, BaseMasterObserver, 
BaseRegionObserver, BaseRegionServerObserver and BaseWALObserver uses 
JDK8’s 'default' keyword to provide empty and no-op implementations.
+
+
+Interface HTableInterface
+HBase 2.0 introduces following changes to the methods listed below:
+
+
+
+
+199.2.1. [−] 
interface CoprocessorEnvironment changes (2)
+
+
+
+
+
+
+
+Change
+Result
+
+
+Abstract 
method getTable ( TableName ) has been removed.
+A client 
program may be interrupted by NoSuchMethodError exception.
+
+
+Abstract 
method getTable ( TableName, ExecutorService ) has been removed.
+A client 
program may be interrupted by NoSuchMethodError exception.
+
+
+
+
+
+
+Public Audience
+
+
+
+
+The following tables describes the coprocessor changes.
+
+
+[−] class CoprocessorRpcChannel  
(1)
+
+
+
+
+
+
+
+Change
+Result
+
+
+This class 
has become interface.
+A client 
program may be interrupted by IncompatibleClassChangeError or 
InstantiationError exception depending on the usage of this class.
+
+
+
+
+
+Class CoprocessorHost
+
+Classes that were Audience Private but were removed.
+
+
+
+
+
+
+
+
+Change
+Result
+
+
+Type of 
field coprocessors has been changed from java.util.SortedSet to 
org.apache.hadoop.hbase.util.SortedList.
+A client 
program may be interrupted by NoSuchFieldError exception.
+
+
+
+
+
+
+199.2.2. MasterObserver
+
+HBase 2.0 introduces following changes to the MasterObserver interface.
+
+
+[−] interface MasterObserver  
(14)
+
+
+
+
+
+
+
+Change
+Result
+
+
+Abstract 
method voidpostCloneSnapshot ( 
ObserverContext, 
HBaseProtos.SnapshotDescription, HTableDescriptor ) has been removed from this 
interface.
+A client 
program may be interrupted by NoSuchMethodError exception.
+
+
+Abstract 
method voidpostCreateTable ( 
ObserverContext, HTableDescriptor, 
HRegionInfo[ ] ) has been removed from this interface.
+A client 
program may be interrupted by NoSuchMethodErrorexception.
+
+
+Abstract 
method voidpostDeleteSnapshot 
(ObserverContext, 
HBaseProtos.SnapshotDescription ) has been removed from this interface.
+A client 
program may be interrupted by NoSuchMethodErrorexception.
+
+
+Abstract 
method voidpostGetTableDescriptors ( 
ObserverContext, 
List ) has been removed from this interface.
+A client 
program may be interrupted by NoSuchMethodErrorexception.
+
+
+Abstract 
method voidpostModifyTable ( 
ObserverContext, TableName, 
HTableDescriptor ) has been removed from this interface.
+A client 
program may be interrupted by NoSuchMethodErrorexception.
+
+
+Abstract 
method voidpostRestoreSnapshot ( 
ObserverContext, 
HBaseProtos.SnapshotDescription, HTableDescriptor ) has been removed from this 
interface.
+A client 
program may be interrupted by NoSuchMethodE

[42/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/client/class-use/RegionInfo.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/client/class-use/RegionInfo.html 
b/devapidocs/org/apache/hadoop/hbase/client/class-use/RegionInfo.html
index a22e91f..41db305 100644
--- a/devapidocs/org/apache/hadoop/hbase/client/class-use/RegionInfo.html
+++ b/devapidocs/org/apache/hadoop/hbase/client/class-use/RegionInfo.html
@@ -2923,8 +2923,8 @@ Input/OutputFormats, a table indexing MapReduce job, and 
utility methods.
 
 
 private void
-AssignmentManager.checkFailoverCleanupCompleted(RegionInfo hri)
-Used to check if the failover cleanup is done.
+AssignmentManager.checkMetaLoaded(RegionInfo hri)
+Used to check if the meta loading is done.
 
 
 
@@ -3025,12 +3025,12 @@ Input/OutputFormats, a table indexing MapReduce job, 
and utility methods.
   RegionInfo regionToMergeB) 
 
 
-private RegionInfo
-AssignmentManager.getMetaForRegion(RegionInfo regionInfo) 
+private ProcedureEvent
+AssignmentManager.getMetaAssignEvent(RegionInfo metaRegionInfo) 
 
 
-private ProcedureEvent
-AssignmentManager.getMetaInitializedEvent(RegionInfo metaRegionInfo) 
+private RegionInfo
+AssignmentManager.getMetaForRegion(RegionInfo regionInfo) 
 
 
 private long
@@ -3172,8 +3172,8 @@ Input/OutputFormats, a table indexing MapReduce job, and 
utility methods.
 
 
 private void
-AssignmentManager.setMetaInitialized(RegionInfo metaRegionInfo,
-  boolean isInitialized) 
+AssignmentManager.setMetaAssigned(RegionInfo metaRegionInfo,
+   boolean assigned) 
 
 
 protected void
@@ -3204,8 +3204,9 @@ Input/OutputFormats, a table indexing MapReduce job, and 
utility methods.
 
 
 private void
-RegionStateStore.updateMetaLocation(RegionInfo regionInfo,
-  ServerName serverName) 
+RegionStateStore.updateMetaLocation(RegionInfo regionInfo,
+  ServerName serverName,
+  RegionState.State state) 
 
 
 private void
@@ -3270,8 +3271,10 @@ Input/OutputFormats, a table indexing MapReduce job, and 
utility methods.
 
 
 boolean
-AssignmentManager.waitMetaInitialized(Procedure proc,
-   RegionInfo regionInfo) 
+AssignmentManager.waitMetaAssigned(Procedure proc,
+RegionInfo regionInfo)
+Notice that this event does not mean the AM has already 
finished region state rebuilding.
+
 
 
 
@@ -4246,6 +4249,7 @@ Input/OutputFormats, a table indexing MapReduce job, and 
utility methods.
 RecoverMetaProcedure.handleRIT(MasterProcedureEnv env,
  RegionInfo ri,
  ServerName crashedServerName)
+Deprecated. 
 Is the region stuck assigning to this failedMetaServer? If 
so, cancel the call
  just as we do over in ServerCrashProcedure#handleRIT except less to do here; 
less context
  to carry.
@@ -4263,14 +4267,14 @@ Input/OutputFormats, a table indexing MapReduce job, 
and utility methods.
 
 
 boolean
-MasterProcedureScheduler.waitRegion(Procedure procedure,
+MasterProcedureScheduler.waitRegion(Procedure procedure,
   RegionInfo regionInfo)
 Suspend the procedure if the specified region is already 
locked.
 
 
 
 boolean
-MasterProcedureScheduler.waitRegions(Procedure procedure,
+MasterProcedureScheduler.waitRegions(Procedure procedure,
TableName table,
RegionInfo... regionInfo)
 Suspend the procedure if the specified set of regions are 
already locked.
@@ -4278,14 +4282,14 @@ Input/OutputFormats, a table indexing MapReduce job, 
and utility methods.
 
 
 void
-MasterProcedureScheduler.wakeRegion(Procedure procedure,
+MasterProcedureScheduler.wakeRegion(Procedure procedure,
   RegionInfo regionInfo)
 Wake the procedures waiting for the specified region
 
 
 
 void
-MasterProcedureScheduler.wakeRegions(Procedure procedure,
+MasterProcedureScheduler.wakeRegions(Procedure procedure,
TableName table,
RegionInfo... regionInfo)
 Wake the procedures waiting for the specified regions

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/client/package-tree.html
--
diff --git a/devapidocs/org/apache/hadoop/hbase/client/package-tree.html 
b/devapidocs/org/apache/hadoop/hbase/client/package-tree.html
index fc95504..bbaaedf 100644
--- a/devapidocs/org/apache/hadoop/hbase/client/package-tree.html
+++ b/devapidocs/org/apache/hadoop/hbase/client/package-tree.html
@@ -552,24 +552,24 @@
 
 java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true";
 title="class or interface in java.lang">Enum (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true";
 title="class or interface in java.lang">Comparable, java.io.https://docs.oracle.com/javase/8/docs/api/java/i

[47/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/checkstyle-aggregate.html
--
diff --git a/checkstyle-aggregate.html b/checkstyle-aggregate.html
index 20f2aa6..f28ddac 100644
--- a/checkstyle-aggregate.html
+++ b/checkstyle-aggregate.html
@@ -7,7 +7,7 @@
   
 
 
-
+
 
 Apache HBase – Checkstyle Results
 
@@ -281,10 +281,10 @@
  Warnings
  Errors
 
-3640
+3641
 0
 0
-16189
+16171
 
 Files
 
@@ -822,7 +822,7 @@
 org/apache/hadoop/hbase/TestMetaTableAccessor.java
 0
 0
-10
+8
 
 org/apache/hadoop/hbase/TestMetaTableAccessorNoCluster.java
 0
@@ -4759,622 +4759,612 @@
 0
 1
 
-org/apache/hadoop/hbase/master/MockNoopMasterServices.java
-0
-0
-2
-
 org/apache/hadoop/hbase/master/MockRegionServer.java
 0
 0
 11
-
+
 org/apache/hadoop/hbase/master/RackManager.java
 0
 0
 2
-
+
 org/apache/hadoop/hbase/master/RegionPlacementMaintainer.java
 0
 0
 29
-
+
 org/apache/hadoop/hbase/master/RegionState.java
 0
 0
 86
-
+
 org/apache/hadoop/hbase/master/ServerListener.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/ServerManager.java
 0
 0
-22
-
+19
+
 org/apache/hadoop/hbase/master/SnapshotOfRegionAssignmentFromMeta.java
 0
 0
 13
-
+
 org/apache/hadoop/hbase/master/SnapshotSentinel.java
 0
 0
 2
-
+
 org/apache/hadoop/hbase/master/SplitLogManager.java
 0
 0
 17
-
+
 org/apache/hadoop/hbase/master/SplitOrMergeTracker.java
 0
 0
 3
-
+
 org/apache/hadoop/hbase/master/TableNamespaceManager.java
 0
 0
 6
-
+
 org/apache/hadoop/hbase/master/TableStateManager.java
 0
 0
 7
-
+
 org/apache/hadoop/hbase/master/TestActiveMasterManager.java
 0
 0
 6
-
+
 org/apache/hadoop/hbase/master/TestCatalogJanitor.java
 0
 0
 13
-
+
 org/apache/hadoop/hbase/master/TestCatalogJanitorInMemoryStates.java
 0
 0
 2
-
+
 org/apache/hadoop/hbase/master/TestHMasterCommandLine.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/TestMaster.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/TestMasterFailoverBalancerPersistence.java
 0
 0
 4
-
+
 org/apache/hadoop/hbase/master/TestMasterFileSystem.java
 0
 0
 3
-
+
 org/apache/hadoop/hbase/master/TestMasterFileSystemWithWALDir.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/TestMasterMetrics.java
 0
 0
 4
-
+
 org/apache/hadoop/hbase/master/TestMasterMetricsWrapper.java
 0
 0
 3
-
+
 org/apache/hadoop/hbase/master/TestMasterNoCluster.java
 0
 0
 20
-
+
 org/apache/hadoop/hbase/master/TestMasterOperationsForRegionReplicas.java
 0
 0
 5
-
+
 org/apache/hadoop/hbase/master/TestMasterStatusServlet.java
 0
 0
 4
-
+
 org/apache/hadoop/hbase/master/TestMasterTransitions.java
 0
 0
 6
-
+
 org/apache/hadoop/hbase/master/TestMirroringTableStateManager.java
 0
 0
 5
-
+
 org/apache/hadoop/hbase/master/TestRegionPlacement.java
 0
 0
 20
-
+
 org/apache/hadoop/hbase/master/TestRegionPlacement2.java
 0
 0
 2
-
+
 org/apache/hadoop/hbase/master/TestRollingRestart.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/TestSplitLogManager.java
 0
 0
 7
-
+
 org/apache/hadoop/hbase/master/TestTableStateManager.java
 0
 0
 2
-
+
 org/apache/hadoop/hbase/master/TestWarmupRegion.java
 0
 0
 19
-
+
 org/apache/hadoop/hbase/master/assignment/AssignProcedure.java
 0
 0
 5
-
+
 org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 0
 0
-32
-
+31
+
 org/apache/hadoop/hbase/master/assignment/GCMergedRegionsProcedure.java
 0
 0
 16
-
+
 org/apache/hadoop/hbase/master/assignment/GCRegionProcedure.java
 0
 0
 32
-
+
 org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.java
 0
 0
 5
-
+
 org/apache/hadoop/hbase/master/assignment/MockMasterServices.java
 0
 0
-3
-
+2
+
 org/apache/hadoop/hbase/master/assignment/MoveRegionProcedure.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/assignment/RegionStateStore.java
 0
 0
 5
-
+
 org/apache/hadoop/hbase/master/assignment/RegionStates.java
 0
 0
 26
-
+
 org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 0
 0
 6
-
+
 org/apache/hadoop/hbase/master/assignment/SplitTableRegionProcedure.java
 0
 0
 8
-
+
 org/apache/hadoop/hbase/master/assignment/TestAssignmentManager.java
 0
 0
 4
-
+
 org/apache/hadoop/hbase/master/assignment/TestAssignmentOnRSCrash.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/assignment/TestRegionStates.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/assignment/TestSplitTableRegionProcedure.java
 0
 0
 2
-
+
 org/apache/hadoop/hbase/master/assignment/TestUnexpectedStateException.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
 0
 0
 4
-
+
 org/apache/hadoop/hbase/master/assignment/Util.java
 0
 0
 3
-
+
 org/apache/hadoop/hbase/master/balancer/BalancerChore.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/balancer/BalancerTestBase.java
 0
 0
 75
-
+
 org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
 0
 0
 60
-
+
 org/apache/hadoop/hbase/master/balancer/ClusterLoadState.java
 0
 0
 1
-
+
 org/apache/hadoop/hbase/master/balancer/ClusterStatusChore.java
 0
 0
 

[06/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/ServerManager.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/ServerManager.html 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/ServerManager.html
index 6b9e2a8..ba6e4aa 100644
--- a/devapidocs/src-html/org/apache/hadoop/hbase/master/ServerManager.html
+++ b/devapidocs/src-html/org/apache/hadoop/hbase/master/ServerManager.html
@@ -33,1047 +33,1151 @@
 025import java.util.ArrayList;
 026import java.util.Collections;
 027import java.util.HashMap;
-028import java.util.HashSet;
-029import java.util.Iterator;
-030import java.util.List;
-031import java.util.Map;
-032import java.util.Map.Entry;
-033import java.util.Set;
-034import 
java.util.concurrent.ConcurrentHashMap;
-035import 
java.util.concurrent.ConcurrentNavigableMap;
-036import 
java.util.concurrent.ConcurrentSkipListMap;
-037import 
java.util.concurrent.CopyOnWriteArrayList;
-038import 
java.util.concurrent.atomic.AtomicBoolean;
-039import java.util.function.Predicate;
-040import 
org.apache.hadoop.conf.Configuration;
-041import 
org.apache.hadoop.hbase.ClockOutOfSyncException;
-042import 
org.apache.hadoop.hbase.HConstants;
-043import 
org.apache.hadoop.hbase.NotServingRegionException;
-044import 
org.apache.hadoop.hbase.RegionMetrics;
-045import 
org.apache.hadoop.hbase.ServerMetrics;
-046import 
org.apache.hadoop.hbase.ServerMetricsBuilder;
-047import 
org.apache.hadoop.hbase.ServerName;
-048import 
org.apache.hadoop.hbase.YouAreDeadException;
-049import 
org.apache.hadoop.hbase.client.ClusterConnection;
-050import 
org.apache.hadoop.hbase.client.RegionInfo;
-051import 
org.apache.hadoop.hbase.client.RetriesExhaustedException;
-052import 
org.apache.hadoop.hbase.ipc.HBaseRpcController;
-053import 
org.apache.hadoop.hbase.ipc.RpcControllerFactory;
-054import 
org.apache.hadoop.hbase.monitoring.MonitoredTask;
-055import 
org.apache.hadoop.hbase.regionserver.HRegionServer;
-056import 
org.apache.hadoop.hbase.util.Bytes;
-057import 
org.apache.hadoop.hbase.zookeeper.ZKUtil;
-058import 
org.apache.hadoop.hbase.zookeeper.ZKWatcher;
-059import 
org.apache.yetus.audience.InterfaceAudience;
-060import 
org.apache.zookeeper.KeeperException;
-061import org.slf4j.Logger;
-062import org.slf4j.LoggerFactory;
-063
-064import 
org.apache.hbase.thirdparty.com.google.common.annotations.VisibleForTesting;
-065import 
org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations;
-066
-067import 
org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil;
-068import 
org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.AdminService;
-069import 
org.apache.hadoop.hbase.shaded.protobuf.generated.ClusterStatusProtos.RegionStoreSequenceIds;
-070import 
org.apache.hadoop.hbase.shaded.protobuf.generated.ClusterStatusProtos.StoreSequenceId;
-071import 
org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.RegionServerStartupRequest;
+028import java.util.Iterator;
+029import java.util.List;
+030import java.util.Map;
+031import java.util.Map.Entry;
+032import java.util.Set;
+033import 
java.util.concurrent.ConcurrentNavigableMap;
+034import 
java.util.concurrent.ConcurrentSkipListMap;
+035import 
java.util.concurrent.CopyOnWriteArrayList;
+036import 
java.util.concurrent.atomic.AtomicBoolean;
+037import java.util.function.Predicate;
+038import 
org.apache.hadoop.conf.Configuration;
+039import 
org.apache.hadoop.fs.FSDataInputStream;
+040import 
org.apache.hadoop.fs.FSDataOutputStream;
+041import org.apache.hadoop.fs.FileSystem;
+042import org.apache.hadoop.fs.Path;
+043import 
org.apache.hadoop.hbase.ClockOutOfSyncException;
+044import 
org.apache.hadoop.hbase.HConstants;
+045import 
org.apache.hadoop.hbase.NotServingRegionException;
+046import 
org.apache.hadoop.hbase.RegionMetrics;
+047import 
org.apache.hadoop.hbase.ScheduledChore;
+048import 
org.apache.hadoop.hbase.ServerMetrics;
+049import 
org.apache.hadoop.hbase.ServerMetricsBuilder;
+050import 
org.apache.hadoop.hbase.ServerName;
+051import 
org.apache.hadoop.hbase.YouAreDeadException;
+052import 
org.apache.hadoop.hbase.client.ClusterConnection;
+053import 
org.apache.hadoop.hbase.client.RegionInfo;
+054import 
org.apache.hadoop.hbase.client.RetriesExhaustedException;
+055import 
org.apache.hadoop.hbase.ipc.HBaseRpcController;
+056import 
org.apache.hadoop.hbase.ipc.RpcControllerFactory;
+057import 
org.apache.hadoop.hbase.master.assignment.RegionStates;
+058import 
org.apache.hadoop.hbase.monitoring.MonitoredTask;
+059import 
org.apache.hadoop.hbase.regionserver.HRegionServer;
+060import 
org.apache.hadoop.hbase.util.Bytes;
+061import 
org.apache.hadoop.hbase.util.FSUtils;
+062import 
org.apache.hadoop.hbase.zookeeper.ZKUtil;
+063import 
org.apache.hadoop.hbase.zookeeper.ZKWatcher;
+064import 
org.apache.yetus.audience.InterfaceAudience;
+065import 
org.apache.zookeeper.Keepe

[50/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/apache_hbase_reference_guide.pdf
--
diff --git a/apache_hbase_reference_guide.pdf b/apache_hbase_reference_guide.pdf
index 90255f0..e443db0 100644
--- a/apache_hbase_reference_guide.pdf
+++ b/apache_hbase_reference_guide.pdf
@@ -5,16 +5,16 @@
 /Author (Apache HBase Team)
 /Creator (Asciidoctor PDF 1.5.0.alpha.15, based on Prawn 2.2.2)
 /Producer (Apache HBase Team)
-/ModDate (D:20180619001822+00'00')
-/CreationDate (D:20180619003342+00'00')
+/ModDate (D:20180620040607+00'00')
+/CreationDate (D:20180620042140+00'00')
 >>
 endobj
 2 0 obj
 << /Type /Catalog
 /Pages 3 0 R
-/Names 26 0 R
-/Outlines 4782 0 R
-/PageLabels 5027 0 R
+/Names 28 0 R
+/Outlines 4917 0 R
+/PageLabels 5164 0 R
 /PageMode /UseOutlines
 /OpenAction [7 0 R /FitH 842.89]
 /ViewerPreferences << /DisplayDocTitle true
@@ -23,8 +23,8 @@ endobj
 endobj
 3 0 obj
 << /Type /Pages
-/Count 748
-/Kids [7 0 R 12 0 R 14 0 R 16 0 R 18 0 R 20 0 R 22 0 R 24 0 R 44 0 R 47 0 R 50 
0 R 54 0 R 61 0 R 63 0 R 67 0 R 69 0 R 71 0 R 78 0 R 81 0 R 83 0 R 89 0 R 92 0 
R 94 0 R 96 0 R 103 0 R 110 0 R 115 0 R 117 0 R 133 0 R 138 0 R 146 0 R 155 0 R 
163 0 R 172 0 R 183 0 R 187 0 R 189 0 R 193 0 R 202 0 R 211 0 R 219 0 R 228 0 R 
233 0 R 242 0 R 250 0 R 259 0 R 272 0 R 279 0 R 289 0 R 297 0 R 305 0 R 312 0 R 
320 0 R 327 0 R 333 0 R 340 0 R 348 0 R 357 0 R 366 0 R 380 0 R 387 0 R 395 0 R 
402 0 R 410 0 R 419 0 R 429 0 R 437 0 R 444 0 R 453 0 R 465 0 R 475 0 R 482 0 R 
489 0 R 497 0 R 506 0 R 514 0 R 519 0 R 523 0 R 528 0 R 532 0 R 548 0 R 559 0 R 
563 0 R 578 0 R 583 0 R 588 0 R 590 0 R 592 0 R 595 0 R 597 0 R 599 0 R 607 0 R 
613 0 R 616 0 R 620 0 R 629 0 R 640 0 R 648 0 R 652 0 R 656 0 R 658 0 R 668 0 R 
683 0 R 690 0 R 701 0 R 711 0 R 722 0 R 734 0 R 754 0 R 763 0 R 767 0 R 773 0 R 
776 0 R 780 0 R 784 0 R 787 0 R 790 0 R 792 0 R 795 0 R 799 0 R 801 0 R 805 0 R 
811 0 R 816 0 R 820 0 R 823 0 R 829 0 R
  831 0 R 835 0 R 843 0 R 845 0 R 848 0 R 851 0 R 854 0 R 857 0 R 871 0 R 879 0 
R 890 0 R 901 0 R 907 0 R 917 0 R 928 0 R 931 0 R 935 0 R 938 0 R 943 0 R 952 0 
R 960 0 R 964 0 R 968 0 R 973 0 R 977 0 R 979 0 R 995 0 R 1006 0 R 1011 0 R 
1018 0 R 1021 0 R 1029 0 R 1037 0 R 1042 0 R 1047 0 R 1052 0 R 1054 0 R 1056 0 
R 1058 0 R 1068 0 R 1076 0 R 1080 0 R 1087 0 R 1094 0 R 1102 0 R 1106 0 R 1112 
0 R 1117 0 R 1125 0 R 1129 0 R 1134 0 R 1136 0 R 1142 0 R 1150 0 R 1156 0 R 
1163 0 R 1174 0 R 1178 0 R 1180 0 R 1182 0 R 1186 0 R 1189 0 R 1194 0 R 1197 0 
R 1209 0 R 1213 0 R 1219 0 R 1227 0 R 1232 0 R 1236 0 R 1240 0 R 1242 0 R 1245 
0 R 1248 0 R 1251 0 R 1255 0 R 1259 0 R 1263 0 R 1268 0 R 1272 0 R 1275 0 R 
1277 0 R 1287 0 R 1290 0 R 1298 0 R 1307 0 R 1313 0 R 1317 0 R 1319 0 R 1330 0 
R 1333 0 R 1339 0 R 1347 0 R 1350 0 R 1357 0 R 1364 0 R 1367 0 R 1369 0 R 1378 
0 R 1380 0 R 1382 0 R 1385 0 R 1387 0 R 1389 0 R 1391 0 R 1393 0 R 1396 0 R 
1400 0 R 1405 0 R 1407 0 R 1409 0 R 1411 0 R 1416 0 R 1423 0
  R 1429 0 R 1432 0 R 1434 0 R 1437 0 R 1441 0 R 1445 0 R 1448 0 R 1450 0 R 
1452 0 R 1455 0 R 1460 0 R 1466 0 R 1474 0 R 1488 0 R 1502 0 R 1505 0 R 1510 0 
R 1523 0 R 1528 0 R 1543 0 R 1551 0 R 1555 0 R 1564 0 R 1579 0 R 1593 0 R 1601 
0 R 1606 0 R 1617 0 R 1622 0 R 1628 0 R 1634 0 R 1646 0 R 1649 0 R 1658 0 R 
1661 0 R 1670 0 R 1676 0 R 1680 0 R 1692 0 R 1697 0 R 1703 0 R 1705 0 R 1712 0 
R 1720 0 R 1728 0 R 1732 0 R 1734 0 R 1736 0 R 1748 0 R 1754 0 R 1763 0 R 1769 
0 R 1782 0 R 1788 0 R 1794 0 R 1805 0 R 1811 0 R 1816 0 R 1821 0 R 1824 0 R 
1827 0 R 1832 0 R 1837 0 R 1844 0 R 1848 0 R 1853 0 R 1862 0 R 1867 0 R 1872 0 
R 1874 0 R 1883 0 R 1890 0 R 1896 0 R 1901 0 R 1905 0 R 1909 0 R 1914 0 R 1919 
0 R 1925 0 R 1927 0 R 1929 0 R 1932 0 R 1943 0 R 1946 0 R 1953 0 R 1961 0 R 
1966 0 R 1970 0 R 1975 0 R 1977 0 R 1980 0 R 1985 0 R 1988 0 R 1990 0 R 1993 0 
R 1996 0 R 1999 0 R 2009 0 R 2014 0 R 2019 0 R 2021 0 R 2029 0 R 2036 0 R 2043 
0 R 2049 0 R 2054 0 R 2056 0 R 2065 0 R 2075 0 R 2085 0 R 2091
  0 R 2098 0 R 2100 0 R 2105 0 R 2107 0 R 2109 0 R 2113 0 R 2116 0 R 2119 0 R 
2124 0 R 2128 0 R 2139 0 R 2142 0 R 2147 0 R 2150 0 R 2152 0 R 2157 0 R 2167 0 
R 2169 0 R 2171 0 R 2173 0 R 2175 0 R 2178 0 R 2180 0 R 2182 0 R 2185 0 R 2187 
0 R 2189 0 R 2193 0 R 2198 0 R 2207 0 R 2209 0 R 2211 0 R 2217 0 R 2219 0 R 
2224 0 R 2226 0 R 2228 0 R 2235 0 R 2240 0 R 2244 0 R 2249 0 R 2253 0 R 2255 0 
R 2257 0 R 2261 0 R 2264 0 R 2266 0 R 2268 0 R 2272 0 R 2274 0 R 2277 0 R 2279 
0 R 2281 0 R 2283 0 R 2290 0 R 2293 0 R 2298 0 R 2300 0 R 2302 0 R 2304 0 R 
2306 0 R 2314 0 R 2325 0 R 2339 0 R 2350 0 R 2354 0 R 2359 0 R 2363 0 R 2366 0 
R 2371 0 R 2377 0 R 2379 0 R 2382 0 R 2384 0 R 2386 0 R 2388 0 R 2393 0 R 2395 
0 R 2408 0 R 2411 0 R 2419 0 R 2425 0 R 2437 0 R 2451 0 R 2464 0 R 2483 0 R 
2485 0 R 2487 0 R 2491 0 R 2509 0 R 2515 0 R 2527 0 R 2531 0 R 2535 0 R 2544 0 
R 2556 0 R 2561 0 R 2571 0 R 2584 0 R 2603 0 R 2612 0 R 2615 0 R 2624 0 R 2641 
0 R 2648 0 R 2651 0 

[14/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.html 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.html
index 4229646..1814633 100644
--- a/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.html
+++ b/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.html
@@ -119,358 +119,355 @@
 111  protected void chore() {
 112try {
 113  AssignmentManager am = 
this.services.getAssignmentManager();
-114  if (this.enabled.get()
-115  && 
!this.services.isInMaintenanceMode()
-116  && am != null
-117  && 
am.isFailoverCleanupDone()
-118  && 
!am.hasRegionsInTransition()) {
-119scan();
-120  } else {
-121LOG.warn("CatalogJanitor is 
disabled! Enabled=" + this.enabled.get() +
-122", maintenanceMode=" + 
this.services.isInMaintenanceMode() +
-123", am=" + am + ", 
failoverCleanupDone=" + (am != null && am.isFailoverCleanupDone()) +
-124", hasRIT=" + (am != null 
&& am.hasRegionsInTransition()));
-125  }
-126} catch (IOException e) {
-127  LOG.warn("Failed scan of catalog 
table", e);
-128}
-129  }
-130
-131  /**
-132   * Scans hbase:meta and returns a 
number of scanned rows, and a map of merged
-133   * regions, and an ordered map of split 
parents.
-134   * @return triple of scanned rows, map 
of merged regions and map of split
-135   * parent regioninfos
-136   * @throws IOException
-137   */
-138  Triple, Map>
-139getMergedRegionsAndSplitParents() 
throws IOException {
-140return 
getMergedRegionsAndSplitParents(null);
-141  }
-142
-143  /**
-144   * Scans hbase:meta and returns a 
number of scanned rows, and a map of merged
-145   * regions, and an ordered map of split 
parents. if the given table name is
-146   * null, return merged regions and 
split parents of all tables, else only the
-147   * specified table
-148   * @param tableName null represents all 
tables
-149   * @return triple of scanned rows, and 
map of merged regions, and map of split
-150   * parent regioninfos
-151   * @throws IOException
-152   */
-153  Triple, Map>
-154getMergedRegionsAndSplitParents(final 
TableName tableName) throws IOException {
-155final boolean isTableSpecified = 
(tableName != null);
-156// TODO: Only works with single 
hbase:meta region currently.  Fix.
-157final AtomicInteger count = new 
AtomicInteger(0);
-158// Keep Map of found split parents.  
There are candidates for cleanup.
-159// Use a comparator that has split 
parents come before its daughters.
-160final Map 
splitParents = new TreeMap<>(new SplitParentFirstComparator());
-161final Map 
mergedRegions = new TreeMap<>(RegionInfo.COMPARATOR);
-162// This visitor collects split 
parents and counts rows in the hbase:meta table
-163
-164MetaTableAccessor.Visitor visitor = 
new MetaTableAccessor.Visitor() {
-165  @Override
-166  public boolean visit(Result r) 
throws IOException {
-167if (r == null || r.isEmpty()) 
return true;
-168count.incrementAndGet();
-169RegionInfo info = 
MetaTableAccessor.getRegionInfo(r);
-170if (info == null) return true; // 
Keep scanning
-171if (isTableSpecified
-172&& 
info.getTable().compareTo(tableName) > 0) {
-173  // Another table, stop 
scanning
-174  return false;
-175}
-176if (LOG.isTraceEnabled()) 
LOG.trace("" + info + " IS-SPLIT_PARENT=" + info.isSplitParent());
-177if (info.isSplitParent()) 
splitParents.put(info, r);
-178if 
(r.getValue(HConstants.CATALOG_FAMILY, HConstants.MERGEA_QUALIFIER) != null) 
{
-179  mergedRegions.put(info, r);
-180}
-181// Returning true means "keep 
scanning"
-182return true;
-183  }
-184};
-185
-186// Run full scan of hbase:meta 
catalog table passing in our custom visitor with
-187// the start row
-188
MetaTableAccessor.scanMetaForTableRegions(this.connection, visitor, 
tableName);
+114  if (this.enabled.get() && 
!this.services.isInMaintenanceMode() && am != null &&
+115am.isMetaLoaded() && 
!am.hasRegionsInTransition()) {
+116scan();
+117  } else {
+118LOG.warn("CatalogJanitor is 
disabled! Enabled=" + this.enabled.get() +
+119  ", maintenanceMode=" + 
this.services.isInMaintenanceMode() + ", am=" + am +
+120  ", metaLoaded=" + (am != null 
&& am.isMetaLoaded()) + ", hasRIT=" +
+121  (am != null && 
am.hasRegionsInTransition()));
+122  }
+123} catch (IOException e) {
+124

[03/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html
index 4b5d00c..96ecbf8 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html
@@ -6,7 +6,7 @@
 
 
 
-001/*
+001/**
 002 * Licensed to the Apache Software 
Foundation (ASF) under one
 003 * or more contributor license 
agreements.  See the NOTICE file
 004 * distributed with this work for 
additional information
@@ -23,1981 +23,1894 @@
 015 * See the License for the specific 
language governing permissions and
 016 * limitations under the License.
 017 */
-018
-019package 
org.apache.hadoop.hbase.master.assignment;
-020
-021import java.io.IOException;
-022import java.util.ArrayList;
-023import java.util.Arrays;
-024import java.util.Collection;
-025import java.util.Collections;
-026import java.util.HashMap;
-027import java.util.HashSet;
-028import java.util.List;
-029import java.util.Map;
-030import java.util.Set;
-031import 
java.util.concurrent.CopyOnWriteArrayList;
-032import java.util.concurrent.Future;
-033import java.util.concurrent.TimeUnit;
-034import 
java.util.concurrent.atomic.AtomicBoolean;
-035import 
java.util.concurrent.locks.Condition;
-036import 
java.util.concurrent.locks.ReentrantLock;
-037import java.util.stream.Collectors;
-038import 
org.apache.hadoop.conf.Configuration;
-039import 
org.apache.hadoop.hbase.HBaseIOException;
-040import 
org.apache.hadoop.hbase.HConstants;
-041import 
org.apache.hadoop.hbase.PleaseHoldException;
-042import 
org.apache.hadoop.hbase.RegionException;
-043import 
org.apache.hadoop.hbase.RegionStateListener;
-044import 
org.apache.hadoop.hbase.ServerName;
-045import 
org.apache.hadoop.hbase.TableName;
-046import 
org.apache.hadoop.hbase.YouAreDeadException;
-047import 
org.apache.hadoop.hbase.client.RegionInfo;
-048import 
org.apache.hadoop.hbase.client.RegionInfoBuilder;
-049import 
org.apache.hadoop.hbase.client.RegionReplicaUtil;
-050import 
org.apache.hadoop.hbase.client.Result;
-051import 
org.apache.hadoop.hbase.client.TableState;
-052import 
org.apache.hadoop.hbase.exceptions.UnexpectedStateException;
-053import 
org.apache.hadoop.hbase.favored.FavoredNodesManager;
-054import 
org.apache.hadoop.hbase.favored.FavoredNodesPromoter;
-055import 
org.apache.hadoop.hbase.master.AssignmentListener;
-056import 
org.apache.hadoop.hbase.master.LoadBalancer;
-057import 
org.apache.hadoop.hbase.master.MasterServices;
-058import 
org.apache.hadoop.hbase.master.MetricsAssignmentManager;
-059import 
org.apache.hadoop.hbase.master.NoSuchProcedureException;
-060import 
org.apache.hadoop.hbase.master.RegionPlan;
-061import 
org.apache.hadoop.hbase.master.RegionState;
-062import 
org.apache.hadoop.hbase.master.RegionState.State;
-063import 
org.apache.hadoop.hbase.master.ServerListener;
-064import 
org.apache.hadoop.hbase.master.TableStateManager;
-065import 
org.apache.hadoop.hbase.master.assignment.RegionStates.RegionStateNode;
-066import 
org.apache.hadoop.hbase.master.assignment.RegionStates.ServerState;
-067import 
org.apache.hadoop.hbase.master.assignment.RegionStates.ServerStateNode;
-068import 
org.apache.hadoop.hbase.master.balancer.FavoredStochasticBalancer;
-069import 
org.apache.hadoop.hbase.master.normalizer.RegionNormalizer;
-070import 
org.apache.hadoop.hbase.master.procedure.MasterProcedureEnv;
-071import 
org.apache.hadoop.hbase.master.procedure.MasterProcedureScheduler;
-072import 
org.apache.hadoop.hbase.master.procedure.ProcedureSyncWait;
-073import 
org.apache.hadoop.hbase.master.procedure.ServerCrashException;
-074import 
org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure;
-075import 
org.apache.hadoop.hbase.procedure2.Procedure;
-076import 
org.apache.hadoop.hbase.procedure2.ProcedureEvent;
-077import 
org.apache.hadoop.hbase.procedure2.ProcedureExecutor;
-078import 
org.apache.hadoop.hbase.procedure2.ProcedureInMemoryChore;
-079import 
org.apache.hadoop.hbase.procedure2.util.StringUtils;
-080import 
org.apache.hadoop.hbase.regionserver.SequenceId;
-081import 
org.apache.hadoop.hbase.util.Bytes;
-082import 
org.apache.hadoop.hbase.util.EnvironmentEdgeManager;
-083import 
org.apache.hadoop.hbase.util.HasThread;
-084import 
org.apache.hadoop.hbase.util.Pair;
-085import 
org.apache.hadoop.hbase.util.Threads;
-086import 
org.apache.hadoop.hbase.util.VersionInfo;
-087import 
org.apache.yetus.audience.InterfaceAudience;
-088import org.slf4j.Logger;
-089import org.slf4j.LoggerFactory;
-090
-091import 
org.apache.hbase.thirdparty.com.google.common.annotations.VisibleForTesting;
-092
-093import 
org.apache.hadoop.

[48/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/bulk-loads.html
--
diff --git a/bulk-loads.html b/bulk-loads.html
index 97aea59..22f2b07 100644
--- a/bulk-loads.html
+++ b/bulk-loads.html
@@ -7,7 +7,7 @@
   
 
 
-
+
 
 Apache HBase –  
   Bulk Loads in Apache HBase (TM)
@@ -306,7 +306,7 @@ under the License. -->
 https://www.apache.org/";>The Apache Software 
Foundation.
 All rights reserved.  
 
-  Last Published: 
2018-06-19
+  Last Published: 
2018-06-20
 
 
 



[02/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.html
index d523437..9050c69 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.html
@@ -561,7 +561,7 @@
 553try {
 554  
env.getMasterServices().getMasterQuotaManager().onRegionMerged(this.mergedRegion);
 555} catch (QuotaExceededException e) 
{
-556  
env.getAssignmentManager().getRegionNormalizer().planSkipped(this.mergedRegion,
+556  
env.getMasterServices().getRegionNormalizer().planSkipped(this.mergedRegion,
 557  
NormalizationPlan.PlanType.MERGE);
 558  throw e;
 559}

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.RegionStateVisitor.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.RegionStateVisitor.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.RegionStateVisitor.html
index c1b4533..a0c568b 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.RegionStateVisitor.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.RegionStateVisitor.html
@@ -136,220 +136,221 @@
 128  public void 
updateRegionLocation(RegionStates.RegionStateNode regionStateNode)
 129  throws IOException {
 130if 
(regionStateNode.getRegionInfo().isMetaRegion()) {
-131  
updateMetaLocation(regionStateNode.getRegionInfo(), 
regionStateNode.getRegionLocation());
-132} else {
-133  long openSeqNum = 
regionStateNode.getState() == State.OPEN ?
-134  regionStateNode.getOpenSeqNum() 
: HConstants.NO_SEQNUM;
-135  
updateUserRegionLocation(regionStateNode.getRegionInfo(), 
regionStateNode.getState(),
-136  
regionStateNode.getRegionLocation(), regionStateNode.getLastHost(), 
openSeqNum,
-137  // The regionStateNode may have 
no procedure in a test scenario; allow for this.
-138  regionStateNode.getProcedure() 
!= null?
-139  
regionStateNode.getProcedure().getProcId(): Procedure.NO_PROC_ID);
-140}
-141  }
-142
-143  private void updateMetaLocation(final 
RegionInfo regionInfo, final ServerName serverName)
-144  throws IOException {
-145try {
-146  
MetaTableLocator.setMetaLocation(master.getZooKeeper(), serverName,
-147regionInfo.getReplicaId(), 
State.OPEN);
-148} catch (KeeperException e) {
-149  throw new IOException(e);
-150}
-151  }
-152
-153  private void 
updateUserRegionLocation(final RegionInfo regionInfo, final State state,
-154  final ServerName regionLocation, 
final ServerName lastHost, final long openSeqNum,
-155  final long pid)
-156  throws IOException {
-157long time = 
EnvironmentEdgeManager.currentTime();
-158final int replicaId = 
regionInfo.getReplicaId();
-159final Put put = new 
Put(MetaTableAccessor.getMetaKeyForRegion(regionInfo), time);
-160MetaTableAccessor.addRegionInfo(put, 
regionInfo);
-161final StringBuilder info =
-162  new 
StringBuilder("pid=").append(pid).append(" updating hbase:meta row=")
-163
.append(regionInfo.getEncodedName()).append(", regionState=").append(state);
-164if (openSeqNum >= 0) {
-165  Preconditions.checkArgument(state 
== State.OPEN && regionLocation != null,
-166  "Open region should be on a 
server");
-167  MetaTableAccessor.addLocation(put, 
regionLocation, openSeqNum, replicaId);
-168  // only update replication barrier 
for default replica
-169  if (regionInfo.getReplicaId() == 
RegionInfo.DEFAULT_REPLICA_ID &&
-170
hasGlobalReplicationScope(regionInfo.getTable())) {
-171
MetaTableAccessor.addReplicationBarrier(put, openSeqNum);
-172info.append(", 
repBarrier=").append(openSeqNum);
-173  }
-174  info.append(", 
openSeqNum=").append(openSeqNum);
-175  info.append(", 
regionLocation=").append(regionLocation);
-176} else if (regionLocation != null 
&& !regionLocation.equals(lastHost)) {
-177  // Ideally, if no regionLocation, 
write null to the hbase:meta but this will confuse clients
-178  // currently; they want a server to 
hit. TODO: Make clients wait if no location.
-179  
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-180  .setRow(put.getRow())
-181  
.setFamily(HConstants.CATALOG_FAMI

[27/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.html 
b/devapidocs/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.html
index a9d814d..e65cf97 100644
--- a/devapidocs/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.html
+++ b/devapidocs/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.html
@@ -18,7 +18,7 @@
 catch(err) {
 }
 //-->
-var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10,"i52":10,"i53":10,"i54":10,"i55":10,"i56":10,"i57":10,"i58":10,"i59":10};
+var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10,"i52":10,"i53":10,"i54":10,"i55":10,"i56":10,"i57":10,"i58":10,"i59":10,"i60":10};
 var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],8:["t4","Concrete Methods"]};
 var altColor = "altColor";
 var rowColor = "rowColor";
@@ -288,13 +288,13 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 private https://docs.oracle.com/javase/8/docs/api/java/lang/ThreadGroup.html?is-external=true";
 title="class or interface in java.lang">ThreadGroup
 threadGroup
-Created in the start(int,
 boolean) method.
+Created in the #start(int, boolean) 
method.
 
 
 
 private TimeoutExecutorThread
 timeoutExecutor
-Created in the start(int,
 boolean) method.
+Created in the #start(int, boolean) 
method.
 
 
 
@@ -308,7 +308,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 private https://docs.oracle.com/javase/8/docs/api/java/util/concurrent/CopyOnWriteArrayList.html?is-external=true";
 title="class or interface in 
java.util.concurrent">CopyOnWriteArrayList
 workerThreads
-Created in the start(int,
 boolean) method.
+Created in the #start(int, boolean) 
method.
 
 
 
@@ -490,107 +490,114 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
   https://docs.oracle.com/javase/8/docs/api/java/lang/InterruptedException.html?is-external=true";
 title="class or interface in 
java.lang">InterruptedException e) 
 
 
+void
+init(int numThreads,
+boolean abortOnCorruption)
+Initialize the procedure executor, but do not start 
workers.
+
+
+
 private Procedure[]
 initializeChildren(RootProcedureState procStack,
   Procedure procedure,
   Procedure[] subprocs) 
 
-
+
 boolean
 isFinished(long procId)
 Return true if the procedure is finished.
 
 
-
+
 boolean
 isProcedureOwner(long procId,
 User user)
 Check if the user is this procedure's owner
 
 
-
+
 boolean
 isRunning() 
 
-
+
 boolean
 isStarted(long procId)
 Return true if the procedure is started.
 
 
-
+
 void
 join() 
 
-
+
 private void
 load(boolean abortOnCorruption) 
 
-
+
 private void
 loadProcedures(ProcedureStore.ProcedureIterator procIter,
   boolean abortOnCorruption) 
 
-
+
 private long
 nextProcId() 
 
-
+
 private Procedure
 prepareProcedure(Procedure proc) 
 
-
+
 private void
 procedureFinished(Procedure proc) 
 
-
+
 private long
 pushProcedure(Procedure proc) 
 
-
+
 void
 refreshConfiguration(org.apache.hadoop.conf.Configuration conf) 
 
-
+
 void
 registerListener(ProcedureExecutor.ProcedureExecutorListener listener) 
 
-
+
 long
 registerNonce(NonceKey nonceKey)
 Register a nonce for a procedure that is going to be 
submitted.
 
 
-
+
 private void
 releaseLock(Procedure proc,
boolean force) 
 
-
+
 boolean
 removeChore(ProcedureInMemoryChore chore)
 Remove a chore procedure from the executor
 
 
-
+
 void
 removeResult(long procId)
 Mark the specified completed procedure, as ready to 
remove.
 
 
-
+
 private void
 sendProcedureAddedNotification(long procId) 
 
-
+
 private void
 sendProcedureFinishedNotification(long procId) 
 
-
+
 private void
 sendProcedureLoadedNotification(long procId) 
 
-
+
 void
 setFailureResultForNonce(NonceKey nonceKey,
 https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";

[35/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html 
b/devapidocs/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html
index c5fbd58..48146a9 100644
--- a/devapidocs/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html
+++ b/devapidocs/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html
@@ -263,8 +263,9 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 private void
-updateMetaLocation(RegionInfo regionInfo,
-  ServerName serverName) 
+updateMetaLocation(RegionInfo regionInfo,
+  ServerName serverName,
+  RegionState.State state) 
 
 
 private void
@@ -416,14 +417,15 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 
-
+
 
 
 
 
 updateMetaLocation
-private void updateMetaLocation(RegionInfo regionInfo,
-ServerName serverName)
+private void updateMetaLocation(RegionInfo regionInfo,
+ServerName serverName,
+RegionState.State state)
  throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true";
 title="class or interface in java.io">IOException
 
 Throws:
@@ -437,7 +439,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 updateUserRegionLocation
-private void updateUserRegionLocation(RegionInfo regionInfo,
+private void updateUserRegionLocation(RegionInfo regionInfo,
   RegionState.State state,
   ServerName regionLocation,
   ServerName lastHost,
@@ -456,7 +458,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 updateRegionLocation
-private void updateRegionLocation(RegionInfo regionInfo,
+private void updateRegionLocation(RegionInfo regionInfo,
   RegionState.State state,
   Put put)
throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true";
 title="class or interface in java.io">IOException
@@ -472,7 +474,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 getOpenSeqNumForParentRegion
-private long getOpenSeqNumForParentRegion(RegionInfo region)
+private long getOpenSeqNumForParentRegion(RegionInfo region)
throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true";
 title="class or interface in java.io">IOException
 
 Throws:
@@ -486,7 +488,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 splitRegion
-public void splitRegion(RegionInfo parent,
+public void splitRegion(RegionInfo parent,
 RegionInfo hriA,
 RegionInfo hriB,
 ServerName serverName)
@@ -503,7 +505,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 mergeRegions
-public void mergeRegions(RegionInfo child,
+public void mergeRegions(RegionInfo child,
  RegionInfo hriA,
  RegionInfo hriB,
  ServerName serverName)
@@ -520,7 +522,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 deleteRegion
-public void deleteRegion(RegionInfo regionInfo)
+public void deleteRegion(RegionInfo regionInfo)
   throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true";
 title="class or interface in java.io">IOException
 
 Throws:
@@ -534,7 +536,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 deleteRegions
-public void deleteRegions(https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List regions)
+public void deleteRegions(https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List regions)
throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true";
 title="class or interface in java.io">IOException
 
 Throws:
@@ -548,7 +550,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 hasGlobalReplicationScope
-private boolean hasGlobalReplicationScope(TableName tableName)
+private boolean hasGlobalReplicationScope(TableName tableName)
throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true";
 title="class or interface in java.io">IOExc

[20/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.QueryType.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.QueryType.html 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.QueryType.html
index fea2b5a..c7a6cc4 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.QueryType.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.QueryType.html
@@ -1354,816 +1354,824 @@
 1346   */
 1347  public static void 
putsToMetaTable(final Connection connection, final List ps)
 1348  throws IOException {
-1349try (Table t = 
getMetaHTable(connection)) {
-1350  debugLogMutations(ps);
-1351  t.put(ps);
-1352}
-1353  }
-1354
-1355  /**
-1356   * Delete the passed 
d from the hbase:meta 
table.
-1357   * @param connection connection we're 
using
-1358   * @param d Delete to add to 
hbase:meta
-1359   */
-1360  private static void 
deleteFromMetaTable(final Connection connection, final Delete d)
-1361  throws IOException {
-1362List dels = new 
ArrayList<>(1);
-1363dels.add(d);
-1364deleteFromMetaTable(connection, 
dels);
-1365  }
-1366
-1367  /**
-1368   * Delete the passed 
deletes from the hbase:meta 
table.
-1369   * @param connection connection we're 
using
-1370   * @param deletes Deletes to add to 
hbase:meta  This list should support #remove.
-1371   */
-1372  private static void 
deleteFromMetaTable(final Connection connection, final List 
deletes)
-1373  throws IOException {
-1374try (Table t = 
getMetaHTable(connection)) {
-1375  debugLogMutations(deletes);
-1376  t.delete(deletes);
-1377}
-1378  }
-1379
-1380  /**
-1381   * Deletes some replica columns 
corresponding to replicas for the passed rows
-1382   * @param metaRows rows in 
hbase:meta
-1383   * @param replicaIndexToDeleteFrom the 
replica ID we would start deleting from
-1384   * @param numReplicasToRemove how many 
replicas to remove
-1385   * @param connection connection we're 
using to access meta table
-1386   */
-1387  public static void 
removeRegionReplicasFromMeta(Set metaRows,
-1388int replicaIndexToDeleteFrom, int 
numReplicasToRemove, Connection connection)
-1389  throws IOException {
-1390int absoluteIndex = 
replicaIndexToDeleteFrom + numReplicasToRemove;
-1391for (byte[] row : metaRows) {
-1392  long now = 
EnvironmentEdgeManager.currentTime();
-1393  Delete deleteReplicaLocations = 
new Delete(row);
-1394  for (int i = 
replicaIndexToDeleteFrom; i < absoluteIndex; i++) {
-1395
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1396  getServerColumn(i), now);
-1397
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1398  getSeqNumColumn(i), now);
-1399
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1400  getStartCodeColumn(i), now);
-1401  }
-1402  deleteFromMetaTable(connection, 
deleteReplicaLocations);
-1403}
-1404  }
-1405
-1406  /**
-1407   * Execute the passed 
mutations against hbase:meta 
table.
-1408   * @param connection connection we're 
using
-1409   * @param mutations Puts and Deletes 
to execute on hbase:meta
-1410   * @throws IOException
-1411   */
-1412  public static void 
mutateMetaTable(final Connection connection,
-1413 
final List mutations)
-1414throws IOException {
-1415Table t = 
getMetaHTable(connection);
-1416try {
-1417  debugLogMutations(mutations);
-1418  t.batch(mutations, null);
-1419} catch (InterruptedException e) {
-1420  InterruptedIOException ie = new 
InterruptedIOException(e.getMessage());
-1421  ie.initCause(e);
-1422  throw ie;
-1423} finally {
-1424  t.close();
-1425}
-1426  }
-1427
-1428  private static void 
addRegionStateToPut(Put put, RegionState.State state) throws IOException {
-1429
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-1430.setRow(put.getRow())
-1431
.setFamily(HConstants.CATALOG_FAMILY)
-1432
.setQualifier(getRegionStateColumn())
-1433
.setTimestamp(put.getTimestamp())
-1434.setType(Cell.Type.Put)
-1435
.setValue(Bytes.toBytes(state.name()))
-1436.build());
-1437  }
-1438
-1439  /**
-1440   * Adds daughter region infos to 
hbase:meta row for the specified region. Note that this does not
-1441   * add its daughter's as different 
rows, but adds information about the daughters in the same row
-1442   * as the parent. Use
-1443   * {@link #splitRegion(Connection, 
RegionInfo, long, RegionInfo, RegionInfo, ServerName, int)}
-1444   * if you want to do that.
-1445   * @param connection connection we're 
using
-1446   * @para

[10/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.html
--
diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.html 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.html
index eb16038..74bacd8 100644
--- a/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.html
+++ b/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.html
@@ -6,7 +6,7 @@
 
 
 
-001/*
+001/**
 002 * Licensed to the Apache Software 
Foundation (ASF) under one
 003 * or more contributor license 
agreements.  See the NOTICE file
 004 * distributed with this work for 
additional information
@@ -48,692 +48,692 @@
 040import java.util.Map;
 041import java.util.Map.Entry;
 042import java.util.Objects;
-043import java.util.Set;
-044import 
java.util.concurrent.ExecutionException;
-045import java.util.concurrent.Future;
-046import java.util.concurrent.TimeUnit;
-047import 
java.util.concurrent.TimeoutException;
-048import 
java.util.concurrent.atomic.AtomicInteger;
-049import 
java.util.concurrent.atomic.AtomicReference;
-050import java.util.function.Function;
-051import java.util.regex.Pattern;
-052import java.util.stream.Collectors;
-053import javax.servlet.ServletException;
-054import javax.servlet.http.HttpServlet;
-055import 
javax.servlet.http.HttpServletRequest;
-056import 
javax.servlet.http.HttpServletResponse;
-057import 
org.apache.commons.lang3.StringUtils;
-058import 
org.apache.hadoop.conf.Configuration;
-059import org.apache.hadoop.fs.Path;
-060import 
org.apache.hadoop.hbase.ClusterId;
-061import 
org.apache.hadoop.hbase.ClusterMetrics;
-062import 
org.apache.hadoop.hbase.ClusterMetrics.Option;
-063import 
org.apache.hadoop.hbase.ClusterMetricsBuilder;
-064import 
org.apache.hadoop.hbase.DoNotRetryIOException;
-065import 
org.apache.hadoop.hbase.HBaseIOException;
-066import 
org.apache.hadoop.hbase.HBaseInterfaceAudience;
-067import 
org.apache.hadoop.hbase.HConstants;
-068import 
org.apache.hadoop.hbase.InvalidFamilyOperationException;
-069import 
org.apache.hadoop.hbase.MasterNotRunningException;
-070import 
org.apache.hadoop.hbase.MetaTableAccessor;
-071import 
org.apache.hadoop.hbase.NamespaceDescriptor;
-072import 
org.apache.hadoop.hbase.PleaseHoldException;
-073import 
org.apache.hadoop.hbase.ReplicationPeerNotFoundException;
-074import 
org.apache.hadoop.hbase.ScheduledChore;
-075import 
org.apache.hadoop.hbase.ServerName;
-076import 
org.apache.hadoop.hbase.TableDescriptors;
-077import 
org.apache.hadoop.hbase.TableName;
-078import 
org.apache.hadoop.hbase.TableNotDisabledException;
-079import 
org.apache.hadoop.hbase.TableNotFoundException;
-080import 
org.apache.hadoop.hbase.UnknownRegionException;
-081import 
org.apache.hadoop.hbase.client.ColumnFamilyDescriptor;
-082import 
org.apache.hadoop.hbase.client.ColumnFamilyDescriptorBuilder;
-083import 
org.apache.hadoop.hbase.client.MasterSwitchType;
-084import 
org.apache.hadoop.hbase.client.RegionInfo;
-085import 
org.apache.hadoop.hbase.client.Result;
-086import 
org.apache.hadoop.hbase.client.TableDescriptor;
-087import 
org.apache.hadoop.hbase.client.TableDescriptorBuilder;
-088import 
org.apache.hadoop.hbase.client.TableState;
-089import 
org.apache.hadoop.hbase.client.VersionInfoUtil;
-090import 
org.apache.hadoop.hbase.coprocessor.CoprocessorHost;
-091import 
org.apache.hadoop.hbase.exceptions.DeserializationException;
-092import 
org.apache.hadoop.hbase.exceptions.MergeRegionException;
-093import 
org.apache.hadoop.hbase.executor.ExecutorType;
-094import 
org.apache.hadoop.hbase.favored.FavoredNodesManager;
-095import 
org.apache.hadoop.hbase.favored.FavoredNodesPromoter;
-096import 
org.apache.hadoop.hbase.http.InfoServer;
-097import 
org.apache.hadoop.hbase.ipc.CoprocessorRpcUtils;
-098import 
org.apache.hadoop.hbase.ipc.RpcServer;
-099import 
org.apache.hadoop.hbase.ipc.ServerNotRunningYetException;
-100import 
org.apache.hadoop.hbase.log.HBaseMarkers;
-101import 
org.apache.hadoop.hbase.master.MasterRpcServices.BalanceSwitchMode;
-102import 
org.apache.hadoop.hbase.master.assignment.AssignmentManager;
-103import 
org.apache.hadoop.hbase.master.assignment.MergeTableRegionsProcedure;
-104import 
org.apache.hadoop.hbase.master.assignment.RegionStates;
-105import 
org.apache.hadoop.hbase.master.assignment.RegionStates.RegionStateNode;
-106import 
org.apache.hadoop.hbase.master.balancer.BalancerChore;
-107import 
org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer;
-108import 
org.apache.hadoop.hbase.master.balancer.ClusterStatusChore;
-109import 
org.apache.hadoop.hbase.master.balancer.LoadBalancerFactory;
-110import 
org.apache.hadoop.hbase.master.cleaner.CleanerChore;
-111import 
org.apache.hadoop.hbase.master.cleaner.HFileCleaner;
-112import 
org.apache.hadoop.hbase.master.cleaner.LogCleaner;
-113import 
org.apache.hadoop.hbase.master.cleaner.ReplicationBarrierCleaner;
-114i

[25/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html
--
diff --git a/devapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html 
b/devapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html
index a5de1cb..8c1b90f 100644
--- a/devapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html
+++ b/devapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html
@@ -219,11 +219,11 @@
 
 java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true";
 title="class or interface in java.lang">Enum (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true";
 title="class or interface in java.lang">Comparable, java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true";
 title="class or interface in java.io">Serializable)
 
-org.apache.hadoop.hbase.procedure2.LockedResourceType
-org.apache.hadoop.hbase.procedure2.LockType
-org.apache.hadoop.hbase.procedure2.RootProcedureState.State
 org.apache.hadoop.hbase.procedure2.Procedure.LockState
 org.apache.hadoop.hbase.procedure2.StateMachineProcedure.Flow
+org.apache.hadoop.hbase.procedure2.RootProcedureState.State
+org.apache.hadoop.hbase.procedure2.LockType
+org.apache.hadoop.hbase.procedure2.LockedResourceType
 
 
 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.html
 
b/devapidocs/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.html
index a60c9b6..ee8b574 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.html
@@ -1428,7 +1428,7 @@ extends 
 
 WALS_PATH_FILTER
-private static final org.apache.hadoop.fs.PathFilter WALS_PATH_FILTER
+private static final org.apache.hadoop.fs.PathFilter WALS_PATH_FILTER
 
 
 
@@ -1437,7 +1437,7 @@ extends 
 
 FILE_STATUS_ID_COMPARATOR
-private static final https://docs.oracle.com/javase/8/docs/api/java/util/Comparator.html?is-external=true";
 title="class or interface in 
java.util">Comparator FILE_STATUS_ID_COMPARATOR
+private static final https://docs.oracle.com/javase/8/docs/api/java/util/Comparator.html?is-external=true";
 title="class or interface in 
java.util">Comparator FILE_STATUS_ID_COMPARATOR
 
 
 
@@ -1991,7 +1991,7 @@ extends 
 
 closeCurrentLogStream
-private void closeCurrentLogStream()
+private void closeCurrentLogStream()
 
 
 
@@ -2000,7 +2000,7 @@ extends 
 
 removeInactiveLogs
-private void removeInactiveLogs()
+private void removeInactiveLogs()
  throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true";
 title="class or interface in java.io">IOException
 
 Throws:
@@ -2014,7 +2014,7 @@ extends 
 
 buildHoldingCleanupTracker
-private void buildHoldingCleanupTracker()
+private void buildHoldingCleanupTracker()
 
 
 
@@ -2023,7 +2023,7 @@ extends 
 
 removeAllLogs
-private void removeAllLogs(long lastLogId)
+private void removeAllLogs(long lastLogId)
 Remove all logs with logId <= lastLogId.
 
 
@@ -2033,7 +2033,7 @@ extends 
 
 removeLogFile
-private boolean removeLogFile(ProcedureWALFile log,
+private boolean removeLogFile(ProcedureWALFile log,
   
org.apache.hadoop.fs.Path walArchiveDir)
 
 
@@ -2043,7 +2043,7 @@ extends 
 
 getWALDir
-public org.apache.hadoop.fs.Path getWALDir()
+public org.apache.hadoop.fs.Path getWALDir()
 
 
 
@@ -2052,7 +2052,7 @@ extends 
 
 getFileSystem
-public org.apache.hadoop.fs.FileSystem getFileSystem()
+public org.apache.hadoop.fs.FileSystem getFileSystem()
 
 
 
@@ -2061,7 +2061,7 @@ extends 
 
 getLogFilePath
-protected org.apache.hadoop.fs.Path getLogFilePath(long logId)
+protected org.apache.hadoop.fs.Path getLogFilePath(long logId)
 throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true";
 title="class or interface in java.io">IOException
 
 Throws:
@@ -2075,7 +2075,7 @@ extends 
 
 getLogIdFromName
-private static long getLogIdFromName(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String name)
+private static long getLogIdFromName(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String name)
 
 
 
@@ -2084,7 +2084,7 @@ extends 
 
 getLogFiles
-private org.apache.hadoop.fs.FileStatus[] getLogFiles()
+private org.apache.hadoop.fs.FileStatus[] getLogFiles()

[21/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.DefaultVisitorBase.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.DefaultVisitorBase.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.DefaultVisitorBase.html
index fea2b5a..c7a6cc4 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.DefaultVisitorBase.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.DefaultVisitorBase.html
@@ -1354,816 +1354,824 @@
 1346   */
 1347  public static void 
putsToMetaTable(final Connection connection, final List ps)
 1348  throws IOException {
-1349try (Table t = 
getMetaHTable(connection)) {
-1350  debugLogMutations(ps);
-1351  t.put(ps);
-1352}
-1353  }
-1354
-1355  /**
-1356   * Delete the passed 
d from the hbase:meta 
table.
-1357   * @param connection connection we're 
using
-1358   * @param d Delete to add to 
hbase:meta
-1359   */
-1360  private static void 
deleteFromMetaTable(final Connection connection, final Delete d)
-1361  throws IOException {
-1362List dels = new 
ArrayList<>(1);
-1363dels.add(d);
-1364deleteFromMetaTable(connection, 
dels);
-1365  }
-1366
-1367  /**
-1368   * Delete the passed 
deletes from the hbase:meta 
table.
-1369   * @param connection connection we're 
using
-1370   * @param deletes Deletes to add to 
hbase:meta  This list should support #remove.
-1371   */
-1372  private static void 
deleteFromMetaTable(final Connection connection, final List 
deletes)
-1373  throws IOException {
-1374try (Table t = 
getMetaHTable(connection)) {
-1375  debugLogMutations(deletes);
-1376  t.delete(deletes);
-1377}
-1378  }
-1379
-1380  /**
-1381   * Deletes some replica columns 
corresponding to replicas for the passed rows
-1382   * @param metaRows rows in 
hbase:meta
-1383   * @param replicaIndexToDeleteFrom the 
replica ID we would start deleting from
-1384   * @param numReplicasToRemove how many 
replicas to remove
-1385   * @param connection connection we're 
using to access meta table
-1386   */
-1387  public static void 
removeRegionReplicasFromMeta(Set metaRows,
-1388int replicaIndexToDeleteFrom, int 
numReplicasToRemove, Connection connection)
-1389  throws IOException {
-1390int absoluteIndex = 
replicaIndexToDeleteFrom + numReplicasToRemove;
-1391for (byte[] row : metaRows) {
-1392  long now = 
EnvironmentEdgeManager.currentTime();
-1393  Delete deleteReplicaLocations = 
new Delete(row);
-1394  for (int i = 
replicaIndexToDeleteFrom; i < absoluteIndex; i++) {
-1395
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1396  getServerColumn(i), now);
-1397
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1398  getSeqNumColumn(i), now);
-1399
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1400  getStartCodeColumn(i), now);
-1401  }
-1402  deleteFromMetaTable(connection, 
deleteReplicaLocations);
-1403}
-1404  }
-1405
-1406  /**
-1407   * Execute the passed 
mutations against hbase:meta 
table.
-1408   * @param connection connection we're 
using
-1409   * @param mutations Puts and Deletes 
to execute on hbase:meta
-1410   * @throws IOException
-1411   */
-1412  public static void 
mutateMetaTable(final Connection connection,
-1413 
final List mutations)
-1414throws IOException {
-1415Table t = 
getMetaHTable(connection);
-1416try {
-1417  debugLogMutations(mutations);
-1418  t.batch(mutations, null);
-1419} catch (InterruptedException e) {
-1420  InterruptedIOException ie = new 
InterruptedIOException(e.getMessage());
-1421  ie.initCause(e);
-1422  throw ie;
-1423} finally {
-1424  t.close();
-1425}
-1426  }
-1427
-1428  private static void 
addRegionStateToPut(Put put, RegionState.State state) throws IOException {
-1429
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-1430.setRow(put.getRow())
-1431
.setFamily(HConstants.CATALOG_FAMILY)
-1432
.setQualifier(getRegionStateColumn())
-1433
.setTimestamp(put.getTimestamp())
-1434.setType(Cell.Type.Put)
-1435
.setValue(Bytes.toBytes(state.name()))
-1436.build());
-1437  }
-1438
-1439  /**
-1440   * Adds daughter region infos to 
hbase:meta row for the specified region. Note that this does not
-1441   * add its daughter's as different 
rows, but adds information about the daughters in the same row
-1442   * as the parent. Use
-1443   * {@link #splitRegion(Connection, 
RegionInfo, long, RegionInfo, RegionInfo, ServerName, int)}
-1444   * if you want to do that.
-1445   * @param conn

[08/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterWalManager.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterWalManager.html 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterWalManager.html
index dd2def7..498695e 100644
--- a/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterWalManager.html
+++ b/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterWalManager.html
@@ -34,282 +34,308 @@
 026import java.util.Set;
 027import java.util.concurrent.locks.Lock;
 028import 
java.util.concurrent.locks.ReentrantLock;
-029
-030import 
org.apache.hadoop.conf.Configuration;
-031import org.apache.hadoop.fs.FileStatus;
-032import org.apache.hadoop.fs.FileSystem;
-033import org.apache.hadoop.fs.Path;
-034import org.apache.hadoop.fs.PathFilter;
-035import 
org.apache.hadoop.hbase.HConstants;
-036import 
org.apache.hadoop.hbase.ServerName;
-037import 
org.apache.hadoop.hbase.util.EnvironmentEdgeManager;
-038import 
org.apache.hadoop.hbase.util.FSUtils;
-039import 
org.apache.hadoop.hbase.wal.AbstractFSWALProvider;
-040import 
org.apache.hadoop.hbase.wal.WALSplitter;
-041import 
org.apache.yetus.audience.InterfaceAudience;
-042import org.slf4j.Logger;
-043import org.slf4j.LoggerFactory;
-044import 
org.apache.hbase.thirdparty.com.google.common.annotations.VisibleForTesting;
-045
-046/**
-047 * This class abstracts a bunch of 
operations the HMaster needs
-048 * when splitting log files e.g. finding 
log files, dirs etc.
-049 */
-050@InterfaceAudience.Private
-051public class MasterWalManager {
-052  private static final Logger LOG = 
LoggerFactory.getLogger(MasterWalManager.class);
-053
-054  final static PathFilter META_FILTER = 
new PathFilter() {
-055@Override
-056public boolean accept(Path p) {
-057  return 
AbstractFSWALProvider.isMetaFile(p);
-058}
-059  };
-060
-061  final static PathFilter NON_META_FILTER 
= new PathFilter() {
-062@Override
-063public boolean accept(Path p) {
-064  return 
!AbstractFSWALProvider.isMetaFile(p);
-065}
-066  };
-067
-068  // metrics for master
-069  // TODO: Rename it, since those metrics 
are split-manager related
-070  private final MetricsMasterFileSystem 
metricsMasterFilesystem = new MetricsMasterFileSystem();
-071
-072  // Keep around for convenience.
-073  private final MasterServices 
services;
-074  private final Configuration conf;
-075  private final FileSystem fs;
-076
-077  // The Path to the old logs dir
-078  private final Path oldLogDir;
-079  private final Path rootDir;
-080
-081  // create the split log lock
-082  private final Lock splitLogLock = new 
ReentrantLock();
-083  private final SplitLogManager 
splitLogManager;
-084
-085  // Is the fileystem ok?
-086  private volatile boolean fsOk = true;
-087
-088  public MasterWalManager(MasterServices 
services) throws IOException {
-089this(services.getConfiguration(), 
services.getMasterFileSystem().getWALFileSystem(),
-090  
services.getMasterFileSystem().getWALRootDir(), services);
-091  }
-092
-093  public MasterWalManager(Configuration 
conf, FileSystem fs, Path rootDir, MasterServices services)
-094  throws IOException {
-095this.fs = fs;
-096this.conf = conf;
-097this.rootDir = rootDir;
-098this.services = services;
-099this.splitLogManager = new 
SplitLogManager(services, conf);
-100
-101this.oldLogDir = new Path(rootDir, 
HConstants.HREGION_OLDLOGDIR_NAME);
-102  }
-103
-104  public void stop() {
-105if (splitLogManager != null) {
-106  splitLogManager.stop();
-107}
-108  }
-109
-110  @VisibleForTesting
-111  SplitLogManager getSplitLogManager() 
{
-112return this.splitLogManager;
-113  }
-114
-115  /**
-116   * Get the directory where old logs 
go
-117   * @return the dir
-118   */
-119  Path getOldLogDir() {
-120return this.oldLogDir;
-121  }
-122
-123  public FileSystem getFileSystem() {
-124return this.fs;
-125  }
-126
-127  /**
-128   * Checks to see if the file system is 
still accessible.
-129   * If not, sets closed
-130   * @return false if file system is not 
available
-131   */
-132  private boolean checkFileSystem() {
-133if (this.fsOk) {
-134  try {
-135
FSUtils.checkFileSystemAvailable(this.fs);
-136
FSUtils.checkDfsSafeMode(this.conf);
-137  } catch (IOException e) {
-138services.abort("Shutting down 
HBase cluster: file system not available", e);
-139this.fsOk = false;
-140  }
-141}
-142return this.fsOk;
-143  }
-144
-145  /**
-146   * Inspect the log directory to find 
dead servers which need recovery work
-147   * @return A set of ServerNames which 
aren't running but still have WAL files left in file system
-148   */
-149  public Set 
getFailedServersFromLogFolders() {
-150boolean retrySplitting = 
!conf.getBoolean("hbase.hlog.split.skip.errors

[16/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.html
--
diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.html 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.html
index fea2b5a..c7a6cc4 100644
--- a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.html
+++ b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.html
@@ -1354,816 +1354,824 @@
 1346   */
 1347  public static void 
putsToMetaTable(final Connection connection, final List ps)
 1348  throws IOException {
-1349try (Table t = 
getMetaHTable(connection)) {
-1350  debugLogMutations(ps);
-1351  t.put(ps);
-1352}
-1353  }
-1354
-1355  /**
-1356   * Delete the passed 
d from the hbase:meta 
table.
-1357   * @param connection connection we're 
using
-1358   * @param d Delete to add to 
hbase:meta
-1359   */
-1360  private static void 
deleteFromMetaTable(final Connection connection, final Delete d)
-1361  throws IOException {
-1362List dels = new 
ArrayList<>(1);
-1363dels.add(d);
-1364deleteFromMetaTable(connection, 
dels);
-1365  }
-1366
-1367  /**
-1368   * Delete the passed 
deletes from the hbase:meta 
table.
-1369   * @param connection connection we're 
using
-1370   * @param deletes Deletes to add to 
hbase:meta  This list should support #remove.
-1371   */
-1372  private static void 
deleteFromMetaTable(final Connection connection, final List 
deletes)
-1373  throws IOException {
-1374try (Table t = 
getMetaHTable(connection)) {
-1375  debugLogMutations(deletes);
-1376  t.delete(deletes);
-1377}
-1378  }
-1379
-1380  /**
-1381   * Deletes some replica columns 
corresponding to replicas for the passed rows
-1382   * @param metaRows rows in 
hbase:meta
-1383   * @param replicaIndexToDeleteFrom the 
replica ID we would start deleting from
-1384   * @param numReplicasToRemove how many 
replicas to remove
-1385   * @param connection connection we're 
using to access meta table
-1386   */
-1387  public static void 
removeRegionReplicasFromMeta(Set metaRows,
-1388int replicaIndexToDeleteFrom, int 
numReplicasToRemove, Connection connection)
-1389  throws IOException {
-1390int absoluteIndex = 
replicaIndexToDeleteFrom + numReplicasToRemove;
-1391for (byte[] row : metaRows) {
-1392  long now = 
EnvironmentEdgeManager.currentTime();
-1393  Delete deleteReplicaLocations = 
new Delete(row);
-1394  for (int i = 
replicaIndexToDeleteFrom; i < absoluteIndex; i++) {
-1395
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1396  getServerColumn(i), now);
-1397
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1398  getSeqNumColumn(i), now);
-1399
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1400  getStartCodeColumn(i), now);
-1401  }
-1402  deleteFromMetaTable(connection, 
deleteReplicaLocations);
-1403}
-1404  }
-1405
-1406  /**
-1407   * Execute the passed 
mutations against hbase:meta 
table.
-1408   * @param connection connection we're 
using
-1409   * @param mutations Puts and Deletes 
to execute on hbase:meta
-1410   * @throws IOException
-1411   */
-1412  public static void 
mutateMetaTable(final Connection connection,
-1413 
final List mutations)
-1414throws IOException {
-1415Table t = 
getMetaHTable(connection);
-1416try {
-1417  debugLogMutations(mutations);
-1418  t.batch(mutations, null);
-1419} catch (InterruptedException e) {
-1420  InterruptedIOException ie = new 
InterruptedIOException(e.getMessage());
-1421  ie.initCause(e);
-1422  throw ie;
-1423} finally {
-1424  t.close();
-1425}
-1426  }
-1427
-1428  private static void 
addRegionStateToPut(Put put, RegionState.State state) throws IOException {
-1429
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-1430.setRow(put.getRow())
-1431
.setFamily(HConstants.CATALOG_FAMILY)
-1432
.setQualifier(getRegionStateColumn())
-1433
.setTimestamp(put.getTimestamp())
-1434.setType(Cell.Type.Put)
-1435
.setValue(Bytes.toBytes(state.name()))
-1436.build());
-1437  }
-1438
-1439  /**
-1440   * Adds daughter region infos to 
hbase:meta row for the specified region. Note that this does not
-1441   * add its daughter's as different 
rows, but adds information about the daughters in the same row
-1442   * as the parent. Use
-1443   * {@link #splitRegion(Connection, 
RegionInfo, long, RegionInfo, RegionInfo, ServerName, int)}
-1444   * if you want to do that.
-1445   * @param connection connection we're 
using
-1446   * @param regionInfo RegionInfo of 
parent region
-1447   * @

hbase-site git commit: INFRA-10751 Empty commit

2018-06-19 Thread git-site-role
Repository: hbase-site
Updated Branches:
  refs/heads/asf-site 65565d77b -> cb3a62e7c


INFRA-10751 Empty commit


Project: http://git-wip-us.apache.org/repos/asf/hbase-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase-site/commit/cb3a62e7
Tree: http://git-wip-us.apache.org/repos/asf/hbase-site/tree/cb3a62e7
Diff: http://git-wip-us.apache.org/repos/asf/hbase-site/diff/cb3a62e7

Branch: refs/heads/asf-site
Commit: cb3a62e7c42a8833b9bc88b61ec2d90c304b3b93
Parents: 65565d7
Author: jenkins 
Authored: Wed Jun 20 04:25:21 2018 +
Committer: jenkins 
Committed: Wed Jun 20 04:25:21 2018 +

--

--




[30/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/SchemaLocking.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/SchemaLocking.html 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/SchemaLocking.html
index 2153167..29b58bc 100644
--- a/devapidocs/org/apache/hadoop/hbase/master/procedure/SchemaLocking.html
+++ b/devapidocs/org/apache/hadoop/hbase/master/procedure/SchemaLocking.html
@@ -18,8 +18,8 @@
 catch(err) {
 }
 //-->
-var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10};
-var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],8:["t4","Concrete Methods"]};
+var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":42,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],8:["t4","Concrete Methods"],32:["t6","Deprecated Methods"]};
 var altColor = "altColor";
 var rowColor = "rowColor";
 var tableTab = "tableTab";
@@ -188,7 +188,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 Method Summary
 
-All Methods Instance Methods Concrete Methods 
+All Methods Instance Methods Concrete Methods Deprecated Methods 
 
 Modifier and Type
 Method and Description
@@ -234,7 +234,12 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 (package private) LockAndQueue
-getMetaLock() 
+getMetaLock()
+Deprecated. 
+only used for RecoverMetaProcedure.
 Should be removed along with
+ RecoverMetaProcedure.
+
+
 
 
 (package private) LockAndQueue
@@ -427,7 +432,10 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 getMetaLock
-LockAndQueue getMetaLock()
+https://docs.oracle.com/javase/8/docs/api/java/lang/Deprecated.html?is-external=true";
 title="class or interface in java.lang">@Deprecated
+LockAndQueue getMetaLock()
+Deprecated. only used for RecoverMetaProcedure.
 Should be removed along with
+ RecoverMetaProcedure.
 
 
 
@@ -436,7 +444,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 removeRegionLock
-LockAndQueue removeRegionLock(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in 
java.lang">String encodedRegionName)
+LockAndQueue removeRegionLock(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in 
java.lang">String encodedRegionName)
 
 
 
@@ -445,7 +453,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 getServerLock
-LockAndQueue getServerLock(ServerName serverName)
+LockAndQueue getServerLock(ServerName serverName)
 
 
 
@@ -454,7 +462,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 getPeerLock
-LockAndQueue getPeerLock(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String peerId)
+LockAndQueue getPeerLock(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String peerId)
 
 
 
@@ -463,7 +471,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 removePeerLock
-LockAndQueue removePeerLock(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String peerId)
+LockAndQueue removePeerLock(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String peerId)
 
 
 
@@ -472,7 +480,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 createLockedResource
-private LockedResource createLockedResource(LockedResourceType resourceType,
+private LockedResource createLockedResource(LockedResourceType resourceType,
 https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String resourceName,
 LockAndQueue queue)
 
@@ -483,7 +491,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html
 
 
 addToLockedResources
-private  void addToLockedResources(https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List lockedResources,
+private  void addToLockedResources(https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List lockedResources,
   https://docs.oracle.com/javase/8/docs/api/java/util/Map.ht

[32/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureScheduler.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureScheduler.html
 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureScheduler.html
index 1d20bab..15825d6 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureScheduler.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureScheduler.html
@@ -18,8 +18,8 @@
 catch(err) {
 }
 //-->
-var methods = 
{"i0":9,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":9,"i11":10,"i12":10,"i13":10,"i14":9,"i15":10,"i16":9,"i17":10,"i18":9,"i19":10,"i20":9,"i21":9,"i22":9,"i23":9,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":9,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10};
-var tabs = {65535:["t0","All Methods"],1:["t1","Static 
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var methods = 
{"i0":9,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":9,"i11":10,"i12":10,"i13":10,"i14":9,"i15":10,"i16":9,"i17":10,"i18":9,"i19":10,"i20":9,"i21":9,"i22":9,"i23":9,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":9,"i30":10,"i31":10,"i32":10,"i33":42,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":42,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static 
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete 
Methods"],32:["t6","Deprecated Methods"]};
 var altColor = "altColor";
 var rowColor = "rowColor";
 var tableTab = "tableTab";
@@ -119,7 +119,7 @@ var activeTableTab = "activeTableTab";
 
 
 @InterfaceAudience.Private
-public class MasterProcedureScheduler
+public class MasterProcedureScheduler
 extends AbstractProcedureScheduler
 ProcedureScheduler for the Master Procedures.
  This ProcedureScheduler tries to provide to the ProcedureExecutor procedures
@@ -269,7 +269,7 @@ extends 
-All Methods Static Methods Instance Methods Concrete Methods 
+All Methods Static Methods Instance Methods Concrete Methods Deprecated Methods 
 
 Modifier and Type
 Method and Description
@@ -443,12 +443,15 @@ extends 
 boolean
 waitMetaExclusiveLock(Procedure procedure)
-Try to acquire the exclusive lock on meta.
+Deprecated. 
+only used for RecoverMetaProcedure.
 Should be removed along with
+ RecoverMetaProcedure.
+
 
 
 
 boolean
-waitNamespaceExclusiveLock(Procedure procedure,
+waitNamespaceExclusiveLock(Procedure procedure,
   https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String namespace)
 Suspend the procedure if the specified namespace is already 
locked.
 
@@ -462,14 +465,14 @@ extends 
 boolean
-waitRegion(Procedure procedure,
+waitRegion(Procedure procedure,
   RegionInfo regionInfo)
 Suspend the procedure if the specified region is already 
locked.
 
 
 
 boolean
-waitRegions(Procedure procedure,
+waitRegions(Procedure procedure,
TableName table,
RegionInfo... regionInfo)
 Suspend the procedure if the specified set of regions are 
already locked.
@@ -484,7 +487,7 @@ extends 
 boolean
-waitTableExclusiveLock(Procedure procedure,
+waitTableExclusiveLock(Procedure procedure,
   TableName table)
 Suspend the procedure if the specified table is already 
locked.
 
@@ -496,7 +499,7 @@ extends 
 boolean
-waitTableSharedLock(Procedure procedure,
+waitTableSharedLock(Procedure procedure,
TableName table)
 Suspend the procedure if the specified table is already 
locked.
 
@@ -504,12 +507,15 @@ extends 
 void
 wakeMetaExclusiveLock(Procedure procedure)
-Wake the procedures waiting for meta.
+Deprecated. 
+only used for RecoverMetaProcedure.
 Should be removed along with
+ RecoverMetaProcedure.
+
 
 
 
 void
-wakeNamespaceExclusiveLock(Procedure procedure,
+wakeNamespaceExclusiveLock(Procedure procedure,
   https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String namespace)
 Wake the procedures waiting for the specified 
namespace
 
@@ -523,14 +529,14 @@ extends 
 void
-wakeRegion(Procedure procedure,
+wakeRegion(Procedure procedure,
   RegionInfo regionInfo)
 Wake the procedures waiting for the specified region
 
 
 
 void
-wakeRegions(Procedure procedure,
+wakeRegions(Procedure procedure,
TableName table,
RegionInfo... regionInfo)
 Wake the procedures waiting for the specified regions
@@ -545,14 +

[12/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.MasterStoppedException.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.MasterStoppedException.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.MasterStoppedException.html
index eb16038..74bacd8 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.MasterStoppedException.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.MasterStoppedException.html
@@ -6,7 +6,7 @@
 
 
 
-001/*
+001/**
 002 * Licensed to the Apache Software 
Foundation (ASF) under one
 003 * or more contributor license 
agreements.  See the NOTICE file
 004 * distributed with this work for 
additional information
@@ -48,692 +48,692 @@
 040import java.util.Map;
 041import java.util.Map.Entry;
 042import java.util.Objects;
-043import java.util.Set;
-044import 
java.util.concurrent.ExecutionException;
-045import java.util.concurrent.Future;
-046import java.util.concurrent.TimeUnit;
-047import 
java.util.concurrent.TimeoutException;
-048import 
java.util.concurrent.atomic.AtomicInteger;
-049import 
java.util.concurrent.atomic.AtomicReference;
-050import java.util.function.Function;
-051import java.util.regex.Pattern;
-052import java.util.stream.Collectors;
-053import javax.servlet.ServletException;
-054import javax.servlet.http.HttpServlet;
-055import 
javax.servlet.http.HttpServletRequest;
-056import 
javax.servlet.http.HttpServletResponse;
-057import 
org.apache.commons.lang3.StringUtils;
-058import 
org.apache.hadoop.conf.Configuration;
-059import org.apache.hadoop.fs.Path;
-060import 
org.apache.hadoop.hbase.ClusterId;
-061import 
org.apache.hadoop.hbase.ClusterMetrics;
-062import 
org.apache.hadoop.hbase.ClusterMetrics.Option;
-063import 
org.apache.hadoop.hbase.ClusterMetricsBuilder;
-064import 
org.apache.hadoop.hbase.DoNotRetryIOException;
-065import 
org.apache.hadoop.hbase.HBaseIOException;
-066import 
org.apache.hadoop.hbase.HBaseInterfaceAudience;
-067import 
org.apache.hadoop.hbase.HConstants;
-068import 
org.apache.hadoop.hbase.InvalidFamilyOperationException;
-069import 
org.apache.hadoop.hbase.MasterNotRunningException;
-070import 
org.apache.hadoop.hbase.MetaTableAccessor;
-071import 
org.apache.hadoop.hbase.NamespaceDescriptor;
-072import 
org.apache.hadoop.hbase.PleaseHoldException;
-073import 
org.apache.hadoop.hbase.ReplicationPeerNotFoundException;
-074import 
org.apache.hadoop.hbase.ScheduledChore;
-075import 
org.apache.hadoop.hbase.ServerName;
-076import 
org.apache.hadoop.hbase.TableDescriptors;
-077import 
org.apache.hadoop.hbase.TableName;
-078import 
org.apache.hadoop.hbase.TableNotDisabledException;
-079import 
org.apache.hadoop.hbase.TableNotFoundException;
-080import 
org.apache.hadoop.hbase.UnknownRegionException;
-081import 
org.apache.hadoop.hbase.client.ColumnFamilyDescriptor;
-082import 
org.apache.hadoop.hbase.client.ColumnFamilyDescriptorBuilder;
-083import 
org.apache.hadoop.hbase.client.MasterSwitchType;
-084import 
org.apache.hadoop.hbase.client.RegionInfo;
-085import 
org.apache.hadoop.hbase.client.Result;
-086import 
org.apache.hadoop.hbase.client.TableDescriptor;
-087import 
org.apache.hadoop.hbase.client.TableDescriptorBuilder;
-088import 
org.apache.hadoop.hbase.client.TableState;
-089import 
org.apache.hadoop.hbase.client.VersionInfoUtil;
-090import 
org.apache.hadoop.hbase.coprocessor.CoprocessorHost;
-091import 
org.apache.hadoop.hbase.exceptions.DeserializationException;
-092import 
org.apache.hadoop.hbase.exceptions.MergeRegionException;
-093import 
org.apache.hadoop.hbase.executor.ExecutorType;
-094import 
org.apache.hadoop.hbase.favored.FavoredNodesManager;
-095import 
org.apache.hadoop.hbase.favored.FavoredNodesPromoter;
-096import 
org.apache.hadoop.hbase.http.InfoServer;
-097import 
org.apache.hadoop.hbase.ipc.CoprocessorRpcUtils;
-098import 
org.apache.hadoop.hbase.ipc.RpcServer;
-099import 
org.apache.hadoop.hbase.ipc.ServerNotRunningYetException;
-100import 
org.apache.hadoop.hbase.log.HBaseMarkers;
-101import 
org.apache.hadoop.hbase.master.MasterRpcServices.BalanceSwitchMode;
-102import 
org.apache.hadoop.hbase.master.assignment.AssignmentManager;
-103import 
org.apache.hadoop.hbase.master.assignment.MergeTableRegionsProcedure;
-104import 
org.apache.hadoop.hbase.master.assignment.RegionStates;
-105import 
org.apache.hadoop.hbase.master.assignment.RegionStates.RegionStateNode;
-106import 
org.apache.hadoop.hbase.master.balancer.BalancerChore;
-107import 
org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer;
-108import 
org.apache.hadoop.hbase.master.balancer.ClusterStatusChore;
-109import 
org.apache.hadoop.hbase.master.balancer.LoadBalancerFactory;
-110import 
org.apache.hadoop.hbase.master.cleaner.CleanerChore;
-111import 
org.apache.hadoop.hbase.master.cleaner.HFileCleaner;
-112import 
org.apache.hado

[36/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html 
b/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html
index 77c2ad4..490dd78 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/assignment/AssignmentManager.html
@@ -18,7 +18,7 @@
 catch(err) {
 }
 //-->
-var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10,"i52":10,"i53":10,"i54":10,"i55":10,"i56":10,"i57":10,"i58":10,"i59":10,"i60":10,"i61":10,"i62":10,"i63":10,"i64":10,"i65":10,"i66":10,"i67":10,"i68":10,"i69":10,"i70":10,"i71":10,"i72":10,"i73":10,"i74":10,"i75":10,"i76":10,"i77":10,"i78":10,"i79":10,"i80":10,"i81":10,"i82":10,"i83":10,"i84":10,"i85":10,"i86":10,"i87":10,"i88":10,"i89":10,"i90":10,"i91":10,"i92":10,"i93":10,"i94":10,"i95":10,"i96":10,"i97":10,"i98":10,"i99":10,"i100":10,"i101":10,"i102":10,"i103":10,"i104":10,"i105":10,"i106":10,"i107":10,"i108":10,"i
 
109":10,"i110":10,"i111":10,"i112":10,"i113":10,"i114":10,"i115":10,"i116":10,"i117":10,"i118":10};
+var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10,"i52":10,"i53":10,"i54":10,"i55":10,"i56":10,"i57":10,"i58":10,"i59":10,"i60":10,"i61":10,"i62":10,"i63":10,"i64":10,"i65":10,"i66":10,"i67":10,"i68":10,"i69":10,"i70":10,"i71":10,"i72":10,"i73":10,"i74":10,"i75":10,"i76":10,"i77":10,"i78":10,"i79":10,"i80":10,"i81":10,"i82":10,"i83":10,"i84":10,"i85":10,"i86":10,"i87":10,"i88":10,"i89":10,"i90":10,"i91":10,"i92":10,"i93":10,"i94":10,"i95":10,"i96":10,"i97":10,"i98":10,"i99":10,"i100":10,"i101":10,"i102":10,"i103":10,"i104":10,"i105":10,"i106":10,"i107":10,"i108":10,"i
 109":10,"i110":10};
 var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],8:["t4","Concrete Methods"]};
 var altColor = "altColor";
 var rowColor = "rowColor";
@@ -114,7 +114,7 @@ var activeTableTab = "activeTableTab";
 
 
 @InterfaceAudience.Private
-public class AssignmentManager
+public class AssignmentManager
 extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true";
 title="class or interface in java.lang">Object
 implements ServerListener
 The AssignmentManager is the coordinator for region 
assign/unassign operations.
@@ -236,86 +236,70 @@ implements DEFAULT_RIT_STUCK_WARNING_THRESHOLD 
 
 
-private ProcedureEvent
-failoverCleanupDone
-Indicator that AssignmentManager has recovered the region 
states so
- that ServerCrashProcedure can be fully enabled and re-assign regions
- of dead servers.
-
-
-
 private https://docs.oracle.com/javase/8/docs/api/java/util/concurrent/CopyOnWriteArrayList.html?is-external=true";
 title="class or interface in 
java.util.concurrent">CopyOnWriteArrayList
 listeners
 Listeners that are called on assignment events.
 
 
-
+
 private static org.slf4j.Logger
 LOG 
 
-
+
 private MasterServices
 master 
 
-
+
 private static https://docs.oracle.com/javase/8/docs/api/java/util/Set.html?is-external=true";
 title="class or interface in java.util">Set
 META_REGION_SET 
 
-
+
 private ProcedureEvent
-metaInitializedEvent 
+metaAssignEvent 
 
-
+
 private ProcedureEvent
 metaLoadEvent 
 
-
+
 private MetricsAssignmentManager
 metrics 
 
-
+
 static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String
 METRICS_RIT_STUCK_WARNING_THRESHOLD
 Region in Transition metrics threshold time
 
 
-
+
 private https://docs.oracle.com/javase/8/docs/api/java/util/ArrayList.html?is-external=true";
 title="class or interface in java.util">ArrayList
 pendingAssignQueue 
 
-
-private RegionNormalizer
-regionNormalizer 
-
 
-private RegionStateListener
-regionStateListener 
-
-
 private RegionStates
 regionStates 
 
-
+
 private RegionStateStore
 regionStateStore 
 
-
+
 static https://docs.oracle.com/javase/8/docs/api/java/lang/St

[22/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectingVisitor.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectingVisitor.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectingVisitor.html
index fea2b5a..c7a6cc4 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectingVisitor.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectingVisitor.html
@@ -1354,816 +1354,824 @@
 1346   */
 1347  public static void 
putsToMetaTable(final Connection connection, final List ps)
 1348  throws IOException {
-1349try (Table t = 
getMetaHTable(connection)) {
-1350  debugLogMutations(ps);
-1351  t.put(ps);
-1352}
-1353  }
-1354
-1355  /**
-1356   * Delete the passed 
d from the hbase:meta 
table.
-1357   * @param connection connection we're 
using
-1358   * @param d Delete to add to 
hbase:meta
-1359   */
-1360  private static void 
deleteFromMetaTable(final Connection connection, final Delete d)
-1361  throws IOException {
-1362List dels = new 
ArrayList<>(1);
-1363dels.add(d);
-1364deleteFromMetaTable(connection, 
dels);
-1365  }
-1366
-1367  /**
-1368   * Delete the passed 
deletes from the hbase:meta 
table.
-1369   * @param connection connection we're 
using
-1370   * @param deletes Deletes to add to 
hbase:meta  This list should support #remove.
-1371   */
-1372  private static void 
deleteFromMetaTable(final Connection connection, final List 
deletes)
-1373  throws IOException {
-1374try (Table t = 
getMetaHTable(connection)) {
-1375  debugLogMutations(deletes);
-1376  t.delete(deletes);
-1377}
-1378  }
-1379
-1380  /**
-1381   * Deletes some replica columns 
corresponding to replicas for the passed rows
-1382   * @param metaRows rows in 
hbase:meta
-1383   * @param replicaIndexToDeleteFrom the 
replica ID we would start deleting from
-1384   * @param numReplicasToRemove how many 
replicas to remove
-1385   * @param connection connection we're 
using to access meta table
-1386   */
-1387  public static void 
removeRegionReplicasFromMeta(Set metaRows,
-1388int replicaIndexToDeleteFrom, int 
numReplicasToRemove, Connection connection)
-1389  throws IOException {
-1390int absoluteIndex = 
replicaIndexToDeleteFrom + numReplicasToRemove;
-1391for (byte[] row : metaRows) {
-1392  long now = 
EnvironmentEdgeManager.currentTime();
-1393  Delete deleteReplicaLocations = 
new Delete(row);
-1394  for (int i = 
replicaIndexToDeleteFrom; i < absoluteIndex; i++) {
-1395
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1396  getServerColumn(i), now);
-1397
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1398  getSeqNumColumn(i), now);
-1399
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1400  getStartCodeColumn(i), now);
-1401  }
-1402  deleteFromMetaTable(connection, 
deleteReplicaLocations);
-1403}
-1404  }
-1405
-1406  /**
-1407   * Execute the passed 
mutations against hbase:meta 
table.
-1408   * @param connection connection we're 
using
-1409   * @param mutations Puts and Deletes 
to execute on hbase:meta
-1410   * @throws IOException
-1411   */
-1412  public static void 
mutateMetaTable(final Connection connection,
-1413 
final List mutations)
-1414throws IOException {
-1415Table t = 
getMetaHTable(connection);
-1416try {
-1417  debugLogMutations(mutations);
-1418  t.batch(mutations, null);
-1419} catch (InterruptedException e) {
-1420  InterruptedIOException ie = new 
InterruptedIOException(e.getMessage());
-1421  ie.initCause(e);
-1422  throw ie;
-1423} finally {
-1424  t.close();
-1425}
-1426  }
-1427
-1428  private static void 
addRegionStateToPut(Put put, RegionState.State state) throws IOException {
-1429
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-1430.setRow(put.getRow())
-1431
.setFamily(HConstants.CATALOG_FAMILY)
-1432
.setQualifier(getRegionStateColumn())
-1433
.setTimestamp(put.getTimestamp())
-1434.setType(Cell.Type.Put)
-1435
.setValue(Bytes.toBytes(state.name()))
-1436.build());
-1437  }
-1438
-1439  /**
-1440   * Adds daughter region infos to 
hbase:meta row for the specified region. Note that this does not
-1441   * add its daughter's as different 
rows, but adds information about the daughters in the same row
-1442   * as the parent. Use
-1443   * {@link #splitRegion(Connection, 
RegionInfo, long, RegionInfo, RegionInfo, ServerName, int)}
-1444   * if you want to do that.
-1445   * @param connectio

[18/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.TableVisitorBase.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.TableVisitorBase.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.TableVisitorBase.html
index fea2b5a..c7a6cc4 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.TableVisitorBase.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.TableVisitorBase.html
@@ -1354,816 +1354,824 @@
 1346   */
 1347  public static void 
putsToMetaTable(final Connection connection, final List ps)
 1348  throws IOException {
-1349try (Table t = 
getMetaHTable(connection)) {
-1350  debugLogMutations(ps);
-1351  t.put(ps);
-1352}
-1353  }
-1354
-1355  /**
-1356   * Delete the passed 
d from the hbase:meta 
table.
-1357   * @param connection connection we're 
using
-1358   * @param d Delete to add to 
hbase:meta
-1359   */
-1360  private static void 
deleteFromMetaTable(final Connection connection, final Delete d)
-1361  throws IOException {
-1362List dels = new 
ArrayList<>(1);
-1363dels.add(d);
-1364deleteFromMetaTable(connection, 
dels);
-1365  }
-1366
-1367  /**
-1368   * Delete the passed 
deletes from the hbase:meta 
table.
-1369   * @param connection connection we're 
using
-1370   * @param deletes Deletes to add to 
hbase:meta  This list should support #remove.
-1371   */
-1372  private static void 
deleteFromMetaTable(final Connection connection, final List 
deletes)
-1373  throws IOException {
-1374try (Table t = 
getMetaHTable(connection)) {
-1375  debugLogMutations(deletes);
-1376  t.delete(deletes);
-1377}
-1378  }
-1379
-1380  /**
-1381   * Deletes some replica columns 
corresponding to replicas for the passed rows
-1382   * @param metaRows rows in 
hbase:meta
-1383   * @param replicaIndexToDeleteFrom the 
replica ID we would start deleting from
-1384   * @param numReplicasToRemove how many 
replicas to remove
-1385   * @param connection connection we're 
using to access meta table
-1386   */
-1387  public static void 
removeRegionReplicasFromMeta(Set metaRows,
-1388int replicaIndexToDeleteFrom, int 
numReplicasToRemove, Connection connection)
-1389  throws IOException {
-1390int absoluteIndex = 
replicaIndexToDeleteFrom + numReplicasToRemove;
-1391for (byte[] row : metaRows) {
-1392  long now = 
EnvironmentEdgeManager.currentTime();
-1393  Delete deleteReplicaLocations = 
new Delete(row);
-1394  for (int i = 
replicaIndexToDeleteFrom; i < absoluteIndex; i++) {
-1395
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1396  getServerColumn(i), now);
-1397
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1398  getSeqNumColumn(i), now);
-1399
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1400  getStartCodeColumn(i), now);
-1401  }
-1402  deleteFromMetaTable(connection, 
deleteReplicaLocations);
-1403}
-1404  }
-1405
-1406  /**
-1407   * Execute the passed 
mutations against hbase:meta 
table.
-1408   * @param connection connection we're 
using
-1409   * @param mutations Puts and Deletes 
to execute on hbase:meta
-1410   * @throws IOException
-1411   */
-1412  public static void 
mutateMetaTable(final Connection connection,
-1413 
final List mutations)
-1414throws IOException {
-1415Table t = 
getMetaHTable(connection);
-1416try {
-1417  debugLogMutations(mutations);
-1418  t.batch(mutations, null);
-1419} catch (InterruptedException e) {
-1420  InterruptedIOException ie = new 
InterruptedIOException(e.getMessage());
-1421  ie.initCause(e);
-1422  throw ie;
-1423} finally {
-1424  t.close();
-1425}
-1426  }
-1427
-1428  private static void 
addRegionStateToPut(Put put, RegionState.State state) throws IOException {
-1429
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-1430.setRow(put.getRow())
-1431
.setFamily(HConstants.CATALOG_FAMILY)
-1432
.setQualifier(getRegionStateColumn())
-1433
.setTimestamp(put.getTimestamp())
-1434.setType(Cell.Type.Put)
-1435
.setValue(Bytes.toBytes(state.name()))
-1436.build());
-1437  }
-1438
-1439  /**
-1440   * Adds daughter region infos to 
hbase:meta row for the specified region. Note that this does not
-1441   * add its daughter's as different 
rows, but adds information about the daughters in the same row
-1442   * as the parent. Use
-1443   * {@link #splitRegion(Connection, 
RegionInfo, long, RegionInfo, RegionInfo, ServerName, int)}
-1444   * if you want to do that.
-1445   * @param connection con

[11/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.RedirectServlet.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.RedirectServlet.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.RedirectServlet.html
index eb16038..74bacd8 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.RedirectServlet.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.RedirectServlet.html
@@ -6,7 +6,7 @@
 
 
 
-001/*
+001/**
 002 * Licensed to the Apache Software 
Foundation (ASF) under one
 003 * or more contributor license 
agreements.  See the NOTICE file
 004 * distributed with this work for 
additional information
@@ -48,692 +48,692 @@
 040import java.util.Map;
 041import java.util.Map.Entry;
 042import java.util.Objects;
-043import java.util.Set;
-044import 
java.util.concurrent.ExecutionException;
-045import java.util.concurrent.Future;
-046import java.util.concurrent.TimeUnit;
-047import 
java.util.concurrent.TimeoutException;
-048import 
java.util.concurrent.atomic.AtomicInteger;
-049import 
java.util.concurrent.atomic.AtomicReference;
-050import java.util.function.Function;
-051import java.util.regex.Pattern;
-052import java.util.stream.Collectors;
-053import javax.servlet.ServletException;
-054import javax.servlet.http.HttpServlet;
-055import 
javax.servlet.http.HttpServletRequest;
-056import 
javax.servlet.http.HttpServletResponse;
-057import 
org.apache.commons.lang3.StringUtils;
-058import 
org.apache.hadoop.conf.Configuration;
-059import org.apache.hadoop.fs.Path;
-060import 
org.apache.hadoop.hbase.ClusterId;
-061import 
org.apache.hadoop.hbase.ClusterMetrics;
-062import 
org.apache.hadoop.hbase.ClusterMetrics.Option;
-063import 
org.apache.hadoop.hbase.ClusterMetricsBuilder;
-064import 
org.apache.hadoop.hbase.DoNotRetryIOException;
-065import 
org.apache.hadoop.hbase.HBaseIOException;
-066import 
org.apache.hadoop.hbase.HBaseInterfaceAudience;
-067import 
org.apache.hadoop.hbase.HConstants;
-068import 
org.apache.hadoop.hbase.InvalidFamilyOperationException;
-069import 
org.apache.hadoop.hbase.MasterNotRunningException;
-070import 
org.apache.hadoop.hbase.MetaTableAccessor;
-071import 
org.apache.hadoop.hbase.NamespaceDescriptor;
-072import 
org.apache.hadoop.hbase.PleaseHoldException;
-073import 
org.apache.hadoop.hbase.ReplicationPeerNotFoundException;
-074import 
org.apache.hadoop.hbase.ScheduledChore;
-075import 
org.apache.hadoop.hbase.ServerName;
-076import 
org.apache.hadoop.hbase.TableDescriptors;
-077import 
org.apache.hadoop.hbase.TableName;
-078import 
org.apache.hadoop.hbase.TableNotDisabledException;
-079import 
org.apache.hadoop.hbase.TableNotFoundException;
-080import 
org.apache.hadoop.hbase.UnknownRegionException;
-081import 
org.apache.hadoop.hbase.client.ColumnFamilyDescriptor;
-082import 
org.apache.hadoop.hbase.client.ColumnFamilyDescriptorBuilder;
-083import 
org.apache.hadoop.hbase.client.MasterSwitchType;
-084import 
org.apache.hadoop.hbase.client.RegionInfo;
-085import 
org.apache.hadoop.hbase.client.Result;
-086import 
org.apache.hadoop.hbase.client.TableDescriptor;
-087import 
org.apache.hadoop.hbase.client.TableDescriptorBuilder;
-088import 
org.apache.hadoop.hbase.client.TableState;
-089import 
org.apache.hadoop.hbase.client.VersionInfoUtil;
-090import 
org.apache.hadoop.hbase.coprocessor.CoprocessorHost;
-091import 
org.apache.hadoop.hbase.exceptions.DeserializationException;
-092import 
org.apache.hadoop.hbase.exceptions.MergeRegionException;
-093import 
org.apache.hadoop.hbase.executor.ExecutorType;
-094import 
org.apache.hadoop.hbase.favored.FavoredNodesManager;
-095import 
org.apache.hadoop.hbase.favored.FavoredNodesPromoter;
-096import 
org.apache.hadoop.hbase.http.InfoServer;
-097import 
org.apache.hadoop.hbase.ipc.CoprocessorRpcUtils;
-098import 
org.apache.hadoop.hbase.ipc.RpcServer;
-099import 
org.apache.hadoop.hbase.ipc.ServerNotRunningYetException;
-100import 
org.apache.hadoop.hbase.log.HBaseMarkers;
-101import 
org.apache.hadoop.hbase.master.MasterRpcServices.BalanceSwitchMode;
-102import 
org.apache.hadoop.hbase.master.assignment.AssignmentManager;
-103import 
org.apache.hadoop.hbase.master.assignment.MergeTableRegionsProcedure;
-104import 
org.apache.hadoop.hbase.master.assignment.RegionStates;
-105import 
org.apache.hadoop.hbase.master.assignment.RegionStates.RegionStateNode;
-106import 
org.apache.hadoop.hbase.master.balancer.BalancerChore;
-107import 
org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer;
-108import 
org.apache.hadoop.hbase.master.balancer.ClusterStatusChore;
-109import 
org.apache.hadoop.hbase.master.balancer.LoadBalancerFactory;
-110import 
org.apache.hadoop.hbase.master.cleaner.CleanerChore;
-111import 
org.apache.hadoop.hbase.master.cleaner.HFileCleaner;
-112import 
org.apache.hadoop.hbase.master.cleaner.LogCleaner;

[15/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/Version.html
--
diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/Version.html 
b/devapidocs/src-html/org/apache/hadoop/hbase/Version.html
index 0b11000..02beab3 100644
--- a/devapidocs/src-html/org/apache/hadoop/hbase/Version.html
+++ b/devapidocs/src-html/org/apache/hadoop/hbase/Version.html
@@ -16,11 +16,11 @@
 008@InterfaceAudience.Private
 009public class Version {
 010  public static final String version = 
"3.0.0-SNAPSHOT";
-011  public static final String revision = 
"78da0e366970cf9bab6add9ba9fd74ca37c75be3";
+011  public static final String revision = 
"9101fc246f86445006bfbcdfda5cc495016dc280";
 012  public static final String user = 
"jenkins";
-013  public static final String date = "Tue 
Jun 19 00:28:02 UTC 2018";
+013  public static final String date = "Wed 
Jun 20 04:15:39 UTC 2018";
 014  public static final String url = 
"git://jenkins-websites1.apache.org/home/jenkins/jenkins-slave/workspace/hbase_generate_website/hbase";
-015  public static final String srcChecksum 
= "72ef87fb3fa82a7c510def4b3609400b";
+015  public static final String srcChecksum 
= "bc4bb89ad408bf39c503a300c7481e65";
 016}
 
 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.SplitParentFirstComparator.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.SplitParentFirstComparator.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.SplitParentFirstComparator.html
index 4229646..1814633 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.SplitParentFirstComparator.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/CatalogJanitor.SplitParentFirstComparator.html
@@ -119,358 +119,355 @@
 111  protected void chore() {
 112try {
 113  AssignmentManager am = 
this.services.getAssignmentManager();
-114  if (this.enabled.get()
-115  && 
!this.services.isInMaintenanceMode()
-116  && am != null
-117  && 
am.isFailoverCleanupDone()
-118  && 
!am.hasRegionsInTransition()) {
-119scan();
-120  } else {
-121LOG.warn("CatalogJanitor is 
disabled! Enabled=" + this.enabled.get() +
-122", maintenanceMode=" + 
this.services.isInMaintenanceMode() +
-123", am=" + am + ", 
failoverCleanupDone=" + (am != null && am.isFailoverCleanupDone()) +
-124", hasRIT=" + (am != null 
&& am.hasRegionsInTransition()));
-125  }
-126} catch (IOException e) {
-127  LOG.warn("Failed scan of catalog 
table", e);
-128}
-129  }
-130
-131  /**
-132   * Scans hbase:meta and returns a 
number of scanned rows, and a map of merged
-133   * regions, and an ordered map of split 
parents.
-134   * @return triple of scanned rows, map 
of merged regions and map of split
-135   * parent regioninfos
-136   * @throws IOException
-137   */
-138  Triple, Map>
-139getMergedRegionsAndSplitParents() 
throws IOException {
-140return 
getMergedRegionsAndSplitParents(null);
-141  }
-142
-143  /**
-144   * Scans hbase:meta and returns a 
number of scanned rows, and a map of merged
-145   * regions, and an ordered map of split 
parents. if the given table name is
-146   * null, return merged regions and 
split parents of all tables, else only the
-147   * specified table
-148   * @param tableName null represents all 
tables
-149   * @return triple of scanned rows, and 
map of merged regions, and map of split
-150   * parent regioninfos
-151   * @throws IOException
-152   */
-153  Triple, Map>
-154getMergedRegionsAndSplitParents(final 
TableName tableName) throws IOException {
-155final boolean isTableSpecified = 
(tableName != null);
-156// TODO: Only works with single 
hbase:meta region currently.  Fix.
-157final AtomicInteger count = new 
AtomicInteger(0);
-158// Keep Map of found split parents.  
There are candidates for cleanup.
-159// Use a comparator that has split 
parents come before its daughters.
-160final Map 
splitParents = new TreeMap<>(new SplitParentFirstComparator());
-161final Map 
mergedRegions = new TreeMap<>(RegionInfo.COMPARATOR);
-162// This visitor collects split 
parents and counts rows in the hbase:meta table
-163
-164MetaTableAccessor.Visitor visitor = 
new MetaTableAccessor.Visitor() {
-165  @Override
-166  public boolean visit(Result r) 
throws IOException {
-167if (r == null || r.isEmpty()) 
return true;
-168count.incrementAndGet();
-169RegionInfo info = 
MetaTableAccessor.getRegion

[01/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
Repository: hbase-site
Updated Branches:
  refs/heads/asf-site 630414573 -> 65565d77b


http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html
index c1b4533..a0c568b 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/RegionStateStore.html
@@ -136,220 +136,221 @@
 128  public void 
updateRegionLocation(RegionStates.RegionStateNode regionStateNode)
 129  throws IOException {
 130if 
(regionStateNode.getRegionInfo().isMetaRegion()) {
-131  
updateMetaLocation(regionStateNode.getRegionInfo(), 
regionStateNode.getRegionLocation());
-132} else {
-133  long openSeqNum = 
regionStateNode.getState() == State.OPEN ?
-134  regionStateNode.getOpenSeqNum() 
: HConstants.NO_SEQNUM;
-135  
updateUserRegionLocation(regionStateNode.getRegionInfo(), 
regionStateNode.getState(),
-136  
regionStateNode.getRegionLocation(), regionStateNode.getLastHost(), 
openSeqNum,
-137  // The regionStateNode may have 
no procedure in a test scenario; allow for this.
-138  regionStateNode.getProcedure() 
!= null?
-139  
regionStateNode.getProcedure().getProcId(): Procedure.NO_PROC_ID);
-140}
-141  }
-142
-143  private void updateMetaLocation(final 
RegionInfo regionInfo, final ServerName serverName)
-144  throws IOException {
-145try {
-146  
MetaTableLocator.setMetaLocation(master.getZooKeeper(), serverName,
-147regionInfo.getReplicaId(), 
State.OPEN);
-148} catch (KeeperException e) {
-149  throw new IOException(e);
-150}
-151  }
-152
-153  private void 
updateUserRegionLocation(final RegionInfo regionInfo, final State state,
-154  final ServerName regionLocation, 
final ServerName lastHost, final long openSeqNum,
-155  final long pid)
-156  throws IOException {
-157long time = 
EnvironmentEdgeManager.currentTime();
-158final int replicaId = 
regionInfo.getReplicaId();
-159final Put put = new 
Put(MetaTableAccessor.getMetaKeyForRegion(regionInfo), time);
-160MetaTableAccessor.addRegionInfo(put, 
regionInfo);
-161final StringBuilder info =
-162  new 
StringBuilder("pid=").append(pid).append(" updating hbase:meta row=")
-163
.append(regionInfo.getEncodedName()).append(", regionState=").append(state);
-164if (openSeqNum >= 0) {
-165  Preconditions.checkArgument(state 
== State.OPEN && regionLocation != null,
-166  "Open region should be on a 
server");
-167  MetaTableAccessor.addLocation(put, 
regionLocation, openSeqNum, replicaId);
-168  // only update replication barrier 
for default replica
-169  if (regionInfo.getReplicaId() == 
RegionInfo.DEFAULT_REPLICA_ID &&
-170
hasGlobalReplicationScope(regionInfo.getTable())) {
-171
MetaTableAccessor.addReplicationBarrier(put, openSeqNum);
-172info.append(", 
repBarrier=").append(openSeqNum);
-173  }
-174  info.append(", 
openSeqNum=").append(openSeqNum);
-175  info.append(", 
regionLocation=").append(regionLocation);
-176} else if (regionLocation != null 
&& !regionLocation.equals(lastHost)) {
-177  // Ideally, if no regionLocation, 
write null to the hbase:meta but this will confuse clients
-178  // currently; they want a server to 
hit. TODO: Make clients wait if no location.
-179  
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-180  .setRow(put.getRow())
-181  
.setFamily(HConstants.CATALOG_FAMILY)
-182  
.setQualifier(getServerNameColumn(replicaId))
-183  
.setTimestamp(put.getTimestamp())
-184  .setType(Cell.Type.Put)
-185  
.setValue(Bytes.toBytes(regionLocation.getServerName()))
-186  .build());
-187  info.append(", 
regionLocation=").append(regionLocation);
-188}
-189
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-190.setRow(put.getRow())
-191
.setFamily(HConstants.CATALOG_FAMILY)
-192
.setQualifier(getStateColumn(replicaId))
-193
.setTimestamp(put.getTimestamp())
-194.setType(Cell.Type.Put)
-195
.setValue(Bytes.toBytes(state.name()))
-196.build());
-197LOG.info(info.toString());
-198updateRegionLocation(regionInfo, 
state, put);
-199  }
-200
-201  private void 
updateRegionLocation(RegionInfo regionInfo, State state, Put put)
-202  throws IOException {
-203try (Table table = 
master.getConnection().getTable(TableName.META_TABLE_NAME)) {
-204  table.put(put);
-205} catch (IOException e) {
-206  // TODO: Revist Means that

[19/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
index fea2b5a..c7a6cc4 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.ReplicationBarrierResult.html
@@ -1354,816 +1354,824 @@
 1346   */
 1347  public static void 
putsToMetaTable(final Connection connection, final List ps)
 1348  throws IOException {
-1349try (Table t = 
getMetaHTable(connection)) {
-1350  debugLogMutations(ps);
-1351  t.put(ps);
-1352}
-1353  }
-1354
-1355  /**
-1356   * Delete the passed 
d from the hbase:meta 
table.
-1357   * @param connection connection we're 
using
-1358   * @param d Delete to add to 
hbase:meta
-1359   */
-1360  private static void 
deleteFromMetaTable(final Connection connection, final Delete d)
-1361  throws IOException {
-1362List dels = new 
ArrayList<>(1);
-1363dels.add(d);
-1364deleteFromMetaTable(connection, 
dels);
-1365  }
-1366
-1367  /**
-1368   * Delete the passed 
deletes from the hbase:meta 
table.
-1369   * @param connection connection we're 
using
-1370   * @param deletes Deletes to add to 
hbase:meta  This list should support #remove.
-1371   */
-1372  private static void 
deleteFromMetaTable(final Connection connection, final List 
deletes)
-1373  throws IOException {
-1374try (Table t = 
getMetaHTable(connection)) {
-1375  debugLogMutations(deletes);
-1376  t.delete(deletes);
-1377}
-1378  }
-1379
-1380  /**
-1381   * Deletes some replica columns 
corresponding to replicas for the passed rows
-1382   * @param metaRows rows in 
hbase:meta
-1383   * @param replicaIndexToDeleteFrom the 
replica ID we would start deleting from
-1384   * @param numReplicasToRemove how many 
replicas to remove
-1385   * @param connection connection we're 
using to access meta table
-1386   */
-1387  public static void 
removeRegionReplicasFromMeta(Set metaRows,
-1388int replicaIndexToDeleteFrom, int 
numReplicasToRemove, Connection connection)
-1389  throws IOException {
-1390int absoluteIndex = 
replicaIndexToDeleteFrom + numReplicasToRemove;
-1391for (byte[] row : metaRows) {
-1392  long now = 
EnvironmentEdgeManager.currentTime();
-1393  Delete deleteReplicaLocations = 
new Delete(row);
-1394  for (int i = 
replicaIndexToDeleteFrom; i < absoluteIndex; i++) {
-1395
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1396  getServerColumn(i), now);
-1397
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1398  getSeqNumColumn(i), now);
-1399
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1400  getStartCodeColumn(i), now);
-1401  }
-1402  deleteFromMetaTable(connection, 
deleteReplicaLocations);
-1403}
-1404  }
-1405
-1406  /**
-1407   * Execute the passed 
mutations against hbase:meta 
table.
-1408   * @param connection connection we're 
using
-1409   * @param mutations Puts and Deletes 
to execute on hbase:meta
-1410   * @throws IOException
-1411   */
-1412  public static void 
mutateMetaTable(final Connection connection,
-1413 
final List mutations)
-1414throws IOException {
-1415Table t = 
getMetaHTable(connection);
-1416try {
-1417  debugLogMutations(mutations);
-1418  t.batch(mutations, null);
-1419} catch (InterruptedException e) {
-1420  InterruptedIOException ie = new 
InterruptedIOException(e.getMessage());
-1421  ie.initCause(e);
-1422  throw ie;
-1423} finally {
-1424  t.close();
-1425}
-1426  }
-1427
-1428  private static void 
addRegionStateToPut(Put put, RegionState.State state) throws IOException {
-1429
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-1430.setRow(put.getRow())
-1431
.setFamily(HConstants.CATALOG_FAMILY)
-1432
.setQualifier(getRegionStateColumn())
-1433
.setTimestamp(put.getTimestamp())
-1434.setType(Cell.Type.Put)
-1435
.setValue(Bytes.toBytes(state.name()))
-1436.build());
-1437  }
-1438
-1439  /**
-1440   * Adds daughter region infos to 
hbase:meta row for the specified region. Note that this does not
-1441   * add its daughter's as different 
rows, but adds information about the daughters in the same row
-1442   * as the parent. Use
-1443   * {@link #splitRegion(Connection, 
RegionInfo, long, RegionInfo, RegionInfo, ServerName, int)}
-1444   * if you want to 

[33/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureEnv.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureEnv.html 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureEnv.html
index d9f116c..39e672d 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureEnv.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/MasterProcedureEnv.html
@@ -18,7 +18,7 @@
 catch(err) {
 }
 //-->
-var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10};
+var methods = 
{"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10};
 var tabs = {65535:["t0","All Methods"],2:["t2","Instance 
Methods"],8:["t4","Concrete Methods"]};
 var altColor = "altColor";
 var rowColor = "rowColor";
@@ -115,7 +115,7 @@ var activeTableTab = "activeTableTab";
 
 @InterfaceAudience.Private
  @InterfaceStability.Evolving
-public class MasterProcedureEnv
+public class MasterProcedureEnv
 extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true";
 title="class or interface in java.lang">Object
 implements ConfigurationObserver
 
@@ -265,16 +265,8 @@ implements 
 boolean
-waitFailoverCleanup(Procedure proc) 
-
-
-boolean
 waitInitialized(Procedure proc) 
 
-
-boolean
-waitServerCrashProcessingEnabled(Procedure proc) 
-
 
 
 
@@ -303,7 +295,7 @@ implements 
 
 LOG
-private static final org.slf4j.Logger LOG
+private static final org.slf4j.Logger LOG
 
 
 
@@ -312,7 +304,7 @@ implements 
 
 remoteDispatcher
-private final RSProcedureDispatcher remoteDispatcher
+private final RSProcedureDispatcher remoteDispatcher
 
 
 
@@ -321,7 +313,7 @@ implements 
 
 procSched
-private final MasterProcedureScheduler procSched
+private final MasterProcedureScheduler procSched
 
 
 
@@ -330,7 +322,7 @@ implements 
 
 master
-private final MasterServices master
+private final MasterServices master
 
 
 
@@ -347,7 +339,7 @@ implements 
 
 MasterProcedureEnv
-public MasterProcedureEnv(MasterServices master)
+public MasterProcedureEnv(MasterServices master)
 
 
 
@@ -356,7 +348,7 @@ implements 
 
 MasterProcedureEnv
-public MasterProcedureEnv(MasterServices master,
+public MasterProcedureEnv(MasterServices master,
   RSProcedureDispatcher remoteDispatcher)
 
 
@@ -374,7 +366,7 @@ implements 
 
 getRequestUser
-public User getRequestUser()
+public User getRequestUser()
 
 
 
@@ -383,7 +375,7 @@ implements 
 
 getMasterServices
-public MasterServices getMasterServices()
+public MasterServices getMasterServices()
 
 
 
@@ -392,7 +384,7 @@ implements 
 
 getMasterConfiguration
-public org.apache.hadoop.conf.Configuration getMasterConfiguration()
+public org.apache.hadoop.conf.Configuration getMasterConfiguration()
 
 
 
@@ -401,7 +393,7 @@ implements 
 
 getAssignmentManager
-public AssignmentManager getAssignmentManager()
+public AssignmentManager getAssignmentManager()
 
 
 
@@ -410,7 +402,7 @@ implements 
 
 getMasterCoprocessorHost
-public MasterCoprocessorHost getMasterCoprocessorHost()
+public MasterCoprocessorHost getMasterCoprocessorHost()
 
 
 
@@ -419,7 +411,7 @@ implements 
 
 getProcedureScheduler
-public MasterProcedureScheduler getProcedureScheduler()
+public MasterProcedureScheduler getProcedureScheduler()
 
 
 
@@ -428,7 +420,7 @@ implements 
 
 getRemoteDispatcher
-public RSProcedureDispatcher getRemoteDispatcher()
+public RSProcedureDispatcher getRemoteDispatcher()
 
 
 
@@ -437,7 +429,7 @@ implements 
 
 getReplicationPeerManager
-public ReplicationPeerManager getReplicationPeerManager()
+public ReplicationPeerManager getReplicationPeerManager()
 
 
 
@@ -446,7 +438,7 @@ implements 
 
 isRunning
-public boolean isRunning()
+public boolean isRunning()
 
 
 
@@ -455,7 +447,7 @@ implements 
 
 isInitialized
-public boolean isInitialized()
+public boolean isInitialized()
 
 
 
@@ -464,25 +456,7 @@ implements 
 
 waitInitialized
-public boolean waitInitialized(Procedure proc)
-
-
-
-
-
-
-
-waitServerCrashProcessingEnabled
-public boolean waitServerCrashProcessingEnabled(Procedure proc)
-
-
-
-
-
-
-
-waitFailoverCleanup
-public boolean waitFailoverCleanup(Procedure proc)
+public boolean waitInitialized(Procedure proc)
 
 
 
@@ -491,7 +465,7 @@ implements 
 
 setEventReady
-public void setEventReady(ProcedureEvent event,
+public void setEventReady(ProcedureEvent event,
   boolean isReady)
 
 
@@ -501,7 +475,7 @@ implements 
 
 onConfigurationChange
-public void onConfigurationChange(org.apache.hadoop.conf.Configuration conf)
+public void onConfigurationChange(org.apache.hadoop.conf.Configuration conf)
 Description copied from 
interface: ConfigurationObserver
 This method would be call

[05/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
index 4b5d00c..96ecbf8 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionChore.html
@@ -6,7 +6,7 @@
 
 
 
-001/*
+001/**
 002 * Licensed to the Apache Software 
Foundation (ASF) under one
 003 * or more contributor license 
agreements.  See the NOTICE file
 004 * distributed with this work for 
additional information
@@ -23,1981 +23,1894 @@
 015 * See the License for the specific 
language governing permissions and
 016 * limitations under the License.
 017 */
-018
-019package 
org.apache.hadoop.hbase.master.assignment;
-020
-021import java.io.IOException;
-022import java.util.ArrayList;
-023import java.util.Arrays;
-024import java.util.Collection;
-025import java.util.Collections;
-026import java.util.HashMap;
-027import java.util.HashSet;
-028import java.util.List;
-029import java.util.Map;
-030import java.util.Set;
-031import 
java.util.concurrent.CopyOnWriteArrayList;
-032import java.util.concurrent.Future;
-033import java.util.concurrent.TimeUnit;
-034import 
java.util.concurrent.atomic.AtomicBoolean;
-035import 
java.util.concurrent.locks.Condition;
-036import 
java.util.concurrent.locks.ReentrantLock;
-037import java.util.stream.Collectors;
-038import 
org.apache.hadoop.conf.Configuration;
-039import 
org.apache.hadoop.hbase.HBaseIOException;
-040import 
org.apache.hadoop.hbase.HConstants;
-041import 
org.apache.hadoop.hbase.PleaseHoldException;
-042import 
org.apache.hadoop.hbase.RegionException;
-043import 
org.apache.hadoop.hbase.RegionStateListener;
-044import 
org.apache.hadoop.hbase.ServerName;
-045import 
org.apache.hadoop.hbase.TableName;
-046import 
org.apache.hadoop.hbase.YouAreDeadException;
-047import 
org.apache.hadoop.hbase.client.RegionInfo;
-048import 
org.apache.hadoop.hbase.client.RegionInfoBuilder;
-049import 
org.apache.hadoop.hbase.client.RegionReplicaUtil;
-050import 
org.apache.hadoop.hbase.client.Result;
-051import 
org.apache.hadoop.hbase.client.TableState;
-052import 
org.apache.hadoop.hbase.exceptions.UnexpectedStateException;
-053import 
org.apache.hadoop.hbase.favored.FavoredNodesManager;
-054import 
org.apache.hadoop.hbase.favored.FavoredNodesPromoter;
-055import 
org.apache.hadoop.hbase.master.AssignmentListener;
-056import 
org.apache.hadoop.hbase.master.LoadBalancer;
-057import 
org.apache.hadoop.hbase.master.MasterServices;
-058import 
org.apache.hadoop.hbase.master.MetricsAssignmentManager;
-059import 
org.apache.hadoop.hbase.master.NoSuchProcedureException;
-060import 
org.apache.hadoop.hbase.master.RegionPlan;
-061import 
org.apache.hadoop.hbase.master.RegionState;
-062import 
org.apache.hadoop.hbase.master.RegionState.State;
-063import 
org.apache.hadoop.hbase.master.ServerListener;
-064import 
org.apache.hadoop.hbase.master.TableStateManager;
-065import 
org.apache.hadoop.hbase.master.assignment.RegionStates.RegionStateNode;
-066import 
org.apache.hadoop.hbase.master.assignment.RegionStates.ServerState;
-067import 
org.apache.hadoop.hbase.master.assignment.RegionStates.ServerStateNode;
-068import 
org.apache.hadoop.hbase.master.balancer.FavoredStochasticBalancer;
-069import 
org.apache.hadoop.hbase.master.normalizer.RegionNormalizer;
-070import 
org.apache.hadoop.hbase.master.procedure.MasterProcedureEnv;
-071import 
org.apache.hadoop.hbase.master.procedure.MasterProcedureScheduler;
-072import 
org.apache.hadoop.hbase.master.procedure.ProcedureSyncWait;
-073import 
org.apache.hadoop.hbase.master.procedure.ServerCrashException;
-074import 
org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure;
-075import 
org.apache.hadoop.hbase.procedure2.Procedure;
-076import 
org.apache.hadoop.hbase.procedure2.ProcedureEvent;
-077import 
org.apache.hadoop.hbase.procedure2.ProcedureExecutor;
-078import 
org.apache.hadoop.hbase.procedure2.ProcedureInMemoryChore;
-079import 
org.apache.hadoop.hbase.procedure2.util.StringUtils;
-080import 
org.apache.hadoop.hbase.regionserver.SequenceId;
-081import 
org.apache.hadoop.hbase.util.Bytes;
-082import 
org.apache.hadoop.hbase.util.EnvironmentEdgeManager;
-083import 
org.apache.hadoop.hbase.util.HasThread;
-084import 
org.apache.hadoop.hbase.util.Pair;
-085import 
org.apache.hadoop.hbase.util.Threads;
-086import 
org.apache.hadoop.hbase.util.VersionInfo;
-087import 
org.apache.yetus.audience.InterfaceAudience;
-088import org.slf4j.Logger;
-089import org.slf4j.LoggerFactory;
-090
-091

[07/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/ServerManager.FlushedSequenceIdFlusher.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/ServerManager.FlushedSequenceIdFlusher.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/ServerManager.FlushedSequenceIdFlusher.html
new file mode 100644
index 000..ba6e4aa
--- /dev/null
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/ServerManager.FlushedSequenceIdFlusher.html
@@ -0,0 +1,1244 @@
+http://www.w3.org/TR/html4/loose.dtd";>
+
+
+Source code
+
+
+
+
+001/*
+002 *
+003 * Licensed to the Apache Software 
Foundation (ASF) under one
+004 * or more contributor license 
agreements.  See the NOTICE file
+005 * distributed with this work for 
additional information
+006 * regarding copyright ownership.  The 
ASF licenses this file
+007 * to you under the Apache License, 
Version 2.0 (the
+008 * "License"); you may not use this file 
except in compliance
+009 * with the License.  You may obtain a 
copy of the License at
+010 *
+011 * 
http://www.apache.org/licenses/LICENSE-2.0
+012 *
+013 * Unless required by applicable law or 
agreed to in writing, software
+014 * distributed under the License is 
distributed on an "AS IS" BASIS,
+015 * WITHOUT WARRANTIES OR CONDITIONS OF 
ANY KIND, either express or implied.
+016 * See the License for the specific 
language governing permissions and
+017 * limitations under the License.
+018 */
+019package org.apache.hadoop.hbase.master;
+020
+021import static 
org.apache.hadoop.hbase.util.CollectionUtils.computeIfAbsent;
+022
+023import java.io.IOException;
+024import java.net.InetAddress;
+025import java.util.ArrayList;
+026import java.util.Collections;
+027import java.util.HashMap;
+028import java.util.Iterator;
+029import java.util.List;
+030import java.util.Map;
+031import java.util.Map.Entry;
+032import java.util.Set;
+033import 
java.util.concurrent.ConcurrentNavigableMap;
+034import 
java.util.concurrent.ConcurrentSkipListMap;
+035import 
java.util.concurrent.CopyOnWriteArrayList;
+036import 
java.util.concurrent.atomic.AtomicBoolean;
+037import java.util.function.Predicate;
+038import 
org.apache.hadoop.conf.Configuration;
+039import 
org.apache.hadoop.fs.FSDataInputStream;
+040import 
org.apache.hadoop.fs.FSDataOutputStream;
+041import org.apache.hadoop.fs.FileSystem;
+042import org.apache.hadoop.fs.Path;
+043import 
org.apache.hadoop.hbase.ClockOutOfSyncException;
+044import 
org.apache.hadoop.hbase.HConstants;
+045import 
org.apache.hadoop.hbase.NotServingRegionException;
+046import 
org.apache.hadoop.hbase.RegionMetrics;
+047import 
org.apache.hadoop.hbase.ScheduledChore;
+048import 
org.apache.hadoop.hbase.ServerMetrics;
+049import 
org.apache.hadoop.hbase.ServerMetricsBuilder;
+050import 
org.apache.hadoop.hbase.ServerName;
+051import 
org.apache.hadoop.hbase.YouAreDeadException;
+052import 
org.apache.hadoop.hbase.client.ClusterConnection;
+053import 
org.apache.hadoop.hbase.client.RegionInfo;
+054import 
org.apache.hadoop.hbase.client.RetriesExhaustedException;
+055import 
org.apache.hadoop.hbase.ipc.HBaseRpcController;
+056import 
org.apache.hadoop.hbase.ipc.RpcControllerFactory;
+057import 
org.apache.hadoop.hbase.master.assignment.RegionStates;
+058import 
org.apache.hadoop.hbase.monitoring.MonitoredTask;
+059import 
org.apache.hadoop.hbase.regionserver.HRegionServer;
+060import 
org.apache.hadoop.hbase.util.Bytes;
+061import 
org.apache.hadoop.hbase.util.FSUtils;
+062import 
org.apache.hadoop.hbase.zookeeper.ZKUtil;
+063import 
org.apache.hadoop.hbase.zookeeper.ZKWatcher;
+064import 
org.apache.yetus.audience.InterfaceAudience;
+065import 
org.apache.zookeeper.KeeperException;
+066import org.slf4j.Logger;
+067import org.slf4j.LoggerFactory;
+068
+069import 
org.apache.hbase.thirdparty.com.google.common.annotations.VisibleForTesting;
+070import 
org.apache.hbase.thirdparty.com.google.protobuf.ByteString;
+071import 
org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations;
+072
+073import 
org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil;
+074import 
org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.AdminService;
+075import 
org.apache.hadoop.hbase.shaded.protobuf.generated.ClusterStatusProtos.RegionStoreSequenceIds;
+076import 
org.apache.hadoop.hbase.shaded.protobuf.generated.ClusterStatusProtos.StoreSequenceId;
+077import 
org.apache.hadoop.hbase.shaded.protobuf.generated.HBaseProtos.FlushedRegionSequenceId;
+078import 
org.apache.hadoop.hbase.shaded.protobuf.generated.HBaseProtos.FlushedSequenceId;
+079import 
org.apache.hadoop.hbase.shaded.protobuf.generated.HBaseProtos.FlushedStoreSequenceId;
+080import 
org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos.RegionServerStartupRequest;
+081
+082/**
+083 * The ServerManager class manages info 
about region servers.
+084 * 

+08


[28/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.MetaOperationType.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.MetaOperationType.html
 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.MetaOperationType.html
index 5a3436e..c92c4de 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.MetaOperationType.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.MetaOperationType.html
@@ -104,7 +104,9 @@
 
 
 default MetaProcedureInterface.MetaOperationType
-MetaProcedureInterface.getMetaOperationType() 
+MetaProcedureInterface.getMetaOperationType()
+Deprecated. 
+ 
 
 
 static MetaProcedureInterface.MetaOperationType

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.html
 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.html
index 24b9582..48646fa 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MetaProcedureInterface.html
@@ -105,8 +105,11 @@
 
 class 
 RecoverMetaProcedure
-This procedure recovers meta from prior shutdown/ crash of 
a server, and brings meta online by
- assigning meta region/s.
+Deprecated. 
+Do not use any more, leave 
it here only for compatible. The recovery work will be
+ done in ServerCrashProcedure 
directly, and the initial work for meta table
+ will be done by InitMetaProcedure.
+
 
 
 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/ProcedurePrepareLatch.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/ProcedurePrepareLatch.html
 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/ProcedurePrepareLatch.html
index fa154b7..a274fa7 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/ProcedurePrepareLatch.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/ProcedurePrepareLatch.html
@@ -185,7 +185,9 @@
 
 
 private ProcedurePrepareLatch
-RecoverMetaProcedure.syncLatch 
+RecoverMetaProcedure.syncLatch
+Deprecated. 
+ 
 
 
 private ProcedurePrepareLatch
@@ -310,6 +312,7 @@
 RecoverMetaProcedure(ServerName failedMetaServer,
 boolean shouldSplitLog,
 ProcedurePrepareLatch latch)
+Deprecated. 
 Constructor with latch, for blocking/ sync usage
 
 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/Queue.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/Queue.html 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/Queue.html
index 845f0ed..adc6405 100644
--- a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/Queue.html
+++ b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/Queue.html
@@ -104,7 +104,12 @@
 
 
 (package private) class 
-MetaQueue 
+MetaQueue
+Deprecated. 
+only used for RecoverMetaProcedure.
 Should be removed along with
+ RecoverMetaProcedure.
+
+
 
 
 (package private) class 

http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/TableProcedureInterface.TableOperationType.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/TableProcedureInterface.TableOperationType.html
 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/TableProcedureInterface.TableOperationType.html
index 07630ad..0c685e9 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/TableProcedureInterface.TableOperationType.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/TableProcedureInterface.TableOperationType.html
@@ -243,19 +243,23 @@
 
 
 TableProcedureInterface.TableOperationType
-ReopenTableRegionsProcedure.getTableOperationType() 
+InitMetaProcedure.getTableOperationType() 
 
 
 TableProcedureInterface.TableOperationType
-DeleteNamespaceProcedure.getTableOperationType() 
+ReopenTableRegionsProcedure.getTableOperationType() 
 
 
+TableProcedureInterface.TableOperationType
+D

[23/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectAllVisitor.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectAllVisitor.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectAllVisitor.html
index fea2b5a..c7a6cc4 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectAllVisitor.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/MetaTableAccessor.CollectAllVisitor.html
@@ -1354,816 +1354,824 @@
 1346   */
 1347  public static void 
putsToMetaTable(final Connection connection, final List ps)
 1348  throws IOException {
-1349try (Table t = 
getMetaHTable(connection)) {
-1350  debugLogMutations(ps);
-1351  t.put(ps);
-1352}
-1353  }
-1354
-1355  /**
-1356   * Delete the passed 
d from the hbase:meta 
table.
-1357   * @param connection connection we're 
using
-1358   * @param d Delete to add to 
hbase:meta
-1359   */
-1360  private static void 
deleteFromMetaTable(final Connection connection, final Delete d)
-1361  throws IOException {
-1362List dels = new 
ArrayList<>(1);
-1363dels.add(d);
-1364deleteFromMetaTable(connection, 
dels);
-1365  }
-1366
-1367  /**
-1368   * Delete the passed 
deletes from the hbase:meta 
table.
-1369   * @param connection connection we're 
using
-1370   * @param deletes Deletes to add to 
hbase:meta  This list should support #remove.
-1371   */
-1372  private static void 
deleteFromMetaTable(final Connection connection, final List 
deletes)
-1373  throws IOException {
-1374try (Table t = 
getMetaHTable(connection)) {
-1375  debugLogMutations(deletes);
-1376  t.delete(deletes);
-1377}
-1378  }
-1379
-1380  /**
-1381   * Deletes some replica columns 
corresponding to replicas for the passed rows
-1382   * @param metaRows rows in 
hbase:meta
-1383   * @param replicaIndexToDeleteFrom the 
replica ID we would start deleting from
-1384   * @param numReplicasToRemove how many 
replicas to remove
-1385   * @param connection connection we're 
using to access meta table
-1386   */
-1387  public static void 
removeRegionReplicasFromMeta(Set metaRows,
-1388int replicaIndexToDeleteFrom, int 
numReplicasToRemove, Connection connection)
-1389  throws IOException {
-1390int absoluteIndex = 
replicaIndexToDeleteFrom + numReplicasToRemove;
-1391for (byte[] row : metaRows) {
-1392  long now = 
EnvironmentEdgeManager.currentTime();
-1393  Delete deleteReplicaLocations = 
new Delete(row);
-1394  for (int i = 
replicaIndexToDeleteFrom; i < absoluteIndex; i++) {
-1395
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1396  getServerColumn(i), now);
-1397
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1398  getSeqNumColumn(i), now);
-1399
deleteReplicaLocations.addColumns(getCatalogFamily(),
-1400  getStartCodeColumn(i), now);
-1401  }
-1402  deleteFromMetaTable(connection, 
deleteReplicaLocations);
-1403}
-1404  }
-1405
-1406  /**
-1407   * Execute the passed 
mutations against hbase:meta 
table.
-1408   * @param connection connection we're 
using
-1409   * @param mutations Puts and Deletes 
to execute on hbase:meta
-1410   * @throws IOException
-1411   */
-1412  public static void 
mutateMetaTable(final Connection connection,
-1413 
final List mutations)
-1414throws IOException {
-1415Table t = 
getMetaHTable(connection);
-1416try {
-1417  debugLogMutations(mutations);
-1418  t.batch(mutations, null);
-1419} catch (InterruptedException e) {
-1420  InterruptedIOException ie = new 
InterruptedIOException(e.getMessage());
-1421  ie.initCause(e);
-1422  throw ie;
-1423} finally {
-1424  t.close();
-1425}
-1426  }
-1427
-1428  private static void 
addRegionStateToPut(Put put, RegionState.State state) throws IOException {
-1429
put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY)
-1430.setRow(put.getRow())
-1431
.setFamily(HConstants.CATALOG_FAMILY)
-1432
.setQualifier(getRegionStateColumn())
-1433
.setTimestamp(put.getTimestamp())
-1434.setType(Cell.Type.Put)
-1435
.setValue(Bytes.toBytes(state.name()))
-1436.build());
-1437  }
-1438
-1439  /**
-1440   * Adds daughter region infos to 
hbase:meta row for the specified region. Note that this does not
-1441   * add its daughter's as different 
rows, but adds information about the daughters in the same row
-1442   * as the parent. Use
-1443   * {@link #splitRegion(Connection, 
RegionInfo, long, RegionInfo, RegionInfo, ServerName, int)}
-1444   * if you want to do that.
-1445   * @param connectio

[09/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterMetaBootstrap.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterMetaBootstrap.html 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterMetaBootstrap.html
index e73540e..7b680e9 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterMetaBootstrap.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/MasterMetaBootstrap.html
@@ -28,135 +28,100 @@
 020
 021import java.io.IOException;
 022import java.util.List;
-023import java.util.Set;
-024import 
org.apache.hadoop.hbase.HConstants;
-025import 
org.apache.hadoop.hbase.ServerName;
-026import 
org.apache.hadoop.hbase.client.RegionInfo;
-027import 
org.apache.hadoop.hbase.client.RegionInfoBuilder;
-028import 
org.apache.hadoop.hbase.client.RegionReplicaUtil;
-029import 
org.apache.hadoop.hbase.master.assignment.AssignmentManager;
-030import 
org.apache.hadoop.hbase.zookeeper.MetaTableLocator;
-031import 
org.apache.hadoop.hbase.zookeeper.ZKUtil;
-032import 
org.apache.hadoop.hbase.zookeeper.ZKWatcher;
-033import 
org.apache.yetus.audience.InterfaceAudience;
-034import 
org.apache.zookeeper.KeeperException;
-035import org.slf4j.Logger;
-036import org.slf4j.LoggerFactory;
-037
-038/**
-039 * Used by the HMaster on startup to 
split meta logs and assign the meta table.
-040 */
-041@InterfaceAudience.Private
-042public class MasterMetaBootstrap {
-043  private static final Logger LOG = 
LoggerFactory.getLogger(MasterMetaBootstrap.class);
-044
-045  private final HMaster master;
-046
-047  public MasterMetaBootstrap(HMaster 
master) {
-048this.master = master;
-049  }
-050
-051  public void recoverMeta() throws 
InterruptedException, IOException {
-052// This is a blocking call that waits 
until hbase:meta is deployed.
-053master.recoverMeta();
-054// Now we can start the 
TableStateManager. It is backed by hbase:meta.
-055
master.getTableStateManager().start();
-056// Enable server crash procedure 
handling
-057enableCrashedServerProcessing();
-058  }
-059
-060  public void processDeadServers() {
-061// get a list for previously failed 
RS which need log splitting work
-062// we recover hbase:meta region 
servers inside master initialization and
-063// handle other failed servers in SSH 
in order to start up master node ASAP
-064Set 
previouslyFailedServers =
-065
master.getMasterWalManager().getFailedServersFromLogFolders();
-066
-067// Master has recovered hbase:meta 
region server and we put
-068// other failed region servers in a 
queue to be handled later by SSH
-069for (ServerName tmpServer : 
previouslyFailedServers) {
-070  
master.getServerManager().processDeadServer(tmpServer, true);
-071}
-072  }
-073
-074  /**
-075   * For assigning hbase:meta replicas 
only.
-076   * TODO: The way this assign runs, 
nothing but chance to stop all replicas showing up on same
-077   * server as the hbase:meta region.
-078   */
-079  protected void assignMetaReplicas()
-080  throws IOException, 
InterruptedException, KeeperException {
-081int numReplicas = 
master.getConfiguration().getInt(HConstants.META_REPLICAS_NUM,
-082   
HConstants.DEFAULT_META_REPLICA_NUM);
-083if (numReplicas <= 1) {
-084  // No replicaas to assign. 
Return.
-085  return;
-086}
-087final AssignmentManager 
assignmentManager = master.getAssignmentManager();
-088if 
(!assignmentManager.isMetaInitialized()) {
-089  throw new 
IllegalStateException("hbase:meta must be initialized first before we can " +
-090  "assign out its replicas");
-091}
-092ServerName metaServername =
-093
this.master.getMetaTableLocator().getMetaRegionLocation(this.master.getZooKeeper());
-094for (int i = 1; i < numReplicas; 
i++) {
-095  // Get current meta state for 
replica from zk.
-096  RegionState metaState = 
MetaTableLocator.getMetaRegionState(master.getZooKeeper(), i);
-097  RegionInfo hri = 
RegionReplicaUtil.getRegionInfoForReplica(
-098  
RegionInfoBuilder.FIRST_META_REGIONINFO, i);
-099  
LOG.debug(hri.getRegionNameAsString() + " replica region state from zookeeper=" 
+ metaState);
-100  if 
(metaServername.equals(metaState.getServerName())) {
-101metaState = null;
-102
LOG.info(hri.getRegionNameAsString() +
-103  " old location is same as 
current hbase:meta location; setting location as null...");
-104  }
-105  // These assigns run inline. All is 
blocked till they complete. Only interrupt is shutting
-106  // down hosting server which calls 
AM#stop.
-107  if (metaState != null && 
metaState.getServerName() != null) {
-108// Try to retain old 
assignment.
-109assignmentManager.assign(hri, 
metaState.getServerName());
-110  } el

[29/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MasterProcedureEnv.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MasterProcedureEnv.html
 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MasterProcedureEnv.html
index b0a820f..15337a1 100644
--- 
a/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MasterProcedureEnv.html
+++ 
b/devapidocs/org/apache/hadoop/hbase/master/procedure/class-use/MasterProcedureEnv.html
@@ -958,7 +958,9 @@
 
 
 protected Procedure.LockState
-RecoverMetaProcedure.acquireLock(MasterProcedureEnv env) 
+RecoverMetaProcedure.acquireLock(MasterProcedureEnv env)
+Deprecated. 
+ 
 
 
 protected Procedure.LockState
@@ -985,12 +987,16 @@
 AbstractStateMachineNamespaceProcedure.acquireLock(MasterProcedureEnv env) 
 
 
+protected Procedure.LockState
+InitMetaProcedure.acquireLock(MasterProcedureEnv env) 
+
+
 private void
 CloneSnapshotProcedure.addRegionsToMeta(MasterProcedureEnv env)
 Add regions to hbase:meta table.
 
 
-
+
 private static void
 CreateTableProcedure.addRegionsToMeta(MasterProcedureEnv env,
 TableDescriptor tableDescriptor,
@@ -998,48 +1004,48 @@
 Add the specified set of regions to the hbase:meta 
table.
 
 
-
+
 private static void
 ModifyTableProcedure.addRegionsToMeta(MasterProcedureEnv env,
 TableDescriptor tableDescriptor,
 https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List regionInfos) 
 
-
+
 protected static https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List
 CreateTableProcedure.addTableToMeta(MasterProcedureEnv env,
   TableDescriptor tableDescriptor,
   https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List regions) 
 
-
+
 private static 
org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.OpenRegionRequest
 RSProcedureDispatcher.buildOpenRegionRequest(MasterProcedureEnv env,
   ServerName serverName,
   https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true";
 title="class or interface in java.util">List operations) 
 
-
+
 org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.OpenRegionRequest.RegionOpenInfo
 RSProcedureDispatcher.RegionOpenOperation.buildRegionOpenInfoRequest(MasterProcedureEnv env) 
 
-
+
 protected static void
 AbstractStateMachineTableProcedure.checkOnline(MasterProcedureEnv env,
RegionInfo ri)
 Check region is online.
 
 
-
+
 protected void
 AbstractStateMachineRegionProcedure.checkTableModifiable(MasterProcedureEnv env)
 Check whether a table is modifiable - exists and either 
offline or online with config set
 
 
-
+
 protected void
 AbstractStateMachineTableProcedure.checkTableModifiable(MasterProcedureEnv env)
 Check whether a table is modifiable - exists and either 
offline or online with config set
 
 
-
+
 private static void
 DeleteTableProcedure.cleanAnyRemainingRows(MasterProcedureEnv env,
  TableName tableName)
@@ -1047,17 +1053,23 @@
  info:regioninfo column was empty because of some write error.
 
 
+
+protected void
+RecoverMetaProcedure.completionCleanup(MasterProcedureEnv env)
+Deprecated. 
+ 
+
 
 protected void
-RecoverMetaProcedure.completionCleanup(MasterProcedureEnv env) 
+TruncateTableProcedure.completionCleanup(MasterProcedureEnv env) 
 
 
 protected void
-TruncateTableProcedure.completionCleanup(MasterProcedureEnv env) 
+ModifyTableProcedure.completionCleanup(MasterProcedureEnv env) 
 
 
 protected void
-ModifyTableProcedure.completionCleanup(MasterProcedureEnv env) 
+InitMetaProcedure.completionCleanup(MasterProcedureEnv env) 
 
 
 protected static void
@@ -1245,107 +1257,115 @@
 
 
 protected StateMachineProcedure.Flow
+InitMetaProcedure.executeFromState(MasterProcedureEnv env,
+
org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.InitMetaState state) 
+
+
+protected StateMachineProcedure.Flow
 ModifyNamespaceProcedure.executeFromState(MasterProcedureEnv env,
 
org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.ModifyNamespaceState state) 
 
-
+
 protected StateMachineProcedure.Flow
 ModifyTableProcedure.executeFromState(MasterProcedureEnv env,
 
org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.ModifyTableState state) 
 
-
+
 protected StateMachineProcedure.Flow
 RecoverMetaProcedure.executeFromState(MasterProcedureEnv env,
-
org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProcedureProtos.Re

[26/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/org/apache/hadoop/hbase/procedure2/class-use/Procedure.html
--
diff --git 
a/devapidocs/org/apache/hadoop/hbase/procedure2/class-use/Procedure.html 
b/devapidocs/org/apache/hadoop/hbase/procedure2/class-use/Procedure.html
index 61707dd..4a4d446 100644
--- a/devapidocs/org/apache/hadoop/hbase/procedure2/class-use/Procedure.html
+++ b/devapidocs/org/apache/hadoop/hbase/procedure2/class-use/Procedure.html
@@ -257,21 +257,21 @@
 
 
 boolean
-AssignmentManager.waitMetaInitialized(Procedure proc) 
+AssignmentManager.waitMetaAssigned(Procedure proc,
+RegionInfo regionInfo)
+Notice that this event does not mean the AM has already 
finished region state rebuilding.
+
 
 
 boolean
-AssignmentManager.waitMetaInitialized(Procedure proc,
-   RegionInfo regionInfo) 
+AssignmentManager.waitMetaLoaded(Procedure proc)
+Wait until AM finishes the meta loading, i.e, the region 
states rebuilding.
+
 
 
-boolean
-AssignmentManager.waitMetaLoaded(Procedure proc) 
-
-
 protected boolean
 AssignmentManager.waitServerReportEvent(ServerName serverName,
- Procedure proc) 
+ Procedure proc) 
 
 
 
@@ -373,38 +373,47 @@
 
 
 class 
+InitMetaProcedure
+This procedure is used to initialize meta table for a new 
hbase deploy.
+
+
+
+class 
 ModifyNamespaceProcedure
 The procedure to add a namespace to an existing table.
 
 
-
+
 class 
 ModifyTableProcedure 
 
-
+
 class 
 RecoverMetaProcedure
-This procedure recovers meta from prior shutdown/ crash of 
a server, and brings meta online by
- assigning meta region/s.
+Deprecated. 
+Do not use any more, leave 
it here only for compatible. The recovery work will be
+ done in ServerCrashProcedure 
directly, and the initial work for meta table
+ will be done by InitMetaProcedure.
+
 
 
-
+
 class 
 ReopenTableRegionsProcedure
 Used for non table procedures to reopen the regions for a 
table.
 
 
-
+
 class 
 RestoreSnapshotProcedure 
 
-
+
 class 
 ServerCrashProcedure
 Handle crashed server.
 
 
-
+
 class 
 TruncateTableProcedure 
 
@@ -542,7 +551,9 @@
 
 
 (package private) boolean
-MetaQueue.requireExclusiveLock(Procedure proc) 
+MetaQueue.requireExclusiveLock(Procedure proc)
+Deprecated. 
+ 
 
 
 boolean
@@ -580,64 +591,59 @@
Procedure procedure) 
 
 
-boolean
-MasterProcedureEnv.waitFailoverCleanup(Procedure proc) 
-
-
 static byte[]
 ProcedureSyncWait.waitForProcedureToComplete(ProcedureExecutor procExec,
   Procedure proc,
   long timeout) 
 
-
+
 static byte[]
 ProcedureSyncWait.waitForProcedureToCompleteIOE(ProcedureExecutor procExec,
  Procedure proc,
  long timeout) 
 
-
+
 boolean
 MasterProcedureEnv.waitInitialized(Procedure proc) 
 
-
+
 boolean
 MasterProcedureScheduler.waitMetaExclusiveLock(Procedure procedure)
-Try to acquire the exclusive lock on meta.
+Deprecated. 
+only used for RecoverMetaProcedure.
 Should be removed along with
+ RecoverMetaProcedure.
+
 
 
-
+
 boolean
-MasterProcedureScheduler.waitNamespaceExclusiveLock(Procedure procedure,
+MasterProcedureScheduler.waitNamespaceExclusiveLock(Procedure procedure,
   https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String namespace)
 Suspend the procedure if the specified namespace is already 
locked.
 
 
-
+
 boolean
 MasterProcedureScheduler.waitPeerExclusiveLock(Procedure procedure,
  https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true";
 title="class or interface in java.lang">String peerId)
 Try to acquire the exclusive lock on the specified 
peer.
 
 
-
+
 boolean
-MasterProcedureScheduler.waitRegion(Procedure procedure,
+MasterProcedureScheduler.waitRegion(Procedure procedure,
   RegionInfo regionInfo)
 Suspend the procedure if the specified region is already 
locked.
 
 
-
+
 boolean
-MasterProcedureScheduler.waitRegions(Procedure procedure,
+MasterProcedureScheduler.waitRegions(Procedure procedure,
TableName table,
RegionInfo... regionInfo)
 Suspend the procedure if the specified set of regions are 
already locked.
 
 
-
-boolean
-MasterProcedureEnv.waitServerCrashProcessingEnabled(Procedure proc) 
-
 
 boolean
 MasterProcedureScheduler.waitServerExclusiveLock(Procedure procedure,
@@ -647,7 +653,7 @@
 
 
 boolean
-MasterProcedureScheduler.waitTableExclusiveLock(Procedure procedure,
+MasterProcedureScheduler.waitTableExclusiveLock(Procedure procedure,
   TableName table)
 Suspend the procedure if the specified table is already 
locked.
 
@@ -659,7 +665,7 

[13/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.InitializationMonitor.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.InitializationMonitor.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.InitializationMonitor.html
index eb16038..74bacd8 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.InitializationMonitor.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/HMaster.InitializationMonitor.html
@@ -6,7 +6,7 @@
 
 
 
-001/*
+001/**
 002 * Licensed to the Apache Software 
Foundation (ASF) under one
 003 * or more contributor license 
agreements.  See the NOTICE file
 004 * distributed with this work for 
additional information
@@ -48,692 +48,692 @@
 040import java.util.Map;
 041import java.util.Map.Entry;
 042import java.util.Objects;
-043import java.util.Set;
-044import 
java.util.concurrent.ExecutionException;
-045import java.util.concurrent.Future;
-046import java.util.concurrent.TimeUnit;
-047import 
java.util.concurrent.TimeoutException;
-048import 
java.util.concurrent.atomic.AtomicInteger;
-049import 
java.util.concurrent.atomic.AtomicReference;
-050import java.util.function.Function;
-051import java.util.regex.Pattern;
-052import java.util.stream.Collectors;
-053import javax.servlet.ServletException;
-054import javax.servlet.http.HttpServlet;
-055import 
javax.servlet.http.HttpServletRequest;
-056import 
javax.servlet.http.HttpServletResponse;
-057import 
org.apache.commons.lang3.StringUtils;
-058import 
org.apache.hadoop.conf.Configuration;
-059import org.apache.hadoop.fs.Path;
-060import 
org.apache.hadoop.hbase.ClusterId;
-061import 
org.apache.hadoop.hbase.ClusterMetrics;
-062import 
org.apache.hadoop.hbase.ClusterMetrics.Option;
-063import 
org.apache.hadoop.hbase.ClusterMetricsBuilder;
-064import 
org.apache.hadoop.hbase.DoNotRetryIOException;
-065import 
org.apache.hadoop.hbase.HBaseIOException;
-066import 
org.apache.hadoop.hbase.HBaseInterfaceAudience;
-067import 
org.apache.hadoop.hbase.HConstants;
-068import 
org.apache.hadoop.hbase.InvalidFamilyOperationException;
-069import 
org.apache.hadoop.hbase.MasterNotRunningException;
-070import 
org.apache.hadoop.hbase.MetaTableAccessor;
-071import 
org.apache.hadoop.hbase.NamespaceDescriptor;
-072import 
org.apache.hadoop.hbase.PleaseHoldException;
-073import 
org.apache.hadoop.hbase.ReplicationPeerNotFoundException;
-074import 
org.apache.hadoop.hbase.ScheduledChore;
-075import 
org.apache.hadoop.hbase.ServerName;
-076import 
org.apache.hadoop.hbase.TableDescriptors;
-077import 
org.apache.hadoop.hbase.TableName;
-078import 
org.apache.hadoop.hbase.TableNotDisabledException;
-079import 
org.apache.hadoop.hbase.TableNotFoundException;
-080import 
org.apache.hadoop.hbase.UnknownRegionException;
-081import 
org.apache.hadoop.hbase.client.ColumnFamilyDescriptor;
-082import 
org.apache.hadoop.hbase.client.ColumnFamilyDescriptorBuilder;
-083import 
org.apache.hadoop.hbase.client.MasterSwitchType;
-084import 
org.apache.hadoop.hbase.client.RegionInfo;
-085import 
org.apache.hadoop.hbase.client.Result;
-086import 
org.apache.hadoop.hbase.client.TableDescriptor;
-087import 
org.apache.hadoop.hbase.client.TableDescriptorBuilder;
-088import 
org.apache.hadoop.hbase.client.TableState;
-089import 
org.apache.hadoop.hbase.client.VersionInfoUtil;
-090import 
org.apache.hadoop.hbase.coprocessor.CoprocessorHost;
-091import 
org.apache.hadoop.hbase.exceptions.DeserializationException;
-092import 
org.apache.hadoop.hbase.exceptions.MergeRegionException;
-093import 
org.apache.hadoop.hbase.executor.ExecutorType;
-094import 
org.apache.hadoop.hbase.favored.FavoredNodesManager;
-095import 
org.apache.hadoop.hbase.favored.FavoredNodesPromoter;
-096import 
org.apache.hadoop.hbase.http.InfoServer;
-097import 
org.apache.hadoop.hbase.ipc.CoprocessorRpcUtils;
-098import 
org.apache.hadoop.hbase.ipc.RpcServer;
-099import 
org.apache.hadoop.hbase.ipc.ServerNotRunningYetException;
-100import 
org.apache.hadoop.hbase.log.HBaseMarkers;
-101import 
org.apache.hadoop.hbase.master.MasterRpcServices.BalanceSwitchMode;
-102import 
org.apache.hadoop.hbase.master.assignment.AssignmentManager;
-103import 
org.apache.hadoop.hbase.master.assignment.MergeTableRegionsProcedure;
-104import 
org.apache.hadoop.hbase.master.assignment.RegionStates;
-105import 
org.apache.hadoop.hbase.master.assignment.RegionStates.RegionStateNode;
-106import 
org.apache.hadoop.hbase.master.balancer.BalancerChore;
-107import 
org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer;
-108import 
org.apache.hadoop.hbase.master.balancer.ClusterStatusChore;
-109import 
org.apache.hadoop.hbase.master.balancer.LoadBalancerFactory;
-110import 
org.apache.hadoop.hbase.master.cleaner.CleanerChore;
-111import 
org.apache.hadoop.hbase.master.cleaner.HFileCleaner;
-112import 
org.apache.hadoop.hb

[04/51] [partial] hbase-site git commit: Published site at 9101fc246f86445006bfbcdfda5cc495016dc280.

2018-06-19 Thread git-site-role
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/65565d77/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
--
diff --git 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
index 4b5d00c..96ecbf8 100644
--- 
a/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
+++ 
b/devapidocs/src-html/org/apache/hadoop/hbase/master/assignment/AssignmentManager.RegionInTransitionStat.html
@@ -6,7 +6,7 @@
 
 
 
-001/*
+001/**
 002 * Licensed to the Apache Software 
Foundation (ASF) under one
 003 * or more contributor license 
agreements.  See the NOTICE file
 004 * distributed with this work for 
additional information
@@ -23,1981 +23,1894 @@
 015 * See the License for the specific 
language governing permissions and
 016 * limitations under the License.
 017 */
-018
-019package 
org.apache.hadoop.hbase.master.assignment;
-020
-021import java.io.IOException;
-022import java.util.ArrayList;
-023import java.util.Arrays;
-024import java.util.Collection;
-025import java.util.Collections;
-026import java.util.HashMap;
-027import java.util.HashSet;
-028import java.util.List;
-029import java.util.Map;
-030import java.util.Set;
-031import 
java.util.concurrent.CopyOnWriteArrayList;
-032import java.util.concurrent.Future;
-033import java.util.concurrent.TimeUnit;
-034import 
java.util.concurrent.atomic.AtomicBoolean;
-035import 
java.util.concurrent.locks.Condition;
-036import 
java.util.concurrent.locks.ReentrantLock;
-037import java.util.stream.Collectors;
-038import 
org.apache.hadoop.conf.Configuration;
-039import 
org.apache.hadoop.hbase.HBaseIOException;
-040import 
org.apache.hadoop.hbase.HConstants;
-041import 
org.apache.hadoop.hbase.PleaseHoldException;
-042import 
org.apache.hadoop.hbase.RegionException;
-043import 
org.apache.hadoop.hbase.RegionStateListener;
-044import 
org.apache.hadoop.hbase.ServerName;
-045import 
org.apache.hadoop.hbase.TableName;
-046import 
org.apache.hadoop.hbase.YouAreDeadException;
-047import 
org.apache.hadoop.hbase.client.RegionInfo;
-048import 
org.apache.hadoop.hbase.client.RegionInfoBuilder;
-049import 
org.apache.hadoop.hbase.client.RegionReplicaUtil;
-050import 
org.apache.hadoop.hbase.client.Result;
-051import 
org.apache.hadoop.hbase.client.TableState;
-052import 
org.apache.hadoop.hbase.exceptions.UnexpectedStateException;
-053import 
org.apache.hadoop.hbase.favored.FavoredNodesManager;
-054import 
org.apache.hadoop.hbase.favored.FavoredNodesPromoter;
-055import 
org.apache.hadoop.hbase.master.AssignmentListener;
-056import 
org.apache.hadoop.hbase.master.LoadBalancer;
-057import 
org.apache.hadoop.hbase.master.MasterServices;
-058import 
org.apache.hadoop.hbase.master.MetricsAssignmentManager;
-059import 
org.apache.hadoop.hbase.master.NoSuchProcedureException;
-060import 
org.apache.hadoop.hbase.master.RegionPlan;
-061import 
org.apache.hadoop.hbase.master.RegionState;
-062import 
org.apache.hadoop.hbase.master.RegionState.State;
-063import 
org.apache.hadoop.hbase.master.ServerListener;
-064import 
org.apache.hadoop.hbase.master.TableStateManager;
-065import 
org.apache.hadoop.hbase.master.assignment.RegionStates.RegionStateNode;
-066import 
org.apache.hadoop.hbase.master.assignment.RegionStates.ServerState;
-067import 
org.apache.hadoop.hbase.master.assignment.RegionStates.ServerStateNode;
-068import 
org.apache.hadoop.hbase.master.balancer.FavoredStochasticBalancer;
-069import 
org.apache.hadoop.hbase.master.normalizer.RegionNormalizer;
-070import 
org.apache.hadoop.hbase.master.procedure.MasterProcedureEnv;
-071import 
org.apache.hadoop.hbase.master.procedure.MasterProcedureScheduler;
-072import 
org.apache.hadoop.hbase.master.procedure.ProcedureSyncWait;
-073import 
org.apache.hadoop.hbase.master.procedure.ServerCrashException;
-074import 
org.apache.hadoop.hbase.master.procedure.ServerCrashProcedure;
-075import 
org.apache.hadoop.hbase.procedure2.Procedure;
-076import 
org.apache.hadoop.hbase.procedure2.ProcedureEvent;
-077import 
org.apache.hadoop.hbase.procedure2.ProcedureExecutor;
-078import 
org.apache.hadoop.hbase.procedure2.ProcedureInMemoryChore;
-079import 
org.apache.hadoop.hbase.procedure2.util.StringUtils;
-080import 
org.apache.hadoop.hbase.regionserver.SequenceId;
-081import 
org.apache.hadoop.hbase.util.Bytes;
-082import 
org.apache.hadoop.hbase.util.EnvironmentEdgeManager;
-083import 
org.apache.hadoop.hbase.util.HasThread;
-084import 
org.apache.hadoop.hbase.util.Pair;
-085import 
org.apache.hadoop.hbase.util.Threads;
-086import 
org.apache.hadoop.hbase.util.VersionInfo;
-087import 
org.apache.yetus.audience.InterfaceAudience;
-088import org.slf4j.Logger;
-089import org.slf4j.LoggerFactory;
-090
-091impor

hbase git commit: Add 2.0.1 to the download page

2018-06-19 Thread stack
Repository: hbase
Updated Branches:
  refs/heads/master 21684a32f -> 9101fc246


Add 2.0.1 to the download page


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/9101fc24
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/9101fc24
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/9101fc24

Branch: refs/heads/master
Commit: 9101fc246f86445006bfbcdfda5cc495016dc280
Parents: 21684a3
Author: Michael Stack 
Authored: Tue Jun 19 20:16:28 2018 -0700
Committer: Michael Stack 
Committed: Tue Jun 19 20:16:28 2018 -0700

--
 src/site/xdoc/downloads.xml | 36 
 1 file changed, 32 insertions(+), 4 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/9101fc24/src/site/xdoc/downloads.xml
--
diff --git a/src/site/xdoc/downloads.xml b/src/site/xdoc/downloads.xml
index 25bca02..acd1e59 100644
--- a/src/site/xdoc/downloads.xml
+++ b/src/site/xdoc/downloads.xml
@@ -38,29 +38,57 @@ under the License.
   Version
   Release Date
   Compatiblity Report
+  Changes
   Release Notes
   Commit
   Download
 
 
   
+2.0.1
+  
+  
+2018/06/19
+  
+  
+https://apache.org/dist/hbase/2.0.1/compatibility_report_2.0.0vs2.0.1.html";>2.0.0
 vs 2.0.1
+  
+  
+https://apache.org/dist/hbase/2.0.1/CHANGES.md";>2.0.1 
Changes
+  
+  
+https://apache.org/dist/hbase/2.0.1/RELEASENOTES.md";>2.0.1 
Release Notes
+  
+  
+https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=commit;h=987f7b6d37c2fcacc942cc66e5c5122aba8fdfbe";>987f7b6d37c2fcacc942cc66e5c5122aba8fdfbe
+  
+  
+https://www.apache.org/dyn/closer.lua/hbase/2.0.1/hbase-2.0.1-src.tar.gz";>src
 (https://apache.org/dist/hbase/2.0.1/hbase-2.0.1-src.tar.gz.sha512";>sha512
 https://apache.org/dist/hbase/2.0.1/hbase-2.0.1-src.tar.gz.asc";>asc) 

+https://www.apache.org/dyn/closer.lua/hbase/2.0.1/hbase-2.0.1-bin.tar.gz";>bin
 (https://apache.org/dist/hbase/2.0.1/hbase-2.0.1-bin.tar.gz.sha512";>sha512
 https://apache.org/dist/hbase/2.0.1/hbase-2.0..-bin.tar.gz.asc";>asc)
+  
+
+
+  
 2.0.0
   
   
 2018/04/29
   
   
-http://apache.org/dist/hbase/2.0.0/compatibiliity_report_1.2.6vs2.0.0.html";>1.2.6
 vs 2.0.0
+https://apache.org/dist/hbase/2.0.0/compatibiliity_report_1.2.6vs2.0.0.html";>1.2.6
 vs 2.0.0
+  
+  
+https://apache.org/dist/hbase/2.0.0/CHANGES.md";>2.0.0 
Changes
   
   
-http://apache.org/dist/hbase/2.0.0/RELEASENOTES.md";>2.0.0 
Release Notes
+https://apache.org/dist/hbase/2.0.0/RELEASENOTES.md";>2.0.0 
Release Notes
   
   
 https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=commit;h=7483b111e4da77adbfc8062b3b22cbe7c2cb91c1";>7483b111e4da77adbfc8062b3b22cbe7c2cb91c1
   
   
-http://www.apache.org/dyn/closer.lua/hbase/2.0.0/hbase-2.0.0-src.tar.gz";>src
 (http://apache.org/dist/hbase/2.0.0/hbase-2.0.0-src.tar.gz.sha512";>sha512
 http://apache.org/dist/hbase/2.0.0/hbase-2.0.0-src.tar.gz.asc";>asc) 

-http://www.apache.org/dyn/closer.lua/hbase/2.0.0/hbase-2.0.0-bin.tar.gz";>bin
 (http://apache.org/dist/hbase/2.0.0/hbase-2.0.0-bin.tar.gz.sha512";>sha512
 http://apache.org/dist/hbase/2.0.0/hbase-2.0.0-bin.tar.gz.asc";>asc)
+https://www.apache.org/dyn/closer.lua/hbase/2.0.0/hbase-2.0.0-src.tar.gz";>src
 (https://apache.org/dist/hbase/2.0.0/hbase-2.0.0-src.tar.gz.sha512";>sha512
 https://apache.org/dist/hbase/2.0.0/hbase-2.0.0-src.tar.gz.asc";>asc) 

+https://www.apache.org/dyn/closer.lua/hbase/2.0.0/hbase-2.0.0-bin.tar.gz";>bin
 (https://apache.org/dist/hbase/2.0.0/hbase-2.0.0-bin.tar.gz.sha512";>sha512
 https://apache.org/dist/hbase/2.0.0/hbase-2.0.0-bin.tar.gz.asc";>asc)
   
 
   



svn commit: r27574 - /release/hbase/2.0.1/compatibility_report_2.0.0vs2.0.1.html

2018-06-19 Thread stack
Author: stack
Date: Wed Jun 20 03:11:19 2018
New Revision: 27574

Log:
Add compat report

Added:
release/hbase/2.0.1/compatibility_report_2.0.0vs2.0.1.html

Added: release/hbase/2.0.1/compatibility_report_2.0.0vs2.0.1.html
==
--- release/hbase/2.0.1/compatibility_report_2.0.0vs2.0.1.html (added)
+++ release/hbase/2.0.1/compatibility_report_2.0.0vs2.0.1.html Wed Jun 20 
03:11:19 2018
@@ -0,0 +1,476 @@
+
+
+http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd";>
+http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en">
+
+
+
+
+
+
+hbase: rel/2.0.0 to rel/2.0.1 compatibility report
+
+body {
+font-family:Arial, sans-serif;
+background-color:White;
+color:Black;
+}
+hr {
+color:Black;
+background-color:Black;
+height:1px;
+border:0;
+}
+h1 {
+margin-bottom:0px;
+padding-bottom:0px;
+font-size:1.625em;
+}
+h2 {
+margin-bottom:0px;
+padding-bottom:0px;
+font-size:1.25em;
+white-space:nowrap;
+}
+div.symbols {
+color:#003E69;
+}
+div.symbols i {
+color:Brown;
+}
+span.section {
+font-weight:bold;
+cursor:pointer;
+color:#003E69;
+white-space:nowrap;
+margin-left:0.3125em;
+}
+span:hover.section {
+color:#336699;
+}
+span.sect_aff {
+cursor:pointer;
+padding-left:1.55em;
+font-size:0.875em;
+color:#cc3300;
+}
+span.ext {
+font-weight:normal;
+}
+span.jar {
+color:#cc3300;
+font-size:0.875em;
+font-weight:bold;
+}
+div.jar_list {
+padding-left:0.4em;
+font-size:0.94em;
+}
+span.pkg_t {
+color:#408080;
+font-size:0.875em;
+}
+span.pkg {
+color:#408080;
+font-size:0.875em;
+font-weight:bold;
+}
+span.cname {
+color:Green;
+font-size:0.875em;
+font-weight:bold;
+}
+span.iname_b {
+font-weight:bold;
+}
+span.iname_a {
+color:#33;
+font-weight:bold;
+font-size:0.94em;
+}
+span.sym_p {
+font-weight:normal;
+white-space:normal;
+}
+span.sym_pd {
+white-space:normal;
+}
+span.sym_p span, span.sym_pd span {
+white-space:nowrap;
+}
+span.attr {
+color:Black;
+font-weight:normal;
+}
+span.deprecated {
+color:Red;
+font-weight:bold;
+font-family:Monaco, monospace;
+}
+div.affect {
+padding-left:1em;
+padding-bottom:10px;
+font-size:0.87em;
+font-style:italic;
+line-height:0.9em;
+}
+div.affected {
+padding-left:2em;
+padding-top:10px;
+}
+table.ptable {
+border-collapse:collapse;
+border:1px outset black;
+margin-left:0.95em;
+margin-top:3px;
+margin-bottom:3px;
+width:56.25em;
+}
+table.ptable td {
+border:1px solid Gray;
+padding:3px;
+font-size:0.875em;
+text-align:left;
+vertical-align:top;
+max-width:28em;
+word-wrap:break-word;
+}
+table.ptable th {
+background-color:#ee;
+font-weight:bold;
+color:#33;
+font-family:Verdana, Arial;
+font-size:0.875em;
+border:1px solid Gray;
+text-align:center;
+vertical-align:top;
+white-space:nowrap;
+padding:3px;
+}
+table.summary {
+border-collapse:collapse;
+border:1px outset black;
+}
+table.summary th {
+background-color:#ee;
+font-weight:normal;
+text-align:left;
+font-size:0.94em;
+white-space:nowrap;
+border:1px inset Gray;
+padding:3px;
+}
+table.summary td {
+text-align:right;
+white-space:nowrap;
+border:1px inset Gray;
+padding:3px 5px 3px 10px;
+}
+span.mngl {
+padding-left:1em;
+font-size:0.875em;
+cursor:text;
+color:#44;
+font-weight:bold;
+}
+span.pleft {
+padding-left:2.5em;
+}
+span.color_p {
+font-style:italic;
+color:Brown;
+}
+span.param {
+font-style:italic;
+}
+span.focus_p {
+font-style:italic;
+background-color:#DCDCDC;
+}
+span.ttype {
+font-weight:normal;
+}
+span.nowrap {
+white-space:nowrap;
+}
+span.value {
+white-space:nowrap;
+font-weight:bold;
+}
+.passed {
+background-color:#CCFFCC;
+font-weight:normal;
+}
+.warning {
+background-color:#F4F4AF;
+font-weight:normal;
+}
+.failed {
+background-color:#FF;
+font-weight:normal;
+}
+.new {
+background-color:#C6DEFF;
+font-weight:normal;
+}
+
+.compatible {
+background-color:#CCFFCC;
+font-weight:normal;
+}
+.almost_compatible {
+background-color:#FFDAA3;
+font-weight:normal;
+}
+.incompatible {
+background-color:#FF;
+font-weight:normal;
+}
+.gray {
+background-color:#DCDCDC;
+font-weight:normal;
+}
+
+.top_ref {
+font-size:0.69em;
+}
+.footer {
+font-size:0.8125em;
+}
+.tabset {
+float:left;
+}
+a.tab {
+border:1px solid Black;
+float:left;
+margin:0px 5px -1px 0px;
+padding:3px 5px 3px 5px;
+position:relative;
+font-size:0.875em;
+background-color:#DDD;
+text-decoration:none;
+color:Black;
+}
+a.disabled:hover
+{
+color:Black;
+background:#EEE;

hbase git commit: HBASE-20745 Log when master proc wal rolls

2018-06-19 Thread stack
Repository: hbase
Updated Branches:
  refs/heads/master 9bd98522f -> 21684a32f


HBASE-20745 Log when master proc wal rolls


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/21684a32
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/21684a32
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/21684a32

Branch: refs/heads/master
Commit: 21684a32fa65fcd1f64612a0b1e0cb4dd952d44e
Parents: 9bd9852
Author: Michael Stack 
Authored: Sat Jun 16 13:23:31 2018 -0700
Committer: Michael Stack 
Committed: Tue Jun 19 19:53:51 2018 -0700

--
 .../org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java| 2 +-
 .../hadoop/hbase/procedure2/store/wal/WALProcedureStore.java | 4 +---
 .../apache/hadoop/hbase/master/assignment/AssignmentManager.java | 2 +-
 3 files changed, 3 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/21684a32/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
--
diff --git 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
index bd0a191..db7c118 100644
--- 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
+++ 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
@@ -1861,7 +1861,7 @@ public class ProcedureExecutor {
 
 // WARN the worker is stuck
 stuckCount++;
-LOG.warn("Worker stuck {} run time {}", worker,
+LOG.warn("Worker stuck {}, run time {}", worker,
   StringUtils.humanTimeDiff(worker.getCurrentRunTime()));
   }
   return stuckCount;

http://git-wip-us.apache.org/repos/asf/hbase/blob/21684a32/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
--
diff --git 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
index f2931fc..977921f 100644
--- 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
+++ 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
@@ -1074,9 +1074,7 @@ public class WALProcedureStore extends ProcedureStoreBase 
{
 ". check running procedures to see if something is stuck.");
 }
 
-if (LOG.isDebugEnabled()) {
-  LOG.debug("Roll new state log: " + logId);
-}
+LOG.info("Rolled new Procedure Store WAL, id={}", logId);
 return true;
   }
 

http://git-wip-us.apache.org/repos/asf/hbase/blob/21684a32/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
--
diff --git 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
index 0d1fc16..0736435 100644
--- 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
+++ 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
@@ -135,7 +135,7 @@ public class AssignmentManager implements ServerListener {
 
   public static final String RIT_CHORE_INTERVAL_MSEC_CONF_KEY =
   "hbase.assignment.rit.chore.interval.msec";
-  private static final int DEFAULT_RIT_CHORE_INTERVAL_MSEC = 5 * 1000;
+  private static final int DEFAULT_RIT_CHORE_INTERVAL_MSEC = 60 * 1000;
 
   public static final String ASSIGN_MAX_ATTEMPTS =
   "hbase.assignment.maximum.attempts";



hbase git commit: HBASE-20745 Log when master proc wal rolls

2018-06-19 Thread stack
Repository: hbase
Updated Branches:
  refs/heads/branch-2.0 6a3aa80d8 -> d0f8d7beb


HBASE-20745 Log when master proc wal rolls


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/d0f8d7be
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/d0f8d7be
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/d0f8d7be

Branch: refs/heads/branch-2.0
Commit: d0f8d7bebec66f1a3db8ffc8c18fffa0a7e6e939
Parents: 6a3aa80
Author: Michael Stack 
Authored: Sat Jun 16 13:23:31 2018 -0700
Committer: Michael Stack 
Committed: Tue Jun 19 19:52:53 2018 -0700

--
 .../org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java| 2 +-
 .../hadoop/hbase/procedure2/store/wal/WALProcedureStore.java | 4 +---
 .../apache/hadoop/hbase/master/assignment/AssignmentManager.java | 2 +-
 3 files changed, 3 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/d0f8d7be/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
--
diff --git 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
index 3a75d33..ef1ce59 100644
--- 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
+++ 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
@@ -1860,7 +1860,7 @@ public class ProcedureExecutor {
 
 // WARN the worker is stuck
 stuckCount++;
-LOG.warn("Worker stuck {} run time {}", worker,
+LOG.warn("Worker stuck {}, run time {}", worker,
   StringUtils.humanTimeDiff(worker.getCurrentRunTime()));
   }
   return stuckCount;

http://git-wip-us.apache.org/repos/asf/hbase/blob/d0f8d7be/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
--
diff --git 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
index 0c8cfd2..26f4d15 100644
--- 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
+++ 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
@@ -1074,9 +1074,7 @@ public class WALProcedureStore extends ProcedureStoreBase 
{
 ". check running procedures to see if something is stuck.");
 }
 
-if (LOG.isDebugEnabled()) {
-  LOG.debug("Roll new state log: " + logId);
-}
+LOG.info("Rolled new Procedure Store WAL, id={}", logId);
 return true;
   }
 

http://git-wip-us.apache.org/repos/asf/hbase/blob/d0f8d7be/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
--
diff --git 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
index 261a2db..059faac 100644
--- 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
+++ 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
@@ -136,7 +136,7 @@ public class AssignmentManager implements ServerListener {
 
   public static final String RIT_CHORE_INTERVAL_MSEC_CONF_KEY =
   "hbase.assignment.rit.chore.interval.msec";
-  private static final int DEFAULT_RIT_CHORE_INTERVAL_MSEC = 5 * 1000;
+  private static final int DEFAULT_RIT_CHORE_INTERVAL_MSEC = 60 * 1000;
 
   public static final String ASSIGN_MAX_ATTEMPTS =
   "hbase.assignment.maximum.attempts";



hbase git commit: HBASE-20745 Log when master proc wal rolls

2018-06-19 Thread stack
Repository: hbase
Updated Branches:
  refs/heads/branch-2 3e33aecea -> 9eeb50182


HBASE-20745 Log when master proc wal rolls


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/9eeb5018
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/9eeb5018
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/9eeb5018

Branch: refs/heads/branch-2
Commit: 9eeb501825e1c163f3149eb15b9444089f205460
Parents: 3e33aec
Author: Michael Stack 
Authored: Sat Jun 16 13:23:31 2018 -0700
Committer: Michael Stack 
Committed: Tue Jun 19 19:53:29 2018 -0700

--
 .../org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java| 2 +-
 .../hadoop/hbase/procedure2/store/wal/WALProcedureStore.java | 4 +---
 .../apache/hadoop/hbase/master/assignment/AssignmentManager.java | 2 +-
 3 files changed, 3 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/9eeb5018/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
--
diff --git 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
index bd0a191..db7c118 100644
--- 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
+++ 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
@@ -1861,7 +1861,7 @@ public class ProcedureExecutor {
 
 // WARN the worker is stuck
 stuckCount++;
-LOG.warn("Worker stuck {} run time {}", worker,
+LOG.warn("Worker stuck {}, run time {}", worker,
   StringUtils.humanTimeDiff(worker.getCurrentRunTime()));
   }
   return stuckCount;

http://git-wip-us.apache.org/repos/asf/hbase/blob/9eeb5018/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
--
diff --git 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
index 0c8cfd2..26f4d15 100644
--- 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
+++ 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
@@ -1074,9 +1074,7 @@ public class WALProcedureStore extends ProcedureStoreBase 
{
 ". check running procedures to see if something is stuck.");
 }
 
-if (LOG.isDebugEnabled()) {
-  LOG.debug("Roll new state log: " + logId);
-}
+LOG.info("Rolled new Procedure Store WAL, id={}", logId);
 return true;
   }
 

http://git-wip-us.apache.org/repos/asf/hbase/blob/9eeb5018/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
--
diff --git 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
index 0d1fc16..0736435 100644
--- 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
+++ 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
@@ -135,7 +135,7 @@ public class AssignmentManager implements ServerListener {
 
   public static final String RIT_CHORE_INTERVAL_MSEC_CONF_KEY =
   "hbase.assignment.rit.chore.interval.msec";
-  private static final int DEFAULT_RIT_CHORE_INTERVAL_MSEC = 5 * 1000;
+  private static final int DEFAULT_RIT_CHORE_INTERVAL_MSEC = 60 * 1000;
 
   public static final String ASSIGN_MAX_ATTEMPTS =
   "hbase.assignment.maximum.attempts";



[hbase] Git Push Summary

2018-06-19 Thread stack
Repository: hbase
Updated Tags:  refs/tags/rel/2.0.1 [created] 9ade383bc


svn commit: r27573 - /dev/hbase/hbase-2.0.1RC0/ /release/hbase/2.0.0/ /release/hbase/2.0.1/

2018-06-19 Thread stack
Author: stack
Date: Wed Jun 20 02:28:51 2018
New Revision: 27573

Log:
Remove 2.0.0 and add 2.0.1

Added:
release/hbase/2.0.1/
  - copied from r27572, dev/hbase/hbase-2.0.1RC0/
Removed:
dev/hbase/hbase-2.0.1RC0/
release/hbase/2.0.0/



hbase git commit: HBASE-20369 Document incompatibilities between HBase 1.x and HBase 2.0

2018-06-19 Thread elserj
Repository: hbase
Updated Branches:
  refs/heads/master 6dbbd78aa -> 9bd98522f


HBASE-20369 Document incompatibilities between HBase 1.x and HBase 2.0

Signed-off-by: Josh Elser 


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/9bd98522
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/9bd98522
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/9bd98522

Branch: refs/heads/master
Commit: 9bd98522f6a7e2423f26b0cf04962b3f7a213810
Parents: 6dbbd78
Author: Thiriguna Bharat Rao 
Authored: Fri Apr 20 19:14:39 2018 +0530
Committer: Josh Elser 
Committed: Tue Jun 19 13:17:43 2018 -0700

--
 .../appendix_hbase_incompatibilities.adoc   | 714 +++
 src/main/asciidoc/book.adoc |   1 +
 2 files changed, 715 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/9bd98522/src/main/asciidoc/_chapters/appendix_hbase_incompatibilities.adoc
--
diff --git a/src/main/asciidoc/_chapters/appendix_hbase_incompatibilities.adoc 
b/src/main/asciidoc/_chapters/appendix_hbase_incompatibilities.adoc
new file mode 100644
index 000..d450f04
--- /dev/null
+++ b/src/main/asciidoc/_chapters/appendix_hbase_incompatibilities.adoc
@@ -0,0 +1,714 @@
+
+/**
+ *
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+
+[appendix]
+== Known Incompatibilities Among HBase Versions
+:doctype: book
+:numbered:
+:toc: left
+:icons: font
+:experimental:
+:toc: left
+:source-language: java
+
+== HBase 2.0 Incompatible Changes
+
+This appendix describes incompatible changes from earlier versions of HBase 
against HBase 2.0.
+This list is not meant to be wholly encompassing of all possible 
incompatibilities.
+Instead, this content is intended to give insight into some obvious 
incompatibilities which most
+users will face coming from HBase 1.x releases.
+
+=== List of Major Changes for HBase 2.0
+* HBASE-1912- HBCK is a HBase database checking tool for capturing the 
inconsistency. As an HBase administrator, you should not use HBase version 1.0  
hbck tool to check the HBase 2.0 database. Doing so will break the database and 
throw an exception error.
+* HBASE-16189 and HBASE-18945- You cannot open the HBase 2.0 hfiles through 
HBase 1.0 version.  If you are an admin or an HBase user who is using HBase 
version 1.x, you must first do a rolling upgrade to the latest version of HBase 
1.x and then upgrade to HBase 2.0.
+* HBASE-18240 - Changed the ReplicationEndpoint Interface. It also introduces 
a new hbase-third party 1.0 that packages all the third party utilities, which 
are expected to run in the hbase cluster.
+
+=== Coprocessor API changes
+
+* HBASE-16769 - Deprecated PB references from MasterObserver and 
RegionServerObserver.
+* HBASE-17312 - [JDK8] Use default method for Observer Coprocessors. The 
interface classes of BaseMasterAndRegionObserver, BaseMasterObserver, 
BaseRegionObserver, BaseRegionServerObserver and BaseWALObserver uses JDK8's 
'default' keyword to provide empty and no-op implementations.
+* Interface HTableInterface
+  HBase 2.0 introduces following changes to the methods listed below:
+
+ [−] interface CoprocessorEnvironment changes (2)
+
+[cols="1,1", frame="all"]
+|===
+| Change | Result
+| Abstract method getTable ( TableName ) has been removed. | A client program 
may be interrupted by NoSuchMethodError exception.
+| Abstract method getTable ( TableName, ExecutorService ) has been removed. | 
A client program may be interrupted by NoSuchMethodError exception.
+|===
+
+* Public Audience
+
+The following tables describes the coprocessor changes.
+
+= [−] class CoprocessorRpcChannel  (1)
+[cols="1,1", frame="all"]
+|===
+| Change | Result
+| This class has become interface.| A client program may be interrupted by 
IncompatibleClassChangeError or InstantiationError exception depending on the 
usage of this class.
+|===
+
+= Class CoprocessorHost
+Classes that were Audience Private but were removed.
+[cols="1,1", f

[2/2] hbase git commit: HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup

2018-06-19 Thread zhangduo
HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/3e33aece
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/3e33aece
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/3e33aece

Branch: refs/heads/branch-2
Commit: 3e33aecea2da1071d7336584ed29448c233fe3be
Parents: 0a4ae9f
Author: zhangduo 
Authored: Tue Jun 19 15:02:10 2018 +0800
Committer: zhangduo 
Committed: Tue Jun 19 15:09:11 2018 +0800

--
 .../apache/hadoop/hbase/MetaTableAccessor.java  |  10 +-
 .../hbase/procedure2/ProcedureExecutor.java |  45 +--
 .../procedure2/ProcedureTestingUtility.java |  10 +-
 .../hbase/procedure2/TestChildProcedures.java   |   4 +-
 .../hbase/procedure2/TestProcedureEvents.java   |   4 +-
 .../procedure2/TestProcedureExecution.java  |   4 +-
 .../hbase/procedure2/TestProcedureExecutor.java |   5 +-
 .../procedure2/TestProcedureInMemoryChore.java  |   5 +-
 .../hbase/procedure2/TestProcedureMetrics.java  |   2 +-
 .../hbase/procedure2/TestProcedureNonce.java|   4 +-
 .../hbase/procedure2/TestProcedureRecovery.java |   4 +-
 .../procedure2/TestProcedureReplayOrder.java|   6 +-
 .../procedure2/TestProcedureSuspended.java  |   4 +-
 .../procedure2/TestStateMachineProcedure.java   |   4 +-
 .../hbase/procedure2/TestYieldProcedures.java   |   6 +-
 .../src/main/protobuf/MasterProcedure.proto |  15 +-
 .../hadoop/hbase/master/CatalogJanitor.java |  13 +-
 .../org/apache/hadoop/hbase/master/HMaster.java | 178 +--
 .../hbase/master/MasterMetaBootstrap.java   |  41 +--
 .../hadoop/hbase/master/MasterServices.java |  12 -
 .../hadoop/hbase/master/MasterWalManager.java   |  28 +-
 .../hbase/master/RegionServerTracker.java   |  30 +-
 .../hadoop/hbase/master/ServerManager.java  | 163 ++-
 .../master/assignment/AssignmentManager.java| 293 +++
 .../assignment/MergeTableRegionsProcedure.java  |   2 +-
 .../master/assignment/RegionStateStore.java |  21 +-
 .../assignment/RegionTransitionProcedure.java   |  11 +-
 .../assignment/SplitTableRegionProcedure.java   |   2 +-
 .../AbstractStateMachineTableProcedure.java |   4 +-
 .../master/procedure/InitMetaProcedure.java | 115 
 .../master/procedure/MasterProcedureEnv.java|  16 +-
 .../procedure/MasterProcedureScheduler.java |  26 +-
 .../procedure/MetaProcedureInterface.java   |   5 +
 .../hbase/master/procedure/MetaQueue.java   |   5 +
 .../master/procedure/RecoverMetaProcedure.java  |   9 +-
 .../hbase/master/procedure/SchemaLocking.java   |   5 +
 .../master/procedure/ServerCrashProcedure.java  |  61 ++--
 .../hadoop/hbase/TestMetaTableAccessor.java |   2 -
 .../hbase/master/MockNoopMasterServices.java|  15 -
 .../hadoop/hbase/master/TestCatalogJanitor.java |   3 +-
 .../master/assignment/MockMasterServices.java   |  25 +-
 .../assignment/TestAssignmentManager.java   |  17 +-
 .../MasterProcedureTestingUtility.java  |   5 -
 .../procedure/TestMasterProcedureEvents.java|  76 +
 .../procedure/TestServerCrashProcedure.java |  32 +-
 45 files changed, 609 insertions(+), 738 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/3e33aece/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
--
diff --git 
a/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java 
b/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
index 91f3cf7..60afaca 100644
--- a/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
+++ b/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
@@ -1346,9 +1346,17 @@ public class MetaTableAccessor {
*/
   public static void putsToMetaTable(final Connection connection, final 
List ps)
   throws IOException {
+if (ps.isEmpty()) {
+  return;
+}
 try (Table t = getMetaHTable(connection)) {
   debugLogMutations(ps);
-  t.put(ps);
+  // the implementation for putting a single Put is much simpler so here 
we do a check first.
+  if (ps.size() == 1) {
+t.put(ps.get(0));
+  } else {
+t.put(ps);
+  }
 }
   }
 

http://git-wip-us.apache.org/repos/asf/hbase/blob/3e33aece/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
--
diff --git 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
index 3a75d33..bd0a191 100644
--- 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/proc

[1/2] hbase git commit: HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup

2018-06-19 Thread zhangduo
Repository: hbase
Updated Branches:
  refs/heads/branch-2 0a4ae9fa9 -> 3e33aecea


http://git-wip-us.apache.org/repos/asf/hbase/blob/3e33aece/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
--
diff --git 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
index 3412c82..0d1fc16 100644
--- 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
+++ 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
@@ -1,4 +1,4 @@
-/*
+/**
  * Licensed to the Apache Software Foundation (ASF) under one
  * or more contributor license agreements.  See the NOTICE file
  * distributed with this work for additional information
@@ -15,7 +15,6 @@
  * See the License for the specific language governing permissions and
  * limitations under the License.
  */
-
 package org.apache.hadoop.hbase.master.assignment;
 
 import java.io.IOException;
@@ -24,7 +23,6 @@ import java.util.Arrays;
 import java.util.Collection;
 import java.util.Collections;
 import java.util.HashMap;
-import java.util.HashSet;
 import java.util.List;
 import java.util.Map;
 import java.util.Set;
@@ -40,7 +38,6 @@ import org.apache.hadoop.hbase.HBaseIOException;
 import org.apache.hadoop.hbase.HConstants;
 import org.apache.hadoop.hbase.PleaseHoldException;
 import org.apache.hadoop.hbase.RegionException;
-import org.apache.hadoop.hbase.RegionStateListener;
 import org.apache.hadoop.hbase.ServerName;
 import org.apache.hadoop.hbase.TableName;
 import org.apache.hadoop.hbase.YouAreDeadException;
@@ -66,7 +63,6 @@ import 
org.apache.hadoop.hbase.master.assignment.RegionStates.RegionStateNode;
 import org.apache.hadoop.hbase.master.assignment.RegionStates.ServerState;
 import org.apache.hadoop.hbase.master.assignment.RegionStates.ServerStateNode;
 import org.apache.hadoop.hbase.master.balancer.FavoredStochasticBalancer;
-import org.apache.hadoop.hbase.master.normalizer.RegionNormalizer;
 import org.apache.hadoop.hbase.master.procedure.MasterProcedureEnv;
 import org.apache.hadoop.hbase.master.procedure.MasterProcedureScheduler;
 import org.apache.hadoop.hbase.master.procedure.ProcedureSyncWait;
@@ -84,7 +80,10 @@ import org.apache.hadoop.hbase.util.HasThread;
 import org.apache.hadoop.hbase.util.Pair;
 import org.apache.hadoop.hbase.util.Threads;
 import org.apache.hadoop.hbase.util.VersionInfo;
+import org.apache.hadoop.hbase.zookeeper.MetaTableLocator;
+import org.apache.hadoop.hbase.zookeeper.ZKWatcher;
 import org.apache.yetus.audience.InterfaceAudience;
+import org.apache.zookeeper.KeeperException;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
@@ -147,26 +146,13 @@ public class AssignmentManager implements ServerListener {
   "hbase.metrics.rit.stuck.warning.threshold";
   private static final int DEFAULT_RIT_STUCK_WARNING_THRESHOLD = 60 * 1000;
 
-  private final ProcedureEvent metaInitializedEvent = new 
ProcedureEvent<>("meta initialized");
+  private final ProcedureEvent metaAssignEvent = new ProcedureEvent<>("meta 
assign");
   private final ProcedureEvent metaLoadEvent = new ProcedureEvent<>("meta 
load");
 
-  /**
-   * Indicator that AssignmentManager has recovered the region states so
-   * that ServerCrashProcedure can be fully enabled and re-assign regions
-   * of dead servers. So that when re-assignment happens, AssignmentManager
-   * has proper region states.
-   */
-  private final ProcedureEvent failoverCleanupDone = new 
ProcedureEvent<>("failover cleanup");
-
   /** Listeners that are called on assignment events. */
   private final CopyOnWriteArrayList listeners =
   new CopyOnWriteArrayList();
 
-  // TODO: why is this different from the listeners (carried over from the old 
AM)
-  private RegionStateListener regionStateListener;
-
-  private RegionNormalizer regionNormalizer;
-
   private final MetricsAssignmentManager metrics;
   private final RegionInTransitionChore ritChore;
   private final MasterServices master;
@@ -210,12 +196,9 @@ public class AssignmentManager implements ServerListener {
 int ritChoreInterval = conf.getInt(RIT_CHORE_INTERVAL_MSEC_CONF_KEY,
 DEFAULT_RIT_CHORE_INTERVAL_MSEC);
 this.ritChore = new RegionInTransitionChore(ritChoreInterval);
-
-// Used for region related procedure.
-setRegionNormalizer(master.getRegionNormalizer());
   }
 
-  public void start() throws IOException {
+  public void start() throws IOException, KeeperException {
 if (!running.compareAndSet(false, true)) {
   return;
 }
@@ -227,6 +210,20 @@ public class AssignmentManager implements ServerListener {
 
 // Start the Assignment Thread
 startAssignmentThread();
+
+// load meta region state
+ZKWatcher zkw = master.getZooKeeper();
+// it coul

[1/2] hbase git commit: HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup

2018-06-19 Thread zhangduo
Repository: hbase
Updated Branches:
  refs/heads/master b336da925 -> 6dbbd78aa


http://git-wip-us.apache.org/repos/asf/hbase/blob/6dbbd78a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
--
diff --git 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
index 3412c82..0d1fc16 100644
--- 
a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
+++ 
b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
@@ -1,4 +1,4 @@
-/*
+/**
  * Licensed to the Apache Software Foundation (ASF) under one
  * or more contributor license agreements.  See the NOTICE file
  * distributed with this work for additional information
@@ -15,7 +15,6 @@
  * See the License for the specific language governing permissions and
  * limitations under the License.
  */
-
 package org.apache.hadoop.hbase.master.assignment;
 
 import java.io.IOException;
@@ -24,7 +23,6 @@ import java.util.Arrays;
 import java.util.Collection;
 import java.util.Collections;
 import java.util.HashMap;
-import java.util.HashSet;
 import java.util.List;
 import java.util.Map;
 import java.util.Set;
@@ -40,7 +38,6 @@ import org.apache.hadoop.hbase.HBaseIOException;
 import org.apache.hadoop.hbase.HConstants;
 import org.apache.hadoop.hbase.PleaseHoldException;
 import org.apache.hadoop.hbase.RegionException;
-import org.apache.hadoop.hbase.RegionStateListener;
 import org.apache.hadoop.hbase.ServerName;
 import org.apache.hadoop.hbase.TableName;
 import org.apache.hadoop.hbase.YouAreDeadException;
@@ -66,7 +63,6 @@ import 
org.apache.hadoop.hbase.master.assignment.RegionStates.RegionStateNode;
 import org.apache.hadoop.hbase.master.assignment.RegionStates.ServerState;
 import org.apache.hadoop.hbase.master.assignment.RegionStates.ServerStateNode;
 import org.apache.hadoop.hbase.master.balancer.FavoredStochasticBalancer;
-import org.apache.hadoop.hbase.master.normalizer.RegionNormalizer;
 import org.apache.hadoop.hbase.master.procedure.MasterProcedureEnv;
 import org.apache.hadoop.hbase.master.procedure.MasterProcedureScheduler;
 import org.apache.hadoop.hbase.master.procedure.ProcedureSyncWait;
@@ -84,7 +80,10 @@ import org.apache.hadoop.hbase.util.HasThread;
 import org.apache.hadoop.hbase.util.Pair;
 import org.apache.hadoop.hbase.util.Threads;
 import org.apache.hadoop.hbase.util.VersionInfo;
+import org.apache.hadoop.hbase.zookeeper.MetaTableLocator;
+import org.apache.hadoop.hbase.zookeeper.ZKWatcher;
 import org.apache.yetus.audience.InterfaceAudience;
+import org.apache.zookeeper.KeeperException;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
@@ -147,26 +146,13 @@ public class AssignmentManager implements ServerListener {
   "hbase.metrics.rit.stuck.warning.threshold";
   private static final int DEFAULT_RIT_STUCK_WARNING_THRESHOLD = 60 * 1000;
 
-  private final ProcedureEvent metaInitializedEvent = new 
ProcedureEvent<>("meta initialized");
+  private final ProcedureEvent metaAssignEvent = new ProcedureEvent<>("meta 
assign");
   private final ProcedureEvent metaLoadEvent = new ProcedureEvent<>("meta 
load");
 
-  /**
-   * Indicator that AssignmentManager has recovered the region states so
-   * that ServerCrashProcedure can be fully enabled and re-assign regions
-   * of dead servers. So that when re-assignment happens, AssignmentManager
-   * has proper region states.
-   */
-  private final ProcedureEvent failoverCleanupDone = new 
ProcedureEvent<>("failover cleanup");
-
   /** Listeners that are called on assignment events. */
   private final CopyOnWriteArrayList listeners =
   new CopyOnWriteArrayList();
 
-  // TODO: why is this different from the listeners (carried over from the old 
AM)
-  private RegionStateListener regionStateListener;
-
-  private RegionNormalizer regionNormalizer;
-
   private final MetricsAssignmentManager metrics;
   private final RegionInTransitionChore ritChore;
   private final MasterServices master;
@@ -210,12 +196,9 @@ public class AssignmentManager implements ServerListener {
 int ritChoreInterval = conf.getInt(RIT_CHORE_INTERVAL_MSEC_CONF_KEY,
 DEFAULT_RIT_CHORE_INTERVAL_MSEC);
 this.ritChore = new RegionInTransitionChore(ritChoreInterval);
-
-// Used for region related procedure.
-setRegionNormalizer(master.getRegionNormalizer());
   }
 
-  public void start() throws IOException {
+  public void start() throws IOException, KeeperException {
 if (!running.compareAndSet(false, true)) {
   return;
 }
@@ -227,6 +210,20 @@ public class AssignmentManager implements ServerListener {
 
 // Start the Assignment Thread
 startAssignmentThread();
+
+// load meta region state
+ZKWatcher zkw = master.getZooKeeper();
+// it could 

[2/2] hbase git commit: HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup

2018-06-19 Thread zhangduo
HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup


Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/6dbbd78a
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/6dbbd78a
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/6dbbd78a

Branch: refs/heads/master
Commit: 6dbbd78aa00ed4877292d9cd48621803a175d51a
Parents: b336da9
Author: zhangduo 
Authored: Tue Jun 19 15:02:10 2018 +0800
Committer: zhangduo 
Committed: Tue Jun 19 15:02:10 2018 +0800

--
 .../apache/hadoop/hbase/MetaTableAccessor.java  |  10 +-
 .../hbase/procedure2/ProcedureExecutor.java |  45 +--
 .../procedure2/ProcedureTestingUtility.java |  10 +-
 .../hbase/procedure2/TestChildProcedures.java   |   4 +-
 .../hbase/procedure2/TestProcedureEvents.java   |   4 +-
 .../procedure2/TestProcedureExecution.java  |   4 +-
 .../hbase/procedure2/TestProcedureExecutor.java |   5 +-
 .../procedure2/TestProcedureInMemoryChore.java  |   5 +-
 .../hbase/procedure2/TestProcedureMetrics.java  |   2 +-
 .../hbase/procedure2/TestProcedureNonce.java|   4 +-
 .../hbase/procedure2/TestProcedureRecovery.java |   4 +-
 .../procedure2/TestProcedureReplayOrder.java|   6 +-
 .../procedure2/TestProcedureSuspended.java  |   4 +-
 .../procedure2/TestStateMachineProcedure.java   |   4 +-
 .../hbase/procedure2/TestYieldProcedures.java   |   6 +-
 .../src/main/protobuf/MasterProcedure.proto |  15 +-
 .../hadoop/hbase/master/CatalogJanitor.java |  13 +-
 .../org/apache/hadoop/hbase/master/HMaster.java | 180 ++--
 .../hbase/master/MasterMetaBootstrap.java   |  41 +--
 .../hadoop/hbase/master/MasterServices.java |  12 -
 .../hadoop/hbase/master/MasterWalManager.java   |  28 +-
 .../hbase/master/RegionServerTracker.java   |  30 +-
 .../hadoop/hbase/master/ServerManager.java  | 163 ++-
 .../master/assignment/AssignmentManager.java| 293 +++
 .../assignment/MergeTableRegionsProcedure.java  |   2 +-
 .../master/assignment/RegionStateStore.java |  21 +-
 .../assignment/RegionTransitionProcedure.java   |  11 +-
 .../assignment/SplitTableRegionProcedure.java   |   2 +-
 .../AbstractStateMachineTableProcedure.java |   6 +-
 .../master/procedure/InitMetaProcedure.java | 115 
 .../master/procedure/MasterProcedureEnv.java|  16 +-
 .../procedure/MasterProcedureScheduler.java |  27 +-
 .../procedure/MetaProcedureInterface.java   |   5 +
 .../hbase/master/procedure/MetaQueue.java   |   5 +
 .../master/procedure/RecoverMetaProcedure.java  |   9 +-
 .../hbase/master/procedure/SchemaLocking.java   |   5 +
 .../master/procedure/ServerCrashProcedure.java  |  61 ++--
 .../hadoop/hbase/TestMetaTableAccessor.java |   2 -
 .../hbase/master/MockNoopMasterServices.java|  19 --
 .../hadoop/hbase/master/TestCatalogJanitor.java |   3 +-
 .../master/assignment/MockMasterServices.java   |  25 +-
 .../assignment/TestAssignmentManager.java   |  17 +-
 .../MasterProcedureTestingUtility.java  |   5 -
 .../procedure/TestMasterProcedureEvents.java|  76 +
 .../procedure/TestServerCrashProcedure.java |  32 +-
 45 files changed, 610 insertions(+), 746 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hbase/blob/6dbbd78a/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
--
diff --git 
a/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java 
b/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
index 91f3cf7..60afaca 100644
--- a/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
+++ b/hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
@@ -1346,9 +1346,17 @@ public class MetaTableAccessor {
*/
   public static void putsToMetaTable(final Connection connection, final 
List ps)
   throws IOException {
+if (ps.isEmpty()) {
+  return;
+}
 try (Table t = getMetaHTable(connection)) {
   debugLogMutations(ps);
-  t.put(ps);
+  // the implementation for putting a single Put is much simpler so here 
we do a check first.
+  if (ps.size() == 1) {
+t.put(ps.get(0));
+  } else {
+t.put(ps);
+  }
 }
   }
 

http://git-wip-us.apache.org/repos/asf/hbase/blob/6dbbd78a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
--
diff --git 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
 
b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java
index 3a75d33..bd0a191 100644
--- 
a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/proc