We are in the process of upgrading two of our CDH clusters from version CDH 5.12 (Hbase 1.2.0) to CDH 6.3 (hbase 2.1.0) The first cluster went without any hiccup, and Phoenix 5.0.X worked without any issue with hbase.
But on the second cluster, which is slightly larger than the first cluster, we keep getting the following error, which I think is related to https://issues.apache.org/jira/browse/PHOENIX-4653 Error: Cluster is being concurrently upgraded from 4.13.x to 5.0.x. Please retry establishing connection. (state=INT12,code=2010) org.apache.phoenix.exception.UpgradeInProgressException: Cluster is being concurrently upgraded from 4.13.x to 5.0.x. Please retry establishing connection. at org.apache.phoenix.query.ConnectionQueryServicesImpl.acquireUpgradeMutex(ConnectionQueryServicesImpl.java:3500) at org.apache.phoenix.query.ConnectionQueryServicesImpl.upgradeSystemTables(ConnectionQueryServicesImpl.java:3083) at org.apache.phoenix.query.ConnectionQueryServicesImpl$12.call(ConnectionQueryServicesImpl.java:2625) at org.apache.phoenix.query.ConnectionQueryServicesImpl$12.call(ConnectionQueryServicesImpl.java:2532) at org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:76) at org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2532) at org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:255) at org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:150) at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:221) at sqlline.DatabaseConnection.connect(DatabaseConnection.java:157) at sqlline.DatabaseConnection.getConnection(DatabaseConnection.java:203) at sqlline.Commands.close(Commands.java:906) at sqlline.Commands.closeall(Commands.java:880) at sqlline.SqlLine.begin(SqlLine.java:714) at sqlline.SqlLine.start(SqlLine.java:398) at sqlline.SqlLine.main(SqlLine.java:291) On hbase shell , list, I noticed there is a SYSTEM.MUTEX table, with content as follow: hbase(main):002:0> scan 'SYSTEM.MUTEX' ROW COLUMN+CELL \x00SYSTEM\x00CATALOG column=0:UPGRADE_MUTEX, timestamp=1569387929428, value=UPGRADE_MUTEX_LOCKED 1 row(s) Took 0.1329 seconds Is it safe to just disable, and drop the SYSTEM.MUTEX table from hbase, and try rerunning Phoenix sqlline.py again ? Thanks
