[ 
https://issues.apache.org/jira/browse/PHOENIX-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Samarth Jain updated PHOENIX-3375:
----------------------------------
    Attachment: PHOENIX-3375.patch

wip patch. FYI, [~jamestaylor]. 

 I am not sure why I am hitting the below exception when trying to upgrade from 
4.8.1 to 4.9. 

{code}
Error: org.apache.hadoop.hbase.snapshot.HBaseSnapshotException: 
org.apache.hadoop.hbase.snapshot.HBaseSnapshotException: Snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } had an error.  Procedure 
SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 { waiting=[] done=[] 
}
        at 
org.apache.hadoop.hbase.master.snapshot.SnapshotManager.isSnapshotDone(SnapshotManager.java:342)
        at 
org.apache.hadoop.hbase.master.HMaster.isSnapshotDone(HMaster.java:3241)
        at 
org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:44143)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2197)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:104)
        at 
org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException via 
Failed taking snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } due to exception:Snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } looks 
empty:org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } looks empty
        at 
org.apache.hadoop.hbase.errorhandling.ForeignExceptionDispatcher.rethrowException(ForeignExceptionDispatcher.java:83)
        at 
org.apache.hadoop.hbase.master.snapshot.TakeSnapshotHandler.rethrowExceptionIfFailed(TakeSnapshotHandler.java:307)
        at 
org.apache.hadoop.hbase.master.snapshot.SnapshotManager.isSnapshotDone(SnapshotManager.java:332)
        ... 10 more
Caused by: org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: 
Snapshot { ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } looks empty
        at 
org.apache.hadoop.hbase.master.snapshot.MasterSnapshotVerifier.verifyRegions(MasterSnapshotVerifier.java:159)
        at 
org.apache.hadoop.hbase.master.snapshot.MasterSnapshotVerifier.verifySnapshot(MasterSnapshotVerifier.java:115)
        at 
org.apache.hadoop.hbase.master.snapshot.TakeSnapshotHandler.process(TakeSnapshotHandler.java:194)
        at 
org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:129)
        ... 3 more (state=,code=0)
java.sql.SQLException: org.apache.hadoop.hbase.snapshot.HBaseSnapshotException: 
org.apache.hadoop.hbase.snapshot.HBaseSnapshotException: Snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } had an error.  Procedure 
SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 { waiting=[] done=[] 
}
        at 
org.apache.hadoop.hbase.master.snapshot.SnapshotManager.isSnapshotDone(SnapshotManager.java:342)
        at 
org.apache.hadoop.hbase.master.HMaster.isSnapshotDone(HMaster.java:3241)
        at 
org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:44143)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2197)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:104)
        at 
org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
{code}

[~mujtabachohan] - would you mind giving it a try on your setup. Will keep 
digging in the morning.

> Upgrade from v4.8.1 to 4.9.0 fails
> ----------------------------------
>
>                 Key: PHOENIX-3375
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3375
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.9.0
>            Reporter: Mujtaba Chohan
>            Assignee: Samarth Jain
>         Attachments: PHOENIX-3375.patch
>
>
> {noformat}
> Error: Cluster is being concurrently upgraded from 4.8.x to 4.9.x. Please 
> retry establishing connection. (state=INT12,code=2010)
> org.apache.phoenix.exception.UpgradeInProgressException: Cluster is being 
> concurrently upgraded from 4.8.x to 4.9.x. Please retry establishing 
> connection.
>       at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.acquireUpgradeMutex(ConnectionQueryServicesImpl.java:2979)
>       at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.upgradeSystemTables(ConnectionQueryServicesImpl.java:2499)
>       at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2413)
>       at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2347)
>       at 
> org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:76)
>       at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2347)
>       at 
> org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:232)
>       at 
> org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:147)
>       at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:202)
> {noformat}
> Note: UPGRADE_MUTEX is not present is SYSTEM.CATALOG



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to