[jira] [Updated] (PHOENIX-3375) Upgrade from v4.8.1 to 4.9.0 fails

2016-10-28 Thread Samarth Jain (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PHOENIX-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Samarth Jain updated PHOENIX-3375:
--
Attachment: PHOENIX-3375_v3.patch

[~jamestaylor], please review. 

[~mujtabachohan] - I verified that the upgrade now works from 4.8.1 to 4.x. 
Would be good to get some more verification on your end. This should also fix 
the error reported in PHOENIX-3326 too.

> Upgrade from v4.8.1 to 4.9.0 fails
> --
>
> Key: PHOENIX-3375
> URL: https://issues.apache.org/jira/browse/PHOENIX-3375
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.9.0
>Reporter: Mujtaba Chohan
>Assignee: Samarth Jain
> Attachments: PHOENIX-3375.patch, PHOENIX-3375_v2.patch, 
> PHOENIX-3375_v3.patch
>
>
> {noformat}
> Error: Cluster is being concurrently upgraded from 4.8.x to 4.9.x. Please 
> retry establishing connection. (state=INT12,code=2010)
> org.apache.phoenix.exception.UpgradeInProgressException: Cluster is being 
> concurrently upgraded from 4.8.x to 4.9.x. Please retry establishing 
> connection.
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.acquireUpgradeMutex(ConnectionQueryServicesImpl.java:2979)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.upgradeSystemTables(ConnectionQueryServicesImpl.java:2499)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2413)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2347)
>   at 
> org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:76)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2347)
>   at 
> org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:232)
>   at 
> org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:147)
>   at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:202)
> {noformat}
> Note: UPGRADE_MUTEX is not present is SYSTEM.CATALOG



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (PHOENIX-3375) Upgrade from v4.8.1 to 4.9.0 fails

2016-10-28 Thread James Taylor (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PHOENIX-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

James Taylor updated PHOENIX-3375:
--
Attachment: PHOENIX-3375_v2.patch

I think this patch is too complex, [~samarthjain] (bad advice from my part). 
How about this alternative. It passes UpgradeIT. Give it a look and check it in 
so we can proceed with the RC.

> Upgrade from v4.8.1 to 4.9.0 fails
> --
>
> Key: PHOENIX-3375
> URL: https://issues.apache.org/jira/browse/PHOENIX-3375
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.9.0
>Reporter: Mujtaba Chohan
>Assignee: Samarth Jain
> Attachments: PHOENIX-3375.patch, PHOENIX-3375_v2.patch
>
>
> {noformat}
> Error: Cluster is being concurrently upgraded from 4.8.x to 4.9.x. Please 
> retry establishing connection. (state=INT12,code=2010)
> org.apache.phoenix.exception.UpgradeInProgressException: Cluster is being 
> concurrently upgraded from 4.8.x to 4.9.x. Please retry establishing 
> connection.
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.acquireUpgradeMutex(ConnectionQueryServicesImpl.java:2979)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.upgradeSystemTables(ConnectionQueryServicesImpl.java:2499)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2413)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2347)
>   at 
> org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:76)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2347)
>   at 
> org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:232)
>   at 
> org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:147)
>   at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:202)
> {noformat}
> Note: UPGRADE_MUTEX is not present is SYSTEM.CATALOG



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (PHOENIX-3375) Upgrade from v4.8.1 to 4.9.0 fails

2016-10-28 Thread Samarth Jain (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PHOENIX-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Samarth Jain updated PHOENIX-3375:
--
Attachment: PHOENIX-3375.patch

wip patch. FYI, [~jamestaylor]. 

 I am not sure why I am hitting the below exception when trying to upgrade from 
4.8.1 to 4.9. 

{code}
Error: org.apache.hadoop.hbase.snapshot.HBaseSnapshotException: 
org.apache.hadoop.hbase.snapshot.HBaseSnapshotException: Snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } had an error.  Procedure 
SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 { waiting=[] done=[] 
}
at 
org.apache.hadoop.hbase.master.snapshot.SnapshotManager.isSnapshotDone(SnapshotManager.java:342)
at 
org.apache.hadoop.hbase.master.HMaster.isSnapshotDone(HMaster.java:3241)
at 
org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:44143)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2197)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:104)
at 
org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException via 
Failed taking snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } due to exception:Snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } looks 
empty:org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } looks empty
at 
org.apache.hadoop.hbase.errorhandling.ForeignExceptionDispatcher.rethrowException(ForeignExceptionDispatcher.java:83)
at 
org.apache.hadoop.hbase.master.snapshot.TakeSnapshotHandler.rethrowExceptionIfFailed(TakeSnapshotHandler.java:307)
at 
org.apache.hadoop.hbase.master.snapshot.SnapshotManager.isSnapshotDone(SnapshotManager.java:332)
... 10 more
Caused by: org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: 
Snapshot { ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } looks empty
at 
org.apache.hadoop.hbase.master.snapshot.MasterSnapshotVerifier.verifyRegions(MasterSnapshotVerifier.java:159)
at 
org.apache.hadoop.hbase.master.snapshot.MasterSnapshotVerifier.verifySnapshot(MasterSnapshotVerifier.java:115)
at 
org.apache.hadoop.hbase.master.snapshot.TakeSnapshotHandler.process(TakeSnapshotHandler.java:194)
at 
org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:129)
... 3 more (state=,code=0)
java.sql.SQLException: org.apache.hadoop.hbase.snapshot.HBaseSnapshotException: 
org.apache.hadoop.hbase.snapshot.HBaseSnapshotException: Snapshot { 
ss=SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 
table=SYSTEM.CATALOG type=FLUSH } had an error.  Procedure 
SNAPSHOT_SYSTEM.CATALOG_4.8.x_TO_4.9.0_20161028025623-0700 { waiting=[] done=[] 
}
at 
org.apache.hadoop.hbase.master.snapshot.SnapshotManager.isSnapshotDone(SnapshotManager.java:342)
at 
org.apache.hadoop.hbase.master.HMaster.isSnapshotDone(HMaster.java:3241)
at 
org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:44143)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2197)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:104)
at 
org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{code}

[~mujtabachohan] - would you mind giving it a try on your setup. Will keep 
digging in the morning.

> Upgrade from v4.8.1 to 4.9.0 fails
> --
>
> Key: PHOENIX-3375
> URL: https://issues.apache.org/jira/browse/PHOENIX-3375
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.9.0
>Reporter: Mujtaba Chohan
>Assignee: Samarth Jain
>

[jira] [Updated] (PHOENIX-3375) Upgrade from v4.8.1 to 4.9.0 fails

2016-10-12 Thread Mujtaba Chohan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/PHOENIX-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mujtaba Chohan updated PHOENIX-3375:

Assignee: Samarth Jain

> Upgrade from v4.8.1 to 4.9.0 fails
> --
>
> Key: PHOENIX-3375
> URL: https://issues.apache.org/jira/browse/PHOENIX-3375
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.9.0
>Reporter: Mujtaba Chohan
>Assignee: Samarth Jain
>
> {noformat}
> Error: Cluster is being concurrently upgraded from 4.8.x to 4.9.x. Please 
> retry establishing connection. (state=INT12,code=2010)
> org.apache.phoenix.exception.UpgradeInProgressException: Cluster is being 
> concurrently upgraded from 4.8.x to 4.9.x. Please retry establishing 
> connection.
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.acquireUpgradeMutex(ConnectionQueryServicesImpl.java:2979)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.upgradeSystemTables(ConnectionQueryServicesImpl.java:2499)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2413)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2347)
>   at 
> org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:76)
>   at 
> org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2347)
>   at 
> org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:232)
>   at 
> org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:147)
>   at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:202)
> {noformat}
> Note: UPGRADE_MUTEX is not present is SYSTEM.CATALOG



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)