[ 
https://issues.apache.org/jira/browse/PHOENIX-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15618629#comment-15618629
 ] 

James Taylor edited comment on PHOENIX-3424 at 10/29/16 7:47 PM:
-----------------------------------------------------------------

I can repro it, [~samarthjain]. Like [~mujtabachohan] said, it's after upgrade 
happens, if you quit sqlline and then start it again. The upgrade seems to have 
left things in a bad state. I tried this WIP patch which also update the header 
row of SYSTEM.STATS and thought it would fix it, but it's still happening. 
Needs more investigation.

Here's the full stack trace:
{code}
Caused by: org.apache.hadoop.hbase.DoNotRetryIOException: 
org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.STATS: Didn't find all 
required key values in 'COLUMN_FAMILY' column metadata row
        at 
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
        at 
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1581)
        at 
org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:16282)
        at 
org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7815)
        at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1986)
        at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1968)
        at 
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2178)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
        at 
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: Didn't find all required key values 
in 'COLUMN_FAMILY' column metadata row
        at 
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.addColumnToTable(MetaDataEndpointImpl.java:670)
        at 
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.getTable(MetaDataEndpointImpl.java:956)
        at 
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildTable(MetaDataEndpointImpl.java:542)
        at 
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1208)
        at 
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1406)
{code}


was (Author: jamestaylor):
I can repro it, [~samarthjain]. Like [~mujtabachohan] said, it's after upgrade 
happens, if you quit sqlline and then start it again. The upgrade seems to have 
left things in a bad state. I tried this WIP patch which also update the header 
row of SYSTEM.STATS and thought it would fix it, but it's still happening. 
Needs more investigation.

Here's the full stack trace:
{code}
Error: ERROR 2007 (INT09): Outdated jars. The following servers require an 
updated phoenix.jar to be put in the classpath of HBase: 
region=SYSTEM.CATALOG,,1477760052644.cf6f4c865587882d1e3b8487a42bb70e., 
hostname=10.0.0.3,55327,1477761049001, seqNum=27 (state=INT09,code=2007)
java.sql.SQLException: ERROR 2007 (INT09): Outdated jars. The following servers 
require an updated phoenix.jar to be put in the classpath of HBase: 
region=SYSTEM.CATALOG,,1477760052644.cf6f4c865587882d1e3b8487a42bb70e., 
hostname=10.0.0.3,55327,1477761049001, seqNum=27
        at 
org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:464)
        at 
org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:150)
        at 
org.apache.phoenix.query.ConnectionQueryServicesImpl.checkClientServerCompatibility(ConnectionQueryServicesImpl.java:1252)
        at 
org.apache.phoenix.query.ConnectionQueryServicesImpl.ensureTableCreated(ConnectionQueryServicesImpl.java:1087)
        at 
org.apache.phoenix.query.ConnectionQueryServicesImpl.createTable(ConnectionQueryServicesImpl.java:1409)
        at 
org.apache.phoenix.schema.MetaDataClient.createTableInternal(MetaDataClient.java:2275)
        at 
org.apache.phoenix.schema.MetaDataClient.createTable(MetaDataClient.java:939)
        at 
org.apache.phoenix.compile.CreateTableCompiler$2.execute(CreateTableCompiler.java:211)
        at 
org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:358)
        at 
org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:341)
        at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
        at 
org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:339)
        at 
org.apache.phoenix.jdbc.PhoenixStatement.executeUpdate(PhoenixStatement.java:1492)
        at 
org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2416)
        at 
org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2364)
        at 
org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:76)
        at 
org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2364)
{code}

> Backward compatibility failure: 4.8 -> 4.9 upgrade
> --------------------------------------------------
>
>                 Key: PHOENIX-3424
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3424
>             Project: Phoenix
>          Issue Type: Bug
>            Reporter: Mujtaba Chohan
>            Assignee: James Taylor
>             Fix For: 4.9.0
>
>         Attachments: PHOENIX-3424_wip.patch
>
>
> {noformat}
> Caused by: java.lang.IllegalStateException: Didn't find all required key 
> values in 'COLUMN_FAMILY' column metadata row
>       at 
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.addColumnToTable(MetaDataEndpointImpl.java:671)
>       at 
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.getTable(MetaDataEndpointImpl.java:958)
>       at 
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildTable(MetaDataEndpointImpl.java:543)
>       at 
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1210)
>       at 
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1389)
>       ... 10 more (state=08000,code=101)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to