[
https://issues.apache.org/jira/browse/PHOENIX-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15618629#comment-15618629
]
James Taylor edited comment on PHOENIX-3424 at 10/29/16 7:47 PM:
-----------------------------------------------------------------
I can repro it, [~samarthjain]. Like [~mujtabachohan] said, it's after upgrade
happens, if you quit sqlline and then start it again. The upgrade seems to have
left things in a bad state. I tried this WIP patch which also update the header
row of SYSTEM.STATS and thought it would fix it, but it's still happening.
Needs more investigation.
Here's the full stack trace:
{code}
Caused by: org.apache.hadoop.hbase.DoNotRetryIOException:
org.apache.hadoop.hbase.DoNotRetryIOException: SYSTEM.STATS: Didn't find all
required key values in 'COLUMN_FAMILY' column metadata row
at
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:87)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1581)
at
org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:16282)
at
org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:7815)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:1986)
at
org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:1968)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33652)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2178)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:112)
at
org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalStateException: Didn't find all required key values
in 'COLUMN_FAMILY' column metadata row
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.addColumnToTable(MetaDataEndpointImpl.java:670)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.getTable(MetaDataEndpointImpl.java:956)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildTable(MetaDataEndpointImpl.java:542)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1208)
at
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1406)
{code}
was (Author: jamestaylor):
I can repro it, [~samarthjain]. Like [~mujtabachohan] said, it's after upgrade
happens, if you quit sqlline and then start it again. The upgrade seems to have
left things in a bad state. I tried this WIP patch which also update the header
row of SYSTEM.STATS and thought it would fix it, but it's still happening.
Needs more investigation.
Here's the full stack trace:
{code}
Error: ERROR 2007 (INT09): Outdated jars. The following servers require an
updated phoenix.jar to be put in the classpath of HBase:
region=SYSTEM.CATALOG,,1477760052644.cf6f4c865587882d1e3b8487a42bb70e.,
hostname=10.0.0.3,55327,1477761049001, seqNum=27 (state=INT09,code=2007)
java.sql.SQLException: ERROR 2007 (INT09): Outdated jars. The following servers
require an updated phoenix.jar to be put in the classpath of HBase:
region=SYSTEM.CATALOG,,1477760052644.cf6f4c865587882d1e3b8487a42bb70e.,
hostname=10.0.0.3,55327,1477761049001, seqNum=27
at
org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:464)
at
org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:150)
at
org.apache.phoenix.query.ConnectionQueryServicesImpl.checkClientServerCompatibility(ConnectionQueryServicesImpl.java:1252)
at
org.apache.phoenix.query.ConnectionQueryServicesImpl.ensureTableCreated(ConnectionQueryServicesImpl.java:1087)
at
org.apache.phoenix.query.ConnectionQueryServicesImpl.createTable(ConnectionQueryServicesImpl.java:1409)
at
org.apache.phoenix.schema.MetaDataClient.createTableInternal(MetaDataClient.java:2275)
at
org.apache.phoenix.schema.MetaDataClient.createTable(MetaDataClient.java:939)
at
org.apache.phoenix.compile.CreateTableCompiler$2.execute(CreateTableCompiler.java:211)
at
org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:358)
at
org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:341)
at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
at
org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:339)
at
org.apache.phoenix.jdbc.PhoenixStatement.executeUpdate(PhoenixStatement.java:1492)
at
org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2416)
at
org.apache.phoenix.query.ConnectionQueryServicesImpl$13.call(ConnectionQueryServicesImpl.java:2364)
at
org.apache.phoenix.util.PhoenixContextExecutor.call(PhoenixContextExecutor.java:76)
at
org.apache.phoenix.query.ConnectionQueryServicesImpl.init(ConnectionQueryServicesImpl.java:2364)
{code}
> Backward compatibility failure: 4.8 -> 4.9 upgrade
> --------------------------------------------------
>
> Key: PHOENIX-3424
> URL: https://issues.apache.org/jira/browse/PHOENIX-3424
> Project: Phoenix
> Issue Type: Bug
> Reporter: Mujtaba Chohan
> Assignee: James Taylor
> Fix For: 4.9.0
>
> Attachments: PHOENIX-3424_wip.patch
>
>
> {noformat}
> Caused by: java.lang.IllegalStateException: Didn't find all required key
> values in 'COLUMN_FAMILY' column metadata row
> at
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.addColumnToTable(MetaDataEndpointImpl.java:671)
> at
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.getTable(MetaDataEndpointImpl.java:958)
> at
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.buildTable(MetaDataEndpointImpl.java:543)
> at
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.loadTable(MetaDataEndpointImpl.java:1210)
> at
> org.apache.phoenix.coprocessor.MetaDataEndpointImpl.createTable(MetaDataEndpointImpl.java:1389)
> ... 10 more (state=08000,code=101)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)