Monani Mihir created PHOENIX-4353:
-------------------------------------
Summary: Constraint violation error in Snapshot based index
rebuild job
Key: PHOENIX-4353
URL: https://issues.apache.org/jira/browse/PHOENIX-4353
Project: Phoenix
Issue Type: Bug
Affects Versions: 4.13.0
Reporter: Monani Mihir
Priority: Critical
When we try to rebuild index with data table snapshot, many mappers fails with
ERROR 218 (23018): Constraint violation. Example below :-
Cmd to run snapshot based index job :-
bin/hbase org.apache.phoenix.mapreduce.index.IndexTool -it DATA_INDEX -dt DATA
-s SCHEMA -snap -op /TEST/DATA_INDEX
Mappers failed with error :-
2017-11-06 09:25:24,380 INFO [main] regionserver.HRegion - Onlined
eac5484a276e8d942e9eebf8275f114f; next sequenceid=18399282
2017-11-06 09:25:24,522 ERROR [main] index.PhoenixIndexImportMapper - Error
ERROR 218 (23018): Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID may not be
null while read/write of a record
2017-11-06 09:25:24,545 INFO [42e9eebf8275f114f.-1] regionserver.HStore -
Closed 0
2017-11-06 09:25:24,546 INFO [main] regionserver.HRegion - Closed
SCHEMA.DATA_INDEX,userID1234orgid1234,1509939061852.eac5484a276e8d942e9eebf8275f114f.
2017-11-06 09:25:24,547 INFO [main] mapred.MapTask - Starting flush of map
output
2017-11-06 09:25:24,557 INFO [main] compress.CodecPool - Got brand-new
compressor [.snappy]
2017-11-06 09:25:24,560 WARN [main] mapred.YarnChild - Exception running child
: java.lang.RuntimeException: java.sql.SQLException: ERROR 218 (23018):
Constraint violation. SCHEMA.DATA_INDEX.:DATA_ID may not be null
at
org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:122)
at
org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:48)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1751)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)
Caused by: java.sql.SQLException: ERROR 218 (23018): Constraint violation.
SCHEMA.DATA_INDEX.:DATA_ID may not be null
at
org.apache.phoenix.exception.SQLExceptionCode$Factory$1.newException(SQLExceptionCode.java:488)
at
org.apache.phoenix.exception.SQLExceptionInfo.buildException(SQLExceptionInfo.java:150)
at
org.apache.phoenix.schema.ConstraintViolationException.<init>(ConstraintViolationException.java:39)
at org.apache.phoenix.schema.PTableImpl.newKey(PTableImpl.java:753)
at
org.apache.phoenix.compile.UpsertCompiler.setValues(UpsertCompiler.java:154)
at
org.apache.phoenix.compile.UpsertCompiler.access$500(UpsertCompiler.java:116)
at
org.apache.phoenix.compile.UpsertCompiler$4.execute(UpsertCompiler.java:1078)
at
org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:393)
at
org.apache.phoenix.jdbc.PhoenixStatement$2.call(PhoenixStatement.java:376)
at org.apache.phoenix.call.CallRunner.run(CallRunner.java:53)
at
org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:374)
at
org.apache.phoenix.jdbc.PhoenixStatement.executeMutation(PhoenixStatement.java:363)
at
org.apache.phoenix.jdbc.PhoenixStatement.execute(PhoenixStatement.java:269)
at
org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPreparedStatement.java:172)
at
org.apache.phoenix.jdbc.PhoenixPreparedStatement.execute(PhoenixPreparedStatement.java:177)
at
org.apache.phoenix.mapreduce.index.PhoenixIndexImportMapper.map(PhoenixIndexImportMapper.java:101)
... 9 more
2017-11-06 09:25:24,563 INFO [main] mapred.Task - Runnning cleanup for the task
2017-11-06 09:25:24,564 WARN [main] output.FileOutputCommitter - Could not
delete
hdfs://hdfs-local/TEST/DATA_INDEX/SCHEMA.DATA_INDEX/_temporary/1/_temporary/attempt_1508241002000_5658_m_000014_0
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
