Madhan Neethiraj created ATLAS-2729:
---------------------------------------
Summary: Audit logging fails for large entities
Key: ATLAS-2729
URL: https://issues.apache.org/jira/browse/ATLAS-2729
Project: Atlas
Issue Type: Bug
Components: atlas-core
Affects Versions: 1.0.0
Reporter: Madhan Neethiraj
Assignee: Madhan Neethiraj
Created a table with 4000 columns. Notification message from Hive hooks is
about 5mb; and the hook sends the message in compressed format. However,
processing of this notification fails in Atlas server, due to the following
error:
{noformat}
2018-05-28 06:07:37,817 WARN - [NotificationHookConsumer thread-0:] ~ audit
record too long: entityType=hive_table,
guid=4124f580-b98d-473b-ba51-12e2ca2c6cec, size=2891084; maxSize=1048576.
entity attribute values not stored in audit (EntityAuditListenerV2:189)
2018-05-28 06:07:37,899 ERROR - [NotificationHookConsumer thread-0:] ~ graph
rollback due to exception (GraphTransactionInterceptor:154)
java.lang.IllegalArgumentException: KeyValue size too large
at org.apache.hadoop.hbase.client.HTable.validatePut(HTable.java:952)
at org.apache.hadoop.hbase.client.HTable.validatePut(HTable.java:940)
at org.apache.hadoop.hbase.client.HTable.put(HTable.java:564)
at org.apache.atlas.repository.audit.HBaseBasedAuditRepository.putEve
{noformat}
This issue was addressed in earlier releases via ATLAS-1463. The fix needs to
be reviewed/updated for recent additions in master (i.e. addition of
relationshipAttributes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
