Sergio Peña created SENTRY-2075:
-----------------------------------

             Summary: Previous HMS event with incomplete message information is 
logged every 500ms
                 Key: SENTRY-2075
                 URL: https://issues.apache.org/jira/browse/SENTRY-2075
             Project: Sentry
          Issue Type: Bug
          Components: Sentry
    Affects Versions: 2.0.0
            Reporter: Sergio Peña


Sentry keeps logging the same invalid HMS event when such event has incomplete 
information (due to not using the Sentry JSON message factory for instance). 
This just causes a lot of noise on the log and also on the DB because keeps 
persisting the last ID seen.

The log issue goes away once Sentry detects a valid message and the DB is 
cleaned afterward.

Here's an example of the message logged every 500ms several times:
{noformat}
2017-11-27 23:22:12,019 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:12,529 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:13,021 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:13,529 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:14,023 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:14,524 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:15,027 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:15,529 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:16,028 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:16,530 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:17,029 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:17,528 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:18,031 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:18,532 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:19,026 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:19,522 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:20,027 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:20,527 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:21,023 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:21,530 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:22,030 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:22,531 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:23,031 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:23,530 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:24,023 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
2017-11-27 23:22:24,512 ERROR 
org.apache.sentry.service.thrift.NotificationProcessor: Create table event has 
incomplete information. dbName = default, tableName = t1, location = null
{noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to