----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/65533/ -----------------------------------------------------------
Review request for sentry, Alexander Kolbasov, Na Li, and Sergio Pena. Bugs: SENTRY-2115 https://issues.apache.org/jira/browse/SENTRY-2115 Repository: sentry Description ------- **Scenario-1:** When HDFS sync is disabled, and sentry is started for the first time. **Scenario-2:** When HDFS sync is disabled, and current event-id from HMS is less than last event-d processed by sentry **Scenario-3:** When HDFS sync is disabled, and first event-id in the subsequent pull is not greater than the last event-id processed by sentry by 1. **New Behavior:** Full snapshots need not be taken in all When Sentry detects out-of-sync situations, it should reset SENTRY_HMS_NOTIFICATION_ID table and start processing the event in HMS_NOTIFICATION_LOG from beginning. **Scenario-4:** Initially HDFS sync was enabled and later disabled for while and then HDFS sync is enabled and sentry service is restarted to get it to effect. **New Behavior:** When Sentry detects out-of-sync situations, it should reset SENTRY_HMS_NOTIFICATION_ID table and start processing the event in HMS_NOTIFICATION_LOG from beginning. To handle scenario explained in Scenario-4, sentry should reset the mapping information when ever HDFS sync is disabled. That way it can learn from scratch when the feature is enabled back. There is no value is holding stale data even when we know it will have issues when the feature is enabled back. Diffs ----- sentry-provider/sentry-provider-db/src/main/java/org/apache/sentry/provider/db/service/persistent/HMSFollower.java 2f2b98412e7dfdcc847ffe7975a70f452554e747 sentry-provider/sentry-provider-db/src/main/java/org/apache/sentry/provider/db/service/persistent/SentryStore.java edea5b64d8f98c93aafc1fe43fa97e00c2ce2948 sentry-provider/sentry-provider-db/src/test/java/org/apache/sentry/provider/db/service/persistent/TestHMSFollower.java 79030780c35e5bda432e3ec3f01328e627cb50a6 Diff: https://reviews.apache.org/r/65533/diff/1/ Testing ------- Made sure that all the tests passed. Thanks, kalyan kumar kalvagadda