[
https://issues.apache.org/jira/browse/SENTRY-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16159832#comment-16159832
]
Hadoop QA commented on SENTRY-1939:
-----------------------------------
Here are the results of testing the latest attachment
https://issues.apache.org/jira/secure/attachment/12886230/SENTRY-1939.02-master.patch
against master.
{color:green}Overall:{color} +1 all checks pass
{color:green}SUCCESS:{color} all tests passed
Console output:
https://builds.apache.org/job/PreCommit-SENTRY-Build/3275/console
This message is automatically generated.
> Resetting the CounterWait during full snapshot has to be handled across all
> sentry servers
> ------------------------------------------------------------------------------------------
>
> Key: SENTRY-1939
> URL: https://issues.apache.org/jira/browse/SENTRY-1939
> Project: Sentry
> Issue Type: Bug
> Components: Sentry
> Affects Versions: 2.0.0
> Reporter: Vamsee Yarlagadda
> Assignee: Vamsee Yarlagadda
> Priority: Critical
> Labels: sentry-ha
> Fix For: 2.0.0
>
> Attachments: SENTRY-1939.01-master.patch, SENTRY-1939.02-master.patch
>
>
> Currently as part of SENTRY-1929, we reset the CounterWait on the server that
> does the HMS full snapshot. Ideally this has to be done across all servers
> otherwise i see this error in the log of other servers.
> {code}
> 2017-09-08 19:05:44,697 INFO org.apache.sentry.hdfs.DBUpdateForwarder: A
> newer full update is found with image number: 2
> 2017-09-08 19:05:44,894 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:45,115 INFO org.apache.sentry.hdfs.DBUpdateForwarder: A
> newer full update is found with image number: 2
> 2017-09-08 19:05:45,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:45,963 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:46,391 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:46,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:47,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:47,929 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:48,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:48,898 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:49,391 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:49,897 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:50,452 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:50,506 INFO org.apache.sentry.hdfs.HMSPathsDumper: Paths
> Dump created. 101104 total path strings, 579426 duplicate strings found,
> compacted to 1077 unique strings.
> 2017-09-08 19:05:50,535 INFO org.apache.sentry.hdfs.HMSPathsDumper: Paths
> Dump created. 101104 total path strings, 579426 duplicate strings found,
> compacted to 1077 unique strings.
> 2017-09-08 19:05:50,947 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:51,904 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:51,932 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:52,420 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:52,923 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:53,417 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:53,922 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:54,414 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:54,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:55,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:55,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:56,392 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:56,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:57,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:57,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:58,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:58,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:59,393 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:05:59,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:00,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:00,891 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:01,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:01,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:02,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:02,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:03,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:03,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:04,393 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:04,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:05,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:05,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:06,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:06,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:07,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:07,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:08,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:08,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:09,422 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:09,892 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:10,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:10,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:11,391 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:11,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:12,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:12,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:13,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:13,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:14,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:14,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:15,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:15,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:16,392 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:16,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:17,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 0 is smaller then the previous one 2190
> 2017-09-08 19:06:17,553 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer
> delta updates are found up to sequence number: 2287
> 2017-09-08 19:06:17,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 6 is smaller then the previous one 2190
> 2017-09-08 19:06:18,066 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer
> delta updates are found up to sequence number: 177
> 2017-09-08 19:06:18,081 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer
> delta updates are found up to sequence number: 2294
> 2017-09-08 19:06:18,274 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer
> delta updates are found up to sequence number: 177
> 2017-09-08 19:06:18,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 13 is smaller then the previous one 2190
> 2017-09-08 19:06:18,594 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer
> delta updates are found up to sequence number: 181
> 2017-09-08 19:06:18,610 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer
> delta updates are found up to sequence number: 2298
> 2017-09-08 19:06:18,788 INFO org.apache.sentry.hdfs.DBUpdateForwarder: Newer
> delta updates are found up to sequence number: 181
> 2017-09-08 19:06:18,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:19,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:19,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:20,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:20,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:21,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:21,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:22,393 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:22,918 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:23,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:23,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:24,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:24,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:25,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:25,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:26,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:26,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:27,390 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> 2017-09-08 19:06:27,890 ERROR org.apache.sentry.service.thrift.CounterWait:
> new counter value 16 is smaller then the previous one 2190
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
