Navneet Kaur created NIFI-11847:
-----------------------------------

             Summary: Processor: ActivityMonitor: Time monitoring is incorrect
                 Key: NIFI-11847
                 URL: https://issues.apache.org/jira/browse/NIFI-11847
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Core Framework
    Affects Versions: 1.20.0
            Reporter: Navneet Kaur


I have been using the ActivityMonitor processor to monitor the flowfiles for a 
particular time. An Alert is generated if the time mentioned is exceeded.
I have observed that the time monitored in the background triggers the alert 
incorrectly.

Example-1: (AWS)
1. I have an S3 bucket (A), the file is written to bucket A every minute. 
Bucket A sends the event notification via SQS, and NiFi Processes this 
notification, fetch the file and copies it to S3 bucket B. 
In AWS Console, the file is copied to bucket B every minute. Activity monitor 
is used for GetSQS, and for 5 minutes of monitoring time, at least one alert is 
received for lacking activity!



Example-2: (AWS)

1. We have put monitoring on NiFi for 2160 minutes, but it's observed that at 
least one file is sent every 1440 minutes, we still get the alerts via 
ActivityMonitor processor for lacking activity.


Processor settings:


Threshold Duration.            =.           2160 minContinually Send Message s
 
false
 
Inactivity Message
 
index=rule_engine sourcetype=rulemonitorlog; Host=${hostname(false)}; Lacking 
activity at Splunk Processor as of time: ${now():format('yyyy/MM/dd 
HH:mm:ss')}; Splunk Processor has not send data for 
${inactivityDurationMillis:toNumber():divide(60000)} minutes
 
Activity Restored Message
 
index=rule_engine sourcetype=rulemonitorlog; Host=${hostname(false)}; Activity 
restored at Splunk Processor at time: ${now():format('yyyy/MM/dd HH:mm:ss')}; 
Splunk Processor has started sending data after being inactive for 
${inactivityDurationMillis:toNumber():divide(60000)} minutes
 
Copy Attributes
 
true
 
Monitoring Scope
 
cluster
 
Reporting Node
 
primary
 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to