Matt Burgess created NIFI-8093:
----------------------------------
Summary: Possible race condition when deleting oldest provenance
file
Key: NIFI-8093
URL: https://issues.apache.org/jira/browse/NIFI-8093
Project: Apache NiFi
Issue Type: Improvement
Components: Core Framework
Reporter: Matt Burgess
Saw this in some recent NiFi logs:
2020-12-14 11:42:53,770 WARN [Provenance Repository Maintenance-2-thread-1]
o.a.n.p.store.WriteAheadStorePartition Provenance Event Store
Partition[directory=./provenance_repository] Failed to delete oldest event file
./provenance_repository/37169.prov. This file should be cleaned up manually.
2020-12-14 11:42:53,796 INFO [Provenance Repository Maintenance-2-thread-1]
o.a.n.p.store.WriteAheadStorePartition Provenance Event Store
Partition[directory=./provenance_repository] Deleted
./provenance_repository/37169.prov.gz event file (120.69 MB) due to storage
limits
It appears there may be a race condition where NiFi is attempting to delete the
oldest provenance file while it is being compressed. After compression
completes, the .gz file does get successfully deleted (so no manual
intervention is required).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)