Hi, I'm experiencing provenance data loss after a warning in logs. I have had it on nifi 1.27.0 and now on 2.2.0.
I get a warning in logs 2024-10-16 00:39:39,438 WARN [Provenance Repository Maintenance-2-thread-1] o.a.n.p.store.WriteAheadStorePartition Failed to remove Provenance Event file /opt/provenance_repository/147506975.prov; this file should be cleaned up manually There are no more logs associated with this thread or file. When I search for provenance on the node that has the warning I don't see provenance associated with the file from logs. In the image below there is a 5-minute gap. And I am certain there were events during this gap. [cid:[email protected]] And in the provenance_repository I cannot see 147506975.prov, but there is 147506975.prov.gz. I was able to find that the warning comes from this method nifi/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/WriteAheadStorePartition.java at rel/nifi-1.27.0 · apache/nifi · GitHub<https://github.com/apache/nifi/blob/rel/nifi-1.27.0/nifi-nar-bundles/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/store/WriteAheadStorePartition.java#L565> And I believe this method only runs during the maintenance process of deleting old files due to storage limits. At the same time the warning mentions the active provenance file. I have archive on rollover set to true, so .prov file should be the active one. I'm confused why maintenance tries to delete my active file. And when it fails why I cannot view provenance from that file. Is it a bug? I need all provenance events without nay gaps Thanks in advance, Klavdiya ОДНА КОМПАНИЯ - ОДНИ ЦЕННОСТИ / ONE COMPANY - ONE SET OF VALUES: * Сплочённая команда / One team * Взаимоуважение / Mutual respect * Каждый день становимся лучше / Continuous Improvement * Умный результат / Smart solutions * Партнёрство / Cooperation * Безопасность без компромиссов / Uncompromising safety Подробнее о ценностях СИБУРа http://www.sibur.ru/values More about SIBUR values on https://www.sibur.ru/en/about/values Информация, содержащаяся в настоящем сообщении, регулируется положением об ограничении ответственности, которое доступно по следующей ссылке: http://www.sibur.ru/limitation/ Information contained in this email is subject to the disclaimer found by clicking on the following link: http://www.sibur.ru/en/limitation/
