[ https://issues.apache.org/jira/browse/MINIFICPP-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
marco polo resolved MINIFICPP-293. ---------------------------------- Resolution: Fixed > Insufficient space in atomic entry error, after running for a while > ------------------------------------------------------------------- > > Key: MINIFICPP-293 > URL: https://issues.apache.org/jira/browse/MINIFICPP-293 > Project: NiFi MiNiFi C++ > Issue Type: Bug > Reporter: Andrew Christianson > Assignee: marco polo > Attachments: example.tar.xz, logs.tar.xz > > > I have a flow that looks like this: > {code} > # Licensed to the Apache Software Foundation (ASF) under one or more > # contributor license agreements. See the NOTICE file distributed with > # this work for additional information regarding copyright ownership. > # The ASF licenses this file to You under the Apache License, Version 2.0 > # (the \"License\"); you may not use this file except in compliance with > # the License. You may obtain a copy of the License at > # > # http://www.apache.org/licenses/LICENSE-2.0 > # > # Unless required by applicable law or agreed to in writing, software > # distributed under the License is distributed on an \"AS IS\" BASIS, > # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > # See the License for the specific language governing permissions and > # limitations under the License. > Flow Controller: > name: MiNiFi Flow > Processors: > - name: GetFeedURLs > class: org.apache.nifi.processors.standard.GetFile > scheduling strategy: TIMER_DRIVEN > max concurrent tasks: 1 > scheduling period: 1 sec > #scheduling period: 100 ms > auto-terminated relationships list: > - failure > Properties: > Input Directory: data/rss/feeds > Keep Source File: true > #File Filter: "/url$" > - name: ExtractURL > class: org.apache.nifi.processors.standard.ExtractText > auto-terminated relationships list: > - failure > Properties: > Attribute: feed_url > - name: PaceFetch > class: org.apache.nifi.processors.standard.ExecuteScript > auto-terminated relationships list: > - failure > Properties: > Script Engine: lua > Script File: conf/PaceFetch.lua > - name: FetchFeed > class: org.apache.nifi.processors.standard.ExecuteScript > max concurrent tasks: 5 > auto-terminated relationships list: > - failure > Properties: > Script Engine: python > Script File: conf/ExecA.py > - name: LogEntryAttributes > class: org.apache.nifi.processors.standard.LogAttribute > auto-terminated relationships list: > - failure > - name: PutEntry > class: org.apache.nifi.processors.standard.PutFile > auto-terminated relationships list: > - success > - failure > Properties: > Directory: data > Conflict Resolution Strategy: ignore > Connections: > - name: A > source name: GetFeedURLs > source relationship name: success > destination name: ExtractURL > - name: B > source name: ExtractURL > source relationship name: success > destination name: PaceFetch > - name: C > source name: PaceFetch > source relationship name: success > destination name: FetchFeed > - name: D > source name: FetchFeed > source relationship name: success > destination name: LogEntryAttributes > - name: E > source name: LogEntryAttributes > source relationship name: success > destination name: PutEntry > Remote Processing Groups: [] > Provenance Reporting: > {code} > After it runs for a while (hour or two), the flow stops fully working, and > dumps this out in the DEBUG logs: > {code} > [2017-11-06 11:37:57.063] [org::apache::nifi::minifi::core::ProcessSession] > [debug] Create FlowFile with UUID d81b1832-c310-11e7-a858-bc5ff43a885b > [2017-11-06 11:37:57.063] > [org::apache::nifi::minifi::provenance::ProvenanceReporter] [debug] Prove > reporter now 3 > [2017-11-06 11:37:57.063] [org::apache::nifi::minifi::ResourceClaim] [debug] > Resource Claim created ./content_repository/1509982623798-8558 > [2017-11-06 11:37:57.063] > [org::apache::nifi::minifi::core::repository::VolatileContentRepository] > [debug] enter write for ./content_repository/1509982623798-8558 > [2017-11-06 11:37:57.063] > [org::apache::nifi::minifi::core::repository::VolatileContentRepository] > [debug] Minimize locking > [2017-11-06 11:37:57.064] > [org::apache::nifi::minifi::io::AtomicEntryStream<std::shared_ptr<org::apache::nifi::minifi::ResourceClaim> > > ()] [debug] Cannot insert 46 bytes due to insufficient space in atomic > entry > [2017-11-06 11:37:57.064] > [org::apache::nifi::minifi::io::AtomicEntryStream<std::shared_ptr<org::apache::nifi::minifi::ResourceClaim> > > ()] [debug] Decrementing > [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::ProcessSession] > [debug] Caught Exception File Operation:File Import Error > [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::processors::GetFile] > [debug] GetFile Caught Exception File Operation:File Import Error > [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::Processor] > [debug] Caught Exception File Operation:File Import Error > [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug] > Delete FlowFile UUID d81b1832-c310-11e7-a858-bc5ff43a885b > [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug] > Delete FlowFile UUID d81af500-c310-11e7-a858-bc5ff43a885b > [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug] > Delete Resource Claim ./content_repository/1509982623798-8557 > [2017-11-06 11:37:57.064] > [org::apache::nifi::minifi::core::repository::VolatileContentRepository] > [debug] enter remove for ./content_repository/1509982623798-8557, reducing > 7864286 > [2017-11-06 11:37:57.064] > [org::apache::nifi::minifi::core::repository::VolatileContentRepository] > [debug] removed ./content_repository/1509982623798-8557 > [2017-11-06 11:37:57.064] > [org::apache::nifi::minifi::core::repository::VolatileContentRepository] > [debug] Remove for ./content_repository/1509982623798-8557, reduced to 7864257 > [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::ProcessSession] > [debug] ProcessSession rollback for GetFeedURLs > [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::SchedulingAgent] > [debug] Caught Exception File Operation:File Import Error > {code} > From the logs, it looks like GetFile is where the flow starts breaking. -- This message was sent by Atlassian JIRA (v6.4.14#64029)