Andrew Christianson created MINIFICPP-293:
---------------------------------------------
Summary: Insufficient space in atomic entry error, after running
for a while
Key: MINIFICPP-293
URL: https://issues.apache.org/jira/browse/MINIFICPP-293
Project: NiFi MiNiFi C++
Issue Type: Bug
Reporter: Andrew Christianson
I have a flow that looks like this:
{code}
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the \"License\"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an \"AS IS\" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
Flow Controller:
name: MiNiFi Flow
Processors:
- name: GetFeedURLs
class: org.apache.nifi.processors.standard.GetFile
scheduling strategy: TIMER_DRIVEN
max concurrent tasks: 1
scheduling period: 1 sec
#scheduling period: 100 ms
auto-terminated relationships list:
- failure
Properties:
Input Directory: data/rss/feeds
Keep Source File: true
#File Filter: "/url$"
- name: ExtractURL
class: org.apache.nifi.processors.standard.ExtractText
auto-terminated relationships list:
- failure
Properties:
Attribute: feed_url
- name: PaceFetch
class: org.apache.nifi.processors.standard.ExecuteScript
auto-terminated relationships list:
- failure
Properties:
Script Engine: lua
Script File: conf/PaceFetch.lua
- name: FetchFeed
class: org.apache.nifi.processors.standard.ExecuteScript
max concurrent tasks: 5
auto-terminated relationships list:
- failure
Properties:
Script Engine: python
Script File: conf/ExecA.py
- name: LogEntryAttributes
class: org.apache.nifi.processors.standard.LogAttribute
auto-terminated relationships list:
- failure
- name: PutEntry
class: org.apache.nifi.processors.standard.PutFile
auto-terminated relationships list:
- success
- failure
Properties:
Directory: data
Conflict Resolution Strategy: ignore
Connections:
- name: A
source name: GetFeedURLs
source relationship name: success
destination name: ExtractURL
- name: B
source name: ExtractURL
source relationship name: success
destination name: PaceFetch
- name: C
source name: PaceFetch
source relationship name: success
destination name: FetchFeed
- name: D
source name: FetchFeed
source relationship name: success
destination name: LogEntryAttributes
- name: E
source name: LogEntryAttributes
source relationship name: success
destination name: PutEntry
Remote Processing Groups: []
Provenance Reporting:
{code}
After it runs for a while (hour or two), the flow stops fully working, and
dumps this out in the DEBUG logs:
{code}
[2017-11-06 11:37:57.063] [org::apache::nifi::minifi::core::ProcessSession]
[debug] Create FlowFile with UUID d81b1832-c310-11e7-a858-bc5ff43a885b
[2017-11-06 11:37:57.063]
[org::apache::nifi::minifi::provenance::ProvenanceReporter] [debug] Prove
reporter now 3
[2017-11-06 11:37:57.063] [org::apache::nifi::minifi::ResourceClaim] [debug]
Resource Claim created ./content_repository/1509982623798-8558
[2017-11-06 11:37:57.063]
[org::apache::nifi::minifi::core::repository::VolatileContentRepository]
[debug] enter write for ./content_repository/1509982623798-8558
[2017-11-06 11:37:57.063]
[org::apache::nifi::minifi::core::repository::VolatileContentRepository]
[debug] Minimize locking
[2017-11-06 11:37:57.064]
[org::apache::nifi::minifi::io::AtomicEntryStream<std::shared_ptr<org::apache::nifi::minifi::ResourceClaim>
> ()] [debug] Cannot insert 46 bytes due to insufficient space in atomic entry
[2017-11-06 11:37:57.064]
[org::apache::nifi::minifi::io::AtomicEntryStream<std::shared_ptr<org::apache::nifi::minifi::ResourceClaim>
> ()] [debug] Decrementing
[2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::ProcessSession]
[debug] Caught Exception File Operation:File Import Error
[2017-11-06 11:37:57.064] [org::apache::nifi::minifi::processors::GetFile]
[debug] GetFile Caught Exception File Operation:File Import Error
[2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::Processor] [debug]
Caught Exception File Operation:File Import Error
[2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug]
Delete FlowFile UUID d81b1832-c310-11e7-a858-bc5ff43a885b
[2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug]
Delete FlowFile UUID d81af500-c310-11e7-a858-bc5ff43a885b
[2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug]
Delete Resource Claim ./content_repository/1509982623798-8557
[2017-11-06 11:37:57.064]
[org::apache::nifi::minifi::core::repository::VolatileContentRepository]
[debug] enter remove for ./content_repository/1509982623798-8557, reducing
7864286
[2017-11-06 11:37:57.064]
[org::apache::nifi::minifi::core::repository::VolatileContentRepository]
[debug] removed ./content_repository/1509982623798-8557
[2017-11-06 11:37:57.064]
[org::apache::nifi::minifi::core::repository::VolatileContentRepository]
[debug] Remove for ./content_repository/1509982623798-8557, reduced to 7864257
[2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::ProcessSession]
[debug] ProcessSession rollback for GetFeedURLs
[2017-11-06 11:37:57.064] [org::apache::nifi::minifi::SchedulingAgent] [debug]
Caught Exception File Operation:File Import Error
{code}
>From the logs, it looks like GetFile is where the flow starts breaking.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
