[
https://issues.apache.org/jira/browse/MINIFICPP-293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241237#comment-16241237
]
Andrew Christianson commented on MINIFICPP-293:
-----------------------------------------------
It appears to be still failing. Attached logs generated using same flow as
attached earlier. The error msg is a bit different now:
{code}
[2017-11-06 19:18:58.126] [org::apache::nifi::minifi::processors::GetFile]
[info] GetFile process data/rss/feeds/nifi/url
[2017-11-06 19:18:58.126] [org::apache::nifi::minifi::core::ProcessSession]
[debug] Create FlowFile with UUID 3f624d18-c351-11e7-ad1b-bc5ff43a885b
[2017-11-06 19:18:58.126]
[org::apache::nifi::minifi::provenance::ProvenanceReporter] [debug] Prove
reporter now 1
[2017-11-06 19:18:58.126] [org::apache::nifi::minifi::ResourceClaim] [debug]
Resource Claim created ./content_repository/1510012452125-15000
[2017-11-06 19:18:58.126]
[org::apache::nifi::minifi::core::repository::VolatileContentRepository]
[debug] enter write for ./content_repository/1510012452125-15000
[2017-11-06 19:18:58.127]
[org::apache::nifi::minifi::core::repository::VolatileContentRepository]
[debug] write returns nullptr ./content_repository/1510012452125-15000 15000
[2017-11-06 19:18:58.127] [org::apache::nifi::minifi::core::ProcessSession]
[debug] ProcessSession rollback for GetFeedURLs
[2017-11-06 19:18:58.127] [org::apache::nifi::minifi::FlowFileRecord] [debug]
Delete FlowFile UUID 3f624d18-c351-11e7-ad1b-bc5ff43a885b
[2017-11-06 19:18:58.226] [org::apache::nifi::minifi::processors::GetFile]
[info] Is listing empty 1
[2017-11-06 19:18:58.226] [org::apache::nifi::minifi::processors::GetFile]
[info] Performing file listing against data/rss/feeds
[2017-11-06 19:18:58.226] [org::apache::nifi::minifi::processors::GetFile]
[info] Performing file listing against data/rss/feeds
[2017-11-06 19:18:58.226] [org::apache::nifi::minifi::processors::GetFile]
[info] Performing file listing against data/rss/feeds/nifi
[2017-11-06 19:18:58.226] [org::apache::nifi::minifi::processors::GetFile]
[info] Performing file listing against data/rss/feeds/nifi
[2017-11-06 19:18:58.226] [org::apache::nifi::minifi::processors::GetFile]
[info] Is listing empty 0
[2017-11-06 19:18:58.226] [org::apache::nifi::minifi::processors::GetFile]
[info] GetFile process data/rss/feeds/nifi/url
[2017-11-06 19:18:58.226] [org::apache::nifi::minifi::core::ProcessSession]
[debug] Create FlowFile with UUID 3f719390-c351-11e7-9901-bc5ff43a885b
[2017-11-06 19:18:58.226]
[org::apache::nifi::minifi::provenance::ProvenanceReporter] [debug] Prove
reporter now 1
[2017-11-06 19:18:58.226] [org::apache::nifi::minifi::ResourceClaim] [debug]
Resource Claim created ./content_repository/1510012452125-15001
[2017-11-06 19:18:58.226]
[org::apache::nifi::minifi::core::repository::VolatileContentRepository]
[debug] enter write for ./content_repository/1510012452125-15001
[2017-11-06 19:18:58.227]
[org::apache::nifi::minifi::core::repository::VolatileContentRepository]
[debug] write returns nullptr ./content_repository/1510012452125-15001 15000
[2017-11-06 19:18:58.227] [org::apache::nifi::minifi::core::ProcessSession]
[debug] ProcessSession rollback for GetFeedURLs
[2017-11-06 19:18:58.227] [org::apache::nifi::minifi::FlowFileRecord] [debug]
Delete FlowFile UUID 3f719390-c351-11e7-9901-bc5ff43a885b
{code}
> Insufficient space in atomic entry error, after running for a while
> -------------------------------------------------------------------
>
> Key: MINIFICPP-293
> URL: https://issues.apache.org/jira/browse/MINIFICPP-293
> Project: NiFi MiNiFi C++
> Issue Type: Bug
> Reporter: Andrew Christianson
> Assignee: marco polo
> Attachments: example.tar.xz, logs.tar.xz
>
>
> I have a flow that looks like this:
> {code}
> # Licensed to the Apache Software Foundation (ASF) under one or more
> # contributor license agreements. See the NOTICE file distributed with
> # this work for additional information regarding copyright ownership.
> # The ASF licenses this file to You under the Apache License, Version 2.0
> # (the \"License\"); you may not use this file except in compliance with
> # the License. You may obtain a copy of the License at
> #
> # http://www.apache.org/licenses/LICENSE-2.0
> #
> # Unless required by applicable law or agreed to in writing, software
> # distributed under the License is distributed on an \"AS IS\" BASIS,
> # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
> # See the License for the specific language governing permissions and
> # limitations under the License.
> Flow Controller:
> name: MiNiFi Flow
> Processors:
> - name: GetFeedURLs
> class: org.apache.nifi.processors.standard.GetFile
> scheduling strategy: TIMER_DRIVEN
> max concurrent tasks: 1
> scheduling period: 1 sec
> #scheduling period: 100 ms
> auto-terminated relationships list:
> - failure
> Properties:
> Input Directory: data/rss/feeds
> Keep Source File: true
> #File Filter: "/url$"
> - name: ExtractURL
> class: org.apache.nifi.processors.standard.ExtractText
> auto-terminated relationships list:
> - failure
> Properties:
> Attribute: feed_url
> - name: PaceFetch
> class: org.apache.nifi.processors.standard.ExecuteScript
> auto-terminated relationships list:
> - failure
> Properties:
> Script Engine: lua
> Script File: conf/PaceFetch.lua
> - name: FetchFeed
> class: org.apache.nifi.processors.standard.ExecuteScript
> max concurrent tasks: 5
> auto-terminated relationships list:
> - failure
> Properties:
> Script Engine: python
> Script File: conf/ExecA.py
> - name: LogEntryAttributes
> class: org.apache.nifi.processors.standard.LogAttribute
> auto-terminated relationships list:
> - failure
> - name: PutEntry
> class: org.apache.nifi.processors.standard.PutFile
> auto-terminated relationships list:
> - success
> - failure
> Properties:
> Directory: data
> Conflict Resolution Strategy: ignore
> Connections:
> - name: A
> source name: GetFeedURLs
> source relationship name: success
> destination name: ExtractURL
> - name: B
> source name: ExtractURL
> source relationship name: success
> destination name: PaceFetch
> - name: C
> source name: PaceFetch
> source relationship name: success
> destination name: FetchFeed
> - name: D
> source name: FetchFeed
> source relationship name: success
> destination name: LogEntryAttributes
> - name: E
> source name: LogEntryAttributes
> source relationship name: success
> destination name: PutEntry
> Remote Processing Groups: []
> Provenance Reporting:
> {code}
> After it runs for a while (hour or two), the flow stops fully working, and
> dumps this out in the DEBUG logs:
> {code}
> [2017-11-06 11:37:57.063] [org::apache::nifi::minifi::core::ProcessSession]
> [debug] Create FlowFile with UUID d81b1832-c310-11e7-a858-bc5ff43a885b
> [2017-11-06 11:37:57.063]
> [org::apache::nifi::minifi::provenance::ProvenanceReporter] [debug] Prove
> reporter now 3
> [2017-11-06 11:37:57.063] [org::apache::nifi::minifi::ResourceClaim] [debug]
> Resource Claim created ./content_repository/1509982623798-8558
> [2017-11-06 11:37:57.063]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] enter write for ./content_repository/1509982623798-8558
> [2017-11-06 11:37:57.063]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] Minimize locking
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::io::AtomicEntryStream<std::shared_ptr<org::apache::nifi::minifi::ResourceClaim>
> > ()] [debug] Cannot insert 46 bytes due to insufficient space in atomic
> entry
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::io::AtomicEntryStream<std::shared_ptr<org::apache::nifi::minifi::ResourceClaim>
> > ()] [debug] Decrementing
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::ProcessSession]
> [debug] Caught Exception File Operation:File Import Error
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::processors::GetFile]
> [debug] GetFile Caught Exception File Operation:File Import Error
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::Processor]
> [debug] Caught Exception File Operation:File Import Error
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug]
> Delete FlowFile UUID d81b1832-c310-11e7-a858-bc5ff43a885b
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug]
> Delete FlowFile UUID d81af500-c310-11e7-a858-bc5ff43a885b
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug]
> Delete Resource Claim ./content_repository/1509982623798-8557
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] enter remove for ./content_repository/1509982623798-8557, reducing
> 7864286
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] removed ./content_repository/1509982623798-8557
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] Remove for ./content_repository/1509982623798-8557, reduced to 7864257
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::ProcessSession]
> [debug] ProcessSession rollback for GetFeedURLs
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::SchedulingAgent]
> [debug] Caught Exception File Operation:File Import Error
> {code}
> From the logs, it looks like GetFile is where the flow starts breaking.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
