[
https://issues.apache.org/jira/browse/MINIFICPP-293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250650#comment-16250650
]
ASF GitHub Bot commented on MINIFICPP-293:
------------------------------------------
GitHub user phrocker opened a pull request:
https://github.com/apache/nifi-minifi-cpp/pull/186
MINIFICPP-293: Update repos
MINIFICPP-293: Fix some potential issues with decrement. MINIFICPP-295:
remove new/delete char buffer
Thank you for submitting a contribution to Apache NiFi - MiNiFi C++.
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
### For all changes:
- [ ] Is there a JIRA ticket associated with this PR? Is it referenced
in the commit message?
- [ ] Does your PR title start with MINIFI-XXXX where XXXX is the JIRA
number you are trying to resolve? Pay particular attention to the hyphen "-"
character.
- [ ] Has your PR been rebased against the latest commit within the target
branch (typically master)?
- [ ] Is your initial contribution a single, squashed commit?
### For code changes:
- [ ] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the LICENSE file?
- [ ] If applicable, have you updated the NOTICE file?
### For documentation related changes:
- [ ] Have you ensured that format looks appropriate for the output in
which it is rendered?
### Note:
Please ensure that once the PR is submitted, you check travis-ci for build
issues and submit an update to your PR as soon as possible.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/phrocker/nifi-minifi-cpp MINIFICPP-293
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/nifi-minifi-cpp/pull/186.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #186
----
commit 75564307395f4bd9d14ee12abeb22f5da28c0e96
Author: Marc Parisi <[email protected]>
Date: 2017-11-06T20:22:49Z
MINIFICPP-293: Update repos
MINIFICPP-293: Fix some potential issues with decrement. MINIFICPP-295:
remove new/delete char buffer
----
> Insufficient space in atomic entry error, after running for a while
> -------------------------------------------------------------------
>
> Key: MINIFICPP-293
> URL: https://issues.apache.org/jira/browse/MINIFICPP-293
> Project: NiFi MiNiFi C++
> Issue Type: Bug
> Reporter: Andrew Christianson
> Assignee: marco polo
> Attachments: example.tar.xz, logs.tar.xz
>
>
> I have a flow that looks like this:
> {code}
> # Licensed to the Apache Software Foundation (ASF) under one or more
> # contributor license agreements. See the NOTICE file distributed with
> # this work for additional information regarding copyright ownership.
> # The ASF licenses this file to You under the Apache License, Version 2.0
> # (the \"License\"); you may not use this file except in compliance with
> # the License. You may obtain a copy of the License at
> #
> # http://www.apache.org/licenses/LICENSE-2.0
> #
> # Unless required by applicable law or agreed to in writing, software
> # distributed under the License is distributed on an \"AS IS\" BASIS,
> # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
> # See the License for the specific language governing permissions and
> # limitations under the License.
> Flow Controller:
> name: MiNiFi Flow
> Processors:
> - name: GetFeedURLs
> class: org.apache.nifi.processors.standard.GetFile
> scheduling strategy: TIMER_DRIVEN
> max concurrent tasks: 1
> scheduling period: 1 sec
> #scheduling period: 100 ms
> auto-terminated relationships list:
> - failure
> Properties:
> Input Directory: data/rss/feeds
> Keep Source File: true
> #File Filter: "/url$"
> - name: ExtractURL
> class: org.apache.nifi.processors.standard.ExtractText
> auto-terminated relationships list:
> - failure
> Properties:
> Attribute: feed_url
> - name: PaceFetch
> class: org.apache.nifi.processors.standard.ExecuteScript
> auto-terminated relationships list:
> - failure
> Properties:
> Script Engine: lua
> Script File: conf/PaceFetch.lua
> - name: FetchFeed
> class: org.apache.nifi.processors.standard.ExecuteScript
> max concurrent tasks: 5
> auto-terminated relationships list:
> - failure
> Properties:
> Script Engine: python
> Script File: conf/ExecA.py
> - name: LogEntryAttributes
> class: org.apache.nifi.processors.standard.LogAttribute
> auto-terminated relationships list:
> - failure
> - name: PutEntry
> class: org.apache.nifi.processors.standard.PutFile
> auto-terminated relationships list:
> - success
> - failure
> Properties:
> Directory: data
> Conflict Resolution Strategy: ignore
> Connections:
> - name: A
> source name: GetFeedURLs
> source relationship name: success
> destination name: ExtractURL
> - name: B
> source name: ExtractURL
> source relationship name: success
> destination name: PaceFetch
> - name: C
> source name: PaceFetch
> source relationship name: success
> destination name: FetchFeed
> - name: D
> source name: FetchFeed
> source relationship name: success
> destination name: LogEntryAttributes
> - name: E
> source name: LogEntryAttributes
> source relationship name: success
> destination name: PutEntry
> Remote Processing Groups: []
> Provenance Reporting:
> {code}
> After it runs for a while (hour or two), the flow stops fully working, and
> dumps this out in the DEBUG logs:
> {code}
> [2017-11-06 11:37:57.063] [org::apache::nifi::minifi::core::ProcessSession]
> [debug] Create FlowFile with UUID d81b1832-c310-11e7-a858-bc5ff43a885b
> [2017-11-06 11:37:57.063]
> [org::apache::nifi::minifi::provenance::ProvenanceReporter] [debug] Prove
> reporter now 3
> [2017-11-06 11:37:57.063] [org::apache::nifi::minifi::ResourceClaim] [debug]
> Resource Claim created ./content_repository/1509982623798-8558
> [2017-11-06 11:37:57.063]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] enter write for ./content_repository/1509982623798-8558
> [2017-11-06 11:37:57.063]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] Minimize locking
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::io::AtomicEntryStream<std::shared_ptr<org::apache::nifi::minifi::ResourceClaim>
> > ()] [debug] Cannot insert 46 bytes due to insufficient space in atomic
> entry
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::io::AtomicEntryStream<std::shared_ptr<org::apache::nifi::minifi::ResourceClaim>
> > ()] [debug] Decrementing
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::ProcessSession]
> [debug] Caught Exception File Operation:File Import Error
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::processors::GetFile]
> [debug] GetFile Caught Exception File Operation:File Import Error
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::Processor]
> [debug] Caught Exception File Operation:File Import Error
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug]
> Delete FlowFile UUID d81b1832-c310-11e7-a858-bc5ff43a885b
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug]
> Delete FlowFile UUID d81af500-c310-11e7-a858-bc5ff43a885b
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::FlowFileRecord] [debug]
> Delete Resource Claim ./content_repository/1509982623798-8557
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] enter remove for ./content_repository/1509982623798-8557, reducing
> 7864286
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] removed ./content_repository/1509982623798-8557
> [2017-11-06 11:37:57.064]
> [org::apache::nifi::minifi::core::repository::VolatileContentRepository]
> [debug] Remove for ./content_repository/1509982623798-8557, reduced to 7864257
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::core::ProcessSession]
> [debug] ProcessSession rollback for GetFeedURLs
> [2017-11-06 11:37:57.064] [org::apache::nifi::minifi::SchedulingAgent]
> [debug] Caught Exception File Operation:File Import Error
> {code}
> From the logs, it looks like GetFile is where the flow starts breaking.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
