[
https://issues.apache.org/jira/browse/NIFI-16271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18121890#comment-18121890
]
ASF subversion and git services commented on NIFI-16271:
--------------------------------------------------------
Commit a09d868a52f615a412c773eaa2a82ac59dedf658 in nifi's branch
refs/heads/main from Mark Payne
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=a09d868a52f ]
NIFI-16271 Allow Stateless Process Groups to buffer FlowFile content in memory
(#11676)
* NIFI-16271 Allow Stateless Process Groups to buffer FlowFile content in memory
Adds a Stateless Content Storage Location (INHERITED, CONTENT_REPOSITORY,
IN_MEMORY) to Process Groups so that a Process Group running on the Stateless
Execution Engine can buffer FlowFile content in memory instead of writing to
the Content Repository.
- Thread the value through the ProcessGroup interface, StandardProcessGroup
(get/set/resolve/verify), DTO, DtoFactory, DAO, flow mapping and flow
synchronization, mirroring executionEngine.
- Defer the Stateless engine's ContentRepository selection until the group
starts via DeferredStatelessContentRepository, so the configured location is
honored (the group node is created before configuration is applied). When
resolved to IN_MEMORY, a ByteArrayContentRepository buffers content in
memory; otherwise the NiFi Content Repository is used.
- Restrict IN_MEMORY to Process Groups that are disconnected from all other
components so content never crosses repositories: reject setting IN_MEMORY
when the group has incoming/outgoing connections, and reject connecting into
or out of a group configured to buffer content in memory.
- Add the FlowFile Content Storage selector to the edit-process-group dialog,
shown when the Execution Engine is Stateless.
- Add StandardProcessGroup unit tests and StatelessInMemoryContentIT system
tests (in-memory processing with an on-disk Content Repository scan proving
nothing is written to disk, plus the connection and inheritance constraints).
> Update framework to allow FlowFile content to be stored in-memory for
> Stateless groups
> --------------------------------------------------------------------------------------
>
> Key: NIFI-16271
> URL: https://issues.apache.org/jira/browse/NIFI-16271
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Core Framework
> Reporter: Mark Payne
> Assignee: Mark Payne
> Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
