[
https://issues.apache.org/jira/browse/MINIFICPP-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17909619#comment-17909619
]
Shivani commented on MINIFICPP-2507:
------------------------------------
Appreciate your quick response [~fgerlits], we are also leveraging the
_Recursive lookup_ property in TailFile to ensure that it matches the file
regex in sub directories. However, due to the large number of folders and
subdirectories in our use case, the TailFile performance is significantly slow.
Additionally, we also use _Initial Start Position_ as Current Time. However, we
have noticed that as the number of files the TailFile processor has to track
increases, the performance is severely impacted, even when the file sizes are
not very significant.
Therefore, I opened this issue in the hope of receiving some assistance.
> TailFile "tail-base-directory" property should support Wildcards
> ----------------------------------------------------------------
>
> Key: MINIFICPP-2507
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2507
> Project: Apache NiFi MiNiFi C++
> Issue Type: Improvement
> Reporter: Shivani
> Priority: Major
>
> Currently, the _File to Tail_ property supports wildcards but is limited to a
> specific directory. Requesting an enhancement that allows specifying a regex
> pattern in the parent directory of the _tail-base-directory_ property.
> While it is possible to use multiple TailFile processors as a workaround to
> achieve this, it is often not feasible due to the potentially exhaustive and
> indeterministic list of files that need to be monitored.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
