[ 
https://issues.apache.org/jira/browse/NIFI-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477292#comment-17477292
 ] 

Christoph Langheld commented on NIFI-9577:
------------------------------------------

Hi [~markap14],

thank you.

The template is an example to reproduce the problem.

In our case the workflow is as follows:

At about 0:15 many xml files will be processed and stored under 
tmp/prod/20220117/gaz/artikel (20220117 = current date).

Via CRON the GetFile processor will be called one hour later at 1:15. GetFile 
looks in tmp/prod/${now():format('yyyyMMdd')}/
Path Filter is set to: ((anzg)|(gaz))\/artikel

Here we have the same problem: GetFile lists no files. I have to stop the 
GetFile processor and start it timer driven.
It seems to me, that ${now():format('yyyyMMdd')}/ in Input directory in 
combination with a value in Path filter does not work.
GetFile has no problems, if the Input directory is set to 
tmp/prod/${now():format('yyyyMMdd')}/artikel/gaz and Path filter is empty.

> GetFile and ListFile list no files if Path Filter is not empty
> --------------------------------------------------------------
>
>                 Key: NIFI-9577
>                 URL: https://issues.apache.org/jira/browse/NIFI-9577
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 1.15.2
>            Reporter: Christoph Langheld
>            Priority: Major
>         Attachments: GetFile-ListFile-Problem.xml, workflow.png
>
>
> Hello,
> under special circumstances GetFile and ListFile do not process files.
> To reproduce the problem I attached a template: 
> [^GetFile-ListFile-Problem.xml]
> The template generates every minute (0 0/1 * ? * MON-SAT) a flow file of 10B 
> and stores it locally in a *new* ( ! ) folder: 
> tmp/prod/cltest/${now():format('yyyyMMdd-HHmm')}/gaz/artikel.
> GetFile and ListFile run about 30 seconds after GenerateFlowFile processor(35 
> 0/1 * ? * MON-SAT). For both processors the input directory is: 
> tmp/prod/cltest/${now():format('yyyyMMdd-HHmm')}/.
> Path Filter is set to: ((anzg)|(gaz))\/artikel
> The first time when the processors are running the result set of each 
> processor contains 1 file.
> After the first run the result will always be empty. There occurs no error. 
> It's only empty.
> !workflow.png|width=813,height=449!
> We use NiFi versions 1.11.4 and 1.15.2. Both have the same problem.
> Could you please have a look on it.
> Thank you and regards
> Christoph



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to