[
https://issues.apache.org/jira/browse/NIFI-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486623#comment-17486623
]
David Handermann commented on NIFI-6699:
----------------------------------------
As reported on the NiFi users list, this problem also impacts ListSFTP:
{noformat}
2022-02-03 17:36:45,466 ERROR [Timer-Driven Process Thread-8]
o.a.nifi.processors.standard.ListSFTP
ListSFTP[id=64443154-ac76-1736-9e49-f2ca388dfbdf] Unable to get listing from
*****.gz; skipping: java.io.FileNotFoundException: Could not perform listing on
*****.gz because could not find the file on the remote server
java.io.FileNotFoundException: Could not perform listing on *****.gz because
could not find the file on the remote server
at
org.apache.nifi.processors.standard.util.SFTPTransfer.getListing(SFTPTransfer.java:350)
at
org.apache.nifi.processors.standard.util.SFTPTransfer.getListing(SFTPTransfer.java:365)
at
org.apache.nifi.processors.standard.util.SFTPTransfer.getListing(SFTPTransfer.java:262)
at
org.apache.nifi.processors.standard.ListFileTransfer.performListing(ListFileTransfer.java:120)
at
org.apache.nifi.processors.standard.ListSFTP.performListing(ListSFTP.java:150)
at
org.apache.nifi.processors.standard.ListFileTransfer.performListing(ListFileTransfer.java:112)
at
org.apache.nifi.processor.util.list.AbstractListProcessor.listByTrackingTimestamps(AbstractListProcessor.java:750)
at
org.apache.nifi.processor.util.list.AbstractListProcessor.onTrigger(AbstractListProcessor.java:525)
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1273)
at
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:214)
at
org.apache.nifi.controller.scheduling.AbstractTimeBasedSchedulingAgent.lambda$doScheduleOnce$0(AbstractTimeBasedSchedulingAgent.java:63)
at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
{noformat}
Updating the {{SFTPTransfer}} class to distinguish between a file and directory
when following symbolic links should resolve the problem for both ListSFTP and
GetSFTP.
> GetSFTP for Symbol link files not working
> -----------------------------------------
>
> Key: NIFI-6699
> URL: https://issues.apache.org/jira/browse/NIFI-6699
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.9.2
> Reporter: R.G. Karthic Balaji
> Assignee: David Handermann
> Priority: Major
> Labels: nifi
> Time Spent: 40m
> Remaining Estimate: 0h
>
> I am using NiFi 1.9.2 and when started performing GetSFTP from source having
> a symlink file, I am unable to perform the GetSFTP operation and getting
> below log
>
> I have set the symlink property to true in GetSFTP,
> !https://mail.google.com/mail/u/0?ui=2&ik=d853e70237&attid=0.1&permmsgid=msg-a:r6280950517560155993&th=16d53e3f60b45ae2&view=fimg&sz=s0-l75-ft&attbid=ANGjdJ81rYyKJ4Qhn0m_dD2MSeefZPz8_Wai2zJsUSsLLexUScCSw6XD0m-I4IdvXnRPO1rydaIzudP8PIYCNhdbjl8BgOuqQjGcEWas8m0_YUj6El8VSJz3MLLJgss&disp=emb&realattid=ii_k0tk1sjw1|width=472,height=35!
>
>
> g from /GKBalaajee/input/bulkstat.tgz/bulkstat.tgz; skipping:
> java.io.FileNotFoundException: Could not perform listing on
> /GKBalaajee/input/bulkstat.tgz/bulkstat.tgz because could not find the file
> on the remote server
> java.io.FileNotFoundException: Could not perform listing on
> /GKBalaajee/input/bulkstat.tgz/bulkstat.tgz because could not find the file
> on the remote server
> at
> org.apache.nifi.processors.standard.util.SFTPTransfer.getListing(SFTPTransfer.java:268)
> at
> org.apache.nifi.processors.standard.util.SFTPTransfer.getListing(SFTPTransfer.java:282)
> at
> org.apache.nifi.processors.standard.util.SFTPTransfer.getListing(SFTPTransfer.java:282)
> at
> org.apache.nifi.processors.standard.util.SFTPTransfer.getListing(SFTPTransfer.java:175)
> at
> org.apache.nifi.processors.standard.GetFileTransfer.fetchListing(GetFileTransfer.java:284)
> at
> org.apache.nifi.processors.standard.GetFileTransfer.onTrigger(GetFileTransfer.java:127)
> at
> org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
> at
> org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1162)
> at
> org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:209)
> at
> org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
> at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
