[
https://issues.apache.org/jira/browse/CAMEL-13400?focusedWorklogId=245823&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-245823
]
ASF GitHub Bot logged work on CAMEL-13400:
------------------------------------------
Author: ASF GitHub Bot
Created on: 21/May/19 07:54
Start Date: 21/May/19 07:54
Worklog Time Spent: 10m
Work Description: davsclaus commented on pull request #2931: CAMEL-13400
Camel FTP Cannot list directory with 'File not found' prepending additional '/'
in front of directory automatically
URL: https://github.com/apache/camel/pull/2931
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 245823)
Time Spent: 20m (was: 10m)
> Camel FTP Cannot list directory with 'File not found' prepending additional
> '/' in front of directory automatically
> -------------------------------------------------------------------------------------------------------------------
>
> Key: CAMEL-13400
> URL: https://issues.apache.org/jira/browse/CAMEL-13400
> Project: Camel
> Issue Type: Bug
> Components: camel-ftp
> Affects Versions: 3.0.0-M1
> Reporter: Vidhya Sagar Jeevendran
> Priority: Major
> Fix For: 3.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I need to poll files form a dynamic folder based on a specific date, so I
> have provided the parent directory in endpoint URI, enabled recursive flag
> and add filterDirectory accordingly. But It is not able to poll from the
> directory, it says file not found for that directory. It is trying with an
> addition '/' while listing {{listFor(/XXXX)}}
> *Endpoint URI*
> {{sftp://XXXX:22051?connectTimeout=90000&disconnect=true&filterDirectory=%24%7Bfile%3Aname%7D+starts+with+%27%24%7Bbean%3AdateofExchange%3Fmethod%3DforLoc%28%22MY%22%29%7D%27&flatten=true&include=.*IMG&knownHostsFile=C%3A%5Cprogram+files%5Cascertain%5CI2R-MystiQ-Engine%5Cknown_hosts&noop=true&password=xxxxxx&preferredAuthentications=password&reconnectDelay=30000&recursive=true&scheduler=quartz2&scheduler.cron=0+0%2F5+*+*+*+%3F&stepwise=false&username=XXXX_ftpuser
> }}
> *TRACE LOG*
> {{TRACE 2019-04-05T15:25:03,389
> [org.apache.camel.component.file.remote.SftpConsumer] - Polling directory:
> TRACE 2019-04-05T15:25:03,389
> [org.apache.camel.component.file.remote.SftpOperations] - listFiles() TRACE
> 2019-04-05T15:25:03,712 [org.apache.camel.component.file.remote.SftpConsumer]
> - Found 12 in directory: TRACE 2019-04-05T15:25:03,712
> [org.apache.camel.component.file.remote.SftpConsumer] - SftpFile[fileName=.,
> longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12 05:27 ., dir=true] TRACE
> 2019-04-05T15:25:03,712 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file: RemoteFile[.] TRACE
> 2019-04-05T15:25:03,712 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=.., longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 03:04 .., dir=true] TRACE 2019-04-05T15:25:03,712
> [org.apache.camel.component.file.remote.SftpConsumer] - File did not match.
> Will skip this file: RemoteFile[..] TRACE 2019-04-05T15:25:03,728
> [org.apache.camel.component.file.remote.SftpConsumer] -
> SftpFile[fileName=20170526, longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 02:16 20170526, dir=true] TRACE 2019-04-05T15:25:04,413
> [org.apache.camel.component.file.remote.SftpConsumer] - File did not match.
> Will skip this file: RemoteFile[20170526] TRACE 2019-04-05T15:25:04,413
> [org.apache.camel.component.file.remote.SftpConsumer] -
> SftpFile[fileName=20181119, longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 05:24 20181119, dir=true] TRACE 2019-04-05T15:25:05,117
> [org.apache.camel.component.file.remote.SftpConsumer] - File did not match.
> Will skip this file: RemoteFile[20181119] TRACE 2019-04-05T15:25:05,117
> [org.apache.camel.component.file.remote.SftpConsumer] -
> SftpFile[fileName=20181121, longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 05:25 20181121, dir=true] TRACE 2019-04-05T15:25:05,837
> [org.apache.camel.component.file.remote.SftpConsumer] - File did not match.
> Will skip this file: RemoteFile[20181121] TRACE 2019-04-05T15:25:05,840
> [org.apache.camel.component.file.remote.SftpConsumer] -
> SftpFile[fileName=20181122, longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 05:26 20181122, dir=true] TRACE 2019-04-05T15:25:06,561
> [org.apache.camel.component.file.remote.SftpConsumer] - File did not match.
> Will skip this file: RemoteFile[20181122] TRACE 2019-04-05T15:25:06,563
> [org.apache.camel.component.file.remote.SftpConsumer] -
> SftpFile[fileName=20181123, longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 05:27 20181123, dir=true] TRACE 2019-04-05T15:25:07,258
> [org.apache.camel.component.file.remote.SftpConsumer] - Polling sub
> directory: /20181123 from:
> sftp://XXXX:22051?connectTimeout=90000&disconnect=true&filterDirectory=%24%7Bfile%3Aname%7D+starts+with+%27%24%7Bbean%3AdateofExchange%3Fmethod%3DforLoc%28%22MY%22%29%7D%27&flatten=true&include=.*IMG&knownHostsFile=C%3A%5Cprogram+files%5Cascertain%5CI2R-MystiQ-Engine%5Cknown_hosts&noop=true&password=xxxxxx&preferredAuthentications=password&reconnectDelay=30000&recursive=true&scheduler=quartz2&scheduler.cron=0+0%2F5+*+*+*+%3F&stepwise=false&username=XXXX_ftpuser
> TRACE 2019-04-05T15:25:07,260
> [org.apache.camel.component.file.remote.SftpConsumer] - doPollDirectory from
> absolutePath: /20181123, dirName: 20181123 TRACE 2019-04-05T15:25:07,263
> [org.apache.camel.component.file.remote.SftpConsumer] - Polling directory:
> /20181123 TRACE 2019-04-05T15:25:07,265
> [org.apache.camel.component.file.remote.SftpOperations] -
> listFiles(/20181123) DEBUG 2019-04-05T15:25:07,281
> [org.apache.camel.component.file.remote.SftpConsumer] - Caught exception
> Cannot list directory: /20181123 TRACE 2019-04-05T15:25:07,297
> [org.apache.camel.component.file.remote.SftpConsumer] - Not ignoring file
> error Cannot list directory: /20181123 for /20181123 DEBUG
> 2019-04-05T15:25:07,297 [org.apache.camel.component.file.remote.SftpConsumer]
> - Error occurred during poll directory: due Cannot list directory: /20181123.
> Removing 0 files marked as in-progress. WARN 2019-04-05T15:25:07,297
> [org.apache.camel.component.file.remote.RemoteFilePollingConsumerPollStrategy]
> - Trying to recover by force disconnecting from remote server and
> re-connecting at next poll: sftp://XXX@1XXXX:22051 DEBUG
> 2019-04-05T15:25:07,297 [org.apache.camel.component.file.remote.SftpConsumer]
> - Force disconnecting from: sftp://XXX@XXXX:22051 WARN
> 2019-04-05T15:25:07,297 [org.apache.camel.component.file.remote.SftpConsumer]
> - Consumer
> SftpConsumer[sftp://XXXX:22051?connectTimeout=90000&disconnect=true&filterDirectory=%24%7Bfile%3Aname%7D+starts+with+%27%24%7Bbean%3AdateofExchange%3Fmethod%3DforLoc%28%22MY%22%29%7D%27&flatten=true&include=.*IMG&knownHostsFile=C%3A%5Cprogram+files%5Cascertain%5CI2R-MystiQ-Engine%5Cknown_hosts&noop=true&password=xxxxxx&preferredAuthentications=password&reconnectDelay=30000&recursive=true&scheduler=quartz2&scheduler.cron=0+0%2F5+*+*+*+%3F&stepwise=false&username=XXXX_ftpuser]
> failed polling endpoint:
> sftp://XXXX:22051?connectTimeout=90000&disconnect=true&filterDirectory=%24%7Bfile%3Aname%7D+starts+with+%27%24%7Bbean%3AdateofExchange%3Fmethod%3DforLoc%28%22MY%22%29%7D%27&flatten=true&include=.*IMG&knownHostsFile=C%3A%5Cprogram+files%5Cascertain%5CI2R-MystiQ-Engine%5Cknown_hosts&noop=true&password=xxxxxx&preferredAuthentications=password&reconnectDelay=30000&recursive=true&scheduler=quartz2&scheduler.cron=0+0%2F5+*+*+*+%3F&stepwise=false&username=XXXX_ftpuser.
> Will try again at next poll. Caused by:
> [org.apache.camel.component.file.GenericFileOperationFailedException - Cannot
> list directory: /20181123]
> org.apache.camel.component.file.GenericFileOperationFailedException: Cannot
> list directory: /20181123 at
> org.apache.camel.component.file.remote.SftpOperations.listFiles(SftpOperations.java:660)
> ~[camel-ftp-2.21.1.jar!/:2.21.1] at
> org.apache.camel.component.file.remote.SftpConsumer.doPollDirectory(SftpConsumer.java:128)
> ~[camel-ftp-2.21.1.jar!/:2.21.1] at
> org.apache.camel.component.file.remote.RemoteFileConsumer.doSafePollSubDirectory(RemoteFileConsumer.java:260)
> ~[camel-ftp-2.21.1.jar!/:2.21.1] at
> org.apache.camel.component.file.remote.SftpConsumer.pollSubDirectory(SftpConsumer.java:96)
> ~[camel-ftp-2.21.1.jar!/:2.21.1] at
> org.apache.camel.component.file.remote.SftpConsumer.doPollDirectory(SftpConsumer.java:178)
> ~[camel-ftp-2.21.1.jar!/:2.21.1] at
> org.apache.camel.component.file.remote.SftpConsumer.pollDirectory(SftpConsumer.java:87)
> ~[camel-ftp-2.21.1.jar!/:2.21.1] at
> org.apache.camel.component.file.GenericFileConsumer.poll(GenericFileConsumer.java:124)
> ~[camel-core-2.21.1.jar!/:2.21.1] at
> org.apache.camel.impl.ScheduledPollConsumer.doRun(ScheduledPollConsumer.java:174)
> [camel-core-2.21.1.jar!/:2.21.1] at
> org.apache.camel.impl.ScheduledPollConsumer.run(ScheduledPollConsumer.java:101)
> [camel-core-2.21.1.jar!/:2.21.1] at
> org.apache.camel.pollconsumer.quartz2.QuartzScheduledPollConsumerJob.execute(QuartzScheduledPollConsumerJob.java:61)
> [camel-quartz2-2.21.1.jar!/:2.21.1] at
> org.quartz.core.JobRunShell.run(JobRunShell.java:202) [quartz-2.3.0.jar!/:?]
> at
> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573)
> [quartz-2.3.0.jar!/:?] Caused by: com.jcraft.jsch.SftpException: File not
> found: /20181123 at
> com.jcraft.jsch.ChannelSftp.throwStatusError(ChannelSftp.java:2873)
> ~[jsch-0.1.54.jar!/:?] at
> com.jcraft.jsch.ChannelSftp._stat(ChannelSftp.java:2225)
> ~[jsch-0.1.54.jar!/:?] at
> com.jcraft.jsch.ChannelSftp._stat(ChannelSftp.java:2242)
> ~[jsch-0.1.54.jar!/:?] at
> com.jcraft.jsch.ChannelSftp.ls(ChannelSftp.java:1592) ~[jsch-0.1.54.jar!/:?]
> at com.jcraft.jsch.ChannelSftp.ls(ChannelSftp.java:1553)
> ~[jsch-0.1.54.jar!/:?] at
> org.apache.camel.component.file.remote.SftpOperations.listFiles(SftpOperations.java:651)
> ~[camel-ftp-2.21.1.jar!/:2.21.1] ... 11 more }}
> When I try to hardcode that folder along with endpint URI, it simply can list
> that directory and poll files. This time there is no '/' before the directory
> while listing {{listFor(XXXX)}}
> *Endpoint URI*
> {{sftp://XXXX:22051/20181123?connectTimeout=90000&disconnect=true&flatten=true&include=.*IMG&knownHostsFile=C%3A%5Cprogram+files%5Cascertain%5CI2R-MystiQ-Engine%5Cknown_hosts&noop=true&password=xxxxxx&preferredAuthentications=password&reconnectDelay=30000&recursive=true&scheduler=quartz2&scheduler.cron=0+0%2F5+*+*+*+%3F&separator=Auto&stepwise=false&username=XXXX_ftpuser
> }}
> *TRACE LOG*
> {{TRACE 2019-04-05T18:40:00,009
> [org.apache.camel.component.file.remote.SftpConsumer] - prePollCheck on
> sftp://XXX@XXXX:22051 DEBUG 2019-04-05T18:40:00,009
> [org.apache.camel.component.file.remote.SftpConsumer] - Not connected/logged
> in, connecting to: sftp://XXX@XXXX:22051 TRACE 2019-04-05T18:40:00,009
> [org.apache.camel.component.file.remote.SftpOperations] - Session isn't
> connected, trying to recreate and connect. DEBUG 2019-04-05T18:40:00,009
> [org.apache.camel.component.file.remote.SftpOperations] - Using knownhosts
> file: C:\program files\ascertain\I2R-MystiQ-Engine\known_hosts DEBUG
> 2019-04-05T18:40:00,009
> [org.apache.camel.component.file.remote.SftpOperations] - Using known hosts
> information from file: C:\program
> files\ascertain\I2R-MystiQ-Engine\known_hosts DEBUG 2019-04-05T18:40:00,025
> [org.apache.camel.component.file.remote.SftpOperations] - Using
> StrickHostKeyChecking: no DEBUG 2019-04-05T18:40:00,025
> [org.apache.camel.component.file.remote.SftpOperations] - Using
> PreferredAuthentications: password TRACE 2019-04-05T18:40:00,025
> [org.apache.camel.component.file.remote.SftpOperations] - Connecting use
> connectTimeout: 90000 ... TRACE 2019-04-05T18:40:00,465
> [org.apache.camel.component.file.remote.SftpOperations] - Channel isn't
> connected, trying to recreate and connect. TRACE 2019-04-05T18:40:00,465
> [org.apache.camel.component.file.remote.SftpOperations] - Connecting use
> connectTimeout: 90000 ... DEBUG 2019-04-05T18:40:01,215
> [org.apache.camel.component.file.remote.SftpOperations] - Connected to
> sftp://XXX@XXXX:22051 DEBUG 2019-04-05T18:40:01,215
> [org.apache.camel.component.file.remote.SftpConsumer] - Connected and logged
> in to: sftp://XXX@XXXX:22051 TRACE 2019-04-05T18:40:01,215
> [org.apache.camel.component.file.remote.SftpConsumer] - doPollDirectory from
> absolutePath: 20181123, dirName: null TRACE 2019-04-05T18:40:01,215
> [org.apache.camel.component.file.remote.SftpConsumer] - Polling directory:
> 20181123 TRACE 2019-04-05T18:40:01,215
> [org.apache.camel.component.file.remote.SftpOperations] - listFiles(20181123)
> TRACE 2019-04-05T18:40:02,621
> [org.apache.camel.component.file.remote.SftpConsumer] - Found 6 in directory:
> 20181123 TRACE 2019-04-05T18:40:02,621
> [org.apache.camel.component.file.remote.SftpConsumer] - SftpFile[fileName=.,
> longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12 05:27 ., dir=true] TRACE
> 2019-04-05T18:40:02,621 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file: RemoteFile[.] TRACE
> 2019-04-05T18:40:02,637 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=.., longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 05:27 .., dir=true] TRACE 2019-04-05T18:40:02,637
> [org.apache.camel.component.file.remote.SftpConsumer] - File did not match.
> Will skip this file: RemoteFile[..] TRACE 2019-04-05T18:40:02,637
> [org.apache.camel.component.file.remote.SftpConsumer] -
> SftpFile[fileName=Consolidated, longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar
> 12 05:26 Consolidated, dir=true] TRACE 2019-04-05T18:40:02,637
> [org.apache.camel.component.file.remote.SftpConsumer] - Polling sub
> directory: 20181123/Consolidated from:
> sftp://XXXX:22051/20181123?connectTimeout=90000&disconnect=true&flatten=true&include=.*IMG&knownHostsFile=C%3A%5Cprogram+files%5Cascertain%5CI2R-MystiQ-Engine%5Cknown_hosts&noop=true&password=xxxxxx&preferredAuthentications=password&reconnectDelay=30000&recursive=true&scheduler=quartz2&scheduler.cron=0+0%2F5+*+*+*+%3F&separator=Auto&stepwise=false&username=XXXX_ftpuser
> TRACE 2019-04-05T18:40:02,637
> [org.apache.camel.component.file.remote.SftpConsumer] - doPollDirectory from
> absolutePath: 20181123/Consolidated, dirName: Consolidated TRACE
> 2019-04-05T18:40:02,637 [org.apache.camel.component.file.remote.SftpConsumer]
> - Polling directory: 20181123/Consolidated TRACE 2019-04-05T18:40:02,637
> [org.apache.camel.component.file.remote.SftpOperations] -
> listFiles(20181123/Consolidated) TRACE 2019-04-05T18:40:02,715
> [org.apache.camel.component.file.remote.SftpConsumer] - Found 5 in directory:
> 20181123/Consolidated TRACE 2019-04-05T18:40:02,715
> [org.apache.camel.component.file.remote.SftpConsumer] - SftpFile[fileName=.,
> longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12 05:26 ., dir=true] TRACE
> 2019-04-05T18:40:02,715 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file: RemoteFile[Consolidated/.] TRACE
> 2019-04-05T18:40:02,715 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=.., longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 05:27 .., dir=true] TRACE 2019-04-05T18:40:02,715
> [org.apache.camel.component.file.remote.SftpConsumer] - File did not match.
> Will skip this file: RemoteFile[Consolidated/..] TRACE
> 2019-04-05T18:40:02,715 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=20181124020438943_021420181123INW.MYR,
> longName=-r-x------ 1 ftpadmin ftpadmin 408097 Nov 23 2018
> 20181124020438943_021420181123INW.MYR, dir=false] TRACE
> 2019-04-05T18:40:02,731 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file:
> RemoteFile[Consolidated/20181124020438943_021420181123INW.MYR] TRACE
> 2019-04-05T18:40:02,731 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=20181124020439099_035820181123INW.MYR,
> longName=-r-x------ 1 ftpadmin ftpadmin 21689 Nov 23 2018
> 20181124020439099_035820181123INW.MYR, dir=false] TRACE
> 2019-04-05T18:40:02,731 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file:
> RemoteFile[Consolidated/20181124020439099_035820181123INW.MYR] TRACE
> 2019-04-05T18:40:02,731 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=ToPPay, longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 06:41 ToPPay, dir=true] TRACE 2019-04-05T18:40:02,731
> [org.apache.camel.component.file.remote.SftpConsumer] - Polling sub
> directory: 20181123/Consolidated/ToPPay from:
> sftp://XXXX:22051/20181123?connectTimeout=90000&disconnect=true&flatten=true&include=.*IMG&knownHostsFile=C%3A%5Cprogram+files%5Cascertain%5CI2R-MystiQ-Engine%5Cknown_hosts&noop=true&password=xxxxxx&preferredAuthentications=password&reconnectDelay=30000&recursive=true&scheduler=quartz2&scheduler.cron=0+0%2F5+*+*+*+%3F&separator=Auto&stepwise=false&username=XXXX_ftpuser
> TRACE 2019-04-05T18:40:02,731
> [org.apache.camel.component.file.remote.SftpConsumer] - doPollDirectory from
> absolutePath: 20181123/Consolidated/ToPPay, dirName: ToPPay TRACE
> 2019-04-05T18:40:02,731 [org.apache.camel.component.file.remote.SftpConsumer]
> - Polling directory: 20181123/Consolidated/ToPPay TRACE
> 2019-04-05T18:40:02,731
> [org.apache.camel.component.file.remote.SftpOperations] -
> listFiles(20181123/Consolidated/ToPPay) TRACE 2019-04-05T18:40:02,777
> [org.apache.camel.component.file.remote.SftpConsumer] - Found 8 in directory:
> 20181123/Consolidated/ToPPay TRACE 2019-04-05T18:40:02,777
> [org.apache.camel.component.file.remote.SftpConsumer] - SftpFile[fileName=.,
> longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12 06:41 ., dir=true] TRACE
> 2019-04-05T18:40:02,777 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file: RemoteFile[Consolidated/ToPPay/.]
> TRACE 2019-04-05T18:40:02,777
> [org.apache.camel.component.file.remote.SftpConsumer] - SftpFile[fileName=..,
> longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12 05:26 .., dir=true] TRACE
> 2019-04-05T18:40:02,777 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file: RemoteFile[Consolidated/ToPPay/..]
> TRACE 2019-04-05T18:40:02,793
> [org.apache.camel.component.file.remote.SftpConsumer] -
> SftpFile[fileName=021420181123INW.MYR, longName=-r-x------ 1 ftpadmin
> ftpadmin 408097 Nov 23 2018 021420181123INW.MYR, dir=false] TRACE
> 2019-04-05T18:40:02,793 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file:
> RemoteFile[Consolidated/ToPPay/021420181123INW.MYR] TRACE
> 2019-04-05T18:40:02,793 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=021420181123INW1.MYR, longName=-r-x------ 1 ftpadmin
> ftpadmin 579829 Nov 23 2018 021420181123INW1.MYR, dir=false] TRACE
> 2019-04-05T18:40:02,793 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file:
> RemoteFile[Consolidated/ToPPay/021420181123INW1.MYR] TRACE
> 2019-04-05T18:40:02,793 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=035820181123INW.MYR, longName=-r-x------ 1 ftpadmin
> ftpadmin 21689 Nov 23 2018 035820181123INW.MYR, dir=false] TRACE
> 2019-04-05T18:40:02,793 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file:
> RemoteFile[Consolidated/ToPPay/035820181123INW.MYR] TRACE
> 2019-04-05T18:40:02,793 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=035820181123INW1.MYR, longName=-r-x------ 1 ftpadmin
> ftpadmin 30954 Nov 23 2018 035820181123INW1.MYR, dir=false] TRACE
> 2019-04-05T18:40:02,793 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file:
> RemoteFile[Consolidated/ToPPay/035820181123INW1.MYR] TRACE
> 2019-04-05T18:40:02,809 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=20181124020438943_021420181123INW.MYR,
> longName=-r-x------ 1 ftpadmin ftpadmin 408097 Nov 23 2018
> 20181124020438943_021420181123INW.MYR, dir=false] TRACE
> 2019-04-05T18:40:02,809 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file:
> RemoteFile[Consolidated/ToPPay/20181124020438943_021420181123INW.MYR] TRACE
> 2019-04-05T18:40:02,809 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=20181124020439099_035820181123INW.MYR,
> longName=-r-x------ 1 ftpadmin ftpadmin 21689 Nov 23 2018
> 20181124020439099_035820181123INW.MYR, dir=false] TRACE
> 2019-04-05T18:40:02,809 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file:
> RemoteFile[Consolidated/ToPPay/20181124020439099_035820181123INW.MYR] TRACE
> 2019-04-05T18:40:02,809 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=Data, longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 05:26 Data, dir=true] TRACE 2019-04-05T18:40:02,809
> [org.apache.camel.component.file.remote.SftpConsumer] - Polling sub
> directory: 20181123/Data from:
> sftp://XXXX:22051/20181123?connectTimeout=90000&disconnect=true&flatten=true&include=.*IMG&knownHostsFile=C%3A%5Cprogram+files%5Cascertain%5CI2R-MystiQ-Engine%5Cknown_hosts&noop=true&password=xxxxxx&preferredAuthentications=password&reconnectDelay=30000&recursive=true&scheduler=quartz2&scheduler.cron=0+0%2F5+*+*+*+%3F&separator=Auto&stepwise=false&username=XXXX_ftpuser
> TRACE 2019-04-05T18:40:02,809
> [org.apache.camel.component.file.remote.SftpConsumer] - doPollDirectory from
> absolutePath: 20181123/Data, dirName: Data TRACE 2019-04-05T18:40:02,809
> [org.apache.camel.component.file.remote.SftpConsumer] - Polling directory:
> 20181123/Data TRACE 2019-04-05T18:40:02,809
> [org.apache.camel.component.file.remote.SftpOperations] -
> listFiles(20181123/Data) TRACE 2019-04-05T18:40:02,871
> [org.apache.camel.component.file.remote.SftpConsumer] - Found 501 in
> directory: 20181123/Data TRACE 2019-04-05T18:40:02,871
> [org.apache.camel.component.file.remote.SftpConsumer] - SftpFile[fileName=.,
> longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12 05:26 ., dir=true] TRACE
> 2019-04-05T18:40:02,871 [org.apache.camel.component.file.remote.SftpConsumer]
> - File did not match. Will skip this file: RemoteFile[Data/.] TRACE
> 2019-04-05T18:40:02,871 [org.apache.camel.component.file.remote.SftpConsumer]
> - SftpFile[fileName=.., longName=dr-x------ 2 ftpadmin ftpadmin 0 Mar 12
> 05:27 .., dir=true] TRACE 2019-04-05T18:40:02,871
> [org.apache.camel.component.file.remote.SftpConsumer] - File did not match.
> Will skip this file: RemoteFile[Data/..] TRACE 2019-04-05T18:40:02,871
> [org.apache.camel.component.file.remote.SftpConsumer] -
> SftpFile[fileName=20181123021401015101004323IWNM.MMYR, longName=-r-x------ 1
> ftpadmin ftpadmin 14846 Nov 23 2018 20181123021401015101004323IWNM.MMYR,
> dir=false] TRACE 2019-04-05T18:40:02,871
> [org.apache.camel.component.file.remote.SftpConsumer] - File did not match.
> Will skip this file: RemoteFile[Data/20181123021401015101004323IWNM.MMYR] }}
> I am sure that the cause of the issue has to be the addition '/' prepending
> with directory name while listing {{listFor(/XXXX)}}. How can I avoid it ! ..
> using {{seperator}} parameter didn't effect i suppose it is only for
> producing files and not for consuming. I need to resolve this issue as soon
> as possible. Please suggest me some solution :(
> *EDITED :*
> I can reproduce the issue in latest version as well,I suppose the issue is
> when there is no base path only the '/' gets prepended which should not
> actually happen
> Code Snippet from SftpConsumer.java Camel 3.0.0.M1
> {{if (file.isDirectory()) \{ RemoteFile<SftpRemoteFile> remote =
> asRemoteFile(absolutePath, file, getEndpoint().getCharset()); if
> (endpoint.isRecursive() && depth < endpoint.getMaxDepth() &&
> isValidFile(remote, true, files)) { // recursive scan and add the sub files
> and folders String subDirectory = file.getFilename(); String path =
> absolutePath + "/" + subDirectory; boolean canPollMore =
> pollSubDirectory(path, subDirectory, fileList, depth); if (!canPollMore) {
> return false; } } // we cannot use file.getAttrs().isLink on Windows, so we
> dont invoke the method // just assuming its a file we should poll } }}
> {quote}String path = absolutePath + "/" + subDirectory;
> {quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
