Re: [lftp] lftp issued “CWD /” results in error message but the transfer does not fail

2019-08-26 Thread Alexander Lukyanov
That's correct, omitting the path altogether will do the same.

However, there is a bug in lftp - it does not follow RFC 1738 for ftps URL
scheme. It will be fixed in the next version.

пн, 26 авг. 2019 г. в 18:26, Kevin R. Bulgrien :

> Thanks,  yes, a tilde following works as desired, however, I feel somewhat
> disappointed that I didn't previously think about simply dropping the
> trailing slash from the URL.  For example:
>
> ftps://server.example.net vs. ftps://server.example.net/
>
> --
>
> Kevin R. Bulgrien
>
> ------
>
> *From: *"Alexander Lukyanov" 
> *To: *"Kevin R. Bulgrien" 
> *Cc: *"LFTP Mailing List" 
> *Sent: *Saturday, August 24, 2019 4:39:21 AM
> *Subject: *Re: [lftp] lftp issued “CWD /” results in error message but
> the transfer does not fail
>
> Try adding a tilde at the end of url.
>
> пт, 23 авг. 2019, 18:30 Kevin R. Bulgrien :
>
>> In a scripted and automated process, it seems beneficial to avoid
>> generating unwanted error messages that do not indicate an actual
>> fault, if only to avoid confusion when someone looks at the logs.
>>
>> Given an lftp command similar to the following:
>>
>> lftp -vv -d -c set ssl:ca-file /path/to/cert/ftps_cron-bundle.crt; set
>> ssl:check-hostname no; set ftp:ssl-protect-data true; set
>> sftp:connect-program "ssh -a -x -o PubkeyAuthentication=no"; set
>> net:max-retries 2; open -e 'put /path/to/data/upload.txt;' -u
>> username:password ftps://server.example.net/
>>
>> The command template works on various servers, but, on one server,
>> even though the upload is successful, an error message is shown:
>>
>>    CWD path to be sent is `/'
>>   <--- 200 Command OPTS succeed
>>   ---> CWD /
>>   <--- 550 Permission denied
>>   cd: Access failed: 550 Permission denied (/)
>>
>> How does one prevent lftp from sending CWD / to this server
>>
>>   <--- 230 User logged in
>>   ---> FEAT
>>   <--- 211-Extensions supported
>>   <--- SIZE
>>   <--- XMD5
>>   <--- XSHA1
>>   <--- XSHA256
>>   <--- XSHA512
>>   <--- XQUOTA
>>   <--- LANG EN, ES, FR, GE
>>   <--- MDTM
>>   <--- MLST size*;type*;perm*;create*;modify*;
>>   <--- REST STREAM
>>   <--- TVFS
>>   <--- UTF8
>>   <--- AUTH SSL;TLS-P;
>>   <--- PBSZ
>>   <--- PROT C;P;
>>   <--- 211 end
>>   ---> PWD
>>   <--- 257 "/username/folder" is current directory
>>   ---> PBSZ 0
>>   <--- 200 PBSZ=0
>>   ---> PROT P
>>   <--- 200 PRIVATE data channel protection level set
>>   ---> LANG
>>   <--- 200 Default languages set to EN
>>   ---> OPTS UTF8 ON
>>   <--- 200 Command OPTS succeed
>>   ---> OPTS MLST size;type;perm;modify;
>>    CWD path to be sent is `/'
>>
>> Note that the server automatically sets its default upload
>> directory based on the username... i.e. /username/folder
>>
>> The upload should go to this default upload directory without
>> generating an error message. It does get uploaded, but the
>> log shows the error message:
>>
>>   cd: Access failed: 550 Permission denied (/)
>>   ---> TYPE I
>>   <--- 200 Transfer mode set to BINARY
>>   ---> PASV
>>   <--- 227 Entering Passive Mode (10,10,35,21,195,225).
>>    Address returned by PASV seemed to be incorrect and has been fixed
>>    Connecting data socket to (nnn.nnn.nnn.nnn) port 50145
>>    Data connection established
>>   ---> ALLO 148891
>>   <--- 200 Command ALLO succeed
>>   ---> STOR upload.txt
>>   <--- 150 Uploading in BINARY file upload.txt
>>   Certificate: ...
>>   Issued by: ...
>>   Trusted
>>   WARNING: Certificate verification: hostname checking disabled
>>    Closing data socket
>>   <--- 226 Transfer completed
>>   ---> SITE UTIME 20190819100016 upload.txt
>>   <--- 550 Command SITE failed
>>   ---> QUIT
>>    Closing control socket
>>
>> A number of things have been tried. For example, using various
>> paths with the put command.
>>
>> * put -O . /path/to/data/upload.txt
>> * put -O /username/folder /path/to/data/upload.txt
>>
>> Explicitly placing a cd /username/folder command was also attempted.
>>
>> Removing -vv and -d are ineffective as well.
>>
>> How can lftp be made to avoid automatically i

Re: [lftp] lftp issued “CWD /” results in error message but the transfer does not fail

2019-08-24 Thread Alexander Lukyanov
Try adding a tilde at the end of url.

пт, 23 авг. 2019, 18:30 Kevin R. Bulgrien :

> In a scripted and automated process, it seems beneficial to avoid
> generating unwanted error messages that do not indicate an actual
> fault, if only to avoid confusion when someone looks at the logs.
>
> Given an lftp command similar to the following:
>
> lftp -vv -d -c set ssl:ca-file /path/to/cert/ftps_cron-bundle.crt; set
> ssl:check-hostname no; set ftp:ssl-protect-data true; set
> sftp:connect-program "ssh -a -x -o PubkeyAuthentication=no"; set
> net:max-retries 2; open -e 'put /path/to/data/upload.txt;' -u
> username:password ftps://server.example.net/
>
> The command template works on various servers, but, on one server,
> even though the upload is successful, an error message is shown:
>
>    CWD path to be sent is `/'
>   <--- 200 Command OPTS succeed
>   ---> CWD /
>   <--- 550 Permission denied
>   cd: Access failed: 550 Permission denied (/)
>
> How does one prevent lftp from sending CWD / to this server
>
>   <--- 230 User logged in
>   ---> FEAT
>   <--- 211-Extensions supported
>   <--- SIZE
>   <--- XMD5
>   <--- XSHA1
>   <--- XSHA256
>   <--- XSHA512
>   <--- XQUOTA
>   <--- LANG EN, ES, FR, GE
>   <--- MDTM
>   <--- MLST size*;type*;perm*;create*;modify*;
>   <--- REST STREAM
>   <--- TVFS
>   <--- UTF8
>   <--- AUTH SSL;TLS-P;
>   <--- PBSZ
>   <--- PROT C;P;
>   <--- 211 end
>   ---> PWD
>   <--- 257 "/username/folder" is current directory
>   ---> PBSZ 0
>   <--- 200 PBSZ=0
>   ---> PROT P
>   <--- 200 PRIVATE data channel protection level set
>   ---> LANG
>   <--- 200 Default languages set to EN
>   ---> OPTS UTF8 ON
>   <--- 200 Command OPTS succeed
>   ---> OPTS MLST size;type;perm;modify;
>    CWD path to be sent is `/'
>
> Note that the server automatically sets its default upload
> directory based on the username... i.e. /username/folder
>
> The upload should go to this default upload directory without
> generating an error message. It does get uploaded, but the
> log shows the error message:
>
>   cd: Access failed: 550 Permission denied (/)
>   ---> TYPE I
>   <--- 200 Transfer mode set to BINARY
>   ---> PASV
>   <--- 227 Entering Passive Mode (10,10,35,21,195,225).
>    Address returned by PASV seemed to be incorrect and has been fixed
>    Connecting data socket to (nnn.nnn.nnn.nnn) port 50145
>    Data connection established
>   ---> ALLO 148891
>   <--- 200 Command ALLO succeed
>   ---> STOR upload.txt
>   <--- 150 Uploading in BINARY file upload.txt
>   Certificate: ...
>   Issued by: ...
>   Trusted
>   WARNING: Certificate verification: hostname checking disabled
>    Closing data socket
>   <--- 226 Transfer completed
>   ---> SITE UTIME 20190819100016 upload.txt
>   <--- 550 Command SITE failed
>   ---> QUIT
>    Closing control socket
>
> A number of things have been tried. For example, using various
> paths with the put command.
>
> * put -O . /path/to/data/upload.txt
> * put -O /username/folder /path/to/data/upload.txt
>
> Explicitly placing a cd /username/folder command was also attempted.
>
> Removing -vv and -d are ineffective as well.
>
> How can lftp be made to avoid automatically issuing the "CWD /"
> that causes the unwanted and confusing error message that does
> not mean an operation intended by the user actually failed?
>
> Alternatively, as opposed to stopping the issuance of the "CWD /",
> how might one at least suppress its being treated as an error
> without also suppressing real errors?
>
> Experienced on RHEL 7:
>
> $ lftp --version
> LFTP | Version 4.4.8 | Copyright (c) 1996-2013 Alexander V. Lukyanov
> ...
> Libraries used: Readline 6.2
>
> --
>
> Kevin R. Bulgrien
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] HTTP Basic Auth

2019-07-03 Thread Alexander Lukyanov
Lftp started to support digest authentication, so it sends an
unauthenticated request first to get a challenge.
It should be possible to add a setting to choose auth methods, so that when
only basic method is enabled, then skip the initial unauthenticated
request.

чт, 16 мая 2019, 20:58 Nate Sutton :

> Something changed between lftp 4.4.8 and lftp 4.8.4 with HTTP basic auth.
> In the newer version it only sends the Authorization header if it receives
> a challenge response from making a request without the header. In the older
> version it always sent the Authorization header.
>
> Is there a way to force sending the Authorization header on the first
> request? Not all endpoints that accept HTTP basic auth respond with a
> challenge, some redirect to oauth or whatever else.
>
> Thanks!
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] push of new website, while retaining backup

2018-08-12 Thread Alexander Lukyanov
Renaming a directory should be the fastest operation here, use it if
possible.

вс, 12 авг. 2018, 20:30 John Kelly :

> Hi,
> I'm trying to use lftp to push my new angular app to my website from
> gitlab, but i first want to take a copy of the current website. Logically
> i'm trying to achieve the following, trying to minimise downtime...
>
> a ) push to website-latest
> b) copy website-current to website-previous
> c) replace website-latest to website-current
>
> i'm struggling somewhat with trying to achieve this - any hints would be
> appreciated (it's all done in the context of a docker node image)
>
> kind regards
> john kelly
>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Query on LFTP

2018-07-31 Thread Alexander Lukyanov
Yes, you can do that.
Try "cat file >> local-file"

пн, 16 июля 2018, 15:40 Valliappan, Ramanathan (R.R.) :

> Hi,
>
>
>
> I have a query about the usage of LFTP.
>
>
>
> Is there a possibility to use LFTP to append a file? I mean we should not
> overwrite it, but just append the content.
>
>
>
> I have browsed through the internet, but have not found any possibility.
>
>
>
> *Thanks & Regards*
>
> *Ramanathan V*
>
>
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Certificate validation confusion

2018-03-18 Thread Alexander Lukyanov
Yes, that would be good.

пт, 16 мар. 2018 г. в 10:08, Manfred Lotz <ml_n...@posteo.de>:

> On Thu, 15 Mar 2018 21:58:17 +
> Alexander Lukyanov <lav...@gmail.com> wrote:
>
> > I think the name of your certificate was recognized as a false value.
> > The ssl:verify-certificate setting expacts a boolean value (true,
> > false, yes, no, on, off, 1, 0).
> >
>
> Yes, you are right. My fault. Actually the file name started with a
> letter 'F'.
>
> But why doesn't ResMgr.cc check boolean values more thoroughly?
>
> I think values should be either the full value or a single letter, and
> case-insensitive. For instance: f,F, false and any lower/upper case
> combination of 'false'. Something like: ftp.certificate should give an
> "Invalid boolean value".
>
> Then specyfing a filename would have given a warning.
>
> What do you think.
>
>
> --
> Manfred
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Scripting and Attach

2017-12-10 Thread Alexander Lukyanov
I think you have to feed the commands to lftp from the stdin. Like this:
 echo queue get ... | lftp -c "attach 1234"

The commands after attach command in your script are executed after the
attach is finished (detached).

вс, 10 дек. 2017, 12:00 Tim :

> I'm trying to automate LFTP activity from a Python script. I'm would like
> to achieve a behaviour whereby if there is a background LFTP process then
> attach to it and append to its existing queue. I'm invoking LFTP with -f
> and feeding it a string of commands generated from my Python script.
>
> I'm using LFTP version 4.6.0
>
> If I attach to an existing process and queue files:
> attach 1234
> queue get "ubuntu-16.04.3-desktop-amd64.iso"
> bye
>
> I receive a not connected error and the file isn't queued
>
> If I attach to an existing process, open a connection and queue files:
> attach 1234
> open sftp://releases.ubuntu.com/ -u ubuntu,ubuntu
> queue get "ubuntu-16.04.3-desktop-amd64.iso"
> bye
>
> It creates another process. The output resembles this:
> [1234] Attached to terminal.
> [1234] Detaching from the terminal to complete transfers...
> [5678] Moving to background to complete transfers...
>
> Is there a way to achieve the desired behaviour, i.e. maximum of one LFTP
> process running? Thanks.
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] torrent sharing

2017-09-17 Thread Alexander Lukyanov
I need the full debug from the server an a client with timestamps (use
debug -t).

On пн, 18 сент. 2017, 6:28 Alexander Lukyanov <lavv...@gmail.com> wrote:

> You can run the torrent in background to enter other commands. And BTW
> lftp doesn't use threads.
>
> On пн, 18 сент. 2017, 6:20 Stu Midgley <sdm...@gmail.com> wrote:
>
>> Morning
>>
>> Thanks for taking time with this.
>>
>> How do I type the jobs -vv in?  All the terminals are waiting in the
>> torrent command (to receive the files)
>>
>> I also notice a LOT of DHT timeouts on almost every node I'm testing
>> with...  some are to the dht-bootstrap, but most are to the other lftp
>> torrent clients.
>>
>>
>>  DHT node [172.16.250.22]:6881 has lost 2 packets
>>
>>
>>
>>
>>
>>   initrd2
>>
>>
>>  DHT request get_peers to [172.16.250.22]:6881 timed out
>>
>>  DHT node [172.16.250.22]:6881 has lost 3 packets
>>
>>
>>
>>
>>
>>
>> initrd2: dn:0 up:0
>>
>>  DHT request find_node to [172.16.250.33]:6882 timed out
>>
>>  DHT node [172.16.250.33]:6882 has lost 1 packets
>>
>>  DHT request find_node to [172.16.250.182]:6886 timed out
>>
>>  DHT node [172.16.250.182]:6886 has lost 1 packets
>>
>>
>> Something is not right.  After quite some time (10+ minutes) clients
>> suddenly start downloading the files and also seeding.  BUT it takes over
>> 10 minutes to get into that state.  I feel their is a critical thread
>> somewhere stuck and it eventually timeouts.
>>
>> Thanks
>> Stuart.
>>
>>
>>
>>
>> On Sun, Sep 17, 2017 at 7:25 PM, Alexander Lukyanov <lavv...@gmail.com>
>> wrote:
>>
>>> Try "jobs -vv" to see the peer status.
>>>
>>> On пт, 15 сент. 2017, 8:15 Stu Midgley <sdm...@gmail.com> wrote:
>>>
>>>> OK... getting further along.  It turns out that I had to delete the
>>>> lftp cache so that the nodes didn't all have the same node_id (from ip
>>>> address 127.0.0.1).
>>>>
>>>> I now
>>>>  * remove the tests for 172.16 ip addresses in both lftp and
>>>> dht-bootstrap
>>>>  * specify the torret:ip as the host ip
>>>>  * delete the lftp cache (~/.cache/lftp)
>>>>
>>>> However, no data is transfered.
>>>>
>>>> On the client I get
>>>>
>>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>>> (1 seeds)
>>>>
>>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>>> (1 seeds)
>>>>
>>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>>> (1 seeds)
>>>>
>>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>>> (1 seeds)
>>>>
>>>> ​On the server I get
>>>>
>>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>>> (0 seeds)
>>>>
>>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>>> (0 seeds)
>>>>
>>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>>> (0 seeds)
>>>>
>>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>>> (0 seeds)
>>>>
>>>>
>>>> ​I can see the communication with the dht-bootstrap server and that
>>>> looks good.
>>>>
>>>> I can also see the client and server sending each other dht get_peers
>>>> and getting a response.
>>>>
>>>> Stu.
>>>>
>>>>
>>>> --
>>>> Dr Stuart Midgley
>>>> sdm...@gmail.com
>>>> ___
>>>> lftp mailing list
>>>> lftp@uniyar.ac.ru
>>>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>>>
>>>
>>
>>
>> --
>> Dr Stuart Midgley
>> sdm...@gmail.com
>>
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] torrent sharing

2017-09-17 Thread Alexander Lukyanov
You can run the torrent in background to enter other commands. And BTW lftp
doesn't use threads.

On пн, 18 сент. 2017, 6:20 Stu Midgley <sdm...@gmail.com> wrote:

> Morning
>
> Thanks for taking time with this.
>
> How do I type the jobs -vv in?  All the terminals are waiting in the
> torrent command (to receive the files)
>
> I also notice a LOT of DHT timeouts on almost every node I'm testing
> with...  some are to the dht-bootstrap, but most are to the other lftp
> torrent clients.
>
>
>  DHT node [172.16.250.22]:6881 has lost 2 packets
>
>
>
>
>
> initrd2
>
>
>  DHT request get_peers to [172.16.250.22]:6881 timed out
>
>  DHT node [172.16.250.22]:6881 has lost 3 packets
>
>
>
>
>
>
> initrd2: dn:0 up:0
>
>  DHT request find_node to [172.16.250.33]:6882 timed out
>
>  DHT node [172.16.250.33]:6882 has lost 1 packets
>
>  DHT request find_node to [172.16.250.182]:6886 timed out
>
>  DHT node [172.16.250.182]:6886 has lost 1 packets
>
>
> Something is not right.  After quite some time (10+ minutes) clients
> suddenly start downloading the files and also seeding.  BUT it takes over
> 10 minutes to get into that state.  I feel their is a critical thread
> somewhere stuck and it eventually timeouts.
>
> Thanks
> Stuart.
>
>
>
>
> On Sun, Sep 17, 2017 at 7:25 PM, Alexander Lukyanov <lavv...@gmail.com>
> wrote:
>
>> Try "jobs -vv" to see the peer status.
>>
>> On пт, 15 сент. 2017, 8:15 Stu Midgley <sdm...@gmail.com> wrote:
>>
>>> OK... getting further along.  It turns out that I had to delete the lftp
>>> cache so that the nodes didn't all have the same node_id (from ip address
>>> 127.0.0.1).
>>>
>>> I now
>>>  * remove the tests for 172.16 ip addresses in both lftp and
>>> dht-bootstrap
>>>  * specify the torret:ip as the host ip
>>>  * delete the lftp cache (~/.cache/lftp)
>>>
>>> However, no data is transfered.
>>>
>>> On the client I get
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (1 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (1 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (1 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (1 seeds)
>>>
>>> ​On the server I get
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (0 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (0 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (0 seeds)
>>>
>>>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers
>>> (0 seeds)
>>>
>>>
>>> ​I can see the communication with the dht-bootstrap server and that
>>> looks good.
>>>
>>> I can also see the client and server sending each other dht get_peers
>>> and getting a response.
>>>
>>> Stu.
>>>
>>>
>>> --
>>> Dr Stuart Midgley
>>> sdm...@gmail.com
>>> ___
>>> lftp mailing list
>>> lftp@uniyar.ac.ru
>>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>>
>>
>
>
> --
> Dr Stuart Midgley
> sdm...@gmail.com
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] LFTP manpages on OSX are busted

2017-09-17 Thread Alexander Lukyanov
Unfortunately I am not an expert in nroff or tbl either. I usually just add
information to the man page by analogy with the old text.

On сб, 16 сент. 2017, 23:53 Nate Sutton  wrote:

> On lftp 4.8.0 installed via homebrew on OSX 10.11.6, I get a bunch of
> errors trying to load the manpage and I think it prevents some information
> from being displayed. The errors look like this:
>
> /usr/bin/tbl::171: unrecognised format `<'
> /usr/bin/tbl::171: giving up on this table
> /usr/bin/tbl::190: `p' modifier must be followed by number
> /usr/bin/tbl::190: unrecognised format `h'
> /usr/bin/tbl::190: giving up on this table
> /usr/bin/tbl::220: unrecognised format `h'
> /usr/bin/tbl::220: giving up on this table
> /usr/bin/tbl::243: unrecognised format `\'
> /usr/bin/tbl::243: giving up on this table
> /usr/bin/tbl::303: unrecognised format `\'
> /usr/bin/tbl::303: giving up on this table
> /usr/bin/tbl::323: unrecognised format `\'
> /usr/bin/tbl::323: giving up on this table
> /usr/bin/tbl::364: unrecognised format `\'
> /usr/bin/tbl::364: giving up on this table
> /usr/bin/tbl::398: unrecognised format `\'
> /usr/bin/tbl::398: giving up on this table
> /usr/bin/tbl::427: unrecognised format `\'
> /usr/bin/tbl::427: giving up on this table
> /usr/bin/tbl::454: unrecognised format `\'
> /usr/bin/tbl::454: giving up on this table
> /usr/bin/tbl::484: unrecognised format `\'
> /usr/bin/tbl::484: giving up on this table
> /usr/bin/tbl::545: unrecognised format `\'
> /usr/bin/tbl::545: giving up on this table
> /usr/bin/tbl::571: unrecognised format `\'
> /usr/bin/tbl::571: giving up on this table
>
> Looking at the source of lftp.1, the errors don't seem to match up to the
> text.
>
> I don't understand the manpage format but I suspect OSX is using a crappy,
> old tbl, like it does with other tools. `tbl -v` shows "GNU tbl (groff)
> version 1.19.2". I'm not sure if this is something you're interesting in
> fixing but it would be nice to have the full manpage on osx.
>
>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp to mainframe: ls/get fails with \"No data sets found\" though Sun ftp works

2017-09-17 Thread Alexander Lukyanov
As I remember, sun's ftp uses NLST command by default. You can try "nlist"
command in lftp for that.
If it still doesn't work, please send me debug from sun's ftp with protocol
commands and responses.

On сб, 16 сент. 2017, 23:53 Franklin Issac  wrote:

> Hi - i think i deleted an email from lftp from my spam folder. Sorry. If
> you have sent an email earlier, please could you resend it.
>
> Franklin
>
> On Tue, Aug 22, 2017 at 2:00 PM, Franklin Issac 
> wrote:
>
>> Hi,
>>
>> Please see if you can help with the subject issue??
>>
>> Thanks - Franklin
>>
>> -- Forwarded message --
>> From: Daniel Fazekas 
>> Date: Tue, Aug 22, 2017 at 7:42 AM
>> Subject: Re: lftp to mainframe: ls/get fails with \"No data sets found\"
>> though Sun ftp works
>> To: Franklin Issac 
>>
>>
>> Hi,
>>
>> What I can do is point you to the right direction, which is writing to
>> the lftp mailing list itself. The address is lftp@uniyar.ac.ru
>> You might also want to subscribe to the mailing list first yourself, to
>> make sure you get all replies, which can be done at
>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>
>> Describe your issue there, in as much detail as possible (issue the
>> “debug” command in lftp for extra output), and maybe somebody there will
>> have an idea. The lftp author himself, Alexander V. Lukyanov, reads the
>> list.
>>
>> As for me, I was only another user of the software a decade ago, who at
>> one time subscribed to the mailing list, for the selfish reason of needing
>> help myself. I then tried to help others every now and then in return,
>> including in this thread you came across. Alas, I don’t think we ultimately
>> solved anything there. In any case, I’m afraid I don’t really remember much
>> of anything concerning this case.
>>
>> —Daniel
>>
>> > On Aug 22, 2017, at 03:19, Franklin Issac 
>> wrote:
>> >
>> > Hi,
>> >
>> > The email below came back saying the address is invalid. Please could
>> you assist.
>> >
>> > This is not spam and i am facing this lftp issue in my project. You can
>> also reach me at +1-248 986 8909 (USA) if you like to verify.
>> >
>> > Franklin
>> >
>> > -- Forwarded message --
>> > From: Franklin Issac 
>> > Date: Mon, Aug 21, 2017 at 9:17 PM
>> > Subject: Re: lftp to mainframe: ls/get fails with \"No data sets
>> found\" though Sun ftp works
>> > To: 4bl...@gmail.com
>> >
>> >
>> > Hi,
>> >
>> > I know it has been 10 long years since this thread has been created.
>> Unfortunately this is the only page that exactly explains the problem i am
>> currently facing.
>> >
>> >
>> > can you look through and let me know if this thread has any solution or
>> work arounds.
>> >
>> > I am facing the same problem. lftp against a mainframe server connects
>> ok but when ls command issued even though matching datasets are there it
>> returns no data set found.
>> >
>> > https://www.mail-archive.com/lftp@uniyar.ac.ru/msg02879.html
>> >
>> > I found this in the above link just in case this hyperlink helps.
>> >
>> > Thanks - Franklin
>> >
>>
>>
>>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] [Build-Failed] on ubuntu 14.04

2017-09-17 Thread Alexander Lukyanov
You can install ncurses-devel package for a workaround, but I have to fix
compilation with termcap.

On сб, 16 сент. 2017, 23:52 Yubin Ruan  wrote:

> Hi lftp developer,
>
> I try to build lftp 4.7.4 ~ 4.7.7 on my Ubuntu 14.04 but it always fail
> with a weird message:
>
> $ make
> /bin/bash ../libtool --silent  --tag=CXX   --mode=compile g++
> -DHAVE_CONFIG_H -I. -I../lib  -I../lib -I../trio   -O2 -Wall
> -Wwrite-strings -Woverloaded-virtual -fno-exceptions -fno-rtti
> -fno-implement-inlines -MT netrc.lo -MD -MP -MF .deps/netrc.Tpo -c -o
> netrc.lo netrc.cc
> mv -f .deps/netrc.Tpo .deps/netrc.Plo
> /bin/bash ../libtool --silent  --tag=CXX   --mode=compile g++
> -DHAVE_CONFIG_H -I. -I../lib  -I../lib -I../trio   -O2 -Wall
> -Wwrite-strings -Woverloaded-virtual -fno-exceptions -fno-rtti
> -fno-implement-inlines -MT lftp_tinfo.lo -MD -MP -MF
> .deps/lftp_tinfo.Tpo -c -o lftp_tinfo.lo lftp_tinfo.cc
> lftp_tinfo.cc:55:7: error: use of undeclared identifier 'setupterm'
> if(setupterm(NULL, 1, ) == ERR)
>^
> lftp_tinfo.cc:55:38: error: use of undeclared identifier 'ERR'
> if(setupterm(NULL, 1, ) == ERR)
>   ^
> lftp_tinfo.cc:73:22: error: use of undeclared identifier 'tigetstr'
> const char *ret = tigetstr(const_cast(terminfo_cap));
>   ^
> 3 errors generated.
> make[2]: *** [lftp_tinfo.lo] Error 1
> make[2]: Leaving directory
> `/home/sf/Compute/walkerlala-home/Downloads/lftp-4.7.7/src'
> make[1]: *** [all-recursive] Error 1
> make[1]: Leaving directory
> `/home/sf/Compute/walkerlala-home/Downloads/lftp-4.7.7'
> make: *** [all] Error 2
>
>
> The output of `./configure' have been attached in the attachment.
>
> regards,
> yubinr
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] torrent sharing

2017-09-17 Thread Alexander Lukyanov
Try "jobs -vv" to see the peer status.

On пт, 15 сент. 2017, 8:15 Stu Midgley  wrote:

> OK... getting further along.  It turns out that I had to delete the lftp
> cache so that the nodes didn't all have the same node_id (from ip address
> 127.0.0.1).
>
> I now
>  * remove the tests for 172.16 ip addresses in both lftp and dht-bootstrap
>  * specify the torret:ip as the host ip
>  * delete the lftp cache (~/.cache/lftp)
>
> However, no data is transfered.
>
> On the client I get
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (1
> seeds)
>
> ​On the server I get
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
> seeds)
>
>  torrent B40B0E478CB94A69CE6A3E811744D09AA7F60D31 has 1 known peers (0
> seeds)
>
>
> ​I can see the communication with the dht-bootstrap server and that looks
> good.
>
> I can also see the client and server sending each other dht get_peers and
> getting a response.
>
> Stu.
>
>
> --
> Dr Stuart Midgley
> sdm...@gmail.com
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Error (?) uploading

2017-07-14 Thread Alexander Lukyanov
You can add --no-perms option to mirror to avoid chmod operations.

пт, 14 июля 2017, 22:02 Gianni Piccini :

> While uploading files to a Synology nas, with a bash script that call a
> function like this
>
> lftp -f "
> open $HOST
> user $USER $PASS
> lcd $SOURCEFOLDER
> mirror --reverse --delete --verbose --dereference --use-cache
> --only-newer $SOURCEFOLDER $TARGETFOLDER
> bye
> "
>
> I got this error many and many times: lftp is the Debian package 4.7.7
>
> chmod: Operazione non supportata: MFF and SITE CHMOD are not supported
> by this site
>
> But uploads are done. I'm not so expert about ftp, is it really a
> problem or a simple warning?
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Mirror: Access Failed ... No such file or directory

2017-06-27 Thread Alexander Lukyanov
The first directory on the mirror command line is the source, the second is
the destination. With -R the source is local and the target is remote. So
in your case you have to change the argument order.

пт, 21 апр. 2017, 18:35 Alan Steel :

> We are trying to replicate a local server directory structure to an FTP
> server – these directories exist on the local server, but do not yet exist
> on the FTP server.
>
> I think we are not using the correct combination of slashes at the
> beginning and/or end of the “source” and “target.”
>
>
>
> Following is our current batch file…
>
>
>
> #!/bin/bash
>
> set -x
>
>
>
> FTPHOST='ourcompany.hostedftp.com'
>
> FTPUSER=ouru...@ourcompany.com
>
> FTPPASS=ftppassword
>
> FTPREMOTEFOLDER=/Servers/TestN01IL01/
>
> FTPLOCALFOLDER=/opt/ftpusers/home
>
> FTPLOGFILE=/home/mysusername/ftp/lftp.log
>
>
>
> /usr/local/bin/lftp sftp://$FTPUSER:$FTPPASS@$FTPHOST -e "
>
> lcd $FTPLOCALFOLDER
>
> mirror -R --verbose –no-perms -X * $FTPREMOTEFOLDER $FTPLOCALFOLDER
>
> bye
>
> " >> $FTPLOGFILE
>
>
>
> When we run this, we get…
>
> lcd ok, local cwd=/opt/ftpusers/home
>
> mirror: Access failed: /Servers/TestN01IL01: No such file or directory
>
>
>
> Even though there is such a directory on the FTP server, and the login
> user has full access to it.
>
>
>
> Can we use LFTP in this way to create the directory structure on the FTP
> server, and, if so, what should our command look like?
>
>
>
> Thank you!!
>
>
>
> AGS
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Review of script for syncing HostedFTP and local server

2017-06-01 Thread Alexander Lukyanov
The --include-glob options look incorrect. They should not be given an
absolute path, but rather a relative one. Even more, the glob pattern is
matched against just a few last path components (separated by slashes),
depending on the number of slashes in the pattern. The regex patterns are
different, they are matched against the complete relative path, starting
with the base mirrored directory.

пт, 2 июня 2017, 5:04 Alan Steel :

> Hello,
>
>
>
> We are a SaaS company, migrating our colocation environment to AWS.
>
> As part of that, we are changing how customers will provide us with files
> to be processed by our application.
>
> Currently they SSH to a server in our colo, and place their files in one
> of their subdirectories.
>
> When we migrate to AWS, our customers will instead STFP upload their files
> to a hosted FTP provider.
>
> These files will be synchronized with two AWS-based servers, ProdN01IL01
> and ProdN02IL01, each of which will be running an LFTP script.
>
>
>
> Description –
>
>
>
> On each of the two AWS servers, each customer’s directories will be under
> /opt/ftpusers/home/
>
> Each of these will have 6 subdirectories – as described below.
>
> Some of these directories are to receive files from the customer, some are
> for our application’s use, and some are for file sharing between us and our
> customers.
>
>
>
> At the hosted FTP provider we are going to make the following directory
> structure…
>
> /Servers
>
> /ProdN01IL01
>
> /[Customer1]
>
> /error
>
> /other
>
> /reports
>
> /saved
>
> /synch
>
> /[Customer2]
>
> /error
>
> /other
>
> /reports
>
> /saved
>
> /synch….(and so on)
>
> /ProdN02IL01
>
> /[Customer51]
>
> /error
>
> /other
>
> /reports
>
> /saved
>
> /synch
>
> /[Customer52]
>
> /error
>
> /other
>
> /reports
>
> /saved
>
> /synch….(and so on)
>
>
>
> Note:  We don’t need /inbox subdirectories on HostedFTP, because they are
> only used by our application.
>
>
>
> The script --
>
>
>
> Below is the script we are thinking of using.
>
> We invite comments and suggestions.
>
> Thank you!
>
>
>
> #!/bin/bash
>
>
>
> FTPPROTOCOL=”sftp”
>
> FTPHOST=”ourcompany.hostedftp.com”
>
> FTPUSER=”hftp.itaccou...@ourcompany.com”
>
> FTPPASS=”ourcompanyftppassword”
>
> FTPURL="$FTPPROTOCOL://$FTPUSER:$FTPPASS@$FTPHOST"
>
> FTPREMOTEFOLDER=”/Servers/ProdN01IL01”  (or ProdN02IL01, depending on the
> server)
>
> FTPLOCALFOLDER=”/opt/ftpusers/home”
>
> FTPLOGFILE=”/var/log/lftpsyncs.log”
>
>
>
> # The “Synch” subdirectories -- where customers put files for processing
> by our application
>
> # Move all files from HostedFTP “Synch” directories to local server Synch
> directories, the delete the source files from HostedFTP Synch directories
>
> # “Regular” mirror, with --Remove-source-files
>
>
>
> EXCLUDES="--exclude-glob .*"
>
> EXCLUDES+=" --exclude-glob .*/"
>
>
>
> INCLUDES="--include-glob /opt/ftpusers/home/*/Synch/*"
>
>
>
> lftp -e "
>
> open '$FTPURL ';
>
> lcd $FTPLOCALFOLDER;
>
> cd $FTPREMOTEFOLDER;
>
> mirror --continue --only-newer --Remove-source-files --verbose=3
> --no-perms --parallel=8 $EXCLUDES $INCLUDES”
>
>
>
> # The “Saved” subdirectories – where our application puts files from
> Inbox, after successfully processing them
>
> # The “Error” subdirectories -- where our application puts files from
> Inbox, if it fails to process them
>
> # The “Reports” subdirectories – where our application puts reports
>
> #  Sync-*up* files from local “Saved”, “Error” and “Reports” directories
> to HostedFTP, deleting HostedFTP files if they are not present on the local
> server
>
> # “Reverse” mirror, with deleting of remote files not present locally
>
>
>
> EXCLUDES="--exclude-glob .*"
>
> EXCLUDES+=" --exclude-glob .*/"
>
>
>
> INCLUDES="--include-glob /opt/ftpusers/home/*/Saved/*"
>
> INCLUDES+=" --include-glob /opt/ftpusers/home/*/Error/*"
>
> INCLUDES+=" --include-glob /opt/ftpusers/home/*/Reports/*"
>
>
>
> lftp -e "
>
> open '$FTPURL ';
>
> lcd $FTPLOCALFOLDER;
>
> cd $FTPREMOTEFOLDER;
>
> mirror --reverse --continue --only-newer --delete --verbose=3 

Re: [lftp] How to only show file URLs?

2017-05-30 Thread Alexander Lukyanov
Try "nlist" command. "cls" can also be useful.

вт, 30 мая 2017 г. в 1:18, Peng Yu :

> Hi, The following command shows attributes besides file names. Is
> there a way to let lftp only print file names or the complete URLs?
> Thanks.
>
> $ lftp ftp://ftp.ncbi.nlm.nih.gov:21/blast/db/ -e 'ls
> refseq_protein*.gz;exit'
> cd ok, cwd=/blast/db
> -r--r--r--   1 ftp  anonymous 708658320 May 27 00:07
> refseq_protein.00.tar.gz
> -r--r--r--   1 ftp  anonymous 698643198 May 27 00:09
> refseq_protein.01.tar.gz
> -r--r--r--   1 ftp  anonymous 701727787 May 27 00:11
> refseq_protein.02.tar.gz
> -r--r--r--   1 ftp  anonymous 685980116 May 27 00:13
> refseq_protein.03.tar.gz
> -r--r--r--   1 ftp  anonymous 674373439 May 27 00:15
> refseq_protein.04.tar.gz
> -r--r--r--   1 ftp  anonymous 667130719 May 27 00:17
> refseq_protein.05.tar.gz
> -r--r--r--   1 ftp  anonymous 653667987 May 27 00:19
> refseq_protein.06.tar.gz
> -r--r--r--   1 ftp  anonymous 664252645 May 27 00:21
> refseq_protein.07.tar.gz
> -r--r--r--   1 ftp  anonymous 669007597 May 27 00:23
> refseq_protein.08.tar.gz
> -r--r--r--   1 ftp  anonymous 692145767 May 27 00:25
> refseq_protein.09.tar.gz
> -r--r--r--   1 ftp  anonymous 668212712 May 27 00:27
> refseq_protein.10.tar.gz
> -r--r--r--   1 ftp  anonymous 654469324 May 27 00:29
> refseq_protein.11.tar.gz
> -r--r--r--   1 ftp  anonymous 666731375 May 27 00:31
> refseq_protein.12.tar.gz
> -r--r--r--   1 ftp  anonymous 677603129 May 27 00:33
> refseq_protein.13.tar.gz
> -r--r--r--   1 ftp  anonymous 602597680 May 27 00:34
> refseq_protein.14.tar.gz
> -r--r--r--   1 ftp  anonymous 638866819 May 27 00:36
> refseq_protein.15.tar.gz
> -r--r--r--   1 ftp  anonymous 667459457 May 27 00:38
> refseq_protein.16.tar.gz
> -r--r--r--   1 ftp  anonymous 633813436 May 27 00:40
> refseq_protein.17.tar.gz
> -r--r--r--   1 ftp  anonymous 662808544 May 27 00:42
> refseq_protein.18.tar.gz
> -r--r--r--   1 ftp  anonymous 616701358 May 27 00:44
> refseq_protein.19.tar.gz
> -r--r--r--   1 ftp  anonymous 652949735 May 27 00:46
> refseq_protein.20.tar.gz
> -r--r--r--   1 ftp  anonymous 634818426 May 27 00:48
> refseq_protein.21.tar.gz
> -r--r--r--   1 ftp  anonymous 623748621 May 27 00:50
> refseq_protein.22.tar.gz
> -r--r--r--   1 ftp  anonymous 585690447 May 27 00:51
> refseq_protein.23.tar.gz
> -r--r--r--   1 ftp  anonymous 635681793 May 27 00:53
> refseq_protein.24.tar.gz
> -r--r--r--   1 ftp  anonymous 650962073 May 27 00:55
> refseq_protein.25.tar.gz
> -r--r--r--   1 ftp  anonymous 643073612 May 27 00:57
> refseq_protein.26.tar.gz
> -r--r--r--   1 ftp  anonymous 638013864 May 27 00:59
> refseq_protein.27.tar.gz
> -r--r--r--   1 ftp  anonymous 657784526 May 27 01:01
> refseq_protein.28.tar.gz
> -r--r--r--   1 ftp  anonymous 661048285 May 27 01:03
> refseq_protein.29.tar.gz
> -r--r--r--   1 ftp  anonymous 685732090 May 27 01:06
> refseq_protein.30.tar.gz
> -r--r--r--   1 ftp  anonymous 295331989 May 27 01:07
> refseq_protein.31.tar.gz
>
>
> --
> Regards,
> Peng
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Problem parsing list output : no automatic mirror nor browse is possible

2017-05-11 Thread Alexander Lukyanov
I'll add a workaround. Thanks for the report!

чт, 11 мая 2017, 19:58 Franck Eyraud :

> Hello,
>
> I have the problem with a FTP server, mirroring is not taking into account
> any folder for recursion. I think I noticed why: when running ls command,
> all folders are suffixed with a slash, this doesn't happen on other FTP
> servers I tried. It seems that this cause lftp to completely ignore them.
>
>
> dr-x--   3 user group0 May 11 16:33 folder1/
> dr-x--   3 user group0 May 11 16:33 folder2/
> dr-x--   3 user group0 May 11 16:33 folder3/
> dr-x--   3 user group0 May 11 16:33 folder4/
>
> cls command return an empty list, du gives output "./ 0", as if no folder
> where present there.
>
> The debug .mplist command gives :
>
> Size=4096;Modify=20170511162938.894;Type=dir;Perm=el; folder1/
> Size=4096;Modify=20170511162938.894;Type=dir;Perm=el; folder2/
> Size=4096;Modify=20170511162938.894;Type=dir;Perm=el; folder3/
> Size=4096;Modify=20170511162938.894;Type=dir;Perm=el; folder4/
>
> I tried to look for some parameter, for instance use-msld or list-options
> (but what option to provide), but it doesn't change.
>
> Manually changing directory with cd, and mirroring files work correctly.
>
> I can understand that the FTP server is buggy, but is there a way to work
> around that ?  Of course, I have no control over the server, that would be
> too easy, I have to deal with this, and download data from there...
>
> Thank you !
>
> Franck
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Mirror only directories -- skipping all files

2017-04-21 Thread Alexander Lukyanov
Try mirror -X *

пт, 21 апр. 2017, 15:38 Alan Steel :

> Can you please tell me the easiest way to mirror only directories (no
> files), from a local server to a remote FTP host?
>
>
>
> Thank you!
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Make certificate verification great again

2017-03-20 Thread Alexander Lukyanov
Does the "Not trusted" error happen just after connecting or when doing the
data connection? Can you provide at least the server name?

пн, 20 мар. 2017 г. в 16:55, Nathanaël Naeri :

> It appears that "open -d https://www.seedbox.fr; works indeed
> ("Trusted", certificate chain printed out as in your previous
> message), but "open -d -p 21 -u USER,PASS SERVER.seedbox.fr" doesn't
> ("Certificate verification: Not trusted", same output as reported in
> my first message).
>
> Using lftp 4.7.7 with GnuTLS 3.5.10 and my CA bundle. I also checked
> manually that both your CA bundle and mine:
>   * don't include COMODORSAOrganizationValidationSecureServerCA.pem
>   * include COMODORSACertificationAuthority.pem
>   * don't include COMODORSAAddTrustCA.pem
> So they're not different in this respect. It's not clear to me, which
> one is the root CA certificate. Only the AddTrust one is self-signed,
> but the certificate chain printed by lftp with GnuTLS stops at the
> second one, while that using OpenSSL includes the last one.
>
> The server certificates coming from the HTTP and FTP servers are the
> same: I downloaded one from https://www.seedbox.fr using Firefox 52 >
> Page Info and the other from SERVER.seedbox.fr using "openssl s_client
> -connect SERVER.seedbox.fr:21 -starttls ftp": they're the same except
> for the end-of-line characters, and apply both to *.seedbox.fr.
>
> Is that an issue that this hosting company could do something about? I
> can ask their sysadmins for help.
>
> On Mon, Mar 20, 2017 at 12:52 PM, Alexander V. Lukyanov 
> wrote:
> > On Sat, Mar 18, 2017 at 09:13:27PM +0100, Nathanaël Naeri wrote:
> >> Thank you for your answer. I have updated my version of GnuTLS to
> >> 3.5.10 and compiled lftp 4.7.7 against it. The resulting "./lftp
> >> --version" shows "Libraries used: Readline 6.3, Expat 2.1.0, GnuTLS
> >> 3.5.10, zlib 1.2.8". Yet the error I reported in my first message
> >> remains: "Certificate verification: Not trusted".
> >>
> >> What commands did you use in your last message to verify certificate
> >> chains? The output I get with openssl verify and certtool is quite
> >> different.
> >
> > I did "open -d https://www.seedbox.fr;. My CA bundle is attached.
> >
> > --
> >Alexander.
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Make certificate verification great again

2017-03-11 Thread Alexander Lukyanov
Your understanding of CA is correct. The Comodo certificate should be
present in the CA bundle for the verification to succeed.

вс, 12 марта 2017, 5:16 Nathanaël Naeri :

> I'm trying to connect to a FTP server that supports explicit FTPS
> using TLS, but I can't get certificate verification working. Most of
> the online help I find advises disabling certificate verification with
> "ssl:verify-certificate no", and I assume this is not good advice.
>
> My current understanding of the process is that lftp downloads the
> server's certificate when it negotiates TLS, then follows the
> certificate chain up to the certificate of a root CA, and trusts that
> root CA because it is in my list of trusted third parties, that I
> indicate to lftp using "ssl:ca-file
> /etc/ssl/certs/ca-certificates.crt" (the root CA certificates bundle
> file). This is, as far as I know, what web browsers do when they
> connect to HTTPS hosts (isn't it?).
>
> This doesn't appear to work so I guess I don't understand right. The
> debug output is:
>
> $ lftp -d -p 21 -u USER,PASS SERVER.seedbox.fr
> lftp u...@server.seedbox.fr:~> set ssl:ca-file
> /etc/ssl/certs/ca-certificates.crt
> lftp u...@server.seedbox.fr:~> ls
>  Connecting to SERVER.seedbox.fr (IPADDRESS) port 21
> <--- 220-- Welcome to Pure-FTPd [privsep] [TLS] --
> <--- [other 220 info]
> ---> FEAT
> <--- [feat reply]
> ---> AUTH TLS
> <--- 234 AUTH TLS OK.
> ---> OPTS UTF8 ON
> Certificate:
> C=FR,postalCode=77310,ST=Seine-et-Marne,L=PRINGY,street=IMPASSE
> DU BREAU,O=SDBX FRANCE,OU=0002 529997199,CN=*.seedbox.fr
>  Issued by: C=GB,ST=Greater Manchester,L=Salford,O=COMODO CA
> Limited,CN=COMODO RSA Organization Validation Secure Server CA
> ERROR: Certificate verification: Not trusted
>  Certificate verification: Not trusted
>  Closing control socket
> ls: Fatal error: Certificate verification: Not trusted
>
> However, if I download the server's certificate beforehand, using a
> web browser or the OpenSSL CLI (openssl s_client -connect
> SERVER.seedbox.fr:21 -starttls ftp), and then points lftp to this
> certificate using "ssl ca-file
> /path/to/manually/downloaded/server/certificate.crt", the certificate
> verification succeeds. Why? What is verified in this case, precisely?
> That the certificate lftp downloads from the server during TLS
> negotiation is the same as one that was previously downloaded? How
> does that authenticates the server?
>
> And does this mean that the user has to maintain a certificate
> database of the servers they connect to? I thought the point of
> certificate hierarchies was that the user would only have to maintain
> a short list of trusted third party certificates (the root CA
> certificates).
>
> Thanks in advance for your help
> Naël
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] removing stale socket

2016-07-14 Thread Alexander Lukyanov
The message means that lftp has found a socket on which no other lftp
listens

ср, 13 июля 2016, 17:50 Juan Simón :

> Juan Cole, I sent that message to the lftp mailing list. It has nothing to
> do with your blog, comments, etc. It's a message that lftp shows when I
> attach to lftp background session (with SFTP).
>
> 2016-07-13 15:54 GMT+02:00 Juan Cole :
>
>> sorry, I still don't know what that means.  In what connection are you
>> using an lftp program?  Informed Comment, my blog?  Why?  University of
>> Michigan?I don't think I use ftp with the blog, but have ftp'd a lot of
>> material to umich.edu
>>
>> cheers Juan
>>
>
>> On Wed, Jul 13, 2016 at 9:46 AM, Juan Simón  wrote:
>>
>>> When I attach to a background session.
>>>
>>> 2016-07-13 15:43 GMT+02:00 Juan Cole :
>>>
 could you explain more the context in which you received it?

 cheers  Juan

 On Wed, Jul 13, 2016 at 9:19 AM, Juan Simón  wrote:

> What's the meaning of this message: "attach: removing stale socket
> `/home/juan/.lftp/bg/arch.local-4617'."?
>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
>


 --
 http://www.juancole.com
 author, "The New Arabs: How the Millennial Generation is Changing the
 Middle East"
 *http://tinyurl.com/l7f22ar *

>>>
>>>
>>> ___
>>> lftp mailing list
>>> lftp@uniyar.ac.ru
>>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>>
>>>
>>
>>
>> --
>> http://www.juancole.com
>> author, "The New Arabs: How the Millennial Generation is Changing the
>> Middle East"
>> *http://tinyurl.com/l7f22ar *
>>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] SFTP with certificate

2016-06-05 Thread Alexander Lukyanov
At the time of password input ssh is not started yet. So lftp doesn't know
that the password is not needed.

вс, 5 июня 2016, 12:59 Juan Simón <deced...@gmail.com>:

> But it isn't unnecessary. What is the point of that question? SSH should
> manage the connection.
>
> ___
> Escrito desde el móvil
> El 5 jun. 2016 8:33 AM, "Alexander Lukyanov" <lavv...@gmail.com> escribió:
>
>> You have to specify a password anyway, just an empty one.
>>
>> сб, 4 июня 2016, 22:29 Juan Simón <deced...@gmail.com>:
>>
>>> Hi,
>>> I connect to a remote server with a certificate (without password) but
>>> when I try to connect via lftp, it asks for my password, why?
>>>
>>> I have defined "set sftp:auto-confirm yes" in config file.
>>>
>>> ___
>>> lftp mailing list
>>> lftp@uniyar.ac.ru
>>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>>
>>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] SFTP with certificate

2016-06-05 Thread Alexander Lukyanov
You have to specify a password anyway, just an empty one.

сб, 4 июня 2016, 22:29 Juan Simón :

> Hi,
> I connect to a remote server with a certificate (without password) but
> when I try to connect via lftp, it asks for my password, why?
>
> I have defined "set sftp:auto-confirm yes" in config file.
>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp not removing files from local directory

2016-05-18 Thread Alexander Lukyanov
It should be after the mirror command

ср, 18 мая 2016, 15:33 Steven Dennis <nzdreame...@gmail.com>:

> What about the -e here
>
> lftp -u user,pass *-e* "set sftp:connect-program 'ssh
>
> Is this in the wrong place?  Where should not be?
>
> Again thanks.
> On May 18, 2016 4:04 AM, "Alexander V. Lukyanov" <l...@netis.ru> wrote:
>
>> On Tue, May 17, 2016 at 06:36:16AM -0700, Steven Dennis wrote:
>> > Thanks for taking a look at my code.  I thought that the -e enabled
>> lftp to
>> > delete files.  If I remove the --newer-than what option should I use and
>> > where should I put it to delete files on the target side when not on the
>> > remote side?
>>
>> I don't see -e either.
>>
>> I was wrong about --newer-than option, it should not limit files to be
>> removed.
>> Add -vvv options to see the files to be deleted.
>>
>> --
>>Alexander.
>>
>> > On May 16, 2016 11:33 PM, "Alexander Lukyanov" <lavv...@gmail.com>
>> wrote:
>> >
>> > > Also --newer-than limits the file sets on the target side too, so
>> older
>> > > files won't be deleted.
>> > >
>> > > вт, 17 мая 2016, 9:31 Alexander Lukyanov <lavv...@gmail.com>:
>> > >
>> > >> I don't see the --delete option in your command line.
>> > >>
>> > >> пн, 16 мая 2016, 19:30 Steven Dennis <nzdreame...@gmail.com>:
>> > >>
>> > >>> Hello everyone,
>> > >>>
>> > >>> I am trying get lftp to make my local folders match my remote
>> folder.
>> > >>> When I delete a file/folder on the remote I want lftp to remove it
>> on the
>> > >>> local as well.  The man page says I can use the -e or --delete or
>> > >>> --delete-first
>> > >>>
>> > >>> This is what I have been using and am not sure why it isn't deleting
>> > >>> local files and folders that have been removed from the remote site.
>> > >>>
>> > >>> lftp -u user,pass -e "set sftp:connect-program 'ssh -a -x -T -c
>> arcfour
>> > >>> -o Compression=no'; mirror -v -c --newer-than=now-4hours --loop
>> > >>> --use-pget-n=3  /home/user/finished/TV /home/pi/usrmnt/Target/;
>> quit"
>> > >>> sftp://XXX.XXX.XXX.XXX:XXX
>> > >>>
>> > >>> Any help is greatly appreciated.
>> > >>>
>> > >>> Thanks
>> > >>>
>> > >>> Steve
>> > >>> ___
>> > >>> lftp mailing list
>> > >>> lftp@uniyar.ac.ru
>> > >>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>> > >>>
>> > >>
>>
>> > ___
>> > lftp mailing list
>> > lftp@uniyar.ac.ru
>> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp not removing files from local directory

2016-05-17 Thread Alexander Lukyanov
Also --newer-than limits the file sets on the target side too, so older
files won't be deleted.

вт, 17 мая 2016, 9:31 Alexander Lukyanov <lavv...@gmail.com>:

> I don't see the --delete option in your command line.
>
> пн, 16 мая 2016, 19:30 Steven Dennis <nzdreame...@gmail.com>:
>
>> Hello everyone,
>>
>> I am trying get lftp to make my local folders match my remote folder.
>> When I delete a file/folder on the remote I want lftp to remove it on the
>> local as well.  The man page says I can use the -e or --delete or
>> --delete-first
>>
>> This is what I have been using and am not sure why it isn't deleting
>> local files and folders that have been removed from the remote site.
>>
>> lftp -u user,pass -e "set sftp:connect-program 'ssh -a -x -T -c arcfour
>> -o Compression=no'; mirror -v -c --newer-than=now-4hours --loop
>> --use-pget-n=3  /home/user/finished/TV /home/pi/usrmnt/Target/; quit"
>> sftp://XXX.XXX.XXX.XXX:XXX
>>
>> Any help is greatly appreciated.
>>
>> Thanks
>>
>> Steve
>> ___
>> lftp mailing list
>> lftp@uniyar.ac.ru
>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp not removing files from local directory

2016-05-17 Thread Alexander Lukyanov
I don't see the --delete option in your command line.

пн, 16 мая 2016, 19:30 Steven Dennis :

> Hello everyone,
>
> I am trying get lftp to make my local folders match my remote folder.
> When I delete a file/folder on the remote I want lftp to remove it on the
> local as well.  The man page says I can use the -e or --delete or
> --delete-first
>
> This is what I have been using and am not sure why it isn't deleting local
> files and folders that have been removed from the remote site.
>
> lftp -u user,pass -e "set sftp:connect-program 'ssh -a -x -T -c arcfour
> -o Compression=no'; mirror -v -c --newer-than=now-4hours --loop
> --use-pget-n=3  /home/user/finished/TV /home/pi/usrmnt/Target/; quit"
> sftp://XXX.XXX.XXX.XXX:XXX
>
> Any help is greatly appreciated.
>
> Thanks
>
> Steve
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] download speed drops sharply

2016-05-04 Thread Alexander Lukyanov
Can you please try "set ftp:prefer-epsv no"?

пт, 29 апр. 2016 г. в 19:22, Juan Simón :

> I think the problem isn't in lftp.
> I see messages like this when I execute "jobs -v" to see active transfers:
> "[500 I won't open a connection to 192.168.1.2 (only to
> )]", ¿?
> I didn't see this message before. In server side there isn't any message
> like this in log. Any idea?
> Regards.
>
> 2016-04-29 14:50 GMT+02:00 Alexander V. Lukyanov :
>
>> On Fri, Apr 29, 2016 at 11:28:07AM +0200, Juan Simón wrote:
>> > I'm testing with another server and same problem.
>> > I've defined in config file:
>> > ...
>> > set mirror:no-empty-dirs yes;
>> > set mirror:order "/*";
>> > set mirror:parallel-directories yes;
>> > set mirror:parallel-transfer-count 5;
>> > set mirror:set-permissions no;
>> > set mirror:use-pget-n 3;
>> > 
>> >
>> > But when I execute 'jobs -v 1' only I see 3 downloads:
>>
>> I guess all other files have been transferred already.
>> mirror:parallel-transfer-count is only applied to different files,
>> mirror:use-pget-n is applied to every single file.
>>
>> --
>>Alexander.
>>
>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] http authentication on lftp 4.7.x versions

2016-05-04 Thread Alexander Lukyanov
Please send me the debug output. In 4.7.0 the http authentication was
reworked, so there can be a bug indeed.

пн, 2 мая 2016 г. в 13:20, Frederico Costa :

> Hi there,
>
> I have been using lftp for some years now, and has been working smoothly
> i can say.
>
> Now i have upgrade to version 4.7.1, and it seems i am having a bit of
> an issue when comes to http authentication.
>
> So, my setup is rather simple, and it has been running for some years,
> through a crontab on a daily task to get the latest backup files from an
> external server.
>
> command from crontab:
>
> /usr/local/bin/lftp -f /usr/home/user/scripts/backup.lftp
>
> the content of the script (backup.lftp) i am running
> --
> set mirror:order "backup*"
> set http:authorization user:pass
> set ssl:verify-certificate no
> open https://www.mysite.com/transfer
> mirror -c --Remove-source-files home /data/public/backup &
> at 0610  -- exit top kill &
> --
>
> This has been running without any problems up to version 4.6.5:
> --
> 4.6.5
> lftp :~> set mirror:order "backup*"
> lftp :~> set http:authorization user:pass
> lftp :~> set ssl:verify-certificate no
> lftp :~> open https://www.mysite.com/transfer
> cd: received redirection to `https://www.mysite.com/transfer/'
> cd ok, cwd=/transfer
> lftp www.mufley.com:/transfer> mirror -c --Remove-source-files home
> /data/public/backup
>
> web logs
> mysite.com - transftp [02/May/2016:09:54:03 +0100] "HEAD /transfer
> HTTP/1.1" 301 - "-" "lftp/4.6.5"
> mysite.com - transftp [02/May/2016:09:54:03 +0100] "HEAD /transfer/
> HTTP/1.1" 200 - "-" "lftp/4.6.5"
> --
>
> I have upgraded this weekend to version 4.7.1 (tested also on 4.7.0),
> and now:
> --
> 4.7.0/1
> lftp :~> set mirror:order "backup*"
> lftp :~> set http:authorization user:pass
> lftp :~> set ssl:verify-certificate no
> lftp :~> open https://www.mysite.com/transfer
> (it will cycle now through the below messages)
> cd `https://www.mufley.com/transfer' [Connecting...]
> cd `https://www.mufley.com/transfer' [Fetching headers...]
> cd `https://www.mufley.com/transfer' [Waiting for response...]
>
> web logs
> mysite.com - - [02/May/2016:10:57:17 +0100] "HEAD /transfer HTTP/1.1"
> 401 - "-" "lftp/4.7.0"
> mysite.com - - [02/May/2016:10:57:17 +0100] "HEAD /transfer HTTP/1.1"
> 401 - "-" "lftp/4.7.0"
> mysite.com - - [02/May/2016:10:57:17 +0100] "HEAD /transfer HTTP/1.1"
> 401 - "-" "lftp/4.7.0"
> --
>
> No changes have been done to the webserver, and when i use back again
> version 4.6.5 every works fine.
>
> So it seems on the 4.7.x the server replies with a 401 Unauthorized,
> instead of the 301 redirect and 200 ok.
>  From what i can understand this seems to be related to the new http
> authentication functionality that has been added to 4.7.x.
>
> Maybe i am missing something in the scripts to be updated to run
> correclty on 4.7.x versions?
> I tried to look into the code, but it will take me a bit of time to
> understand, so i decided to drop you this email.
>
> Can you check this when you have some time? Or do you need more
> information, or more debug done?
> I will be more than happier to help.
>
> Looking forward to some feedback...
>
> Fred
>
>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] D/L files that are 24hr old?

2016-02-20 Thread Alexander Lukyanov
Lftp tries to get the file modification time in UTC. So the comparison does
not depend on the server's timezone. Sometimes it fails due to ftp server
limitations or bugs

вс, 21 февр. 2016, 8:03, Steven Dennis :

> Thanks for the help.  I was able to use the --newer-than, but now I am
> wondering how this time is determined if my server where the files are
> located is 9 hours ahead of where I am.  Does it use the time on the server
> and the times that are on the files or does it use the time on the files on
> the server but use my local time to figure out what is 24hr from now?
>
> Steven Dennis
> nzdreame...@gmail.com
> 805.699.6462 (txt + voice)
> 805.903.3237 (voice)
>
> On Thu, Feb 18, 2016 at 11:32 PM, Lars Viklund  wrote:
>
>> On Thu, Feb 18, 2016 at 09:10:01PM -0800, Steven Dennis wrote:
>> > Hello,
>> >
>> > I would like to d/l files and folders from a directory on my web server
>> > that have been put there or modified in the last 24 hours.
>> >
>> > I have read the man page and came across the --newer-than option.
>> >
>> > "For option --newer-than you can either specify a file or time
>> specification
>> > like that used by *at*(1) command, e.g. `now-7days' or `week ago'. If
>> you
>> > specify a file, then modification time of that file will be used."
>> >
>> > Can you tell me if this would be correct?
>> >
>> > lftp open -u user,pass sftp://XXX.XXX.XXX.XXX -P mirror -c
>> --newer-than
>> > 24hrs /remote/directory/ /local/directory/
>>
>> Did you look at the referenced manual page, and the specification that
>> it cites?
>>
>> at(1) (and by extension this feature) takes absolute timepoints as
>> argument, constructed from relative phrasing.
>>
>> Both "now-7days" and "week ago" describe absolute points in time.
>>
>> See https://github.com/lavv17/lftp/issues/21 for a discussion mirroring
>> your question, http://linux.die.net/man/1/at for the manpage. Note that
>> the at(1) spec mostly cares about future timepoints and thus doesn't
>> mention the "ago" flavor.
>>
>> Your argument should probably be along the lines of "24 hours ago" or
>> "day ago".
>>
>> > Also can you tell me if there are other time parameters that can be
>> used as
>> > well as the "grammar" that should be used when putting this together?
>> >
>> > Thanks
>> >
>> > Steven
>>
>> > ___
>> > lftp mailing list
>> > lftp@uniyar.ac.ru
>> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>
>>
>> --
>> Lars Viklund | z...@acc.umu.se
>> ___
>> lftp mailing list
>> lftp@uniyar.ac.ru
>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>
>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] UTF-8 output

2016-01-10 Thread Alexander Lukyanov
What is the correct name of that "(2014-10-15) Ã%89cocups" directory on the
server side? What is printed by "ls" and "cls" lftp commands if invoked by
hand?

2016-01-10 18:09 GMT+03:00 Phyks <webmas...@phyks.me>:

> Hi,
>
> I finally managed to narrow down the problem, but I am not sure of the
> correct way to solve it…
>
> Let's say I am running (in lftp)
> ```
> mirror --dry-run --delete -c --use-pget-n=6 --parallel=4
> photos/gallery/2014/2014-10\ Octobre /tmp
> ```
>
> It returns me:
> ```
> pget -n 6 -O "/tmp/(2014-10-15) Ã%89cocups" ftp://…
> ```
>
> The problem comes from the partly url-encoded string. There is a Ã
> character which is not urlencoded into %c3. When I try to decode it with
> Python, I then get something like "\xc3%89" which is not a valid utf-8
> sequence (should be \xc3\x89).
>
> I guess I could monkey patch above it, but I am feeling like either this
> is a bug or a misuse of lftp from my side.
>
> Thanks!
>
>
> Le 09/01/2016 01:57, Phyks a écrit :
> > I am now pretty much sure the problem comes either from the lftp side or
> > the FTP itself.
> >
> > Actually, I used the same script as previously used, on two different
> > folders. On one folder, it is working as is, and the output is well
> > UTF-8 (as it used to be, and this folder does have some special
> > accentuated characters). On the other one (which was the one I was using
> > when starting this thread), the output has to be parsed as latin-1.
> >
> > Both folders are on the same FTP, and launching lftp with "debug 10"
> > shows that apparently it sends the command to tell the FTP server to use
> > UTF-8 (which seems to be confirmed by the `ftp:charset` and
> > `file:charset` options).
> >
> > I do not have any problems using either directly Filezilla or lftp
> > because I guess they (or the shell) handles encoding conversion.
> >
> > Thanks
> >
> > Le 07/01/2016 20:47, Alexander Lukyanov a écrit :
> >> Can you check the locale under subprocess.run? Can the subprocess itself
> >> recode the output?
> >>
> >> чт, 7 янв. 2016, 21:52, Phyks <webmas...@phyks.me>:
> >>
> >>> I did try to `set file:charset UTF-8` without any success.
> >>>
> >>> From the shell from which I run my Python script:
> >>>
> >>> ```
> >>> % locale charmap
> >>> UTF-8
> >>>
> >>> % locale
> >>> LANG=fr_FR.UTF-8
> >>> LC_CTYPE="fr_FR.UTF-8"
> >>> LC_NUMERIC="fr_FR.UTF-8"
> >>> LC_TIME="fr_FR.UTF-8"
> >>> LC_COLLATE="fr_FR.UTF-8"
> >>> LC_MONETARY="fr_FR.UTF-8"
> >>> LC_MESSAGES="fr_FR.UTF-8"
> >>> LC_PAPER="fr_FR.UTF-8"
> >>> LC_NAME="fr_FR.UTF-8"
> >>> LC_ADDRESS="fr_FR.UTF-8"
> >>> LC_TELEPHONE="fr_FR.UTF-8"
> >>> LC_MEASUREMENT="fr_FR.UTF-8"
> >>> LC_IDENTIFICATION="fr_FR.UTF-8"
> >>> LC_ALL=
> >>> ```
> >>>
> >>> Which should be ok AFAIK, no?
> >>>
> >>> In case it can be useful for anyone, here is the full script:
> >>> https://gist.github.com/Phyks/4e4c65fcd12d600374a7. Problem is with
> the
> >>> call at line 33.
> >>>
> >>>
> >>> Le 07/01/2016 19:42, Alexander Lukyanov a écrit :
> >>>> Probably you run lftp with a latin-1 locale. Try to set
> >>> LC_ALL=en_US.UTF-8
> >>>> (for example). Alternatively you can force a local character set in
> lftp
> >>> by
> >>>> "set file:charset UTF-8".
> >>>>
> >>>> 2016-01-07 20:04 GMT+03:00 Phyks <webmas...@phyks.me>:
> >>>>
> >>>>> Hi,
> >>>>>
> >>>>> I am using lftp from a Python script, calling it through
> >>>>> `subprocess.run`. Everything should be UTF-8 (shell, lftp is sending
> >>>>> OPTS UTF-8 to the server) and my Python script is using UTF-8, sends
> >>>>> UTF-8 to lftp on the stdin and expect UTF-8 on its stdout.
> >>>>>
> >>>>> But for some unknown reason, it seems that lftp is returning latin-1
> >>>>> encoding, instead of UTF-8, for the directory listings.
> >>>>>
> >>>>> Are you aware of such a problem? I did not find any way to force
> lftp to
> >>>>> use UTF-8.
> >>>>>
> >>>>> Thanks!
> >>>>>
> >>>>>
> >>>>> ___
> >>>>> lftp mailing list
> >>>>> lftp@uniyar.ac.ru
> >>>>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>> --
> >>>>Alexander.
> >>>>
> >>>
> >>> ___
> >>> lftp mailing list
> >>> lftp@uniyar.ac.ru
> >>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
> >>>
> >>
> >
> >
> >
> > ___
> > lftp mailing list
> > lftp@uniyar.ac.ru
> > http://univ.uniyar.ac.ru/mailman/listinfo/lftp
> >
>
>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
>


-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp 4.6.4

2015-08-21 Thread Alexander Lukyanov
Sorry about that. I'll update the man page in the next version.

2015-08-21 17:03 GMT+03:00 Juan Simón deced...@gmail.com:

 Thanks. You forgot update the man file with new prompt option \l
 Regards.

 2015-08-21 15:43 GMT+02:00 Alexander V. Lukyanov lavv...@gmail.com:

 lftp-4.6.4 has been released. Changes:

 Version 4.6.4 - 2015-08-20

 * mirror: new option --transfer-all.
 * torrent: new setting torrent:timeout to limit time without any progress.
 * torrent: fixed handling of udp tracker without explicit port number.
 * torrent: improved transfer start time after metadata download.
 * improved sftp put -c to use a single FSETSTAT.
 * mirror --skip-noaccess now uses user name to check for permissions.
 * don't rename temporary file to the target name when transfer fails.
 * new cmd:prompt escapes \l and \L for local working directory.
 * translations updated (pl, ru, uk).
 * new configure option --disable-ipv6.
 * fixed compilation with an old gcc.

 Get it from http://lftp.yar.ru/get.html or your favorite mirror.
 Fedora binaries are also available.

 --
Alexander.
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp



 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] Bug in lftp mirror when using xfer:use-temp-file option

2015-05-15 Thread Alexander Lukyanov
The problem should be fixed by
https://github.com/lavv17/lftp/commit/a2b4cdbf8ccdb98c8d5c79834ea6e29f83575da9
without unnecessary memory allocation.

2015-05-15 20:22 GMT+03:00 Alexander Lukyanov lavv...@gmail.com:

 Thanks for debugging! I'll fix it by using heap memory

 чт, 14 мая 2015, 14:59, Ankit Khurana ankit.khurana0...@gmail.com:

 Hi

 Found the issue, the lsToList is using string_alloca to allocate the ls
 result in stack memory which was limited.
 Tested by increasing the stack memory limit for a process. Fixing it by
 using heap memory using malloc instead of string_alloca.

 Thanks
 Ankit

 On Thu, May 14, 2015 at 2:48 PM, Ankit Khurana 
 ankit.khurana0...@gmail.com wrote:

 Hi

 The segmention fault is coming only in case of mirror. ls -la is working
 when run on lftp using fish.
 lftp test@192.168.10.15:/data2/data/history/231 mirror data/
 --- #CWD /data2/data/history/231/data
 cd /data2/data/history/231/data; echo '### 000'
 --- ### 000
 --- #LIST
 ls -la ; echo '### 200'
 --- ### 200
 Segmentation fault (core dumped)

 Thanks
 Ankit

 On Thu, May 14, 2015 at 11:57 AM, Ankit Khurana 
 ankit.khurana0...@gmail.com wrote:

 Th last log printed is from Fish.CC line 410. The process is giving
 segmentation on every run.

 Thanks
 Ankit

 On Thu, May 14, 2015 at 10:16 AM, Ankit Khurana 
 ankit.khurana0...@gmail.com wrote:

 Hi Alexander

 sending the core dump file for reference.

 Regards
 Ankit Khurana

 On Thu, May 14, 2015 at 9:32 AM, Ankit Khurana 
 ankit.khurana0...@gmail.com wrote:

 Hi Alexander

 I am trying to generate the non stripped executable using the default
 make install packaged in lftp tar. But i am always getting the stripped
 executable. Thus not able to debug the core dump produced.

 Regards
 Ankit Khurana

 On Thu, May 14, 2015 at 9:05 AM, Alexander Lukyanov 
 lavv...@gmail.com wrote:

 There should be no limitations. Please produce a stack trace and
 send it to me.

 ср, 13 мая 2015, 18:34, Ankit Khurana ankit.khurana0...@gmail.com:


 Hi,

 I am trying to mirror files using lftp, the mirror path contains
 around 1 million files.

 The problem i am facing is that when i start the mirror, it
 attempts to do `ls -la` on the mirror site and then the process dies 
 with
 segmentation fault producing a core dump.
 Is there a limitation on the number of files to be present at the
 mirror site?

 Thanks
 Ankit









-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2015-05-13 Thread Alexander Lukyanov
There should be no limitations. Please produce a stack trace and send it to
me.

ср, 13 мая 2015, 18:34, Ankit Khurana ankit.khurana0...@gmail.com:


 Hi,

 I am trying to mirror files using lftp, the mirror path contains around 1
 million files.

 The problem i am facing is that when i start the mirror, it attempts to do
 `ls -la` on the mirror site and then the process dies with segmentation
 fault producing a core dump.
 Is there a limitation on the number of files to be present at the mirror
 site?

 Thanks
 Ankit


___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] Bug in lftp mirror when using xfer:use-temp-file option

2015-05-13 Thread Alexander Lukyanov
There should be no limitations. Please produce a stack trace and send it to
me.

ср, 13 мая 2015, 18:34, Ankit Khurana ankit.khurana0...@gmail.com:


 Hi,

 I am trying to mirror files using lftp, the mirror path contains around 1
 million files.

 The problem i am facing is that when i start the mirror, it attempts to do
 `ls -la` on the mirror site and then the process dies with segmentation
 fault producing a core dump.
 Is there a limitation on the number of files to be present at the mirror
 site?

 Thanks
 Ankit


___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] [LFTP] https_proxy

2015-03-03 Thread Alexander Lukyanov
Please turn on debug in lftp (command debug) and send me the output

пн, 2 марта 2015, 12:56, Vincent Lasselin vlasse...@lfdj.com:

 Hi Alexander,

 I've provided user and password with the https:proxy. But it's not
 working.
 It's working very well with the http:proxy variable if I try to access
 some http website.
 But it's not working for https.

 --
 Vincent Lasselin


  De : Alexander V. Lukyanov l...@netis.ru A: Vincent Lasselin 
 vlasse...@lfdj.com,  Cc : lftp@uniyar.ac.ru Date: 25/02/2015 09:06 Objet
 : Re: [lftp] [LFTP] https_proxy
 --



 On Tue, Feb 10, 2015 at 02:51:04PM +0100, Vincent Lasselin wrote:
  I'm using lftp to access an https url. I'm using an https proxy.
  I've set https_proxy variable and it's not working...
  With wireshark, I've constated that the CONNECT frame is send without
  credentials to my proxy :
 
  cd: Access failed: 407 Proxy Authentication Required (...)

 You have to provide user and password for the proxy. You can do it in the
 proxy URL:

 set https:proxy http://user:p...@your-proxy.example.com

 --
   Alexander.


 Si vous n’êtes pas destinataires de ce message, merci d’avertir
 l’expéditeur de l’erreur de distribution et de le détruire immédiatement.
 Ce message contient des informations confidentielles ou appartenant à la
 Française des jeux. Il est établi à l’intention exclusive de ses
 destinataires. Toute divulgation, utilisation, diffusion ou reproduction
 (totale ou partielle) de ce message ou des informations qu’il contient,
 doit être préalablement autorisée. Tout message électronique est
 susceptible d’altération et son intégrité ne peut être assurée. La
 Française des Jeux décline toute responsabilité au titre de ce message s’il
 a été modifié ou falsifié.
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] Handling for small files

2015-02-24 Thread Alexander Lukyanov
Which protocol do you use?

вт, 24 февр. 2015, 13:48, akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to transfer about 80GB of data using mirror option. File sizes
 are very small about 0.5 KB to 3 KB per file. Transfer is taking a lot of
 time which I am attributing to small file size. Is there any option in lftp
 which I can use to increase the transfer speed. May be some sort of
 compression option like rsync -av*z.*

 I know about the parallel file transfer option but I cant use it because I
 want to maintain the order of file transfer.

 Please help.


 Thanks,

 Akshay





___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] Handling for small files

2015-02-24 Thread Alexander Lukyanov
Which protocol do you use?

вт, 24 февр. 2015, 13:48, akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to transfer about 80GB of data using mirror option. File sizes
 are very small about 0.5 KB to 3 KB per file. Transfer is taking a lot of
 time which I am attributing to small file size. Is there any option in lftp
 which I can use to increase the transfer speed. May be some sort of
 compression option like rsync -av*z.*

 I know about the parallel file transfer option but I cant use it because I
 want to maintain the order of file transfer.

 Please help.


 Thanks,

 Akshay





___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Problem with Spam in Gmail with this list

2015-02-16 Thread Alexander Lukyanov
SPF record was recently fixed for the domain uniyar.ac.ru, so the spam
problem should become less frequent.

ср, 11 февр. 2015, 19:29, Juan Simón deced...@gmail.com:

 I've done it now, thanks.

 2015-02-11 17:10 GMT+01:00 Kai Stian Olstad kai.stian.ols...@gmail.com:

 On Wednesday 11. February 2015 09:43:26 Juan Simón wrote:
  I have a problem related to this mail list. Gmail considers some mails
 of
  this list like spam. I have added the email address of this list in
  contacts but it still occurs. Is there any solution?

 Create a filter an tick the box Never send it to Spam.

 --
 Kai Stian Olstad
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp


 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Fwd: sftp with an encrypted key

2014-12-18 Thread Alexander Lukyanov
Currently it is not possible as ftp does not ask for passwords
asynchronously, and the need for password arises only during the connection
phase.

4:23, ср, 10.12.2014, Andrew Schulman and...@utexas.edu:

  Specify the passphrase for the key as password for the connection. In the
  example you have provided, you have specified an empty passphrase, thus
 it
  failed to decrypt the key.
 
  If you don't want to give the passphrase in cleartext, don't specify a
  password in the URL and lftp will ask for a password, type the passphrase
  at the prompt.

 Thanks.  Now, is there a way to get lftp to prompt me for the password if
 the key needs one, and not prompt me if it doesn't?

 As far as I can tell, I can either specify

   open sftp://cyg...@cygwin.com

 and always be prompted, or

   open sftp://cygwin:@cygwin.com

 and never be prompted.  Is there a way to be prompted if and only if the
 key needs to be decrypted?

 Andrew

 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


{Disarmed} [lftp] {Disarmed} Re: Move files to ftp

2014-12-17 Thread Alexander Lukyanov
You can run rm -rf after mirror to remove any remaining files.

23:37, сб, 13.12.2014, Kai Stian Olstad kai.stian.ols...@gmail.com:

 Hi,

 I'm trying to move files recursive to a ftp server.
 Since mput doesn't support moving files recursive I'm using mirror instead.

 lftp -e 'mirror -c -p -R --Remove-source-files /source /target; bye' -u ftp
 ftp://192.168.1.10

 This sort of work since it remove the source files aka. move on the first
 run.
 But if the same files is copied in to /target directory again with cp -p to
 preserve the modification time, lftp doesn't put the file to the ftp server
 since the file already exist in /target and it doesn't remove the source
 file
 either.

 Shouldn't lftp remove the source anyway since I used the
 --Remove-source-files
 argument?

 Or is there another way to achieve this?


 --
 Kai Stian Olstad
 PS: I tried sending this mail from a different domain but it did not
 go through so I'll try with Gmail.
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


{Disarmed} [lftp] {Disarmed} Re: Move files to ftp

2014-12-17 Thread Alexander Lukyanov
Ok, I see the problem. I'll implement a solution.
17.12.2014 17:34 пользователь Kai Stian Olstad kai.stian.ols...@gmail.com
написал:

  Hi,



 My challenge is that I have no control over when files appear in the
 source folder, so running a rm -rf after a lftp most probably will delete
 new files that have been added to source.



 -

 Kai Stian





 On Wednesday 17. December 2014 12:05:18 Alexander Lukyanov wrote:

  You can run rm -rf after mirror to remove any remaining files.

 

  23:37, сб, 13.12.2014, Kai Stian Olstad kai.stian.ols...@gmail.com:

   Hi,

  

   I'm trying to move files recursive to a ftp server.

   Since mput doesn't support moving files recursive I'm using mirror

   instead.

  

   lftp -e 'mirror -c -p -R --Remove-source-files /source /target; bye' -u

   ftp

   ftp://192.168.1.10

  

   This sort of work since it remove the source files aka. move on the
 first

   run.

   But if the same files is copied in to /target directory again with cp
 -p

   to

   preserve the modification time, lftp doesn't put the file to the ftp

   server

   since the file already exist in /target and it doesn't remove the
 source

   file

   either.

  

   Shouldn't lftp remove the source anyway since I used the

   --Remove-source-files

   argument?

  

   Or is there another way to achieve this?

  

  

   --

   Kai Stian Olstad

   PS: I tried sending this mail from a different domain but it did not

   go through so I'll try with Gmail.

   ___

   lftp mailing list

   lftp@uniyar.ac.ru

   http://univ.uniyar.ac.ru/mailman/listinfo/lftp



___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Mirror and ASCII transfer selection

2014-12-13 Thread Alexander Lukyanov
There is no such feature in lftp. I don't think it's feasible to do: ascii
mode changes the file and the next mirror will consider the file changed
and thus re-transfer it.

2014-12-12 14:52 GMT+04:00 Franck Eyraud franck+l...@nospam.yrnm.net:

  Hi lftp list,

 Just a quick question, because I didn't find in the man page :

 Is it possible to select the transfert type (binary/ascii) based of file
 name pattern (e.g. download ascii all *.txt files) when mirroring a ftp
 server ?
 I remember that I saw this options on some graphical client, so I was
 wondering for lftp. I checked also the variables, but I didn't find any.

 Thank you for your help,

 Franck

 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp



-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


[lftp] Fwd: sftp with an encrypted key

2014-12-09 Thread Alexander Lukyanov
Specify the passphrase for the key as password for the connection. In the
example you have provided, you have specified an empty passphrase, thus it
failed to decrypt the key.

If you don't want to give the passphrase in cleartext, don't specify a
password in the URL and lftp will ask for a password, type the passphrase
at the prompt.

2014-12-09 13:01 GMT+03:00 Andrew Schulman and...@utexas.edu:

 To connect to an sftp site using an SSH private key, the standard advice is
 to use

   set sftp:connect-program ssh -a -x -i /path/to/key

 If the private key is unencrypted, this works fine.  (A key loaded in a
 running ssh-agent also works fine, without the above.)  But if the key is
 encrypted, the password prompt seems to be blocked:

 $ lftp sftp://cygwin:@cygwin.com
 lftp cyg...@cygwin.com:~ set sftp:connect-program ssh -a -x -i
 /path/to/key
 lftp cyg...@cygwin.com:~ ls
 `.' Delaying before reconnect: 30

 The text

   `.' Enter passphrase for key '/path/to/key': 

 sometimes appears briefly on the screen.  Eventually the connection
 fails.

 It seems that lftp is blocking the password input from the console.  Is
 this a known problem?  Any idea how hard it would be to fix?

 lftp 4.6.0 in Cygwin x86_64.

 Thanks,
 Andrew

 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp


-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] Possible Bug in lftp mirror using mirror:sort-by option

2014-12-08 Thread Alexander Lukyanov
rpmbuild -tb lftp-VERSION.tar.gz should do the trick.

10:19, пн, 08.12.2014, akshay gupta akshaygupta...@gmail.com:

 Hi Alexander,

 Can you please also tell the steps needed to build an rpm for lftp.

 ~ Akshay

 On Sat, Dec 6, 2014 at 12:42 AM, akshay gupta akshaygupta...@gmail.com
 wrote:

 Have done some initial high level testing. It seems to work. Will test it
 thoroughly and will get back to you in case I find any bug.

 On Fri, Dec 5, 2014 at 10:20 PM, Alexander Lukyanov lavv...@gmail.com
 wrote:

 I think you need to install gettext-devel.

 I have also made a snapshot in case you don't want to build from git:
 http://lftp.yar.ru/ftp/devel/lftp-4.6.0.20141205.tar.gz

 2014-12-05 9:43 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Its not working: I run the ./autogen.sh --without-gnutls --with-openssl
 command and it cannot seem to find Makefile.in in the configure step.
 Attached the complete logs



 On Thu, Dec 4, 2014 at 8:54 PM, Alexander Lukyanov lavv...@gmail.com
 wrote:

 autogen.sh script should generate everything. You'll have to get
 gnulib too.

 четверг, 4 декабря 2014 г. пользователь akshay gupta написал:

  I have cloned the lftp repo, can you please tell me the steps to
 create configure file and make script. I tried automake --force-missing
 --add-missing but its giving
 
  src/Makefile.am:45: NEED_TRIO does not appear in AM_CONDITIONAL
  src/Makefile.am: installing `build-aux/depcomp'
  Makefile.am:4: NEED_TRIO does not appear in AM_CONDITIONAL
  configure.ac:607: required file `lib/Makefile.in' not found
 
 
  ~ Akshay
 
  On Thu, Dec 4, 2014 at 4:56 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:
 
  On Wed, Dec 03, 2014 at 02:11:28PM +0400, Alexander Lukyanov wrote:
   It's almost done, needs to be tested and also some issues with
 sorting to
   be fixed.
  
   2014-12-03 10:26 GMT+03:00 akshay gupta akshaygupta...@gmail.com
 :
  
Are these feature present in LFTP implementation timeline? By
 when will
they be implemented?
 
  You can now test the feature (git ee6391e adds --scan-all-first
 option).
 
 https://github.com/lavv17/lftp/commit/ee6391e3213e12013894aa98508a1a151f542da0
 
  --
 Alexander.
 
 

 --
Alexander.





 --
Alexander.




___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp-devel] Possible Bug in lftp mirror using mirror:sort-by option

2014-12-05 Thread Alexander Lukyanov
I think you need to install gettext-devel.

I have also made a snapshot in case you don't want to build from git:
http://lftp.yar.ru/ftp/devel/lftp-4.6.0.20141205.tar.gz

2014-12-05 9:43 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Its not working: I run the ./autogen.sh --without-gnutls --with-openssl
 command and it cannot seem to find Makefile.in in the configure step.
 Attached the complete logs



 On Thu, Dec 4, 2014 at 8:54 PM, Alexander Lukyanov lavv...@gmail.com
 wrote:

 autogen.sh script should generate everything. You'll have to get gnulib
 too.

 четверг, 4 декабря 2014 г. пользователь akshay gupta написал:

  I have cloned the lftp repo, can you please tell me the steps to create
 configure file and make script. I tried automake --force-missing
 --add-missing but its giving
 
  src/Makefile.am:45: NEED_TRIO does not appear in AM_CONDITIONAL
  src/Makefile.am: installing `build-aux/depcomp'
  Makefile.am:4: NEED_TRIO does not appear in AM_CONDITIONAL
  configure.ac:607: required file `lib/Makefile.in' not found
 
 
  ~ Akshay
 
  On Thu, Dec 4, 2014 at 4:56 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:
 
  On Wed, Dec 03, 2014 at 02:11:28PM +0400, Alexander Lukyanov wrote:
   It's almost done, needs to be tested and also some issues with
 sorting to
   be fixed.
  
   2014-12-03 10:26 GMT+03:00 akshay gupta akshaygupta...@gmail.com:
  
Are these feature present in LFTP implementation timeline? By when
 will
they be implemented?
 
  You can now test the feature (git ee6391e adds --scan-all-first
 option).
 
 https://github.com/lavv17/lftp/commit/ee6391e3213e12013894aa98508a1a151f542da0
 
  --
 Alexander.
 
 

 --
Alexander.





-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp-devel] Possible Bug in lftp mirror using mirror:sort-by option

2014-11-12 Thread Alexander Lukyanov
I think it is possible and the amount of programming work is moderate. The
recursive model of mirror will stay but the file transfers will be deferred
and done on the top level when recursive directory traversal is finished.

2014-11-12 8:32 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Hi Alexander,

 Are there any plans for redesigning LFTP Mirror algorithm to build the
 whole recursive list first. How much change would that require if we go
 that path?

 Thanks,
 Akshay

 On Thu, Oct 30, 2014 at 4:44 PM, akshay gupta akshaygupta...@gmail.com
 wrote:

 lftp have options like --depth-first and --no-recursion I think it will
 make sense to have an option like   --iterative for iterative file
 transfer. This option will fetch the full file list and then fetch them
 iteratively.

 On Wed, Oct 29, 2014 at 2:29 PM, akshay gupta akshaygupta...@gmail.com
 wrote:

 I think the functionality of mirror:sort-by option implies that the
 order is for all the files irrespective of the directory structure. Or may
 be it should support both the options and it would be configuration defined
 which one to use.

 On Wed, Oct 29, 2014 at 2:09 PM, Alexander Lukyanov lavv...@gmail.com
 wrote:

 Mirror in lftp works directory by directory. It does not build full
 list of files first, so it cannot sort the whole list. Maybe the mirror
 algorithm should be redesigned to build the whole recursive list first.
 What do you think?

 2014-10-29 10:07 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to mirror files using mirror:sort-by option set to
 'date-desc'. My  file structure is like this

 $ ls -l -R
 total 3191264
 drwxr-xr-x  3 vikasgoyal  biadmin 102 Oct 22 12:35 1
 -rw-r--r--  1 vikasgoyal  biadmin   0 Aug  1 01:00 tmp.txt
 -rw-r--r--  1 vikasgoyal  biadmin   0 Aug  1 05:31 tmp1.txt
 -rw-r--r--  1 vikasgoyal  biadmin   263940738 Oct 28 13:51 abc.csv

 ./1:
 total 0
 drwxr-xr-x  4 vikasgoyal  biadmin  136 Oct 28 14:19 2

 ./1/2:
 total 515512
 -rw-r--r--  1 vikasgoyal  biadmin  0 Oct 28 14:19 3
 -rw-r--r--  1 vikasgoyal  biadmin  263940732 Oct 28 14:03 bc.csv


 I expect the file synch order should be

 ~/tmp.txt
 ~/tmp1.txt
 ~/abc.csv
 ~/1/2/bc.csv
 ~/1/2/3


 but the synch order is:
 ~/tmp.txt
 ~/tmp1.txt
 ~/1/2/bc.csv
 ~/1/2/3
 ~/abc.csv


 I think its the folder modification time that is causing this issue.
 Lftp considers folder synch time to decide the order even though files
 contained in the folder are newer then the remaining files in the parent
 folder. File synch order should be in order of the modification time
 irrespective of the folder structure. Please help.

 Thanks,
 Akshay








 --
Alexander.







-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-11-12 Thread Alexander Lukyanov
I think it is possible and the amount of programming work is moderate. The
recursive model of mirror will stay but the file transfers will be deferred
and done on the top level when recursive directory traversal is finished.

2014-11-12 8:32 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Hi Alexander,

 Are there any plans for redesigning LFTP Mirror algorithm to build the
 whole recursive list first. How much change would that require if we go
 that path?

 Thanks,
 Akshay

 On Thu, Oct 30, 2014 at 4:44 PM, akshay gupta akshaygupta...@gmail.com
 wrote:

 lftp have options like --depth-first and --no-recursion I think it will
 make sense to have an option like   --iterative for iterative file
 transfer. This option will fetch the full file list and then fetch them
 iteratively.

 On Wed, Oct 29, 2014 at 2:29 PM, akshay gupta akshaygupta...@gmail.com
 wrote:

 I think the functionality of mirror:sort-by option implies that the
 order is for all the files irrespective of the directory structure. Or may
 be it should support both the options and it would be configuration defined
 which one to use.

 On Wed, Oct 29, 2014 at 2:09 PM, Alexander Lukyanov lavv...@gmail.com
 wrote:

 Mirror in lftp works directory by directory. It does not build full
 list of files first, so it cannot sort the whole list. Maybe the mirror
 algorithm should be redesigned to build the whole recursive list first.
 What do you think?

 2014-10-29 10:07 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to mirror files using mirror:sort-by option set to
 'date-desc'. My  file structure is like this

 $ ls -l -R
 total 3191264
 drwxr-xr-x  3 vikasgoyal  biadmin 102 Oct 22 12:35 1
 -rw-r--r--  1 vikasgoyal  biadmin   0 Aug  1 01:00 tmp.txt
 -rw-r--r--  1 vikasgoyal  biadmin   0 Aug  1 05:31 tmp1.txt
 -rw-r--r--  1 vikasgoyal  biadmin   263940738 Oct 28 13:51 abc.csv

 ./1:
 total 0
 drwxr-xr-x  4 vikasgoyal  biadmin  136 Oct 28 14:19 2

 ./1/2:
 total 515512
 -rw-r--r--  1 vikasgoyal  biadmin  0 Oct 28 14:19 3
 -rw-r--r--  1 vikasgoyal  biadmin  263940732 Oct 28 14:03 bc.csv


 I expect the file synch order should be

 ~/tmp.txt
 ~/tmp1.txt
 ~/abc.csv
 ~/1/2/bc.csv
 ~/1/2/3


 but the synch order is:
 ~/tmp.txt
 ~/tmp1.txt
 ~/1/2/bc.csv
 ~/1/2/3
 ~/abc.csv


 I think its the folder modification time that is causing this issue.
 Lftp considers folder synch time to decide the order even though files
 contained in the folder are newer then the remaining files in the parent
 folder. File synch order should be in order of the modification time
 irrespective of the folder structure. Please help.

 Thanks,
 Akshay








 --
Alexander.







-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] ftp mode Z

2014-11-05 Thread Alexander Lukyanov
Mode Z is not supported. Compressed SSH should not be a problem.

2014-11-05 0:18 GMT+03:00 Farzin Hamrahi farzin...@gmail.com:

 Hi
 Does lftp support FTP Mode Z compression?
 Can I use compressed TCP/IP−Sessions using SSH with default
 sftp:connect-program by ssh -C option ?
 How aboute compressed TCP/IP−Sessions using SSH or ftp mode Z compression
 for mirror command ?

 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


[lftp] Re: some questions

2014-10-30 Thread Alexander Lukyanov
2014-10-30 13:10 GMT+03:00 Farzin Hamrahi farzin...@gmail.com:

 Hi
 Is lftp check transferred files check sum (md5sum or another ones) after
 transferring files with get or mirror command ?


It's possible. There is xfer:verify setting, when it's true the script
specified by xfer:verify-command is run. verify-file script is distributed
with lftp and it can check files against checksums in md5sum and *.sfv
files.
gzip, bzip2 and rpm can also be used to check file contents.


 If yes how that do ?
 Is it possible to read exclude or include matching files from list file or
 stdin ?


No, there is no such feature yet.

-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] Possible Bug in lftp mirror using mirror:sort-by option

2014-10-29 Thread Alexander Lukyanov
Mirror in lftp works directory by directory. It does not build full list of
files first, so it cannot sort the whole list. Maybe the mirror algorithm
should be redesigned to build the whole recursive list first. What do you
think?

2014-10-29 10:07 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to mirror files using mirror:sort-by option set to
 'date-desc'. My  file structure is like this

 $ ls -l -R
 total 3191264
 drwxr-xr-x  3 vikasgoyal  biadmin 102 Oct 22 12:35 1
 -rw-r--r--  1 vikasgoyal  biadmin   0 Aug  1 01:00 tmp.txt
 -rw-r--r--  1 vikasgoyal  biadmin   0 Aug  1 05:31 tmp1.txt
 -rw-r--r--  1 vikasgoyal  biadmin   263940738 Oct 28 13:51 abc.csv

 ./1:
 total 0
 drwxr-xr-x  4 vikasgoyal  biadmin  136 Oct 28 14:19 2

 ./1/2:
 total 515512
 -rw-r--r--  1 vikasgoyal  biadmin  0 Oct 28 14:19 3
 -rw-r--r--  1 vikasgoyal  biadmin  263940732 Oct 28 14:03 bc.csv


 I expect the file synch order should be

 ~/tmp.txt
 ~/tmp1.txt
 ~/abc.csv
 ~/1/2/bc.csv
 ~/1/2/3


 but the synch order is:
 ~/tmp.txt
 ~/tmp1.txt
 ~/1/2/bc.csv
 ~/1/2/3
 ~/abc.csv


 I think its the folder modification time that is causing this issue. Lftp
 considers folder synch time to decide the order even though files contained
 in the folder are newer then the remaining files in the parent folder. File
 synch order should be in order of the modification time irrespective of the
 folder structure. Please help.

 Thanks,
 Akshay








-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] Possible Bug in lftp mirror using mirror:sort-by option

2014-10-29 Thread Alexander Lukyanov
Mirror in lftp works directory by directory. It does not build full list of
files first, so it cannot sort the whole list. Maybe the mirror algorithm
should be redesigned to build the whole recursive list first. What do you
think?

2014-10-29 10:07 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to mirror files using mirror:sort-by option set to
 'date-desc'. My  file structure is like this

 $ ls -l -R
 total 3191264
 drwxr-xr-x  3 vikasgoyal  biadmin 102 Oct 22 12:35 1
 -rw-r--r--  1 vikasgoyal  biadmin   0 Aug  1 01:00 tmp.txt
 -rw-r--r--  1 vikasgoyal  biadmin   0 Aug  1 05:31 tmp1.txt
 -rw-r--r--  1 vikasgoyal  biadmin   263940738 Oct 28 13:51 abc.csv

 ./1:
 total 0
 drwxr-xr-x  4 vikasgoyal  biadmin  136 Oct 28 14:19 2

 ./1/2:
 total 515512
 -rw-r--r--  1 vikasgoyal  biadmin  0 Oct 28 14:19 3
 -rw-r--r--  1 vikasgoyal  biadmin  263940732 Oct 28 14:03 bc.csv


 I expect the file synch order should be

 ~/tmp.txt
 ~/tmp1.txt
 ~/abc.csv
 ~/1/2/bc.csv
 ~/1/2/3


 but the synch order is:
 ~/tmp.txt
 ~/tmp1.txt
 ~/1/2/bc.csv
 ~/1/2/3
 ~/abc.csv


 I think its the folder modification time that is causing this issue. Lftp
 considers folder synch time to decide the order even though files contained
 in the folder are newer then the remaining files in the parent folder. File
 synch order should be in order of the modification time irrespective of the
 folder structure. Please help.

 Thanks,
 Akshay








-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-28 Thread Alexander Lukyanov
It looks like a bug in the FS (fuse and/or hdfs) which also hits rsync:
https://groups.google.com/a/cloudera.org/forum/#!msg/cdh-user/R1GR2Asj_lc/f_uuIjG5R1UJ

Please try this workaround.

2014-10-28 10:29 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 will giving --delete-first option in lftp mirror help in my case? I think
 its not working in case of use-temp-file option. As per the man page its
 suppose to delete the old version of the file before it start downloading
 the new one. Its not doing anything. Please help.


 On Mon, Oct 27, 2014 at 11:50 PM, akshay gupta akshaygupta...@gmail.com
 wrote:

 I am using fuse mounted hadoop distributed file system(HDFS). Can you
 suggest what changes need to be done to make it work as this is a very
 critical requirement for my project. Will deleting file and then renaming
 temp file help? how to achieve that?

 On Mon, Oct 27, 2014 at 7:38 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:

 On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta wrote:
  now its producing 0 byte files and i am also getting input/output error
  here are the debug logs:
 
  copy: renaming `/mount/user/tom/test.txt_tmp_' to `test.txt'
  mirror: rename(/mount/user/tom/test.txt_tmp_,
 /mount/user/tom/test.txt):
  Input/output error

 Which filesystem do you use? Maybe it is necessary to unlink target file
 before renaming, although rename should do it automatically.

If  newpath already exists it will be atomically replaced
 (subject to a
few conditions; see ERRORS below), so that there is no point  at
 which
another process attempting to access newpath will find it missing.

 And man page for rename(2) does not list EIO error.

 --
Alexander.






-- 
   Alexander.


diff
Description: Binary data
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-28 Thread Alexander Lukyanov
It looks like a bug in the FS (fuse and/or hdfs) which also hits rsync:
https://groups.google.com/a/cloudera.org/forum/#!msg/cdh-user/R1GR2Asj_lc/f_uuIjG5R1UJ

Please try this workaround.

2014-10-28 10:29 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 will giving --delete-first option in lftp mirror help in my case? I think
 its not working in case of use-temp-file option. As per the man page its
 suppose to delete the old version of the file before it start downloading
 the new one. Its not doing anything. Please help.


 On Mon, Oct 27, 2014 at 11:50 PM, akshay gupta akshaygupta...@gmail.com
 wrote:

 I am using fuse mounted hadoop distributed file system(HDFS). Can you
 suggest what changes need to be done to make it work as this is a very
 critical requirement for my project. Will deleting file and then renaming
 temp file help? how to achieve that?

 On Mon, Oct 27, 2014 at 7:38 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:

 On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta wrote:
  now its producing 0 byte files and i am also getting input/output error
  here are the debug logs:
 
  copy: renaming `/mount/user/tom/test.txt_tmp_' to `test.txt'
  mirror: rename(/mount/user/tom/test.txt_tmp_,
 /mount/user/tom/test.txt):
  Input/output error

 Which filesystem do you use? Maybe it is necessary to unlink target file
 before renaming, although rename should do it automatically.

If  newpath already exists it will be atomically replaced
 (subject to a
few conditions; see ERRORS below), so that there is no point  at
 which
another process attempting to access newpath will find it missing.

 And man page for rename(2) does not list EIO error.

 --
Alexander.






-- 
   Alexander.


diff
Description: Binary data
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-28 Thread Alexander Lukyanov
BTW, it looks like mirror should remove the old file before transferring
the new one, please run mirror -vvv to check that. You can also run
strace to check system call sequence.

2014-10-28 11:18 GMT+03:00 Alexander Lukyanov lavv...@gmail.com:

 It looks like a bug in the FS (fuse and/or hdfs) which also hits rsync:

 https://groups.google.com/a/cloudera.org/forum/#!msg/cdh-user/R1GR2Asj_lc/f_uuIjG5R1UJ

 Please try this workaround.

 2014-10-28 10:29 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 will giving --delete-first option in lftp mirror help in my case? I think
 its not working in case of use-temp-file option. As per the man page its
 suppose to delete the old version of the file before it start downloading
 the new one. Its not doing anything. Please help.


 On Mon, Oct 27, 2014 at 11:50 PM, akshay gupta akshaygupta...@gmail.com
 wrote:

 I am using fuse mounted hadoop distributed file system(HDFS). Can you
 suggest what changes need to be done to make it work as this is a very
 critical requirement for my project. Will deleting file and then renaming
 temp file help? how to achieve that?

 On Mon, Oct 27, 2014 at 7:38 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:

 On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta wrote:
  now its producing 0 byte files and i am also getting input/output
 error
  here are the debug logs:
 
  copy: renaming `/mount/user/tom/test.txt_tmp_' to `test.txt'
  mirror: rename(/mount/user/tom/test.txt_tmp_,
 /mount/user/tom/test.txt):
  Input/output error

 Which filesystem do you use? Maybe it is necessary to unlink target file
 before renaming, although rename should do it automatically.

If  newpath already exists it will be atomically replaced
 (subject to a
few conditions; see ERRORS below), so that there is no point
 at  which
another process attempting to access newpath will find it
 missing.

 And man page for rename(2) does not list EIO error.

 --
Alexander.






 --
Alexander.




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander Lukyanov
Can you provide a debug log? Why lftp cannot replace the old file?

2014-10-27 10:44 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to mirror files using lftp, I have tested a use case where a
 file at the source machine gets modified but the file name remains the
 same. After mirroring, lftp is unable to replace the old file and also
 leaves a temporary file.

 For example. If source have file a.txt and its mirrored successfully at
 the destination, now if I update a.txt append some content and save it with
 same name. If I run lftp mirror again then its not able to replace the
 existing a.txt but it also leaves the temp file a.txt_transit_ behind. And
 if i run the mirror multiple times it always downloads the changed a.txt, i
 can see this from the lftp logs.

 Suggestion: Will it make sense to keep versions of the files as they are
 updated at the source. Like if a.txt is changed at source then lftp mirror
 will save it as a.txt_{TIMESTAMP}_. Every time a file is updated it will be
 saved with a new time stamp. And mirror will consider these file to decide
 whether to download or not.


 Thanks,
 Akshay







-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp-devel] [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander Lukyanov
I have found the bug. As a workaround, use set xfer:clobber yes.

2014-10-27 13:06 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 no, I am running as a root user. There is some issue with lftp, when file
 with same name already exist its not able to rename the temp file to actual
 file.

 On Mon, Oct 27, 2014 at 1:44 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:

 On Mon, Oct 27, 2014 at 01:30:42PM +0530, akshay gupta wrote:
  --- RETR test.txt
  --- 150 Opening BINARY mode data connection for 'test.txt' (202 bytes).
   Got EOF on data connection
   Closing data socket
  --- 226 Transfer complete.

 So the file cannot be renamed locally, right? Is there a permissions
 problem?

 --
Alexander.

  On Mon, Oct 27, 2014 at 1:18 PM, Alexander Lukyanov lavv...@gmail.com
  wrote:
 
   Can you provide a debug log? Why lftp cannot replace the old file?
  
   2014-10-27 10:44 GMT+03:00 akshay gupta akshaygupta...@gmail.com:
  
   Hi,
  
   I am trying to mirror files using lftp, I have tested a use case
 where a
   file at the source machine gets modified but the file name remains
 the
   same. After mirroring, lftp is unable to replace the old file and
 also
   leaves a temporary file.
  
   For example. If source have file a.txt and its mirrored successfully
 at
   the destination, now if I update a.txt append some content and save
 it with
   same name. If I run lftp mirror again then its not able to replace
 the
   existing a.txt but it also leaves the temp file a.txt_transit_
 behind. And
   if i run the mirror multiple times it always downloads the changed
 a.txt, i
   can see this from the lftp logs.
  
   Suggestion: Will it make sense to keep versions of the files as they
 are
   updated at the source. Like if a.txt is changed at source then lftp
 mirror
   will save it as a.txt_{TIMESTAMP}_. Every time a file is updated it
 will be
   saved with a new time stamp. And mirror will consider these file to
 decide
   whether to download or not.
  
  
   Thanks,
   Akshay
  
  
  
  
  
  
  
   --
  Alexander.
  

  ___
  lftp mailing list
  l...@uniyar.ac.ru
  http://univ.uniyar.ac.ru/mailman/listinfo/lftp





-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander Lukyanov
Can you provide a debug log? Why lftp cannot replace the old file?

2014-10-27 10:44 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to mirror files using lftp, I have tested a use case where a
 file at the source machine gets modified but the file name remains the
 same. After mirroring, lftp is unable to replace the old file and also
 leaves a temporary file.

 For example. If source have file a.txt and its mirrored successfully at
 the destination, now if I update a.txt append some content and save it with
 same name. If I run lftp mirror again then its not able to replace the
 existing a.txt but it also leaves the temp file a.txt_transit_ behind. And
 if i run the mirror multiple times it always downloads the changed a.txt, i
 can see this from the lftp logs.

 Suggestion: Will it make sense to keep versions of the files as they are
 updated at the source. Like if a.txt is changed at source then lftp mirror
 will save it as a.txt_{TIMESTAMP}_. Every time a file is updated it will be
 saved with a new time stamp. And mirror will consider these file to decide
 whether to download or not.


 Thanks,
 Akshay







-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander Lukyanov
I have found the bug. As a workaround, use set xfer:clobber yes.

2014-10-27 13:06 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 no, I am running as a root user. There is some issue with lftp, when file
 with same name already exist its not able to rename the temp file to actual
 file.

 On Mon, Oct 27, 2014 at 1:44 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:

 On Mon, Oct 27, 2014 at 01:30:42PM +0530, akshay gupta wrote:
  --- RETR test.txt
  --- 150 Opening BINARY mode data connection for 'test.txt' (202 bytes).
   Got EOF on data connection
   Closing data socket
  --- 226 Transfer complete.

 So the file cannot be renamed locally, right? Is there a permissions
 problem?

 --
Alexander.

  On Mon, Oct 27, 2014 at 1:18 PM, Alexander Lukyanov lavv...@gmail.com
  wrote:
 
   Can you provide a debug log? Why lftp cannot replace the old file?
  
   2014-10-27 10:44 GMT+03:00 akshay gupta akshaygupta...@gmail.com:
  
   Hi,
  
   I am trying to mirror files using lftp, I have tested a use case
 where a
   file at the source machine gets modified but the file name remains
 the
   same. After mirroring, lftp is unable to replace the old file and
 also
   leaves a temporary file.
  
   For example. If source have file a.txt and its mirrored successfully
 at
   the destination, now if I update a.txt append some content and save
 it with
   same name. If I run lftp mirror again then its not able to replace
 the
   existing a.txt but it also leaves the temp file a.txt_transit_
 behind. And
   if i run the mirror multiple times it always downloads the changed
 a.txt, i
   can see this from the lftp logs.
  
   Suggestion: Will it make sense to keep versions of the files as they
 are
   updated at the source. Like if a.txt is changed at source then lftp
 mirror
   will save it as a.txt_{TIMESTAMP}_. Every time a file is updated it
 will be
   saved with a new time stamp. And mirror will consider these file to
 decide
   whether to download or not.
  
  
   Thanks,
   Akshay
  
  
  
  
  
  
  
   --
  Alexander.
  

  ___
  lftp mailing list
  lftp@uniyar.ac.ru
  http://univ.uniyar.ac.ru/mailman/listinfo/lftp





-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Bug in lftp mirror when using xfer:use-temp-file option

2014-10-27 Thread Alexander Lukyanov
This change should fix the problem.
https://github.com/lavv17/lftp/commit/b1164d695393cf8ec8429bb2b5caa9f05cfc4d39

2014-10-27 14:20 GMT+03:00 Alexander Lukyanov lavv...@gmail.com:

 I have found the bug. As a workaround, use set xfer:clobber yes.

 2014-10-27 13:06 GMT+03:00 akshay gupta akshaygupta...@gmail.com:

 no, I am running as a root user. There is some issue with lftp, when file
 with same name already exist its not able to rename the temp file to actual
 file.

 On Mon, Oct 27, 2014 at 1:44 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:

 On Mon, Oct 27, 2014 at 01:30:42PM +0530, akshay gupta wrote:
  --- RETR test.txt
  --- 150 Opening BINARY mode data connection for 'test.txt' (202
 bytes).
   Got EOF on data connection
   Closing data socket
  --- 226 Transfer complete.

 So the file cannot be renamed locally, right? Is there a permissions
 problem?

 --
Alexander.

  On Mon, Oct 27, 2014 at 1:18 PM, Alexander Lukyanov lavv...@gmail.com
 
  wrote:
 
   Can you provide a debug log? Why lftp cannot replace the old file?
  
   2014-10-27 10:44 GMT+03:00 akshay gupta akshaygupta...@gmail.com:
  
   Hi,
  
   I am trying to mirror files using lftp, I have tested a use case
 where a
   file at the source machine gets modified but the file name remains
 the
   same. After mirroring, lftp is unable to replace the old file and
 also
   leaves a temporary file.
  
   For example. If source have file a.txt and its mirrored
 successfully at
   the destination, now if I update a.txt append some content and save
 it with
   same name. If I run lftp mirror again then its not able to replace
 the
   existing a.txt but it also leaves the temp file a.txt_transit_
 behind. And
   if i run the mirror multiple times it always downloads the changed
 a.txt, i
   can see this from the lftp logs.
  
   Suggestion: Will it make sense to keep versions of the files as
 they are
   updated at the source. Like if a.txt is changed at source then lftp
 mirror
   will save it as a.txt_{TIMESTAMP}_. Every time a file is updated it
 will be
   saved with a new time stamp. And mirror will consider these file to
 decide
   whether to download or not.
  
  
   Thanks,
   Akshay
  
  
  
  
  
  
  
   --
  Alexander.
  

  ___
  lftp mailing list
  lftp@uniyar.ac.ru
  http://univ.uniyar.ac.ru/mailman/listinfo/lftp





 --
Alexander.




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Question regarding fix in 4.6.0

2014-10-21 Thread Alexander Lukyanov
No, it isn't. I have decided that the change is too significant to include
in a maintenance release. Use 4.6. And I don't consider it a serious bug -
it was there for years and nobody complained.
21.10.2014 14:47 пользователь tilo.mue...@bertelsmann.de написал:

  Hi Alexander,

 we’ve seen that in 4.6.0 a bug “ftp: wait for QUIT reply before closing
 control socket.” was fixed. Can you please tell us, if this fixed bug is
 present in release 4.5.6 ?



 Thanks and regards,

 Tilo



 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp


___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Question regarding fix in 4.6.0

2014-10-21 Thread Alexander Lukyanov
Failed transfers are most probably not related to the QUIT issue. To
determine the cause for failed transfers it is necessary to analyse traces,
debug logs, maybe packet dumps.

The QUIT issue is only related to control connection termination, not to
data transfers.
21.10.2014 16:43 пользователь tilo.mue...@bertelsmann.de написал:

  OK, thank you.



 Just for your information: We’re using a managed file transfer (MFT)
 product called Ayway Synchrony Gateway as a multi-protocol service
 (supports FTP, FTPS, SFTP, HTTPS, and so on). And this solution checks for
 complete transfers, which means it checks the data flow, if a transfer is
 correct or not. And if it’s not correct we will get an interrupted
 transfer. Most of our transfers between Synchrony Gateway - lftp works
 fine, but every now and then we’ll get failed transfers. So this bug is
 quite important for us, but I wonder why most of the transfers are working
 fine, if this bug was already in lftp for years. Any idea?



 *From:* Alexander Lukyanov [mailto:lavv...@gmail.com]
 *Sent:* Tuesday, October 21, 2014 1:03 PM
 *To:* Mütze, Tilo, NMD-C4.2
 *Subject:* Re: [lftp] Question regarding fix in 4.6.0



 I mean: it is not fixed in 4.5.6.

 21.10.2014 15:01 пользователь Alexander Lukyanov lavv...@gmail.com
 написал:

 No, it isn't. I have decided that the change is too significant to include
 in a maintenance release. Use 4.6. And I don't consider it a serious bug -
 it was there for years and nobody complained.

 21.10.2014 14:47 пользователь tilo.mue...@bertelsmann.de написал:

 Hi Alexander,

 we’ve seen that in 4.6.0 a bug “ftp: wait for QUIT reply before closing
 control socket.” was fixed. Can you please tell us, if this fixed bug is
 present in release 4.5.6 ?



 Thanks and regards,

 Tilo




 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] possible bug in lftp mirror using xfer:use-temp-file option

2014-09-30 Thread Alexander Lukyanov
In unix it is usually allowed to rename open files, so lftp does that. I'll
see if it is possible to reverse the order.

2014-09-30 12:18 GMT+04:00 akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to mirror files on Fuse mounted hdfs file system (
 https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0
 byte files.

 Observations:
 1. Files of size larger then 64k are getting transferred properly. Smaller
 files have 0 byte file size.
 2. Debug logs shows that lftp downloaded data for the files correctly. It
 also renamed them.

 Additional tests on fuse mounted hdfs.
 - I created a file with a temp file name, written the data to it, then
 renamed the file and finally closed the output stream. In this case it
 creates a 0 byte file.
 - I created a file with a temp file name, written the data to it, closed
 the file and then renamed the file. In this case it creates the file
 correctly.


 Can someone please look into this issue, it might be possible that stream
 is closed after the file is renamed.

 Thanks,
 Akshay






-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] possible bug in lftp mirror using xfer:use-temp-file option

2014-09-30 Thread Alexander Lukyanov
In unix it is usually allowed to rename open files, so lftp does that. I'll
see if it is possible to reverse the order.

2014-09-30 12:18 GMT+04:00 akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to mirror files on Fuse mounted hdfs file system (
 https://wiki.apache.org/hadoop/MountableHDFS). Lftp is creating some 0
 byte files.

 Observations:
 1. Files of size larger then 64k are getting transferred properly. Smaller
 files have 0 byte file size.
 2. Debug logs shows that lftp downloaded data for the files correctly. It
 also renamed them.

 Additional tests on fuse mounted hdfs.
 - I created a file with a temp file name, written the data to it, then
 renamed the file and finally closed the output stream. In this case it
 creates a 0 byte file.
 - I created a file with a temp file name, written the data to it, closed
 the file and then renamed the file. In this case it creates the file
 correctly.


 Can someone please look into this issue, it might be possible that stream
 is closed after the file is renamed.

 Thanks,
 Akshay






-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp does not wait for 221 Goodbye message before closing control connection

2014-09-26 Thread Alexander Lukyanov
I cannot reproduce it. Please use strace on the lftp process, also use
pstack PID on it and send me the output.

2014-09-26 6:26 GMT+04:00 Stephen Powell zlinux...@wowway.com:

 On Tue, 23 Sep 2014 01:49:57 -0400 (EDT), Alexander V. Lukyanov wrote:
  On Mon, Sep 22, 2014 at 10:02:29PM -0400, Stephen Powell wrote:
  I tried setting both of these server options to yes and tried my get
 with
  lftp again.  The last few lines of output in the debug file are now as
 follows:
 
   Got EOF on data connection
   Closing data socket
  --- 426 Failure writing network stream.
   received all data but no EOF
 
  Please test this change.

 Yes, the patch worked, for this specific test case.  But I am having
 a problem connecting to a different server which does not support
 TLS.  In this case, I'm using lftp interactively instead of via a
 script.  After issuing the close command, I receive the 221 Goodbye.
 response from the server, and an lftp command prompt.  But I can't type
 anything at the prompt.  I type exit on the keyboard, but it is not
 echoed on the screen.  The whole program appears to be hung.  Eventually,
 after several minutes, I get a closing idle connection message and
 the exit command shows up on the screen, followed by program termination.
 I rather doubt that this last patch is responsible.  I think it's something
 in how the close command is processed.  It has to work in both TLS and
 non-TLS environments.  It currently seems to have a problem in non-TLS
 environments.

 --
   .''`. Stephen Powellzlinux...@wowway.com
  : :'  :
  `. `'`
`-
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] tail -f

2014-09-22 Thread Alexander Lukyanov
You can get easy tail -f with fish protocol or with a plain ssh:
   quote tail -f /log/error.log


2014-09-22 21:17 GMT+04:00 Alexander Lukyanov lavv...@gmail.com:

 Loop is easy: repeat 2s cat /log/error.log | tail
 tail -f is harder, it's in TODO for a long time. but I did not get to
 implementing it.

 2014-09-22 19:59 GMT+04:00 Szépe Viktor vik...@szepe.net:


 Now I issue `cat /log/error.log | tail` one in a while to see log file
 changes

 1
 It is possible to loop `cat /log/error.log | tail; sleep2` ?

 2
 Is it possible to add a tail -f feature?
 To see only the new lines.

 Thank you!

 Szépe Viktor
 --
 +36-20-4242498  s...@szepe.net  skype: szepe.viktor
 Budapest, XX. kerület





 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




 --
Alexander.




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] [lftp] Status for incomplete files

2014-09-19 Thread Alexander Lukyanov
Please try http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz, it
introduces another setting xfer:temp-file-name. You can thus change the
temporary file name; an asterisk is replaced by the original file name. So
you would do set xfer:temp-file-name _tmp_* to achieve wanted behaviour.

2014-09-19 11:11 GMT+04:00 akshay gupta akshaygupta...@gmail.com:

 Hi Alexander,

 Thanks for the reply!

 I tried using this and it seems to works prefixing .in. to files
 getting transferred.

 What is the expected release date for this development version?

 Does it also have an additional setting to use custom flags for temporary
 files. Like if i want _tmp_ prefixed to temporary files.

 ~ Akshay

 On Fri, Sep 19, 2014 at 12:09 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:

 On Fri, Sep 19, 2014 at 01:36:18AM +0530, akshay gupta wrote:
  I am looking for a way to know the file is still getting transferred
 and is
  incomplete. Some file downloaders  append some token such as _tmp or
  something else to the file name until its getting transferred when the
 file
  transfer completes its renamed to its original name. I know about pget
  option which creates a *lftp-pget-status* file but I prefer more direct
  option.

 Please try development snapshot
http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140918.tar.gz
 with xfer:use-temp-file set to yes.

 --
Alexander.



 ___
 lftp mailing list
 l...@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp-devel] [lftp] Status for incomplete files

2014-09-19 Thread Alexander Lukyanov
It will be released in one or two weeks.

2014-09-19 15:38 GMT+04:00 akshay gupta akshaygupta...@gmail.com:

 Thanks a lot Alexander, when will these features come out in release
 version? I want to use these features in production, would be best if I
 could use a stable version.

 On Fri, Sep 19, 2014 at 4:58 PM, Alexander Lukyanov lavv...@gmail.com
 wrote:

 Please try http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz, it
 introduces another setting xfer:temp-file-name. You can thus change the
 temporary file name; an asterisk is replaced by the original file name. So
 you would do set xfer:temp-file-name _tmp_* to achieve wanted behaviour.

 2014-09-19 11:11 GMT+04:00 akshay gupta akshaygupta...@gmail.com:

 Hi Alexander,

 Thanks for the reply!

 I tried using this and it seems to works prefixing .in. to files
 getting transferred.

 What is the expected release date for this development version?

 Does it also have an additional setting to use custom flags
 for temporary files. Like if i want _tmp_ prefixed to temporary files.

 ~ Akshay

 On Fri, Sep 19, 2014 at 12:09 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:

 On Fri, Sep 19, 2014 at 01:36:18AM +0530, akshay gupta wrote:
  I am looking for a way to know the file is still getting transferred
 and is
  incomplete. Some file downloaders  append some token such as _tmp or
  something else to the file name until its getting transferred when
 the file
  transfer completes its renamed to its original name. I know about pget
  option which creates a *lftp-pget-status* file but I prefer more
 direct
  option.

 Please try development snapshot
http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140918.tar.gz
 with xfer:use-temp-file set to yes.

 --
Alexander.



 ___
 lftp mailing list
 l...@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




 --
Alexander.





-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] lftp does not wait for 221 Goodbye message before closing control connection

2014-09-19 Thread Alexander Lukyanov
Look for gnutls_bye (gnutls) or SSL_shutdown (openssl) calls. See
https://github.com/lavv17/lftp/commit/fc468dc987cb45bab4a3d31a1e832601bc239774
for the change.

2014-09-19 3:24 GMT+04:00 Stephen Powell zlinux...@wowway.com:

 As to your claim that the new development snapshot of lftp
 does indeed send a close_notify alert to the server prior to
 closing the control connection when TLS is used, I guess I'll
 have to take your word for it.  I could not find the word alert
 anywhere in the source package, and the word notify could only be
 found in reference to notifying other jobs of some event.  Of
 course, there are lots of references to close.  Too many.
 I can't separate the wheat from the chaff.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Status for incomplete files

2014-09-19 Thread Alexander Lukyanov
It will be released in one or two weeks.

2014-09-19 15:38 GMT+04:00 akshay gupta akshaygupta...@gmail.com:

 Thanks a lot Alexander, when will these features come out in release
 version? I want to use these features in production, would be best if I
 could use a stable version.

 On Fri, Sep 19, 2014 at 4:58 PM, Alexander Lukyanov lavv...@gmail.com
 wrote:

 Please try http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140919.tar.gz, it
 introduces another setting xfer:temp-file-name. You can thus change the
 temporary file name; an asterisk is replaced by the original file name. So
 you would do set xfer:temp-file-name _tmp_* to achieve wanted behaviour.

 2014-09-19 11:11 GMT+04:00 akshay gupta akshaygupta...@gmail.com:

 Hi Alexander,

 Thanks for the reply!

 I tried using this and it seems to works prefixing .in. to files
 getting transferred.

 What is the expected release date for this development version?

 Does it also have an additional setting to use custom flags
 for temporary files. Like if i want _tmp_ prefixed to temporary files.

 ~ Akshay

 On Fri, Sep 19, 2014 at 12:09 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:

 On Fri, Sep 19, 2014 at 01:36:18AM +0530, akshay gupta wrote:
  I am looking for a way to know the file is still getting transferred
 and is
  incomplete. Some file downloaders  append some token such as _tmp or
  something else to the file name until its getting transferred when
 the file
  transfer completes its renamed to its original name. I know about pget
  option which creates a *lftp-pget-status* file but I prefer more
 direct
  option.

 Please try development snapshot
http://lftp.yar.ru/ftp/devel/lftp-4.5.5.20140918.tar.gz
 with xfer:use-temp-file set to yes.

 --
Alexander.



 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




 --
Alexander.





-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp does not wait for 221 Goodbye message before closing control connection

2014-09-17 Thread Alexander Lukyanov
Can you send me a sample of the script?

2014-09-17 6:36 GMT+04:00 Stephen Powell zlinux...@wowway.com:

 On Tue, 16 Sep 2014 02:38:21 -0400 (EDT), Alexander Lukyanov wrote:
 
  Here is a patch to make lftp wait for QUIT reply at exit.  I think to
 avoid
  lingering one can set use-quit no.

 OK.  Thanks for the patch.  But it does not work as intended.  It doesn't
 seem to break anything, but neither does it fix anything.  I still don't
 get the 221 Goodbye. message most of the time.  Most of the time, the
 control connection gets closed before the 221 message arrives.  In order
 to get the 221 message consistently, I have to add a delay to the end of
 the script.  For example,

 !sleep 1

 This introduces enough delay that the 221 message arrives prior to
 shutdown.
 But this is a kludge.  I shouldn't have to do that.

 --
   .''`. Stephen Powell
  : :'  :
  `. `'`
`-
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp does not wait for 221 Goodbye message before closing control connection

2014-09-17 Thread Alexander Lukyanov
Here is an additional patch to wait for QUIT reply after close command.

2014-09-17 10:50 GMT+04:00 Alexander Lukyanov lavv...@gmail.com:

 Ok, I could reproduce the proble you see. For now try to remove the
 close command from the script.

 2014-09-17 10:47 GMT+04:00 Alexander Lukyanov lavv...@gmail.com:

 Can you send me a sample of the script?

 2014-09-17 6:36 GMT+04:00 Stephen Powell zlinux...@wowway.com:

 On Tue, 16 Sep 2014 02:38:21 -0400 (EDT), Alexander Lukyanov wrote:
 
  Here is a patch to make lftp wait for QUIT reply at exit.  I think to
 avoid
  lingering one can set use-quit no.

 OK.  Thanks for the patch.  But it does not work as intended.  It doesn't
 seem to break anything, but neither does it fix anything.  I still don't
 get the 221 Goodbye. message most of the time.  Most of the time, the
 control connection gets closed before the 221 message arrives.  In order
 to get the 221 message consistently, I have to add a delay to the end of
 the script.  For example,

 !sleep 1

 This introduces enough delay that the 221 message arrives prior to
 shutdown.
 But this is a kludge.  I shouldn't have to do that.

 --
   .''`. Stephen Powell
  : :'  :
  `. `'`
`-
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




 --
Alexander.




 --
Alexander.




-- 
   Alexander.


diff1
Description: Binary data
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp does not wait for 221 Goodbye message before closing control connection

2014-09-16 Thread Alexander Lukyanov
Here is a patch to make lftp wait for QUIT reply at exit. I think to avoid
lingering one can set use-quit no.

2014-09-16 3:44 GMT+04:00 Stephen Powell zlinux...@wowway.com:

 On Mon, 15 Sep 2014 05:04:36 -0400 (EDT), Alexander V. Lukyanov wrote:
 
  As far as I can tell, lftp does not wait for QUIT reply only when it
  exits.  Is it really necessary to linger at exit to wait for clean
  connection shutdown?

 Well, I don't know if necessary is the right word; but it is the
 expected behavior to wait for a 221 reply to the QUIT command before
 closing the control connection.  That's what all other FTP clients do.
 On the other hand, lftp has a long-standing tradition of being as
 asynchronous as possible and as fast as possible, and I respect
 that tradition as well.

 I propose a compromise.  Let's introduce a new set variable.  Maybe
 we could call it ftp:wait-for-goodbye, or something along those lines.
 It would be a boolean variable.  You could make its default value no
 for forward compatibility with the current behavior.  If set to yes,
 then lftp will wait for a 221 Goodbye. message to be received in
 response to the QUIT command before closing the control connection.
 What do you think?

 --
   .''`. Stephen Powell
  : :'  :
  `. `'`
`-
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.


diff
Description: Binary data
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Why is PROT P issued twice?

2014-09-08 Thread Alexander Lukyanov
Please send the debug log (use command debug to turn it on).

2014-09-06 18:58 GMT+04:00 Stephen Powell zlinux...@wowway.com:


 I searched the mailing list archives, but I was unable to find anything
 related to this.  The lftp client is issuing the PROT P command to the
 server twice, back to back.  Why does it do this?  Is there any way to
 prevent it?  In the overall grand scheme of things, this really isn't
 very important, as it doesn't really hurt anything; but the client
 should know that it just issued this command and therefore doesn't need
 to issue it again.

 --
   .''`. Stephen Powell
  : :'  :
  `. `'`
`-
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] mirror feature request and tab completion bug

2014-08-29 Thread Alexander Lukyanov
Tab completion is not perfect, but you can switch local/remote completion
by using Meta-Tab (or Esc+Tab) combination.



2014-08-29 1:33 GMT+04:00 Dan39 dda...@gmail.com:

 Hello, I have been using lftp for a while and love it! Thank you very much.

 When mirroring it would be a huge help if it was possible to have
 multiple source directories. example: If i do mirror a b c stuff/ it
 will mirror the remote directories a b and c into stuff/

 but with this also brings to light the problem of tab completions. how
 would lftp know when to tab complete for remote or local directories,
 besides knowing the first one you start typing is of course the remote
 directory. the best way im thinking is to add an option like -o
 local/ and always tab complete for remote directory until the -o
 option is typed (tho if -o is not given the last directory would still
 be used as local directory so that old scripts work as expected)

 and it already looks like this is a bug with mirror and tab
 completion. whenever i type the argument for an option, like -x git
 it will start tab completing for the local directories when I want it
 to tab complete for remote. it seems this is since i typed the word
 git which is not preceded with a -/--

 doing mirror sourcedir target/ -x hi actually does work and allows
 me to type the directories with proper tab completion and still add
 the options, but the man section for mirror specifies to do the
 options before source/target directories, Are there any potential
 problems/bugs with putting the options at end?

 It looks like --exclude=hi also works at beginning of command and
 doesnt break the tab completion after it, but that is a lot more
 typing :P

 Thanks,
 Dan
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp-devel] [lftp] FW: Regarding LFTP checksum issue

2014-06-09 Thread Alexander Lukyanov
Do you have checksum issues if you use plain get command? Does pget work
as expected with other ftp servers?


2014-04-01 13:15 GMT+04:00 PRADHAN Priyabrata priyabrata.prad...@murex.com
:

  Fyia



 Thanks

 Priya



 *From:* PRADHAN Priyabrata
 *Sent:* Tuesday, April 01, 2014 6:14 PM
 *To:* 'l...@yars.free.net'
 *Subject:* Regarding LFTP checksum issue



 Hi Alexander V. Lukyanov,



 Thanks for this lftp tool.

 We are testing this tool.

 It’s a good tool having good features.

 But checksum is not intact after ftp.

 Any work around?

 We are using



 lftp -u user,passwd -e 'pget -n 20 -c file' remote server



 Thanks

 Priya



 ***

 This e-mail contains information for the intended recipient only. It may
 contain proprietary material or confidential information. If you are not
 the intended recipient you are not authorised to distribute, copy or use
 this e-mail or any attachment to it. Murex cannot guarantee that it is
 virus free and accepts no responsibility for any loss or damage arising
 from its use. If you have received this e-mail in error please notify
 immediately the sender and delete the original email received, any
 attachments and all copies from your system.

 ___
 lftp mailing list
 l...@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp] Trying to create a directory

2014-06-06 Thread Alexander Lukyanov
Git HEAD sources now contain mkdir -f option for quiet operation. Funny
that mkdirJob had already boolean quiet flag.


2014-01-04 18:47 GMT+04:00 Gianni Piccini g...@antani.se:

 Hi to all. I would ask if there is a solution to my (mainly estethic)
 problem. I use lftp launching it with a script in parameters:

 lftp -f script.txt

 I need to upload some files in a server that has many files e directories
 (so, a complete mirror is not good due the needed time), and I compose the
 script in this way:

 open -u myuser,mypass ftp.mysite.com
 mkdir -p /www/dir1
 put -a -c -O /www/dir2 /home/me/upload/index.txt
 mkdir -p /www/dir2
 put -c -O /www/dir2 /home/me/upload/image.jpg
 quit

 Sometimes files are not present in the server, or directory could not
 exist, so, if overwriting with new files is handled by switch -c, I've put
 the command mkdir -p before upload, but, that's my question, there is any
 way to silently create the directory or try to create it only if not
 exists, or avoiding error messages if it is already present?
 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] forward slash on root not allowed

2014-05-12 Thread Alexander Lukyanov
Please send the debug output of lftp. Which protocol do you use?


2014-05-12 3:55 GMT+04:00 Robert DuToit rdut...@comcast.net:

 Hi Alexander,

 I have found that some servers won’t allow a forward slash at root level.
 leaving it off solves the problem but otherwise an error is thrown “mkdir….
  permission denied”

 I am trying to test for this and adjust the paths sent to lftp but it is
 tricky. I didn’t know if there is any way to catch this in lftp and then
 remove the slash.

 Best,  Rob



 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp




-- 
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Can't connect to FreeBSD sftp

2014-03-11 Thread Alexander Lukyanov
I think you can try to use strace to find out what data lftp receives from
the connection (if any). Then compare that with the data lftp receives from
other sftp servers.
Also it would help if you provided me with access to a FreeBSD sftp account.

-- 
   Alexander.



2014-02-19 5:16 GMT+04:00 Michael Ross g...@ross.cx:

 Hello,


 I can't connect to any FreeBSD-sftp servers.

 I get this in my sshd log:

 Feb 19 02:00:14 host sshd[74322]: Connection from x.x.x.x port 63552
 Feb 19 02:00:14 host sshd[74322]: Failed publickey for michael from
 x.x.x.x port 63552 ssh2
 Feb 19 02:00:14 host sshd[74322]: Postponed keyboard-interactive for
 michael from x.x.x.x port 63552 ssh2 [preauth]

 and there the connection stalls, lftp stays at

 --- sending a packet, length=5, type=1(INIT), id=0
 »ls« bei 0 [Verbinde...]

 I tried lftp 4.4.0 and 4.4.15 (on FreeBSD 9.2), 4.4.9 (on Cygwin), 4.4.14
 (on FreeBSD 9.1),
 they all connect to other sftp-servers fine, but not to any of me FreeBSD
 ones.

 At the same time, the sftp servers seem to be alright, I can connect to
 them using other clients.


 What can I do?

 Regards,

 Michael

 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] tell if file is directory

2014-01-30 Thread Alexander Lukyanov
You can try to use cls command, then analyze the output, or just try to
cd to the could-be-directory and act depending on the resulting exit
code, like this:

   cd DIR  do-something
   cd DIR || do-something-else



2014-01-27 Robert DuToit rdut...@comcast.net:

 Hi Alexander,

 Is there a way to tell if a file is a directory via lftp on server. I need
 to differentiate for a script that downloads various chosen files and
 folders.

 Locally no problem as I can just use the TCL command:

 set is_dir  [file isdirectory $this_file]

 Thanks,  rob




 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Continuous Mirror of new folders

2014-01-18 Thread Alexander Lukyanov
You can use repeat mirror command for continuous mirroring. attach
command can be used to control backgrounded lftp instance. HTH.
17.01.2014 19:02 пользователь Purple Nugs purplen...@gmail.com написал:



 I would like to make something so that lftp never disconnects from an ftp
 and constantly mirrors a directory and it's sub directories.



 Is there a way to send commands to an already connected lftp instance?

 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp


___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] SSH key trouble

2014-01-18 Thread Alexander Lukyanov
Does plain ssh try to use WT key? Try in lftp set | grep WT.
09.01.2014 18:34 пользователь John Niendorf j...@jfniendorf.org написал:

 Hi Everyone,

 I'm running the latest stable version of lftp on a laptop running Ubuntu
 12.04

 My problem is I recently changed SSH keys and lftp still looks for the old
 key.

 The key is stored in ~/.ssh
 The old key was called WT
 The new key is called the name of the site I connect to.

 When I type lftp in the terminal I get the message that there is no such
 file as ~/.ssh/WT
 Then I am able to connect securely using the new key.

 I've tried setting which key to use in both ~/.lftp/rc  and ~/lftprc  but
 the problem persists.

 I wonder why is lftp still expecting the old key?  Does anyone know how I
 can make lftp forget that key?

 I've looked all over for an answer but cannot find one.

 Thank you,

 John

 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] mirror hangs itself / gets stuck

2013-12-27 Thread Alexander Lukyanov
I'd recommend to use newest stable lftp version (4.4.14). Then try several
possibilities to access the server:
1. disable ssl (set ftp:ssl-allow no) or disable ssl for file listings
connections only (set ftp:ssl-protect-list no)
2. try to use fish or sftp if they are allowed (open fish://user@server)

-- 
   Alexander.


2013/12/15 Matthias Kauer softw...@matthiaskauer.com

 Hi,

 I am trying to sync my wordpress installation from my host's FTP to my home
 computer. I have ssh access, but the server is very limited in what
 commands
 it offers; in particular, there's no rsync.

 My version is:
 matthias@volcano:~$ lftp --version
 LFTP | Version 4.3.8 | Copyright (c) 1996-2012 Alexander V. Lukyanov
 on a ubuntu 13.04 computer.

 Therefore, I tried to go ahead with something like this:
 lftp -u A,B -e'mirror --parallel=10 httpdocs/
 website_backup/matthiaskauer.com' matthiaskauer.com
 This command got stuck after a while, only retrieving directory information
 after a while and then reaching max retries after a really long time.

 I figured this may be caused by symlinks on the server that create a loop.
 I tested only synchronizing a subdirectory (about 46M) with less
 parallelization and -n and it worked.
 lftp -u A,B -e'mirror -n --parallel=4 --no-symlinks httpdocs/dokuwiki/
 test3;exit' matthiaskauer.com

 I added debugging and tried the same for the entire server structure again:
 lftp -d -u A,B -e'mirror -n --parallel=4 --no-symlinks httpdocs/
 test3;exit'
 matthiaskauer.com 2 lftplog.txt

 The messages I get in the command prompt are:
  dokuwiki/lib/plugins/indexmenu/conf: Getting directory contents (0)
 [Delaying before retry]
  tt-rss-bef1.7.10/schema/versions/pgsql: Getting directory contents (0)
 [Delaying before retry]
 owncloud/owncloud/apps/files_trashbin: Getting directory contents (0)
 [Delaying before retry]
  dokuwiki/lib/plugins/indexmenu/conf: Getting directory contents (0)
 [Connection idle]

 The debug log is quite lengthy. At the end, the following seems to repeat
 itself (pasted below)

 Thanks for your help and best regards,
 Matthias Kauer

 --- PASV
 --- PASV
 --- 227 Entering Passive Mode (212,224,89,152,153,160).
  Connecting data socket to (212.224.89.152) port 39328
 --- 227 Entering Passive Mode (212,224,89,152,180,98).
  Connecting data socket to (212.224.89.152) port 46178
  Data connection established
 --- LIST
  Data connection established
 --- LIST
 --- 150 Opening ASCII mode data connection for file list
 --- 150 Opening ASCII mode data connection for file list
 Certificate: C=US,ST=Virginia,L=Herndon,O=Parallels,OU=Parallels
 Panel,CN=Parallels Panel,EMAIL=i...@parallels.com
  Issued by: C=US,ST=Virginia,L=Herndon,O=Parallels,OU=Parallels
 Panel,CN=Parallels Panel,EMAIL=i...@parallels.com
 WARNING: Certificate verification: Not trusted
 WARNING: Certificate verification: certificate common name doesn't match
 requested host name ‘matthiaskauer.com’
 Certificate: C=US,ST=Virginia,L=Herndon,O=Parallels,OU=Parallels
 Panel,CN=Parallels Panel,EMAIL=i...@parallels.com
  Issued by: C=US,ST=Virginia,L=Herndon,O=Parallels,OU=Parallels
 Panel,CN=Parallels Panel,EMAIL=i...@parallels.com
 WARNING: Certificate verification: Not trusted
 WARNING: Certificate verification: certificate common name doesn't match
 requested host name ‘matthiaskauer.com’
 --- 425 Unable to build data connection: Operation not permitted
  Closing data socket
 --- 425 Unable to build data connection: Operation not permitted
  Closing data socket
 --- PASV
 --- PASV
 --- 227 Entering Passive Mode (212,224,89,152,160,245).
  Connecting data socket to (212.224.89.152) port 41205
 --- 227 Entering Passive Mode (212,224,89,152,188,96).
  Connecting data socket to (212.224.89.152) port 48224
  Data connection established
 --- LIST
  Data connection established
 --- LIST
 --- 150 Opening ASCII mode data connection for file list
 --- 150 Opening ASCII mode data connection for file list
 Certificate: C=US,ST=Virginia,L=Herndon,O=Parallels,OU=Parallels
 Panel,CN=Parallels Panel,EMAIL=i...@parallels.com
  Issued by: C=US,ST=Virginia,L=Herndon,O=Parallels,OU=Parallels
 Panel,CN=Parallels Panel,EMAIL=i...@parallels.com
 WARNING: Certificate verification: Not trusted
 WARNING: Certificate verification: certificate common name doesn't match
 requested host name ‘matthiaskauer.com’
 Certificate: C=US,ST=Virginia,L=Herndon,O=Parallels,OU=Parallels
 Panel,CN=Parallels Panel,EMAIL=i...@parallels.com
  Issued by: C=US,ST=Virginia,L=Herndon,O=Parallels,OU=Parallels
 Panel,CN=Parallels Panel,EMAIL=i...@parallels.com
 WARNING: Certificate verification: Not trusted
 WARNING: Certificate verification: certificate common name doesn't match
 requested host name ‘matthiaskauer.com’
 --- 425 Unable to build data connection: Operation not permitted
  Closing data socket
 --- 425 Unable to build data connection: Operation not permitted
  Closing data socket
 --- PASV

 --- 

Re: [lftp] Weird behavior using get command in lftp

2013-12-27 Thread Alexander Lukyanov
Please use newest lftp version (4.4.14) and turn on debug output using
debug command.

-- 
   Alexander.


2013/12/13 Rey Guillen rey.n.guil...@gmail.com

 Hi.

 I'm getting a weired behavior when doing a get command in lftp.  one the
 flat files I'm trying to extract from the sftp server  becomes empty (zero
 byte file) when it gets to the destination folder.

 I'm using lftp so I can automate the extract from the sftp server.

 Do you know the reason for this behavior?

 Please advise.


 Thanks.
 Rey


 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp


___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] Unable to Compile LFTP with OPENSSL under Debian Wheezy

2013-11-07 Thread Alexander Lukyanov
lftp --version gets the openssl version from SSL_version_str variable in
case it is available. Probably the version of openssl does not provide that
variable. It should not affect other operations though.

And BTW, on fedora 19 lftp shows openssl version correctly.


2013/11/7 Purple Nugs purplen...@gmail.com

 I am unable to compile lftp using openssl under debian Wheezy.  I have
 tried all three using lftp-4.4.10
 ./configure --with-openssl=/usr
 ./configure --with-openssl=/usr/lib
 ./configure --with-openssl=/usr/lib/openssl

 When I make the source and do ldd i see libssl and libcrypto in the list:
 linux-vdso.so.1 =  (0x7fffc51fe000)
  libexpat.so.1 = /lib/x86_64-linux-gnu/libexpat.so.1 (0x7f1a35814000)
 libz.so.1 = /lib/x86_64-linux-gnu/libz.so.1 (0x7f1a355fd000)
  libssl.so.1.0.0 = /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0
 (0x7f1a3539d000)
 libcrypto.so.1.0.0 = /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0
 (0x7f1a34fb9000)
  librt.so.1 = /lib/x86_64-linux-gnu/librt.so.1 (0x7f1a34db1000)
 libreadline.so.6 = /lib/x86_64-linux-gnu/libreadline.so.6
 (0x7f1a34b69000)
  libutil.so.1 = /lib/x86_64-linux-gnu/libutil.so.1 (0x7f1a34966000)
 libtinfo.so.5 = /lib/x86_64-linux-gnu/libtinfo.so.5 (0x7f1a3473d000)
  libdl.so.2 = /lib/x86_64-linux-gnu/libdl.so.2 (0x7f1a34538000)
 libgcc_s.so.1 = /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x7f1a34322000)
  libc.so.6 = /lib/x86_64-linux-gnu/libc.so.6 (0x7f1a33f98000)
 /lib64/ld-linux-x86-64.so.2 (0x7f1a35a47000)
  libpthread.so.0 = /lib/x86_64-linux-gnu/libpthread.so.0
 (0x7f1a33d7b000)


 However, when I do ./lftp --version I don't see OpenSSL
 Libraries used: Readline 6.2, Expat 2.1.0, zlib 1.2.7

 And when I connect to the ftp using the above strange version i see:
  SSL_connect: error::lib(0):func(0):reason(0)







 On my other box ( running slackware 14.0 ) lftp (version 4.3.8) compiled
 just fine with openssl showing ./lftp --version of:
 Libraries used: Readline 5.2, Expat 2.0.1, OpenSSL 1.0.1e 11 Feb 2013






 Is there a trick to install lftp using OpenSSL under Debian Wheezy can not
 figure it out since GnuTLS is not going to work for the ftp I need to
 connect to.

 ___
 lftp mailing list
 lftp@uniyar.ac.ru
 http://univ.uniyar.ac.ru/mailman/listinfo/lftp


___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp mirror not removing directories...

2013-07-02 Thread Alexander Lukyanov
--Remove-source-files removes only plain files, not directories. It's done
that way because the direcories could contain other files which were not
downloaded (e.g. because they were excluded or they are present locally
already).

2013/6/25 Chris Richards chris...@routemaster.net

 One small issue I have noticed is that directories on the server are not
 being removed, all the files in the directories are being removed though.

mirror --Remove-source-files -X .* -X .*/ -c
 --log=/share/Download/logs/downloads-sync-lastrun.log $remote_dir $local_dir

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] getenv issue

2013-05-30 Thread Alexander Lukyanov
I have applied the fix. It will be available in the next lftp version (in
github now).
Thank you!

2013/5/19 Shigeharu Isoda s-is...@ricelabo.com

 But I found lftp ignores getenv() return value, this causes
 segmentation fault, while lftp invoked on no 'TERM' environment
 variable, such as cron job.

 Here is a simple patch.

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] How to mirror (with FXP) specific dir

2013-05-13 Thread Alexander Lukyanov
lftp reconnects as needed, so you don't have to keep those connections open
all the times.

If the connections are anonymous, you can just do:
   mirror URL1 URL2

If a login/password is required, you have to login first so that lftp
remembers the password. Them you can use the URL without a password.
   login ftps://user@host
   mirror ftps://user@host URL2

You can also use bookmarks to remember those URLs and refer to them by name:
   bookmark add site1 URL1
   bookmark add site2 URL2
   mirror bm:site1 bm:site2


2013/5/6 Hernan Lopes hernanlo...@gmail.com

 Could you give an example?

 My intent is to connect to many ftps..  and leave them open/idling
 connected, and i will keep sending those commands to transfer dirs from
 some source into some destiny


 On Mon, May 6, 2013 at 10:17 AM, Alexander Lukyanov lavv...@gmail.comwrote:

 Use  or set fail-exit yes.

 BTW, mirror automatically creates the target directory and you can
 specify target URL directly without any slots.

 --
Alexander.

 2013/5/6 Hernan Lopes hernanlo...@gmail.com

 slot FTPDESTINY; mkdir /some/other/dirs/This-Dir-Destiny; cd
 /some/other/dirs/This-Dir-Destiny;

 Then, FTPDESTINY was busy and conclusion: none of those commands were
 executed and i am at directory /the/wrong/directory/

 And then comes the next command which is:

 slot FTPSOURCE; mirror /some/dirs/This-Dir-Source slot:FTPDESTINY

 And BAAAM, its going to mirror into /the/wrong/directory/

 So to solve this, i think the whole tihng should be passed all together
 within one command so either the whole thing works or none of it... at
 least it will always act correctly.



___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp


Re: [lftp] lftp-4.4.4 ipv6 question

2013-04-23 Thread Alexander Lukyanov
Try set dns:order inet.

-- 
   Alexander.



2013/4/24 Justin Piszcz jpis...@lucidpixels.com

 Aside from changing lftp to disable IPv6 support, is there a way to
 disable IPv6 for transfers or to prefer IPv4 for the initial connection?
  By default if IPv6 module/option is loaded in the Linux kernel it tries
 IPv6 first, can this be made an option to use one first over the other
 and/or use IPv4 or IPv6 explicitly?

___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp