subject:"Re\: \[lftp\] download speed drops sharply"

Re: [lftp] download speed drops sharply

2016-05-04 Thread Juan Simón

Thanks, but it's solved.

___
Escrito desde el móvil
El 4 may. 2016 1:26 PM, "Alexander Lukyanov"  escribió:

> Can you please try "set ftp:prefer-epsv no"?
>
> пт, 29 апр. 2016 г. в 19:22, Juan Simón :
>
>> I think the problem isn't in lftp.
>> I see messages like this when I execute "jobs -v" to see active
>> transfers: "[500 I won't open a connection to 192.168.1.2 (only to
>> )]", ¿?
>> I didn't see this message before. In server side there isn't any message
>> like this in log. Any idea?
>> Regards.
>>
>> 2016-04-29 14:50 GMT+02:00 Alexander V. Lukyanov :
>>
>>> On Fri, Apr 29, 2016 at 11:28:07AM +0200, Juan Simón wrote:
>>> > I'm testing with another server and same problem.
>>> > I've defined in config file:
>>> > ...
>>> > set mirror:no-empty-dirs yes;
>>> > set mirror:order "/*";
>>> > set mirror:parallel-directories yes;
>>> > set mirror:parallel-transfer-count 5;
>>> > set mirror:set-permissions no;
>>> > set mirror:use-pget-n 3;
>>> > 
>>> >
>>> > But when I execute 'jobs -v 1' only I see 3 downloads:
>>>
>>> I guess all other files have been transferred already.
>>> mirror:parallel-transfer-count is only applied to different files,
>>> mirror:use-pget-n is applied to every single file.
>>>
>>> --
>>>Alexander.
>>>
>>
>> ___
>> lftp mailing list
>> lftp@uniyar.ac.ru
>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] download speed drops sharply

2016-05-04 Thread Alexander Lukyanov

Can you please try "set ftp:prefer-epsv no"?

пт, 29 апр. 2016 г. в 19:22, Juan Simón :

> I think the problem isn't in lftp.
> I see messages like this when I execute "jobs -v" to see active transfers:
> "[500 I won't open a connection to 192.168.1.2 (only to
> )]", ¿?
> I didn't see this message before. In server side there isn't any message
> like this in log. Any idea?
> Regards.
>
> 2016-04-29 14:50 GMT+02:00 Alexander V. Lukyanov :
>
>> On Fri, Apr 29, 2016 at 11:28:07AM +0200, Juan Simón wrote:
>> > I'm testing with another server and same problem.
>> > I've defined in config file:
>> > ...
>> > set mirror:no-empty-dirs yes;
>> > set mirror:order "/*";
>> > set mirror:parallel-directories yes;
>> > set mirror:parallel-transfer-count 5;
>> > set mirror:set-permissions no;
>> > set mirror:use-pget-n 3;
>> > 
>> >
>> > But when I execute 'jobs -v 1' only I see 3 downloads:
>>
>> I guess all other files have been transferred already.
>> mirror:parallel-transfer-count is only applied to different files,
>> mirror:use-pget-n is applied to every single file.
>>
>> --
>>Alexander.
>>
>
> ___
> lftp mailing list
> lftp@uniyar.ac.ru
> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] download speed drops sharply

2016-04-29 Thread Juan Simón

I think the problem isn't in lftp.
I see messages like this when I execute "jobs -v" to see active transfers:
"[500 I won't open a connection to 192.168.1.2 (only to
)]", ¿?
I didn't see this message before. In server side there isn't any message
like this in log. Any idea?
Regards.

2016-04-29 14:50 GMT+02:00 Alexander V. Lukyanov :

> On Fri, Apr 29, 2016 at 11:28:07AM +0200, Juan Simón wrote:
> > I'm testing with another server and same problem.
> > I've defined in config file:
> > ...
> > set mirror:no-empty-dirs yes;
> > set mirror:order "/*";
> > set mirror:parallel-directories yes;
> > set mirror:parallel-transfer-count 5;
> > set mirror:set-permissions no;
> > set mirror:use-pget-n 3;
> > 
> >
> > But when I execute 'jobs -v 1' only I see 3 downloads:
>
> I guess all other files have been transferred already.
> mirror:parallel-transfer-count is only applied to different files,
> mirror:use-pget-n is applied to every single file.
>
> --
>Alexander.
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] download speed drops sharply

2016-04-29 Thread Alexander V. Lukyanov

On Fri, Apr 29, 2016 at 11:28:07AM +0200, Juan Simón wrote:
> I'm testing with another server and same problem.
> I've defined in config file:
> ...
> set mirror:no-empty-dirs yes;
> set mirror:order "/*";
> set mirror:parallel-directories yes;
> set mirror:parallel-transfer-count 5;
> set mirror:set-permissions no;
> set mirror:use-pget-n 3;
> 
>
> But when I execute 'jobs -v 1' only I see 3 downloads:

I guess all other files have been transferred already.
mirror:parallel-transfer-count is only applied to different files,
mirror:use-pget-n is applied to every single file.

--
   Alexander.
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] download speed drops sharply

2016-04-29 Thread Juan Simón

I'm testing with another server and same problem.
I've defined in config file:
...
set mirror:no-empty-dirs yes;
set mirror:order "/*";
set mirror:parallel-directories yes;
set mirror:parallel-transfer-count 5;
set mirror:set-permissions no;
set mirror:use-pget-n 3;


But when I execute 'jobs -v 1' only I see 3 downloads:

[1] mirror Synchronicity 2015 LIMITED COMPLETE BLURAY-BAKED/  -- 8.0G/24G
(33%) 3.25 MiB/s
 \mirror `BDMV'  -- 8.0G/24G (33%) 3.25 MiB/s
  \mirror `BDMV/STREAM'  -- 8.0G/24G (33%) 3.25 MiB/s
   \transfer `BDMV/STREAM/2.m2ts'
`2.m2ts', se obtuvieron 4926432740 de 20894730240 (23%) 3.25M/s
falta:84m
   \chunk 0-6964910080
`2.m2ts' en 1669761120 (7%) 1.14M/s falta:76m [Recibiendo datos]
   \chunk 13929820160-20894730239
`2.m2ts' en 15502994980 (22%) 1.00M/s falta:84m [Recibiendo datos]
   \chunk 6964910080-13929820159
`2.m2ts' en 8648406880 (24%) 1.11M/s falta:77m [Recibiendo datos]

In server side only there are 3 established connections:
  PID %CPU %MEM   TIME COMMAND
 7321  0.1  0.0   0:01 proftpd: x: RETR 2.m2ts
 7584  0.1  0.0   0:01 proftpd: x: RETR 2.m2ts
 7586  0.1  0.0   0:01 proftpd: x: RETR 2.m2ts

I'm using lftp v4.7.1
---

Another question is about the jobs command, the help says:
$ help jobs
Uso: jobs [-v] []
List running jobs. -v means verbose, several -v can be specified.
If  is specified, only list a job with that number.

If I specify more than one "-v", should I see more info about that job?
Because actually it shows always the same info.

Regards.


2016-04-24 21:12 GMT+02:00 Juan Simón :

> It's a weird problem. I don't know why it occurs. I've tested with 2 FTP
> servers: vsftpd and Pure-FTPd but it fails with both. It starts well but
> after a few minutes the download speed drops sharply.
> I've tested with another FTP servers near to my server but it fails with
> another error:
>
> $ lftp --norc ftp://ubuntu.mirrors.ovh.net -e "debug 5"
> lftp ubuntu.mirrors.ovh.net:~> ls
>  Connecting to ubuntu.mirrors.ovh.net (2001:41d0:1:7c8b::1) port 21
>  connect(control_sock): Cannot assign requested address
> ls: Cannot assign requested address
>
> $ lftp --norc ftp://ftp.crihan.fr/releases/ -e "debug 5"
> cd: Cannot assign requested address
> lftp ftp.crihan.fr:~> ls
>  Connecting to ftp.crihan.fr (2001:660:7401:211::36) port 21
>  connect(control_sock): Cannot assign requested address
> ls: Cannot assign requested address
> 
> IPv6? I have disabled IPv6 totally in my system
> /router
> :
>
> net.ipv6.conf.all.disable_ipv6 = 1
> net.ipv6.conf.default.disable_ipv6 = 1
> net.ipv6.conf.internet.disable_ipv6 = 1
> net.ipv6.conf.lo.disable_ipv6 = 1
> net.ipv6.conf.vten.disable_ipv6 = 1
>
> I can connect from the browser, gFTP and GNU ftp.
>
> My lftp config: http://pastebin.com/YqEJfLmR
>
> The debug log: http://pastebin.com/KLH3k9FZ
>
> I've seen the next line in debug: "AUTH TLS" and I have disabled SSL (I
> don't need it) with: "set ftp:ssl-allow no;" but it still shows those
> lines: http://pastebin.com/bmyLK0GY
>
> I have done many tests but I can not determine where the problem is. :-(
>
> Any idea?
> Regards.
>
>
> 2016-04-23 21:47 GMT+02:00 Alexander Lukyanov :
>
>> Please turn on debug and see the ftp protocol details, it may shed some
>> light.
>>
>> сб, 23 апр. 2016 г. в 17:28, Juan Simón :
>>
>>> With lftp v4.6.5 is fails too. The curious thing is that it works well
>>> for a while at start. I've tested with pget and same problem.
>>> I have defined in config file:
>>> ...
>>> set pget:default-n 6;
>>> set pget:min-chunk-size 4M;
>>> set pget:save-status 2s;
>>> ...
>>>
>>> But it shows only 2:
>>> ...
>>> $ jobs -vv
>>>  [1] pget -c Munich (2005) (Ed.USA) [Remux AVC 1080p DTS-HD 5.1 Esp-Eng
>>> Subs][Cachotronco][GrupoHDS].mkv  -- 13.1 KiB/s
>>> ftp://monsi@sys/%2Ftorrent-descargas/pelis
>>> `Munich (2005) (Ed.USA) [Remux AVC 1080p DTS-HD 5.1 Esp-Eng
>>> Subs][Cachotronco][GrupoHDS].mkv', se obtuvieron 36110696993 de 43319521696
>>> (83%) 13.1K/s falta:6d1h
>>>   \chunk 14439840568-21659760849
>>> `Munich (2005) (Ed.USA) [Remux AVC 1080p DTS-HD 5.1 Esp-Eng
>>> Subs][Cachotronco][GrupoHDS].mkv' en 14450936147 (0%) 13.1K/s falta:6d1h
>>> [Recibiendo datos]
>>>
>>> And this is the connections list with my server:
>>> $ ss -ta | grep -i IP-server
>>> ESTAB  0  0  192.168.1.2:55947
>>>  IP-server:13439
>>> ESTAB  0  0  192.168.1.2:59774
>>>  IP-server:zoomcp
>>> CLOSE-WAIT 0  0  192.168.1.2:58064IP-server:ftp
>>>
>>> ESTAB  0  0  192.168.1.2:58072IP-server:ftp
>>>
>>> ESTAB  4590008 0  192.168.1.2:45404
>>>  IP-server:30142
>>> ...
>>>
>>> Any help?
>>> Thanks.
>>>
>>> 2016-04-23 15:54 GMT+02:00 Juan Simón :
>>>
 lftp v4.7.1
 Arch Linux 64 bits

 I have

Re: [lftp] download speed drops sharply

2016-04-24 Thread Juan Simón

It's a weird problem. I don't know why it occurs. I've tested with 2 FTP
servers: vsftpd and Pure-FTPd but it fails with both. It starts well but
after a few minutes the download speed drops sharply.
I've tested with another FTP servers near to my server but it fails with
another error:

$ lftp --norc ftp://ubuntu.mirrors.ovh.net -e "debug 5"
lftp ubuntu.mirrors.ovh.net:~> ls
 Connecting to ubuntu.mirrors.ovh.net (2001:41d0:1:7c8b::1) port 21
 connect(control_sock): Cannot assign requested address
ls: Cannot assign requested address

$ lftp --norc ftp://ftp.crihan.fr/releases/ -e "debug 5"
cd: Cannot assign requested address
lftp ftp.crihan.fr:~> ls
 Connecting to ftp.crihan.fr (2001:660:7401:211::36) port 21
 connect(control_sock): Cannot assign requested address
ls: Cannot assign requested address

IPv6? I have disabled IPv6 totally in my system
/router
:

net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv6.conf.internet.disable_ipv6 = 1
net.ipv6.conf.lo.disable_ipv6 = 1
net.ipv6.conf.vten.disable_ipv6 = 1

I can connect from the browser, gFTP and GNU ftp.

My lftp config: http://pastebin.com/YqEJfLmR

The debug log: http://pastebin.com/KLH3k9FZ

I've seen the next line in debug: "AUTH TLS" and I have disabled SSL (I
don't need it) with: "set ftp:ssl-allow no;" but it still shows those
lines: http://pastebin.com/bmyLK0GY

I have done many tests but I can not determine where the problem is. :-(

Any idea?
Regards.


2016-04-23 21:47 GMT+02:00 Alexander Lukyanov :

> Please turn on debug and see the ftp protocol details, it may shed some
> light.
>
> сб, 23 апр. 2016 г. в 17:28, Juan Simón :
>
>> With lftp v4.6.5 is fails too. The curious thing is that it works well
>> for a while at start. I've tested with pget and same problem.
>> I have defined in config file:
>> ...
>> set pget:default-n 6;
>> set pget:min-chunk-size 4M;
>> set pget:save-status 2s;
>> ...
>>
>> But it shows only 2:
>> ...
>> $ jobs -vv
>>  [1] pget -c Munich (2005) (Ed.USA) [Remux AVC 1080p DTS-HD 5.1 Esp-Eng
>> Subs][Cachotronco][GrupoHDS].mkv  -- 13.1 KiB/s
>> ftp://monsi@sys/%2Ftorrent-descargas/pelis
>> `Munich (2005) (Ed.USA) [Remux AVC 1080p DTS-HD 5.1 Esp-Eng
>> Subs][Cachotronco][GrupoHDS].mkv', se obtuvieron 36110696993 de 43319521696
>> (83%) 13.1K/s falta:6d1h
>>   \chunk 14439840568-21659760849
>> `Munich (2005) (Ed.USA) [Remux AVC 1080p DTS-HD 5.1 Esp-Eng
>> Subs][Cachotronco][GrupoHDS].mkv' en 14450936147 (0%) 13.1K/s falta:6d1h
>> [Recibiendo datos]
>>
>> And this is the connections list with my server:
>> $ ss -ta | grep -i IP-server
>> ESTAB  0  0  192.168.1.2:55947
>>  IP-server:13439
>> ESTAB  0  0  192.168.1.2:59774
>>  IP-server:zoomcp
>> CLOSE-WAIT 0  0  192.168.1.2:58064IP-server:ftp
>>
>> ESTAB  0  0  192.168.1.2:58072IP-server:ftp
>>
>> ESTAB  4590008 0  192.168.1.2:45404
>>  IP-server:30142
>> ...
>>
>> Any help?
>> Thanks.
>>
>> 2016-04-23 15:54 GMT+02:00 Juan Simón :
>>
>>> lftp v4.7.1
>>> Arch Linux 64 bits
>>>
>>> I have defined in my rc config file:
>>> ...
>>> set mirror:exclude-regex "^.+\.[pP][aA][rR][tT]$|^.+\.[uU][rR][lL]$";
>>> set mirror:no-empty-dirs yes;
>>> set mirror:order "/*";
>>> set mirror:parallel-directories yes;
>>> set mirror:parallel-transfer-count 2;
>>> set mirror:set-permissions no;
>>> set mirror:use-pget-n 6;
>>> 
>>>
>>> But I have download a folder with mirror and only there are 2 threads:
>>>
>>> $ jobs -vvv
>>> 
>>> [1] mirror STAR_WARS_EPISODE_IV_THE_FORCE_AWAKENS/  -- 42G/42G (99%)
>>> 27.0 KiB/s
>>>   \mirror `BDMV'  -- 42G/42G (99%) 27.0 KiB/s
>>>\mirror `BDMV/STREAM'  -- 42G/42G (99%) 27.0 KiB/s
>>> \transfer `BDMV/STREAM/00155.m2ts'
>>> `00155.m2ts', se obtuvieron 602416339 de 635123712 (94%) 27.0K/s
>>> falta:20m
>>> \chunk 423415808-529269759
>>> `00155.m2ts' en 510521379 (82%) 19.5K/s falta:18m [Recibiendo datos]
>>> \chunk 211707904-317561855
>>> `00155.m2ts' en 303602864 (86%) 7.5K/s falta:20m [Recibiendo datos]
>>>
>>> I've noticed this because the download speed is very slow. Generally the
>>> download speed is ~323mbps and today is ~300kbps. I have tested with iperf
>>> between my FTP server and the link is right.
>>> I'll test it with lftp v4.6.5.
>>>
>>> Regards.
>>>
>>
>> ___
>> lftp mailing list
>> lftp@uniyar.ac.ru
>> http://univ.uniyar.ac.ru/mailman/listinfo/lftp
>>
>
___
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Re: [lftp] download speed drops sharply

Re: [lftp] download speed drops sharply

Re: [lftp] download speed drops sharply

Re: [lftp] download speed drops sharply

Re: [lftp] download speed drops sharply

Re: [lftp] download speed drops sharply

6 matches

Site Navigation

Mail list logo

Footer information