Re: [lftp-devel] Handling for small files

2015-02-24 Thread Alexander Lukyanov
Which protocol do you use?

вт, 24 февр. 2015, 13:48, akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to transfer about 80GB of data using mirror option. File sizes
 are very small about 0.5 KB to 3 KB per file. Transfer is taking a lot of
 time which I am attributing to small file size. Is there any option in lftp
 which I can use to increase the transfer speed. May be some sort of
 compression option like rsync -av*z.*

 I know about the parallel file transfer option but I cant use it because I
 want to maintain the order of file transfer.

 Please help.


 Thanks,

 Akshay





___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


[lftp-devel] Handling for small files

2015-02-24 Thread akshay gupta
Hi,

I am trying to transfer about 80GB of data using mirror option. File sizes
are very small about 0.5 KB to 3 KB per file. Transfer is taking a lot of
time which I am attributing to small file size. Is there any option in lftp
which I can use to increase the transfer speed. May be some sort of
compression option like rsync -av*z.*

I know about the parallel file transfer option but I cant use it because I
want to maintain the order of file transfer.

Please help.


Thanks,

Akshay
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp-devel] Handling for small files

2015-02-24 Thread akshay gupta
I am using fish protocol.

On Tue, Feb 24, 2015, 4:23 PM Alexander Lukyanov lavv...@gmail.com wrote:

 Which protocol do you use?

 вт, 24 февр. 2015, 13:48, akshay gupta akshaygupta...@gmail.com:

 Hi,

 I am trying to transfer about 80GB of data using mirror option. File
 sizes are very small about 0.5 KB to 3 KB per file. Transfer is taking a
 lot of time which I am attributing to small file size. Is there any option
 in lftp which I can use to increase the transfer speed. May be some sort of
 compression option like rsync -av*z.*

 I know about the parallel file transfer option but I cant use it because
 I want to maintain the order of file transfer.

 Please help.


 Thanks,

 Akshay





___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp-devel] Handling for small files

2015-02-24 Thread Alexander V. Lukyanov
On Tue, Feb 24, 2015 at 11:07:23AM +, akshay gupta wrote:
 I am using fish protocol.

If possible, try to use sftp. Fish is not quite the most efficient option.
Even ftp is better, especially with pipelining (set ftp:sync-mode off).

-- 
   Alexander.

 On Tue, Feb 24, 2015, 4:23 PM Alexander Lukyanov lavv...@gmail.com wrote:
 
  Which protocol do you use?
 
  вт, 24 февр. 2015, 13:48, akshay gupta akshaygupta...@gmail.com:
 
  Hi,
 
  I am trying to transfer about 80GB of data using mirror option. File
  sizes are very small about 0.5 KB to 3 KB per file. Transfer is taking a
  lot of time which I am attributing to small file size. Is there any option
  in lftp which I can use to increase the transfer speed. May be some sort of
  compression option like rsync -av*z.*
 
  I know about the parallel file transfer option but I cant use it because
  I want to maintain the order of file transfer.
 
  Please help.
 
 
  Thanks,
 
  Akshay
 
 
 
 
 
___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel


Re: [lftp-devel] Possible Bug in lftp mirror using mirror:sort-by option

2015-02-24 Thread akshay gupta
Its not working: I run the ./autogen.sh --without-gnutls --with-openssl
command and it cannot seem to find Makefile.in in the configure step.
Attached the complete logs



On Thu, Dec 4, 2014 at 8:54 PM, Alexander Lukyanov lavv...@gmail.com
wrote:

 autogen.sh script should generate everything. You'll have to get gnulib
 too.

 четверг, 4 декабря 2014 г. пользователь akshay gupta написал:

  I have cloned the lftp repo, can you please tell me the steps to create
 configure file and make script. I tried automake --force-missing
 --add-missing but its giving
 
  src/Makefile.am:45: NEED_TRIO does not appear in AM_CONDITIONAL
  src/Makefile.am: installing `build-aux/depcomp'
  Makefile.am:4: NEED_TRIO does not appear in AM_CONDITIONAL
  configure.ac:607: required file `lib/Makefile.in' not found
 
 
  ~ Akshay
 
  On Thu, Dec 4, 2014 at 4:56 PM, Alexander V. Lukyanov l...@netis.ru
 wrote:
 
  On Wed, Dec 03, 2014 at 02:11:28PM +0400, Alexander Lukyanov wrote:
   It's almost done, needs to be tested and also some issues with
 sorting to
   be fixed.
  
   2014-12-03 10:26 GMT+03:00 akshay gupta akshaygupta...@gmail.com:
  
Are these feature present in LFTP implementation timeline? By when
 will
they be implemented?
 
  You can now test the feature (git ee6391e adds --scan-all-first option).
 
 https://github.com/lavv17/lftp/commit/ee6391e3213e12013894aa98508a1a151f542da0
 
  --
 Alexander.
 
 

 --
Alexander.


[root@localhost lftp]# ./autogen.sh --without-gnutls --with-openssl
processing .
Creating ./aclocal.m4 ...
Running gettextize...  Ignore non-fatal messages.
Not copying intl/ directory.
Copying file po/Makefile.in.in
Copying file po/boldquot.sed
Copying file po/en@boldquot.header
Copying file po/en@quot.header
Copying file po/insert-header.sin
Copying file po/Makevars.template
Copying file po/quot.sed
Copying file po/remove-potcdate.sin
Copying file po/Rules-quot
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LC_CTYPE = UTF-8,
LANG = en_US.UTF-8
are supported and installed on your system.
perl: warning: Falling back to the standard locale (C).
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LC_CTYPE = UTF-8,
LANG = en_US.UTF-8
are supported and installed on your system.
perl: warning: Falling back to the standard locale (C).
Copying file m4/gettext.m4
cp: cannot stat `/usr/share/aclocal/gettext.m4': No such file or directory
Copying file m4/iconv.m4
cp: cannot stat `/usr/share/aclocal/iconv.m4': No such file or directory
Copying file m4/lib-ld.m4
cp: cannot stat `/usr/share/aclocal/lib-ld.m4': No such file or directory
Copying file m4/lib-link.m4
cp: cannot stat `/usr/share/aclocal/lib-link.m4': No such file or directory
Copying file m4/lib-prefix.m4
cp: cannot stat `/usr/share/aclocal/lib-prefix.m4': No such file or directory
Copying file m4/nls.m4
cp: cannot stat `/usr/share/aclocal/nls.m4': No such file or directory
Copying file m4/po.m4
cp: cannot stat `/usr/share/aclocal/po.m4': No such file or directory
Copying file m4/progtest.m4
cp: cannot stat `/usr/share/aclocal/progtest.m4': No such file or directory

Please update po/Makevars so that it defines all the variables mentioned
in po/Makevars.template.
You can then remove po/Makevars.template.

Please run 'aclocal -I m4' to regenerate the aclocal.m4 file.
You need aclocal from GNU automake 1.9 (or newer) to do this.
Then run 'autoconf' to regenerate the configure file.

You might also want to copy the convenience header file gettext.h
from the /usr/share/gettext directory into your package.
It is a wrapper around libintl.h that implements the configure --disable-nls
option.

Press Return to acknowledge the previous three paragraphs.

mv: cannot stat `configure.ac~': No such file or directory
mv: cannot stat `m4/Makefile.am~': No such file or directory
Making ./aclocal.m4 writable ...
Running libtoolize...
libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, `build-aux'.
libtoolize: copying file `build-aux/ltmain.sh'
libtoolize: putting macros in AC_CONFIG_MACRO_DIR, `m4'.
libtoolize: copying file `m4/libtool.m4'
libtoolize: copying file `m4/ltoptions.m4'
libtoolize: copying file `m4/ltsugar.m4'
libtoolize: copying file `m4/ltversion.m4'
libtoolize: copying file `m4/lt~obsolete.m4'
mv: cannot stat `Makefile.am~': No such file or directory
Module list with included dependencies (indented):
absolute-header
alloca
  alloca-opt
argmatch
  arpa_inet
btowc
c-ctype
c-strcase
c-strcaseeq
chown
clock-time
cloexec
close
closedir
configmake
  crypto/md5
  crypto/sha1
d-type
dirent
dirfd
dosname
dup2
  environ
errno
error
exitfail
extensions
extern-inline
fcntl
fcntl-h
fd-hook
  filemode
filename
  

Re: [lftp-devel] Add option to specify non-standard zlib

2015-02-24 Thread Andrew Reis
Any thought from the devs?

 

Andrew Reis

MCTS, Network+, Mobility+

Network/Systems Analyst  Webmaster

 

From: lftp-devel [mailto:lftp-devel-boun...@uniyar.ac.ru] On Behalf Of
Andrew Reis
Sent: Sunday, February 22, 2015 00:22
To: lftp-devel@uniyar.ac.ru
Subject: [lftp-devel] Add option to specify non-standard zlib

 

I'd like to be able to compile against a non-system zlib (and possibly other
libraries) in non-standard locations. I see that gnutls and openssl can be
specified but not zlib. Can this be added in the next release?

 

Thanks,

 

Andrew Reis

MCTS, Network+, Mobility+

Network/Systems Analyst  Webmaster

___
lftp-devel mailing list
lftp-devel@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp-devel