GNU Parallel for multi threaded copy of 1GB file from linux machine to remote windows machine

[Pradeep Patra]

Hi all,
   I am sorry I am beginner to use GNU parallel. I want to use GNU parallel
for multithreaded copy from linux machine to remote windows machine.

Is it possible ? If so could anyone help me in providing the usage of it.

Regards
Pradeep

Re: GNU Parallel for multi threaded copy of 1GB file from linux machine to remote windows machine

[Shlomi Fish]

Hi Pradeep,

please reply to all recipients. See http://shlom.in/reply .

On Mon, 19 Oct 2015 13:10:43 +0530
Pradeep Patra  wrote:

> Hi all,
>I am sorry I am beginner to use GNU parallel. I want to use GNU parallel
> for multithreaded copy from linux machine to remote windows machine.

GNU parallel performs multitasking using multiple processes - not using
multiple threads. That put aside - a network copy is likely going to be
https://en.wikipedia.org/wiki/I/O_bound and I suggest you take a look at tools
like https://en.wikipedia.org/wiki/Rsync and http://zsync.moria.org.uk/ .

> 
> Is it possible ? If so could anyone help me in providing the usage of it.

You can read about how to use GNU parallel on its web site:

* https://www.gnu.org/software/parallel/

There is a tutorial and if you find anything lacking you can tell us and
hopefully it will be improved. But the gods helps them that help themselves.

Regards,

Shlomi Fish

-- 
-
Shlomi Fish   http://www.shlomifish.org/
The Case for File Swapping - http://shlom.in/file-swap

Forth - There are several ways to write it, but no way to read it.
— http://www.shlomifish.org/humour/ways_to_do_it.html

Please reply to list if it's a mailing list post - http://shlom.in/reply .

Re: GNU Parallel for multi threaded copy of 1GB file from linux machine to remote windows machine

[Ole Tange]

On Mon, Oct 19, 2015 at 9:40 AM, Pradeep Patra  wrote:
> Hi all,
>I am sorry I am beginner to use GNU parallel. I want to use GNU parallel
> for multithreaded copy from linux machine to remote windows machine.
>
> Is it possible ? If so could anyone help me in providing the usage of it.

For this you need a single command that can copy from a GNU/Linux
machine to a Microsoft Windows machine. I cannot help you with that,
but let us assume it is called scp and takes filename and
host:/dir/filename for the remote machine, and that it requires no
password to login (login done through digital certificates).

Then it is as simple as:

parallel scp {} host:/dir/{} ::: file1 file2 ...

/Ole