Re: Tutorial length. The Parallel Book

sequential behavior forced by the "2 runs at the > time" > restriction. I think that is a valid point. I was trying to use an example that I have actually run in real life, but real life examples should be in another part of the book, which can the reference the relevant s

Re: Limiting memory used by parallel?

On Wed, Jan 31, 2018 at 12:40 PM, hubert depesz lubaczewski <dep...@depesz.com> wrote: > On Tue, Jan 30, 2018 at 05:52:47PM +0100, Ole Tange wrote: >> Typically the tmp-filesystem will be at least as fast as any other >> file system, but on many systems /tmp is faster t

Re: Limiting memory used by parallel?

On Mon, Jan 29, 2018 at 6:19 PM, hubert depesz lubaczewski <dep...@depesz.com> wrote: > On Sun, Jan 28, 2018 at 02:45:42AM +0100, Ole Tange wrote: >> On Thu, Jan 25, 2018 at 4:33 PM, hubert depesz lubaczewski >> You can also use --cat: >> >> tar cf - /some

Re: Limiting memory used by parallel?

On Thu, Jan 25, 2018 at 4:33 PM, hubert depesz lubaczewski wrote: > Hi, > I'm writing a tool that will make a tarball, and then the tarball is > passed to parallel, which splits it into 5GB blocks, and each block is > sent to separate pipe. > > Call looks like: > > tar cf -

Re: GNU Parallel 20180122 ('Mayon') released [stable]

On Tue, Jan 23, 2018 at 4:34 PM, Renan Valieris wrote: > I caught the difference as well, looks like the only files changed were: : >> On Jan 23, 2018 8:51 AM, "Tobias Geerinckx-Rice" wrote: : >> While I was merrily updating the parallel package in GNU Guix,

Re: Testing firewall ports with parallel

On Thu, Jan 18, 2018 at 6:55 PM, Divan Santana wrote: > Like a lot of GNU software parallel is awesome. Thanks. > How can I achieve the below equivalent in a better way? : > [cloud-ec.amp.cisco.com]='443 32137' It seems you can run: nc -w 2 -vz

Re: Tutorial length

On Tue, Jan 9, 2018 at 2:47 AM, Gilles LAMIRAL wrote: > The beginning of the tutorial advises to "Spend an hour walking through the > tutorial". Well, it took me 3 hours to just reach half of it and I didn't run > the > "complex" examples Yeah, hmm, well I believe

Re: Problems to reuse --eta output

On Mon, Dec 18, 2017 at 12:11 PM, Pacho Ramos wrote: > I am trying to let users to get meaningful time remaining measurements from > the parallel output. Use --bar. The output from --bar is deceptive: When output to the terminal it looks like a walking bar, but in reality

Re: Thanks Ole

On Mon, Dec 25, 2017 at 7:09 PM, Gilles LAMIRAL wrote: > Many thanks for this marvellous software tool! You are welcome. If you like GNU parallel: * Re-walk through the tutorial once per year. You will discover new features and be reminded of old ones. * Give a

Re: Is there some syntax for executing {} for 1..Inf?

On Mon, Dec 18, 2017 at 10:48 PM, Ævar Arnfjörð Bjarmason wrote: : > This works as expected, quits soon after the 2nd job fails: > > $ yes | parallel-20171122/src/parallel --jobs=2 --halt-on-error > soon,fail=1 'echo {#}; if test {#} -ge 2; then exit 1; fi' > 1 > 2 >

GNU Parallel 20171222 ('Jerusalem') released

GNU Parallel 20171222 ('Jerusalem') has been released. It is available for download at: http://ftpmirror.gnu.org/parallel/ Quote of the month: You know what? GNU Parallel is cool. Concurrency, but in the Unix-philosophy style, without the Enterprise wankeriness. -- NickM

Re: How can I do replacement strings with an arg-file?

On Fri, Dec 15, 2017 at 8:04 PM, Dew, James (NRCAN/RNCAN) wrote: > I'm trying to use some replacement strings inside an arg-file and unable to > do so, is there something I'm missing? You cannot do that. The replacement strings only work on the command line. > In my

Re: GNU Parallel on Amazon Linux

On Fri, Dec 15, 2017 at 3:10 PM, Osborne, Darryl wrote: > First, thanks for developing and maintaining GNU Parallel. It’s an essential > tool and I recommend it in just about every customer call, talk, or > presentation I give. Happy to hear that. I believe I linked to one

Re: input buffering

On Wed, Nov 15, 2017 at 2:05 PM, Ryan Berckmans wrote: > When using GNU parallel 20160522 with bash 3.2.57(1)-release, my use case is > of the form > > slow-computation | parallel --pipe sh -c "quick-computation1 | > quick-computation2" > > In this case, slow-computation

Re: Is there some syntax for executing {} for 1..Inf?

On Thu, Dec 7, 2017 at 1:28 PM, Martin Møller Skarbiniks Pedersen wrote: > On 7 December 2017 at 00:37, Ævar Arnfjörð Bjarmason > wrote: >> >> I recently had a use-case for: >> >> parallel 'cmd {}' ::: {1..Inf} > > Maybe something like this: > > yes |

Re: Displaying output of shell script

On Wed, Nov 8, 2017 at 12:09 AM, Arun Vimalathithen wrote: > I am already outputting to a file (which I omitted in the pseudo code) > which is working ok. The EXIT_VALUE is there as an accumulation of all > HTTP calls so that the end of the job a user can investigate if

Re: GNU Parallel in GNU Guix

On Wed, Nov 8, 2017 at 1:11 AM, Eric Bavier wrote: > Hello, > > I noticed there is a list of "official packages" on the GNU Parallel > homepage at http://www.gnu.org/s/parallel. I just wanted to note that > GNU Guix (http://www.gnu.org/s/guix) has had a GNU Parallel

Re: parallel bug: Warning: No more file handles. when one job is delayed (reproducible with a test case)

On Sat, Oct 28, 2017 at 12:44 PM, Shlomi Fish wrote: > I see. So what you are saying is that parallel will work fine despite the > warning and will continue running? Yep. But if you run into this problem, it might be a better idea to remove -k and use something like

Re: parallel bug: Warning: No more file handles. when one job is delayed (reproducible with a test case)

On Fri, Oct 27, 2017 at 9:23 AM, Shlomi Fish wrote: > Thanks for your work. Good to know it is appreciated. > Attached are two files to reproduce a bug I ran into with GNU parallel > including the latest one on Mageia v7 x86-64: > > shlomif@telaviv1:~$ bash

Re: Memory limits per job

On Wed, Oct 25, 2017 at 1:46 PM, Joe Sapp wrote: > I have a situation where I [want a more advanced --memlimit]. : >What do you think? I think you should build that using '--limit' and $SSHLOGIN. If you cannot, then explain how you need '--limit' changed, so that you can.

GNU Parallel 20171022 ('Catalonia') released [stable]

to do! Use GNU Parallel. -- Ole Tange New in this release: * Initial support for XDG Base Directory $XDG_* environment variables. * Validating half a million TIFF files. Part Two. https://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/ * Turing data science class

GNU Parallel 20170822 ('Barcelona') released

GNU Parallel 20170822 ('Barcelona') has been released. It is available for download at: http://ftpmirror.gnu.org/parallel/ Haiku of the month: --line-buffer touches files on disk no more faster than before -- Ole Tange New in this release: * --line-buffer no longer uses tempfiles

Re: parallel does not preserve symlinked directory structure on remote

On Thu, Aug 3, 2017 at 1:56 PM, Benjamin Leutner wrote: > I just had to add yet another rsync flag, namely "-L" in order to transfer > the actual file a symlink points to instead of the symlink itself when using > --transferfile > > This gave me the idea that

Re: This should not happen

On Tue, Aug 1, 2017 at 11:33 PM, Johannes Graën wrote: : > The reason for not using the Debian package is that we need the > package that contains the other parallel program for some other reason, > which conflicts with GNU parallel. Is there any chance for this issue to > be

Re: This should not happen

On Sun, Jul 30, 2017 at 11:07 AM, Johannes Graën wrote: > parallel: This should not happen. You have found a bug. > Please contact and include: > * The version number: 20170522 > * The bugid: loadavg_invalid_content: This looks like the bug fixed in

Re: I apparently found a bug...

On Wed, Jul 26, 2017 at 7:11 AM, Charlie Ross wrote: > > This is what happened: > > # for i in $(seq 10) ; do sem -j 2 "echo $i started ; sleep 2; echo $i > finished" & done Thanks for your bug report. I have tried reproducing your report by running it 100 times - with no

Re: parallel does not preserve symlinked directory structure on remote

On Fri, Jun 23, 2017 at 7:48 AM, Ole Tange <o...@tange.dk> wrote: > My worry would be if old rsync do not support -K. In that case GNU > Parallel would be incompatible with old versions. But it seems -K was > supported back to before version 2.0.0, so that is not an issue. &

GNU Parallel 20170722 ('Grenfell') released [stable]

GNU Parallel 20170622 ('Grenfell') [stable] has been released. It is available for download at: http://ftpmirror.gnu.org/parallel/ No new functionality was introduced so this is a good candidate for a stable release. Quote of the month: I don't care I just need to get shit done -- Sab

Re: Problem with parallel : it stops with a warning after several hours of operations

On Tue, Jul 11, 2017 at 9:35 AM, Shlomi Fish wrote: > On Tue, 11 Jul 2017 08:50:49 +0200 (CEST) > Hubert Kowalski wrote: > >> > parallel: Warning: No more file handles. >> > parallel: Warning: Raising ulimit -n or /etc/security/limits.conf may >> >

Re: Use of --colsep without --header for multiple input files

On Sat, Jul 1, 2017 at 1:56 AM, Coby Viner wrote: > Is it possible to use --colsep with multiple input files, without having to > manually prefix each files' header by a unique identifier for use in > conjunction with --header? Yes. > For example, it would be nice if

Re: HP compute nodes ; Is GNU parallel executing files in parallel?

On Tue, Jun 27, 2017 at 9:34 PM, Anukesh K A wrote: > Hi, > > My name is Anukesh Hi Anukesh Thanks for your report. Unfortunately I have not been able to reproduce the behavior you see: Amongst other things I do not have access to

What should standard output of --results be?

Having read https://savannah.gnu.org/bugs/index.php?51261 I am wondering whether --results is doing the right thing. Currently this: parallel --results res echo ::: foo saves 'foo' into res/1/foo/stdout, after which GNU Parallel reads back the file and outputs it to standard output. It is

Re: parallel does not preserve symlinked directory structure on remote

On Wed, Jun 21, 2017 at 5:38 PM, Benjamin Leutner wrote: > adding the -K flag (=treat symlinked dir on receiver as dir) to the rsync > call in rsync_transfer_cmd() would solve this issue. > > some scenarios (following my initial example) for what would happen on

Re: parallel does not preserve symlinked directory structure on remote

On Wed, Jun 21, 2017 at 5:38 PM, Benjamin Leutner wrote: > adding the -K flag (=treat symlinked dir on receiver as dir) to the rsync > call in rsync_transfer_cmd() would solve this issue. https://savannah.gnu.org/bugs/index.php?51293 /Ole

Re: Max Number of Records

On Fri, Jun 9, 2017 at 5:47 PM, Ling, Stephen * wrote: > I am currently using the program to split a database that is around Size > 134,625,557,455 bytes. I’ve been trying to split the database into around > 0.5g, 0.25g, and 0.125g pieces. The program however, has been

Re: Parallel is having trouble handling quotes for unicode characters

On Sun, May 28, 2017 at 8:56 AM, Glen Huang wrote: > I'm sorry, but I think I just found another strange case: > > parallel echo 芦港 ::: foo > > fails with "parallel: Error: Command cannot contain the character ?. Use a > function for that." > > in which case I didn't quote

Re: Parallel is having trouble handling quotes for unicode characters

On Fri, May 26, 2017 at 4:44 AM, Glen Huang wrote: > Thanks for the quick reply. Didn't realize {} is already quotes. > > But if the solution is to not quote {}, how do I pass "${start} {}" as a > single argument to subshell? You are going to say 'Doh, ofcourse' now. > For

Re: Thank you to Ole, and Question 1 (choice of colon operators)

On Wed, May 17, 2017 at 10:41 PM, paralleluser <parallelu...@fastmail.net> wrote: > I want to begin by thanking Ole Tange for all his work and continuing efforts > with GNU Parallel. It is a very impressive set of work. Thanks. > I've read over all the parallel docs

Re: Question 2 (argfile input syntax)

On Wed, May 17, 2017 at 10:42 PM, paralleluser wrote: > Question 2: > There are a multitude of ways to give GNU parallel arguments contained in a > file. > > 1. cat argfile | parallel > 2. parallel < argfile > 3. parallel argfile > 4. parallel ::: `cat argfile` >

Re: Thank you to Ole, and Question 1 (choice of colon operators)

On Wed, May 17, 2017 at 10:41 PM, paralleluser wrote: : > Question 1: > The choice of ::: and are unique. Yes, they are arbitrary and they can > be changed with parallel command line arguments. But how/why where they > chosen? I have a good guess as to why ":"

Re: RAM memory consumption

On Wed, May 10, 2017 at 8:08 AM, Samdani A wrote: > Dear all, > > I have been tried using parallel combining with another executable file to > run jobs parallel. For example > > ls -1U | parallel -j 24 a.exe {} > > This work fine when there are 1500 files. But when I tried

Re: parallel interprets rsync log file format options as files to transfer that do not exist

On Thu, May 11, 2017 at 5:39 PM, Jason Paul Joines wrote: > GNU Parallel Users, > > > I am using GNU Parallel version 20170422 on Scientific Linux > release 6.6. When using rsync log file format options with parallel, > the logs are filled with errors because each log

Re: Using pre-existing SSH connection

On Mon, May 8, 2017 at 10:20 PM, Joe Sapp <sa...@ieee.org> wrote: > On Mon, May 8, 2017 at 4:09 PM, Ole Tange <o...@tange.dk> wrote: >> On Mon, May 8, 2017 at 9:02 PM, Joe Sapp <sa...@ieee.org> wrote: : > I am using --controlmaster in my calls to parallel, but it

GNU Parallel 20170422 ('Санкт-Петербу́рг') has been released

GNU Parallel 20170422 ('Санкт-Петербу́рг') has been released. It is available for download at: http://ftpmirror.gnu.org/parallel/ Haiku of the month: Alias and vars export them more easily With env_parallel -- Ole Tange New in this release: * --halt supports done in addition

Re: output of parallel pipe to another grep

On Thu, Apr 20, 2017 at 3:24 AM, Asif Iqbal wrote: > Hi I have multiple compressed files that I need to run grep against. > > I am trying to find 'foo', 'bar' and '192.168.1.100' against all the > compressed log files. > > This will work? > > ls 201612*.gz | parallel zgrep foo

Re: Distributing work to local and remote computers

On Wed, Apr 19, 2017 at 12:14 AM, Eric Geoffroy wrote: >> That failed because *.mp4 was not expanded by the shell and GNU >> Parallel quotes special chars so it will also not expand *.mp4. >> >> Try this instead: >> >> cd '/Volumes/Cinera/SBO- Video/Python Videos >>

Re: Distributing work to local and remote computers

On Mon, Apr 17, 2017 at 11:09 PM, Eric Geoffroy wrote: > I had a working command until I ran into files whose paths exceeded the > maximum for the shell (or socket). Which shell, OS and file system are you using? In Bash on my Ubuntu box with ext4 I can run the below

My record with GNU Parallel

Today I ran: seq 100 | parallel --pipe --tee wc ::: {1..13000} This feeds 6.8 MB to 13000 wc's running in parallel (+ 26000 helper processes) giving a total of 39000 parallel processes. It took 15 GB RAM and did not feel very fast. But it worked correctly. It also required 'ulimit -u

Re: newbie ?

On Fri, Apr 7, 2017 at 4:42 AM, ed bierly wrote: > thank you very much Ole > could you point me to where i can get this capability for ubuntu 16.10 = 10 seconds installation = For security reasons it is recommended you use your package manager to install. But if you cannot do

Re: Bug in version 20170322: certain functions in the Bash environment break invocation of env_parallel on macOS 10.12.4

On Sat, Apr 15, 2017 at 3:06 PM, Michael Klement wrote: > I'm aware of that workaround, but I thought you'd want to know that > env_parallel is not fully robust and fails in obscure ways. > Is env_parallel deprecated? The man page doesn't seem to say so. env_parallel is

Re: ssh GSSAPI authentication issue

On Sat, Apr 8, 2017 at 9:56 PM, Joe Sapp wrote: : > I haven't been able to reproduce in a VirtualBox yet, but I did some > more testing. It appears that an environment variable is not being > passed on completely. > > This will now work: > seq 10 | parallel --ssh "env

Re: ssh GSSAPI authentication issue

On Wed, Apr 5, 2017 at 5:27 PM, Joe Sapp wrote: > I'm trying to run some remote jobs with parallel (20170322) via ssh, > but the authentication system here for ssh is set up to use GSSAPI. I : > For example, this works, with the command being run remotely and locally: > seq 10

Re: How to clean corrupt SQL joblog?

On Wed, Mar 22, 2017 at 9:40 PM, Andy Loftus wrote: > While running some jobs in parallel, the filesystem filled up so running > tasks died but never updated the joblog (joblog is a sqlite3 DB file). > There are 24 tasks with an Exitcode of -1220. > > How can I clean up the

GNU Parallel 20170322 ('TRAPPIST-1') released

GNU Parallel 20170322 ('TRAPPIST-1') has been released. It is available for download at: http://ftpmirror.gnu.org/parallel/ Haiku of the month: --rpl used to be a static string Now it can take args --ole-tange New in this release: * --rpl can now take arguments by adding '(regexp

Re: Send stdin to multiple servers (multiplexing)

On Sun, Mar 12, 2017 at 10:11 AM, Anton Polonskiy wrote: > I want to send all stdin data to multiple servers. > Something like: > > seq 1 3 | tee >(ssh server1 cat) >(ssh server2 cat) > /dev/null > > How to do it with gnu parallel? --tee is in alpha test: seq

Re: Solution looking for (more than one) problem

On Sat, Mar 11, 2017 at 12:14 AM, Ole Tange <o...@tange.dk> wrote: > So far the --rpl strings are fixed. There is no way to "pass an > argument". I have changed that: > > parallel --rpl '{%(.*?)} s/$$1//' echo {%.tar.gz} ::: my.tar.gz > > To as

Solution looking for (more than one) problem

I like Bash's removal of strings: $ file=my.tar.gz $ echo ${file%.tar.gz} my So far the --rpl strings are fixed. There is no way to "pass an argument". I have changed that: parallel --rpl '{%(.*?)} s/$$1//' echo {%.tar.gz} ::: my.tar.gz To ask for an argument you put '(regexp)' in the

Re: Unexpected positional replacement strings substitution

On Thu, Feb 23, 2017 at 10:02 PM, Ole Tange <o...@tange.dk> wrote: > On Thu, Feb 23, 2017 at 6:17 AM, aero <chahk...@gmail.com> wrote: > >> I am going to try like the following. >> Send divided list to workers. And workers runs own parallel against the list >> f

Re: Unexpected positional replacement strings substitution

On Thu, Feb 23, 2017 at 6:17 AM, aero wrote: > I am going to try like the following. > Send divided list to workers. And workers runs own parallel against the list > from master. > > cat SERVERLIST.txt | parallel --pipe -N[ int(lines count of SERVERLIST.txt/ > number of

Re: feature suggestion: --preserve-blocking-factor

On Sat, Feb 18, 2017 at 5:39 AM, Cook, Malcolm wrote: > I don't think my needs were clear. Your needs were clear and I am really surprised that you did not understand the solution I proposed. > I know you are bioinformatics savvy and are familiar with bedtools, so let me >

Re: Unexpected positional replacement strings substitution

On Sat, Feb 18, 2017 at 5:49 AM, aero wrote: > The purpose of HEREDOC in my parallel command is to avoid needing script > transferring to worker servers when using -S worker1,worker2,.. option. > But i encountered the problem with gnu parallel's positional replacement >

Re: Unexpected positional replacement strings substitution

On Sat, Feb 11, 2017 at 10:36 AM, aero wrote: : > #!/bin/bash > > SCRIPT=$(cat <<'EOF' > # long shell script > echo $1 > echo ${1} > EOF > ) > > parallel -v "ssh {} bash <<'_PARALLEL' > $SCRIPT > _PARALLEL" ::: localhost > -script end-- > > But I

Re: feature suggestion: --preserve-blocking-factor

On Thu, Feb 16, 2017 at 7:16 PM, Cook, Malcolm wrote: > When using the --spreadstdin option, it may be desirable to ensure that the > blocks "keep together" certain blocks of data. Yes. We use --recend --recstart for that. > For example the input may be sorted on column 3,

GNU Parallel 20170206alpha released

GNU Parallel 20170206alpha has been released. It is available for download at: http://alpha.gnu.org/gnu/parallel/ I would appreciate if people tried out the new features. New in this release: * --tee makes it possible to send all input to multiple jobs. The jobs can be generated using normal

Re: joblog + sshlogin, use 'column -t'

On Sat, Jan 28, 2017 at 10:52 AM, Hans Schou wrote: > > Suggestion, add 'column -t' to get aligned output with joblog It is unclear where you what this. Is it in the program or in the examples? column in not standard on: hpux-ia64.p /usr/local/bin/bash: column:

Re: calling python script from exported bash function, module import fails

On Tue, Dec 27, 2016 at 2:38 PM, Benjamin Leutner wrote: > I could reproduce the issue on another Ubuntu Gnome machine and also on the > plain Ubuntu VirtualBox image from osboxes.org. https://savannah.gnu.org/bugs/index.php?49970 /Ole

Re: calling python script from exported bash function, module import fails

On Thu, Dec 22, 2016 at 5:28 PM, Benjamin Leutner wrote: > Here's the modified example: > > function FUN { > echo -e "\n- Try number: ${1} -" > echo "Host: $(hostname), Level: $SHLVL" > python -c " > import setuptools > print 'import succesful'" > } >

Re: Parallel “Bug”

On Thu, Nov 17, 2016 at 10:24 PM, Larry Ploetz wrote: > Don't know if this really qualifies as a bug, but there were too many open > files on my MacOS system, which resulted in parallel doing: > > Couldn't open /dev/null: Too many open files in system > parallel: This should

Re: It says I found a bug?

On Wed, Nov 23, 2016 at 5:23 AM, Pierre Poujade wrote: > Hi, > > I wanted to see how parallel behaves when one of the hosts is down. > root@nope is down (host doesn't exist on the network and won't resolve), > scanner-helper is up and running. > > $ parallel --controlmaster

GNU Parallel 20161122 ('Trump') released [stable]

Parallel -- Ole Tange New in this release: * --record-env can now be used with env_parallel for bash, ksh, pdksh, and zsh. * GNU Parallel was cited in: An improved implementation of Conditional Reciprocal Best Hits with LAST and Python https://pypi.python.org/pypi/shmlast/1.0.3 * GNU Parallel

Re: GNU Parallel Bug Reports Parallel as for (no argument)

On Sun, Oct 30, 2016 at 4:51 PM, Hadrien Lacour <hadrien.lac...@openmailbox.org> wrote: > On Sun, Oct 30, 2016 at 02:31:21PM +0100, Ole Tange wrote: >> On Sat, Oct 29, 2016 at 12:43 PM, Hadrien Lacour : >> parallel --eta 'sleep 1; echo {2}' <(seq 5) <(seq 5) >

GNU Parallel 20161022 ('Matthew') released [stable]

GNU Parallel -- Ole Tange New in this release: * First command no longer gets stdin as it causes unpredictable issues. * GNU Parallel was cited in: Efficiently parallelized modeling of tightly focused, large bandwidth laser pulses https://arxiv.org/pdf/1609.08146v1.pdf * How to crunch lots

Re: "parallel: This should not happen. You have found a bug."

On Wed, Sep 14, 2016 at 4:53 AM, Greg McCann wrote: [...bug report...] > Bad: >> parallel -k -j0 --nonall --slf ~/bin/gw_servers.txt 'uname' : > Linux > parallel: This should not happen. You have found a bug. > Please contact and include: > * The

Re: gnu parallel bug

On Thu, Sep 29, 2016 at 5:10 PM, Johannes Graën wrote: > $ parallel --load 100% echo load is less than {} job per cpu ::: 1 > parallel: This should not happen. You have found a bug. > Please contact and include: > * The version number: 20160722 > * The bugid:

Re: Parallel bug report

On Mon, Sep 5, 2016 at 2:03 AM, Argent9660 wrote: > Parallel --version (error) > > The version number: 20160722 > The bugid: pid_parentpid_cmd for android missing I need a command on android that will produce: PID PPID CMD 1 0 /sbin/init 2 0 [kthreadd] 3 2

Re: How to debug error "Signal SIGCHLD received, but no signal handler set."?

On Fri, Jul 22, 2016 at 2:50 PM, wrote: : > I use Cygwin (updated to latest packages) with the latest parallel version > (20160622). > My workflow looks like this: > > cat input.txt | parallel --pipe -N64 --blocksize 63K --joblog > joblog.txt --retries 3 --progress python

Re: bug in parallel

On Wed, Jul 20, 2016 at 5:15 AM, K.IEMURA wrote: >> 2016-07-14 10:50 GMT+02:00 jessin janice james peter >> : >>> I was trying to install paralell in my centos machine and ended up with >>> this bug. >>> >>> * The version number: 20150522

GNU Parallel 20160722 ('Brexit') released

GNU Parallel 20160722 ('Brexit') has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/ Haiku of the month: Pipes are fast and good. Use them in your programs, too. Use GNU Parallel -- Ole Tange New in this release: * env_parallel is now ready for wider

Re: expected behavior of --results with -n0

On Wed, Jul 6, 2016 at 9:30 PM, Joel Uckelman wrote: > Thus spake Joel Uckelman: >> >> When I run this: >> >> seq 3 | parallel --results b -n0 echo hey >> >> parallel writes me a directory tree like this: >> >> [uckelman@scylla tmp]$ tree b >> b >> └── 1 >> └──

Re: Sflow input stream and parallel

On Thu, Jul 7, 2016 at 2:33 PM, Łukasz Matys wrote: > Hello. > I use an sflowtool to collect sflow data like below, and next grep some > things for example: > > # cat aaa.txt > 8.8.8.8 > 8.8.4.4 > # > > # sflowtool -p 6000 -l +v 250 | grep -f aaa.txt >

GNU Parallel 20160622 ('Orlando') released

GNU Parallel 20160622 ('Orlando') has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/ Haiku of the month: Does path on remote not include GNU Parallel? Try --env PATH. -- Ole Tange New in this release: * $PATH can now be exported using --env PATH

Re: Can't dup STDERR: Inappropriate ioctl for device

On Thu, Jun 16, 2016 at 9:32 AM, Shyam Saladi wrote: > I seem to have encountered a bug with GNU parallel. The python code being > run isn't very portable. Based on the bugid, does anyone have test data that > I could run that would help diagnose the problem here? I agree:

Re: Your opinion needed: Should GNU Parallel ignore, kill or wait for background children?

On Tue, May 24, 2016 at 3:55 AM, Martin d'Anjou <martin.danjo...@gmail.com> wrote: > On 16-05-23 06:46 PM, Ole Tange wrote: >> >> Should GNU Parallel ignore, kill or wait for background children? >> >> Example: >> >> $ parallel '(sleep 100) & ech

Your opinion needed: Should GNU Parallel ignore, kill or wait for background children?

Should GNU Parallel ignore, kill or wait for background children? Example: $ parallel '(sleep 100) & echo' ::: 1 1 $ ps -opid,pgrp,cmd PIDPGRP CMD 915719 915719 /bin/bash 937618 937617 sleep 100 937620 937620 ps -opid,pgrp,cmd The sleep is put in the background. The echo finishes,

Re: Your input needed: How many hops to the internet?

On Sat, May 14, 2016 at 1:14 AM, Jan Engelhardt <jeng...@inai.de> wrote: > > On Friday 2016-05-13 23:22, Ole Tange wrote: >> >>The router is found by tracerouting to 8.8.8.8 (Google's public DNS) >>and selecting a router "a few hops out". But most of us

Re: parallel error while parsing options

On Tue, May 10, 2016 at 10:28 AM, Gabriel Ganne wrote: > Hi, > > I installed parallel from this link > http://ftp.gnu.org/gnu/parallel/parallel-20160422.tar.bz2 > I encounter the following error (or with any command) : > > $ parallel --help > parallel: This should not

Re: writing a combined list of all unique pairs

On Wed, May 11, 2016 at 6:00 PM, Patrick Buchholz wrote: > Hi, > > an example input would be a list: > A > B > C > > And a list of unique combinations as output > A B > A C > B C You would have to repeat the list so there are 2 input sources: parallel

Re: writing a combined list of all unique pairs (was: GNU Parallel 20150607alpha released)

On Fri, Apr 29, 2016 at 7:56 PM, Patrick Buchholz wrote: > Dear Mr Tange, Use the mailinglist parallel@gnu.org next time. > Is it possible to use GNU/Parallel for writing a combined list of all unique > pairs from two input source files? Not really sure

GNU Parallel 20160422 ('PanamaPapers') released

GNU Parallel 20160422 ('PanamaPapers') has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/ Haiku of the month: xapply too strict? :::+ is just made for you -- Ole Tange New in this release: * :::+ and + work like ::: and but links this input

Re: [Bug/Patch] mkdir_or_die doesn't work correctly with network paths

On Wed, Apr 13, 2016 at 2:20 PM, Achim Gratz wrote: > Splitting on :/: is a bad idea for paths like "//server/dir". Since > parallel already uses File::Path, use File::Path::mkpath instead which is > known to work correctly. You are absolutely right. Fixed in git. /Ole

Re: Detecting stdout

On Tue, Apr 12, 2016 at 2:28 AM, Kip Warner Something strange though happened during the migration. Previously > my_program was able to detect correctly when the standard out device > was an actual terminal via a call at runtime to isatty(STDOUT_FILENO). > > I noticed with GNU

Re: Using --dryrun records to the joblog as a successful event, which ignores "real" runs.

On Mon, Sep 21, 2015 at 2:07 PM, Pariksheet Nanda wrote: > I'm using GNU Parallel version 20150810 when both --joblog and --dryrun > together. This has the side effect of recording the dryrun as "successful" > in the joblog. Fixed in current release. /Ole

Re: GNU Parallel 20160322 ('Bruxelles') released

On Thu, Mar 24, 2016 at 3:11 PM, Shlomi Fish wrote: : > One note: can the tarball also be supplied as tar.xz? I checked and it reduces > the size quite a bit. I have considered that. I get 1053860 (xz) vs. 1265407 (bz2). So a saving of 200 KB. Less than a photo these

Re: Citation requirement and the GPL

On Sun, Mar 27, 2016 at 11:20 AM, Christopher Jefferson wrote: : > Would I cite 'parallel' if it was an integral part of my research > project (for example, a parallelisation project)? Of course! Further, > if I reported times taken I would cite parallel, as it would be an

Re: transferring file relative to work dir

On Sat, Mar 12, 2016 at 3:24 AM, Ryan Brothers wrote: > I am trying to transfer a file specified by an absolute path and have > it be relative to the work dir. When I run the following example from > the man page: > > echo /tmp/./foo/bar.txt | parallel \ > --sshlogin

Re: Citation requirement and the GPL

On Thu, Mar 24, 2016 at 2:17 PM, Christopher Jefferson wrote: > If it is acceptable to ignore the citing requirement, I have tried to see if I could come up with a scenario where a respectable scientist would not cite sources that he used for his article - especially when

Re: Input pattern

On Mon, Mar 21, 2016 at 4:37 PM, Ali Roustaei wrote: > Hello, > > My script (say myscript) has three input parameters H, Re and Bn. Re and Bn > are tied so that for each Re input there is only a specific Bn. > > I want parallel to run all combinations of H with Bn,Re and not

GNU Parallel 20160222 ('N977GA') released [stable]

-- Ole Tange New in this release: * Vote for new community on Superuser, Ask Ubuntu, Unix http://meta.superuser.com/questions/11127/community-promotion-ads-2016/11225#11225 http://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046 http://meta.unix.stackexchange.com

GNU Parallel 20160122 ('Bowie') released

GNU Parallel 20160122 ('Bowie') has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/ Haiku of the month: Dash dash pipe too slow? Dash dash pipepart is your friend. Use GNU Parallel -- Ole Tange New in this release: * --sql DBURL uses DBURL as storage

GNU Parallel 20151222 ('ParisAgreement') released

GNU Parallel 20151222 ('ParisAgreement') has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/ Haiku of the month: | ||| Use GNU Parallel -- Malcolm Cook New in this release: * --transfer is now an alias for --transferfile {}. * --transferfile

<    1   2   3   4   5   6   7   >