Re: sleep command memory violation using parallel

2024-05-09 Thread Ole Tange
On Mon, May 6, 2024 at 3:22 PM Mauro Tridici wrote: : > checking the operating system (CentOS 7.2) audit logs, I detect a lot of > "sleep command memory violation". > I investigated about this issue for almost a week and I think I found the > cause of the error message mentioned above. > It

Re: bugid: open3-GLOB(0x5558e07a78e0)

2024-03-09 Thread Ole Tange
On Thu, Feb 29, 2024 at 8:23 PM Gregor Kaczor wrote: > If I delete ~/.parallel/tmp/sshlogin/ and try again I get parallel: Error: > Command line too long (132116 >= 63543) at input 0: curl -K > hostcheckconfig_http2.txt "https://www.lib… Great. So we know it is due to line length and not some

Re: Use of Vagrant in tests poses licencing question

2024-03-09 Thread Ole Tange
On Fri, Mar 1, 2024 at 4:26 AM Richard Stallman wrote: > > [[[ To any NSA and FBI agents reading my email: please consider]]] > [[[ whether defending the US Constitution against all enemies, ]]] > [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > > > I think a

Re: does parallel handle --null and --block correctly?

2024-03-09 Thread Ole Tange
On Sun, Feb 11, 2024 at 7:25 PM Ecks Hecker wrote: > > i recently tried to use parallel --pipe, but failed. This is what i saw: > > > parallel -V > > GNU parallel 20231122 > > > > cat source | parallel --recend $'\0' --pipe --block 800 "wc" > > 0 1 800 > > ... > > > > cat source |

Re: bugid: open3-GLOB(0x5558e07a78e0)

2024-02-28 Thread Ole Tange
On Mon, Feb 26, 2024 at 5:42 PM Gregor Kaczor wrote: : > The following command lead to a following output. It is easy to reproduce. > > parallel -a line > r > > parallel: This should not happen. You have found a bug. Please follow > https://www.gnu.org/software/parallel/man.html#reporting-bugs

Re: Use of Vagrant in tests poses licencing question

2024-02-28 Thread Ole Tange
On Tue, Feb 20, 2024 at 4:23 AM Richard Stallman wrote: > > [[[ To any NSA and FBI agents reading my email: please consider]]] > [[[ whether defending the US Constitution against all enemies, ]]] > [[[ foreign or domestic, requires you to follow Snowden's example. ]]] : > > Since there

Re: Use of Vagrant in tests poses licencing question

2024-02-28 Thread Ole Tange
On Tue, Feb 20, 2024 at 4:23 AM Richard Stallman wrote: > > [[[ To any NSA and FBI agents reading my email: please consider]]] > [[[ whether defending the US Constitution against all enemies, ]]] > [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > > > but

Re: Use of Vagrant in tests poses licencing question

2024-02-18 Thread Ole Tange
On Fri, Feb 9, 2024 at 1:43 AM Richard Stallman wrote: > > [[[ To any NSA and FBI agents reading my email: please consider]]] > [[[ whether defending the US Constitution against all enemies, ]]] > [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > > Thank you for

Re: GNU Parallel 20240122 ('Frederik X') released

2024-01-26 Thread Ole Tange
On Thu, Jan 25, 2024 at 3:27 PM Saint Michael wrote: > > I found a bug. > this script generates an error > > #!/bin/bash > export HOME="/tmp" > process2(){ > x="$1" > job="$2" > echo "$job, $x" > > } > export -f process2 > seq 2 11|parallel --gnu --no-run-if-empty -k --lb

GNU Parallel 20240122 ('Frederik X') released

2024-01-24 Thread Ole Tange
GNU Parallel 20240122 ('Frederik X') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: GNU Parallel alone provides more value than moreutils -- ferret7...@news.ycombinator.com New in this release: * --sshlogin supports ranges: server[01-12,15]

Re: Installation/update question

2023-12-23 Thread Ole Tange
On Fri, Dec 15, 2023 at 7:48 PM Nagesh Adluru wrote: > I was trying to update the parallel version to the latest version and getting > the attached message. It looks like the signature on the download is > incorrect. As you could see the from the attached screenshot sha1sum isn’t > finding

GNU Parallel 20231222 ('Sundhnúkagígur') released

2023-12-23 Thread Ole Tange
GNU Parallel 20231222 ('Sundhnúkagígur') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: Parallel is so damn good! You’ve got to use it. -- @theprimetimea...@youtube.com New in this release: * --combine-exec combines GNU Parallel with any

Re: best options to try to avoid bogging down user's systems with parallel builds?

2023-12-14 Thread Ole Tange
On Tue, Dec 12, 2023 at 12:47 AM paralleluser wrote: > # I want parallel to stop new jobs for a while so no new load is taken up Will CTRL-Z not work for you? > echo 0 > job_count; > > Right now "0" does something else. 0 means the same as in "--jobs 0" namely infinity (run as many jobs as

Re: best options to try to avoid bogging down user's systems with parallel builds?

2023-12-11 Thread Ole Tange
On Sat, Dec 2, 2023 at 9:53 PM Britton Kerin wrote: > > I just made a script to pre-build all git revisions in a git-bisect, > so the actual bisection testing that requires human attention can be > done without being interrupted by a build each time. Yeah, CPU-time is way cheaper than human

Re: Your input is needed: Use regexp to match content

2023-10-30 Thread Ole Tange
On Mon, Oct 30, 2023 at 2:22 AM Ole Tange wrote: > Is there an easy way to go from: > > parallel echo {2} {1} ::: A-BB C-DD ::: E-FF G-HH > > to this (where I have to calculate what number {4} would get): > > parallel --match '((.)-(..))' \ > echo {4} {1} {3} :::

Your input is needed: Use regexp to match content

2023-10-29 Thread Ole Tange
I am really happy about the {= =} construct (thanks Malcolm - it was a brilliant idea). But it is a bit cumbersome to use that when a regexp would just match. echo 2023-10-29 | parallel echo 'Year={=s/()-..-../$1/=} Month={=s/-(..)-../$1/=} Day of month={=s/-..-(..)/$1/=}' In this

GNU Parallel 20230922 ('Derna') released [stable]

2023-09-24 Thread Ole Tange
GNU Parallel 20230922 ('Derna') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: Parallel is so damn good! You’ve got to use it. -- @theprimetimea...@youtube.com New in this release: * No new features. This is a candidate for a stable release.

Re: Not getting semaphores to work as I want

2023-08-06 Thread Ole Tange
On Thu, Aug 3, 2023 at 5:11 PM nadim khemir wrote: > Not having any directories processed twice, within a time period, > would be best and I will add that to my code as I don't think it's > possible to put a timeout on a mutex in gnu parallel that would be > valid after all its arguments are

Re: Not getting semaphores to work as I want

2023-08-06 Thread Ole Tange
On Thu, Aug 3, 2023 at 5:11 PM nadim khemir wrote: > When entering a directory a background process is started to generate > previews for some extensions, say E1 E2 E3 . : > new code is: > > find ... | grep -P "E1|E2|E3" | parallel generator > > The replacement works as expected. > > The

Re: How to take user input within parallel functions

2023-06-04 Thread Ole Tange
On Tue, May 30, 2023 at 3:36 PM Ahmad Ismail wrote: > > Here is my script. : > I want to ask whether the user wants to continue with the script or not. from > within the function. If this is not the pattern then does parallel has any > option which ask do you want to continue with jobN. > > For

GNU Parallel 20230522 ('Charles') released [stable]

2023-05-22 Thread Ole Tange
GNU Parallel 20230522 ('Charles') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: Recently learned how to use GNU parallel (from ChatGPT, no less!) and I've gone mad with power -- Mark, Anthropomorphic Anuran @reject_resubmit@twitter New in

Re: [bug?] The curious case of the newline in a filename

2023-04-06 Thread Ole Tange
On Thu, Apr 6, 2023 at 5:14 PM Fredrick R. Brennan wrote: > > Consider the following, if you dare: > > > ffmpeg -f concat -safe 0 -i <(find . -iname '*.flac' -and -type f -print0 | > > parallel --null printf '"file %q"' '{=1 my $pwd=qx(pwd); $pwd =~ > > s/^\s+|\s+$//g; $_=($pwd . "/" . q())

GNU Parallel 20230322 ('Arrest Warrant') released

2023-03-22 Thread Ole Tange
GNU Parallel 20230322 ('Arrest Warrant') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: GNU parallel is magic, half of my work uses it, to the point where they're referenced and thanked in my thesis -- Best Catboy Key Grip

GNU Parallel 20230222 ('Gaziantep') released

2023-02-22 Thread Ole Tange
GNU Parallel 20230222 ('Gaziantep') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: Praise GNU parallel, though. That gets me pretty far. -- Your Obed. Servant, J. B. @Jeffinatorator New in this release: * parsort: --parallel now does closer

GNU Parallel 20230122 ('Bolsanaristas') released [stable]

2023-01-22 Thread Ole Tange
GNU Parallel 20230122 ('Bolsanaristas') has been released. It is available for download at: lbry://@GnuParallel:4 No new functionality was introduced so this is a good candidate for a stable release. Haiku of the month: Colorful output parallel, with --color flag tasks more vibrant now

Re: Positional arguments in nested parallel

2022-12-25 Thread Ole Tange
On Thu, Dec 22, 2022 at 9:52 PM Nagesh Adluru wrote: > > Firstly, I would like to sincerely thank you for building and supporting such > a wonderful program. I really love using it. This is my first time asking a > question on the forum but I have been using the parallel for years now. Great

Re: Question

2022-12-21 Thread Ole Tange
Hi Michael Please use parallel@gnu.org for support questions. I assume the process runs on a Unix-like system (such as GNU/Linux). When you remove a file, you are only removing the reference to the file. The file is still stored on disk. So GNU Parallel will continue to read from that. Only

GNU Parallel 20221222 ('ChatGPT') released

2022-12-21 Thread Ole Tange
GNU Parallel 20221222 ('ChatGPT') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: GNU Parallel absolutely rocks. -- Austin Mordahl@Stackoverflow New in this release: * --results works on more file systems (e.g. fat) * Joblog gives the same

GNU Parallel 20221122 ('Херсо́н') released

2022-11-22 Thread Ole Tange
GNU Parallel 20221122 ('Херсо́н') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: [GNU Parallel] is the most amazing tool ever invented for bioinformatics! -- Istvan Albert https://www.ialbert.me/ New in this release: * Support for IPv6

Re: Bug report: csv parsing seem to be incorrectly initialized

2022-11-15 Thread Ole Tange
On Tue, Nov 15, 2022 at 1:21 AM Istvan Albert wrote: > First of all, thanks for this tool! It is the most amazing tool ever invented > for bioinformatics! It is leaps and bounds better than Snakemake Patterns, or > NextFlow automation etc. My students and I can get 100x more done with >

Re: How to parallelize find|while read do; ffprobe, grep and get the filenames?

2022-11-12 Thread Ole Tange
;1) URL=$("$INFOS"|& grep -i 'http\|www') if [ "$URL" != "" ]; then echo -e "$FILENAME\t$URL" fi } export -f doit find . -type f -iname "*.flac" -print0 | parallel doit | column -t -s $'\t' I think you have misunderstood how

Re: Spreading parallel across nodes on HPC system

2022-11-11 Thread Ole Tange
On Fri, Nov 11, 2022 at 5:58 PM Ken Mankoff wrote: > I'll try to simplify my original question... > > If I run > > parallel -s-slf hostfile -j 1000

Re: parallel: This should not happen. You have found a bug.

2022-11-03 Thread Ole Tange
On Sun, Oct 30, 2022 at 4:42 PM wrote: > > Hi, i was told to email what i did, so here i go, > > i was running the following command: > > parallel --semaphore -j -4 "echo foo" > > the machine has only 4 cores, so there are no cores to run the job. > > Obvious that it cant work, > but it told me

Re: Error

2022-11-03 Thread Ole Tange
On Wed, Nov 2, 2022 at 10:58 PM Douglas Duane Rhoads wrote: > Not certain what is happening but this command has been working for a year > or more in WSL2Ubuntu on a Win 11-64bit machine (fully updated). I just > did a sudo apt upgrade when I started this time and several packages were >

GNU Parallel 20221022 ('Nord Stream') released

2022-10-23 Thread Ole Tange
GNU Parallel 20221022 ('Nord Stream') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: If used properly, #gnuparallel actually enables time travel. -- Dr. James Wasmuth @jdwasmuth@twitter New in this release: * --latest-line chops line length

Re: Properly setting $Global::max_file_length to avoid line 12170 error

2022-10-09 Thread Ole Tange
On Wed, Oct 5, 2022 at 7:55 AM Nagle, Michael F wrote: > > Correct. I have a few lines of bash code to automatically prepare the jobs > file I just sent. Immediately after that file is made, it is passed as the > $job_list_name variable to... > > parallel --results output -a $job_list_name > >

Re: Properly setting $Global::max_file_length to avoid line 12170 error

2022-10-09 Thread Ole Tange
On Wed, Oct 5, 2022 at 7:55 AM Nagle, Michael F wrote: > > Correct. I have a few lines of bash code to automatically prepare the jobs > file I just sent. Immediately after that file is made, it is passed as the > $job_list_name variable to... > > parallel --results output -a $job_list_name > >

GNU Parallel 20220922 ('Elizabeth') released

2022-09-22 Thread Ole Tange
GNU Parallel 20220922 ('Elizabeth') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: reduced our backend test pipelines from 4 to 1.30 hrs. gnu parallel for the win!!! -- Swapnil Sahu @CaffeinatedWryy@twitter New in this release: *

GNU Parallel 20220822 ('Rushdie') released

2022-08-22 Thread Ole Tange
GNU Parallel 20220822 ('Rushdie') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: Parallel is Good Stuff (tm) -- bloopernova@ycombinator New in this release: * --header 0 allows using {filename} as replacement string * Bug fixes and man page

Re: file permissions on joblog

2022-07-31 Thread Ole Tange
On Sun, Jul 31, 2022 at 12:00 PM Rob Sargent wrote: : > Still not correct. I'm now getting > > "parallel: Error: Cannot write to --joblog > +/scratch/general/pe-nfs1/u0138544/logs/o2iY02/o2iY02.ll." Only version parallel-20160522..parallel-20161222 give that error. What version are you using?

Re: file permissions on joblog

2022-07-29 Thread Ole Tange
On Thu, Jul 28, 2022 at 5:45 PM Rob Sargent wrote: > > On 7/28/22 09:28, Christian Meesters wrote: > > > On 7/28/22 14:56, Rob Sargent wrote: > > On Jul 28, 2022, at 1:10 AM, Christian Meesters wrote: > Hi, > > not quite. Under SLURM the jobstep starter (SLURM lingo) is "srun". You do > not do

Re: file permissions on joblog

2022-07-28 Thread Ole Tange
On Tue, Jul 26, 2022 at 2:49 AM Rob Sargent wrote: > > I'm using GNU Parallel behind not one but two intermediaries. I submit to > the first, the first wraps the jobs in a "slurm" script and submits the jobs > to the second (the slurm host). > > The jobs run on the slurm host under the account

GNU Parallel 20220722 ('Roe vs Wade') released

2022-07-24 Thread Ole Tange
GNU Parallel 20220722 ('Roe vs Wade') has been released. It is available for download at: lbry://@GnuParallel:4 Quote of the month: The syntax for GNU Parallel is so slick that I often use it just to make my script read nicer, and the parallelism is a cherry on top. -- Epistaxis@reddit

Re: [PATCH] Makefile: respect DESTDIR for shell completions

2022-07-09 Thread Ole Tange
On Sun, Jul 3, 2022 at 6:05 AM Sam James wrote: > > It's respected for the main 'parallel' script but not for > the new completions. Please try git d4be5907b9. git clone https://git.savannah.gnu.org/git/parallel.git /Ole

Re: How to debug `parallel` crash?

2022-07-09 Thread Ole Tange
On Sun, Jul 10, 2022 at 5:35 AM Nagle, Michael F wrote: > > First, I’d like to thank the developers and community for producing GNU > Parallel and supporting it. Thanks. You can help by: • (Re-)walk through the tutorial if you have not done so in the past year

new completion code in parallel 20220622

2022-06-25 Thread Ole Tange
> I'm packaging parallel for Void Linux and have a few notes on the last Great. Thanks. > 1) install-data-hook doesn't respect $DESTDIR when installing completions. > 2) install-data-hook assumes parallel is in $PATH when installing completions, > which is not true when using $DESTDIR; using

Re: GNU Parallel 20220622 ('Bongbong') released

2022-06-23 Thread Ole Tange
On Thu, Jun 23, 2022 at 7:06 PM Jan Engelhardt wrote: > > On Thursday 2022-06-23 10:30, Ole Tange wrote: > >GNU Parallel 20220622 ('Bongbong') has been released. It is available > >for download at: http://ftpmirror.gnu.org/parallel/ > > > >* 'make install' inst

GNU Parallel 20220622 ('Bongbong') released

2022-06-23 Thread Ole Tange
GNU Parallel 20220622 ('Bongbong') has been released. It is available for download at: http://ftpmirror.gnu.org/parallel/ Quote of the month: Parallel has been (and still is) super useful and simple tool for speeding up all kinds of shell tasks during my career. -- ValtteriL@ycombinator

Re: Couple Minor “Bugs” (?)

2022-06-10 Thread Ole Tange
On Fri, Jun 10, 2022 at 12:54 AM Larry Ploetz wrote: > I'm trying to use ssh's proxy (-J flag) with GNU parallel. The -J flag on ssh > allows multiple hosts to be specified with commas between them. You clearly already know the , is the culprit. > larryp-MBP:~ larry$ seq 48 | parallel -j0

Re: Possible Bug In Quote Processing?

2022-06-05 Thread Ole Tange
On Tue, May 31, 2022 at 1:12 AM Larry Ploetz wrote: > > I would think these should all produce the same output > > $ parallel echo "{}" \| cat -nvet ::: VAR > 1 VAR$ > $ parallel -q echo "{}" \| cat -nvet ::: VAR > VAR | cat -nvet > $ parallel echo {} \| cat -nvet ::: VAR > 1 VAR$ > $

Re: bug report (parallel --slf feature)

2022-05-30 Thread Ole Tange
> #parallel --halt soon,fail=1 --gnu --no-notice --slf /usr/hpc-bio/mpi/slf.silent.nnode4 > # cat /usr/hpc-bio/mpi/slf.silent.nnode4 > 12/T640 It was caused by a bug: GNU Parallel (wrongly) assumed hosts could not contain UPPERCASE letters. Try the newest release. /Ole

Re: GNU Parallel More Frequently Check Nodelist

2022-05-30 Thread Ole Tange
On Wed, Mar 16, 2022 at 1:07 PM Saydjari, Andrew < andrew.saydj...@cfa.harvard.edu> wrote: > > I think the only "feature" really needed to make this possible is a flag > that changes how frequently the "nodelist" is checked. Personally, my tasks > are often 8h+ and I wouldn't want to waste 8h of

Re: Can parallel have any shell completions?

2022-05-30 Thread Ole Tange
On Sun, May 15, 2022 at 6:29 PM Wu Zhenyu wrote:> > I found in man, there provide a zsh script: > > ``` >--shell-completion shell (alpha testing) >Generate shell completion code for interactive shells. > >Supported shells: bash zsh. > >Use auto as shell

Re: GNU Parallel --plus Capabilities

2022-05-30 Thread Ole Tange
On Fri, May 27, 2022 at 5:25 AM Larry Ploetz wrote: > > Feature request: > > Given the (second) command below, line 3 would be more like bash if it > substituted all periods with underscores (instead of none due to no match): That is not a feature request. That is a bug report. If you find

GNU Parallel 20220522 ('NATO') released

2022-05-22 Thread Ole Tange
://www.youtube.com/watch?v=2udvC90rIa4 Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Parallel record a video testimonial: Say who you are, what you use GNU

Re: Bug found

2022-04-25 Thread Ole Tange
On Sun, Apr 24, 2022 at 2:12 AM Saint Michael wrote: > > parallel: This should not happen. You have found a bug. Please follow > https://www.gnu.org/software/parallel/man.html#REPORTING-BUGS Please follow https://www.gnu.org/software/parallel/man.html#reporting-bugs Otherwise it will be

GNU Parallel 20220422 ('Буча') released

2022-04-23 Thread Ole Tange
updates. Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Parallel record a video testimonial: Say who you are, what you use GNU Parallel for, how it helps

Re: Hanging with defunct processes

2022-04-15 Thread Ole Tange
On Wed, Apr 13, 2022 at 3:06 PM Schweiss, Chip wrote: > > Something else is going on here. The same is consistently happening without > logging enabled at about 23K jobs completed. > > Any clues on how to debug the cause of this? Is it possibly a perl problem? It will be impossible to give

Re: Can parallel have any shell completions?

2022-03-31 Thread Ole Tange
On Wed, Mar 30, 2022 at 10:35 PM Ole Tange wrote: > On Wed, Mar 30, 2022 at 3:03 PM Wu Zhenyu wrote: > > I notice parallel seem to have no shell completions. It is not convenient. > > Instead of having a separate file, I would prefer letting GNU Parallel > generate the complet

Re: Can parallel have any shell completions?

2022-03-30 Thread Ole Tange
On Wed, Mar 30, 2022 at 3:03 PM Wu Zhenyu wrote: > > I notice parallel seem to have no shell completions. It is not convenient. I have no experience coding those, so I need someone to support/test them. Instead of having a separate file, I would prefer letting GNU Parallel generate the

GNU Parallel 20220322 ('Маріу́поль')

2022-03-22 Thread Ole Tange
-cbd41e23775a Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Parallel record a video testimonial: Say who you are, what you use GNU Parallel for, how it helps

Re: @gnuparallel Twitter account disappeared

2022-03-21 Thread Ole Tange
On Sun, Mar 20, 2022 at 7:30 PM Juan Sierra Pons wrote: > I just realized that @gnuparallel is not active anymore :( > > I think it is bad news :( The good news is @GNU_Parallel@twitter is more active than ever. > Any idea what happened? Yes. *embarressed face* /Ole

Re: Lower API Access

2022-03-10 Thread Ole Tange
On Thu, Mar 10, 2022 at 2:57 AM Bai, Jack wrote: > Excuse me, I’m just wondering whether it’s a good idea to expose the lower > level APIs for the Parallel software, for example, number of threads to use, > highest temperature of the CPU, etc. Way ahead of you: The code is Perl. You can

Re: I/O spin loop

2022-03-10 Thread Ole Tange
On Thu, Mar 10, 2022 at 4:24 AM Anderson, Stuart B. wrote: > > On Mar 9, 2022, at 4:04 PM, Ole Tange wrote: > > On Wed, Mar 9, 2022 at 7:21 PM Anderson, Stuart B. wrote: > >>> On Mar 8, 2022, at 3:35 PM, Ole Tange wrote: > >>> On Tue, Mar 8, 2022 at 11:22

Re: I/O spin loop

2022-03-09 Thread Ole Tange
On Wed, Mar 9, 2022 at 7:21 PM Anderson, Stuart B. wrote: > > On Mar 8, 2022, at 3:35 PM, Ole Tange wrote: > > On Tue, Mar 8, 2022 at 11:22 PM Anderson, Stuart B. > > wrote: > >> parallel version 20190922 from EPEL 8 running a Rocky Linux 8 system > >> occ

Re: bug report

2022-03-08 Thread Ole Tange
On Mon, Mar 7, 2022 at 3:10 PM Julien Gamba wrote: > Here is the message I get: > * The version number: 20161222 > * The bugid: swap_activity_file-r : > I hope there is enough information here! Unfortunately this is not enough to see what is going on. > Happy to give more details if needed.

Re: I/O spin loop

2022-03-08 Thread Ole Tange
On Tue, Mar 8, 2022 at 11:22 PM Anderson, Stuart B. wrote: > > parallel version 20190922 from EPEL 8 running a Rocky Linux 8 system > occasionally gets into an I/O spin loop writing 8193 bytes of "x" to a > deleted TMPDIR file and then immediately truncating it, e.g., This is by design:

Re: processing csv files

2022-03-08 Thread Ole Tange
On Mon, Mar 7, 2022 at 4:22 AM Saint Michael wrote: > > So how would I submit the contents of many files to parallel, without > concatenating them? Why do you see this as a problem? If you are going to start a process for each line of input cat will not slow things down. You _can_ avoid the

Re: Question

2022-03-06 Thread Ole Tange
On Sat, Mar 5, 2022 at 2:56 AM Saint Michael wrote: > > I have a case where I need the output to be written out to stdout as soon as > it's received, no ordering needed, just spit it out. > Is there an option to disable reordering or any manipulation of the output? Look at --ungroup and

Re: processing csv files

2022-03-06 Thread Ole Tange
On Sat, Mar 5, 2022 at 2:46 AM Saint Michael wrote: > > I have a bunch of *.csv files. > I need to process each line of the separately, so I do > function() { any process } > export -f function > cat *.csv | parallel --colsep ',' function "{1} {2} {3} {4} {5} {6} {7}" > > The question is: is

GNU Parallel 20220222 ('Donetsk Luhansk')

2022-02-22 Thread Ole Tange
of ls -l Output https://www.baeldung.com/linux/iterating-ls-l-output Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Parallel record a video testimonial

Re: parallel makes ffmpeg output files names garbled

2022-02-12 Thread Ole Tange
On Sat, Feb 12, 2022 at 12:47 AM Ole Tange wrote: > > On Fri, Feb 4, 2022 at 5:14 PM Ch g wrote: > : > > I tried GNU parallel 20161222 on Ubuntu 20.04 > > Please use the latest stable version: 20220122. My guess is that your > problem is solved by that. Looking at the

Re: --load question

2022-02-11 Thread Ole Tange
wrote: > > Thanks for the clarification. That's what I wanted to be sure of, that the > load would immediately include any job just started so the system wouldn't be > overloaded > > On Fri, Feb 11, 2022, 6:41 PM Ole Tange wrote: >> >> 100% is (as Joe says

Re: parallel makes ffmpeg output files names garbled

2022-02-11 Thread Ole Tange
On Fri, Feb 4, 2022 at 5:14 PM Ch g wrote: : > I tried GNU parallel 20161222 on Ubuntu 20.04 Please use the latest stable version: 20220122. My guess is that your problem is solved by that. If it is still an issue, see if you can follow

Re: --load question

2022-02-11 Thread Ole Tange
100% is (as Joe says) computed as it is for --jobs. The load average is computed as: ps ax -o state,command|grep '^R'| wc -l This is basically 5 min average, but for this second only. This is to make sure that when GNU Parallel starts a job, the load will increase by one. /Ole On Tue, Feb

GNU Parallel 20220122 ('20 years') released [stable]

2022-01-22 Thread Ole Tange
eg-and-gnu-parallel/ * Bash 平行 https://learntutorials.net/ja/bash/topic/10778/%E5%B9%B3%E8%A1%8C Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Paral

--pipe and :::

2022-01-09 Thread Ole Tange
This: seq 30 | parallel --pipe 'echo {1}-{2}; md5sum' ::: 1 2 ::: A B gives: 1-A 1490f57cc8cedc0f3c9c6b26d29ac58a - 1-B 20fbf3f07d8e81789f78b3906d951f09 - But I think it would be better if it gave: 1-A 1490f57cc8cedc0f3c9c6b26d29ac58a - 1-B

GNU Parallel's 20th birthday

2022-01-05 Thread Ole Tange
On 2022-01-06 GNU Parallel will be 20 years old. The birthday is an opportunity to take stock. https://www.gnu.org/software/parallel/20th-birthday.html /Ole

GNU Parallel 20211222 ('Støjberg') released [stable]

2021-12-22 Thread Ole Tange
://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Parallel record a video testimonial: Say who you are, what you use GNU Parallel for, how it helps you, and what you like most about it. Include a command

Re: Parallel by combination and link.

2021-12-09 Thread Ole Tange
On Wed, Dec 8, 2021 at 2:19 AM Jin Li wrote: > Could you please help suggest how could I combine the combination of > the first two but link the third argument with wrapping? Thanks. GNU Parallel currently cannot (patch welcome). Here is a crappy workaround: parallel -I II --argsep ,,

GNU Parallel 20211122 ('Peng Shuai') released [stable]

2021-11-22 Thread Ole Tange
=lXDGY7NvOYk Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Parallel record a video testimonial: Say who you are, what you use GNU Parallel for, how it helps

Re: GNU Parallel 20211022 ('Sinclair') released

2021-10-23 Thread Ole Tange
On Sat, Oct 23, 2021 at 7:21 AM Shlomi Fish wrote: > On Fri, 22 Oct 2021 22:51:17 +0200 > Ole Tange wrote: > > > GNU Parallel 20211022 ('Sinclair') has been released. It is available > > for download at: lbry://@GnuParallel:4 > > wrt the tagline, I thought it was about

GNU Parallel 20211022 ('Sinclair') released

2021-10-22 Thread Ole Tange
://www.youtube.com/watch?v=PIyJH4ben5o * Compiling GNU Parallel on CentOS-7 https://thelinuxcluster.com/2021/10/19/compiling-gnu-parallel-on-centos-7/ Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live

Re: Queue system limitation

2021-09-23 Thread Ole Tange
On Sun, Sep 19, 2021 at 6:39 PM Thomas Bereknyei wrote: > > The limitation mentioned in the man page has bitten me several times GNU Parallel determines the number of jobslots by looking at both input and limits. Before starting the first job it runs a loop: While jobslots <

GNU Parallel 20210922 ('Vindelev') released [stable]

2021-09-22 Thread Ole Tange
/93b936a55de9a331199d6582bc2921d2 Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Parallel record a video testimonial: Say who you are, what you use GNU Parallel for, how

GNU Parallel 20210822 ('Kabul') released

2021-08-22 Thread Ole Tange
multiple CPU Cores with your Linux commands - awk, sed, bzip2, grep, wc, etc. https://cdmana.com/2021/07/20210728132344693t.html * How to execute commands in parallel in Linux https://net2.com/how-to-execute-commands-in-parallel-in-linux/ Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole

GNU Parallel 20210722 ('Blue Unity') released

2021-07-22 Thread Ole Tange
with Open Source Tools https://kaerumy.medium.com/cleaning-up-scanned-documents-with-open-source-tools-9d87e15305b Get the book: GNU Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane

Re: gnu-find + gnu-parallel --pipe and executing cmds with some files having space(s) in their names

2021-07-13 Thread Ole Tange
On Sun, Jun 27, 2021 at 6:58 AM Normand Robert wrote: > > Posted on stackoverflow and did not get a useful answer. Answered here: https://stackoverflow.com/questions/68136966/bash-gnu-find-gnu-parallel-in-pipe-mode-and-executing-cmds-with-some-fil /Ole

VOTE: When should skipped commands be included?

2021-07-09 Thread Ole Tange
In replacement strings you can use 'skip()' to skip a command: $ parallel echo {= '$arg[1] % 2 or skip();' =} ::: {1..5} 1 3 5 --filter can be used with a similar effect: $ parallel --filter '{1} % 2' echo ::: {1..5} 1 3 5 In theory the skipped commands are never run (right now they are run

GNU Parallel 20210622 ('Protasevich') released [stable]

2021-06-22 Thread Ole Tange
://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Parallel record a video testimonial: Say who you are, what you use GNU Parallel for, how it helps you, and what you like most about it. Include

Re: bugid: open3-GLOB(0x7ffff9207528) c d e a

2021-06-17 Thread Ole Tange
I have just tested the installation on a fresh Ubuntu 18.04 on WSL on Microsoft Windows 10. It worked with no problems. On Wed, Jun 9, 2021 at 3:03 PM Pete Jalajas via GNU Parallel Discussion wrote: > > $ (wget -O - pi.dk/3 || curl pi.dk/3/) | bash > bash: /home/pjalajas/bin/bash: No such file

Re: Splitting input into jobs

2021-04-25 Thread Ole Tange
On Sat, Apr 3, 2021 at 5:10 AM Fredrick Brennan wrote: > You must drop --bar to use -m. Then the equal distribution of the arguments > will happen with e.g.: > > ⇒ find build/SVG_layers/ -iname '*.svg' | parallel -m 'inkscape > --batch-process --actions >

Re: parallel: This should not happen. You have found a bug. ; Cannot figure out version of rsync

2021-04-22 Thread Ole Tange
On Tue, Apr 20, 2021 at 11:18 PM Noel Kuntze via GNU Parallel Discussion wrote: > > $ echo test.txt | parallel -P 1 --sshlogin root@localhost --transferfile {} > parallel: This should not happen. You have found a bug. > Please contact and follow >

GNU Parallel 20210422 ('Ever Given') released [stable]

2021-04-22 Thread Ole Tange
Parallel 2018 http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html GNU Parallel - For people who live life in the parallel lane. If you like GNU Parallel record a video testimonial: Say who you are, what you use GNU Parallel for, how it helps you, and what you like most

Re: Error with Galaxy FreeBayes

2021-03-23 Thread Ole Tange
On Tue, Mar 23, 2021 at 10:03 PM Julianne Marguerite Radford wrote: > > My Galaxy username is jradfor8, and I have been getting a bug error when > running the tool FreeBayes: > > parallel: This should not happen. You have found a bug. > Please contact and include: > * The version number:

First version of Parallel recovered

2021-03-06 Thread Ole Tange
Last summer I dug out a 16 years old backup disk: https://www.version2.dk/blog/dekryptering-16-aar-gammel-harddisk-1090958 (Danish) Today I went through some of the data. And imagine my delight when I found an old version of Parallel (way before it was called GNU). It is dated 2002-01-06. Here

Re: Possible bug with --resume and .csv --results

2021-03-05 Thread Ole Tange
On Wed, Mar 3, 2021 at 9:46 PM Joe Sapp wrote: > I tried a feature today (version 20210222) that I haven't before and > got an unexpected error: > > $ parallel -j1 --resume --joblog test_joblog.log --results test-$(date > > +%Y%m%dT%H%M%SZ).csv 'echo {}; sleep 2s' ::: $(seq 100) > > mkdir

Re: Parallel Question Issue

2021-03-05 Thread Ole Tange
On Thu, Mar 4, 2021 at 11:22 PM Hogue, Robert (Nokia - CA/Ottawa) wrote: > I am running the below parallel when I run it again 500 targets in this case > commands that ssh to host and grabs information. > > I runs fine. > > parallel --timeout 800% --tag linux_boxes_ssh "$passwords" >

Re: Graceful Process / Script Termination

2021-02-27 Thread Ole Tange
e > https://www.gnu.org/software/parallel/man.html#EXAMPLE:-Using-remote-computers > would have saved some time on experimenting. > > All the best > Jens > > > > INTERNAL > > -Ursprüngliche Nachricht- > Von: Ole Tange > Gesendet: Sonntag, 20.

Re: parallel refusing to take my request

2020-12-23 Thread Ole Tange
On Tue, Dec 8, 2020 at 4:10 PM Ecks Hecker wrote: : > > parallel: Warning: Only enough file handles to run 252 jobs in parallel. > > parallel: Warning: Running 'parallel -j0 -N 252 --pipe parallel -j0' or > > parallel: Warning: raising 'ulimit -n' or 'nofile' in > > /etc/security/limits.conf > >

  1   2   3   4   5   6   7   >