Re: Use of Vagrant in tests poses licencing question

[[[ To any NSA and FBI agents reading my email: please consider]]] [[[ whether defending the US Constitution against all enemies, ]]] [[[ foreign or domestic, requires you to follow Snowden's example. ]]] WHat you've done seems ok. Thanks. -- Dr Richard Stallman (https://stallman.org)

Re: Use of Vagrant in tests poses licencing question

[[[ To any NSA and FBI agents reading my email: please consider]]] [[[ whether defending the US Constitution against all enemies, ]]] [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > > After that is dealt with, could you please inform the people who work > > on

Re: Use of Vagrant in tests poses licencing question

On Fri, Mar 1, 2024 at 4:26 AM Richard Stallman wrote: > > [[[ To any NSA and FBI agents reading my email: please consider]]] > [[[ whether defending the US Constitution against all enemies, ]]] > [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > > > I think a

Re: Use of Vagrant in tests poses licencing question

[[[ To any NSA and FBI agents reading my email: please consider]]] [[[ whether defending the US Constitution against all enemies, ]]] [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > I think a solution that adheres to POLA would be to check if Vagrant > is

Re: Use of Vagrant in tests poses licencing question

[[[ To any NSA and FBI agents reading my email: please consider]]] [[[ whether defending the US Constitution against all enemies, ]]] [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > > Can you report these problems to people who might fix them? > I have the

Re: Use of Vagrant in tests poses licencing question

On Tue, Feb 20, 2024 at 4:23 AM Richard Stallman wrote: > > [[[ To any NSA and FBI agents reading my email: please consider]]] > [[[ whether defending the US Constitution against all enemies, ]]] > [[[ foreign or domestic, requires you to follow Snowden's example. ]]] : > > Since there

Re: Use of Vagrant in tests poses licencing question

On Tue, Feb 20, 2024 at 4:23 AM Richard Stallman wrote: > > [[[ To any NSA and FBI agents reading my email: please consider]]] > [[[ whether defending the US Constitution against all enemies, ]]] > [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > > > but

Re: Use of Vagrant in tests poses licencing question

[[[ To any NSA and FBI agents reading my email: please consider]]] [[[ whether defending the US Constitution against all enemies, ]]] [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > but https://github.com/viagrunts/viagrunts does not seem to work, and >

Re: Use of Vagrant in tests poses licencing question

[[[ To any NSA and FBI agents reading my email: please consider]]] [[[ whether defending the US Constitution against all enemies, ]]] [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > Nothing in the test suite of GNU Parallel currently depends on Vagrant > newer

Re: Use of Vagrant in tests poses licencing question

On Fri, Feb 9, 2024 at 1:43 AM Richard Stallman wrote: > > [[[ To any NSA and FBI agents reading my email: please consider]]] > [[[ whether defending the US Constitution against all enemies, ]]] > [[[ foreign or domestic, requires you to follow Snowden's example. ]]] > > Thank you for

Re: Use of Vagrant in tests poses licencing question

[[[ To any NSA and FBI agents reading my email: please consider]]] [[[ whether defending the US Constitution against all enemies, ]]] [[[ foreign or domestic, requires you to follow Snowden's example. ]]] Thank you for bringing this up. Indeed, GNU Parallel should not recommend a

Use of Vagrant in tests poses licencing question

Hi, I noticed that a recent commit (07c87e1af3f3ddf2ff12cf90baae2a897d13ea25, testsuite: Make it easier to run test on other machines.) uses Vagrant for testing GNU Parallel on remote machines. Vagrant, however, is not free software. It was previously licenced under the MIT licence, but is now

Re: Installation/update question

On Fri, Dec 15, 2023 at 7:48 PM Nagesh Adluru wrote: > I was trying to update the parallel version to the latest version and getting > the attached message. It looks like the signature on the download is > incorrect. As you could see the from the attached screenshot sha1sum isn’t > finding

Re: Question

/Ole On Sun, Dec 11, 2022 at 6:28 PM Saint Michael wrote: > > I am running a process that takes as input a FILE > parallel --gnu --no-run-if-empty -k --lb -j-5 --eta --colsep ' ' > processx "{1} {#}" ${FILE} > the file is huge, and it got erased after the process star

Re: Question

On Sat, Mar 5, 2022 at 2:56 AM Saint Michael wrote: > > I have a case where I need the output to be written out to stdout as soon as > it's received, no ordering needed, just spit it out. > Is there an option to disable reordering or any manipulation of the output? Look at --ungroup and

Question

I have a case where I need the output to be written out to stdout as soon as it's received, no ordering needed, just spit it out. Is there an option to disable reordering or any manipulation of the output?

Question

> > I have a bunch of *.csv files. I need to process each line of the separately, so I do function() { any process } export -f function cat *.csv | parallel --colsep ',' function "{1} {2} {3} {4} {5} {6} {7}" The question is: is this the best possible way to do this? I don't like to use "cat"

Re: --load question

You can guess whether the first implementation included that or whether it caused an overloaded machine (that had to be rebooted) to discover that using the 5 min average is a pretty bad idea. There is, however, no prize for the correct guess :) /Ole On Sat, Feb 12, 2022 at 12:46 AM Neal Becker

Re: --load question

Thanks for the clarification. That's what I wanted to be sure of, that the load would immediately include any job just started so the system wouldn't be overloaded On Fri, Feb 11, 2022, 6:41 PM Ole Tange wrote: > 100% is (as Joe says) computed as it is for --jobs. > > The load average is

Re: --load question

100% is (as Joe says) computed as it is for --jobs. The load average is computed as: ps ax -o state,command|grep '^R'| wc -l This is basically 5 min average, but for this second only. This is to make sure that when GNU Parallel starts a job, the load will increase by one. /Ole On Tue, Feb

Re: --load question

See the man page description for "--use-sockets-instead-of-threads" and "--use-cores-instead-of-threads". I believe GNU Parallel counts the number of processes running and uses that information to match what you specify. By default it's the number of hyperthreaded cores available. Joe On Sat,

--load question

Newb here. I want to schedule a bunch of tasks > #cores. Let's say I want to run #cores at a time (100% utilization). If I do seq 1 1000 | parallel --load 100% blah blah... What is the load that is being looked at? A 5 minute load average? So at the time I start this 1000 tasks, loadave is 0

RE: Parallel Question Issue

ommand output I send with ssh. Thanks for your help. Should I use other different options? Bob -Original Message- From: Ole Tange Sent: Friday, March 5, 2021 4:13 PM To: Hogue, Robert (Nokia - CA/Ottawa) Cc: parallel@gnu.org Subject: Re: Parallel Question Issue On Thu, Mar 4, 2021 at 11

Re: Parallel Question Issue

On Thu, Mar 4, 2021 at 11:22 PM Hogue, Robert (Nokia - CA/Ottawa) wrote: > I am running the below parallel when I run it again 500 targets in this case > commands that ssh to host and grabs information. > > I runs fine. > > parallel --timeout 800% --tag linux_boxes_ssh "$passwords" >

Re: Parallel Question Issue

There's a per job delay, if that helps. On 3/4/21 1:27 PM, Hogue, Robert (Nokia - CA/Ottawa) wrote: Hi, I am running the below parallel when I run it again 500 targets in this case commands that ssh to host and grabs information. I runs fine. parallel --timeout 800% --tag linux_boxes_ssh

Question: --limit tool?

Hello Parallelizers! I'm using GNU Parallel to run the AWS CLI utility, and I want to use Parallel's --limit option to avoid being throttled. Before I sit down and write something, has anybody already invented this wheel? Essentially, AWS has a token-bucket rate-limiting system: * Every

Re: Query regarding stackoverflow question (Run million of list in PBS with parallel tool)

On Fri, Oct 4, 2019 at 6:33 AM Rajiv Gandhi Govindaraj wrote: > Thanks for this great tool and for helping me out on this. You can pay back by spreading the word and help others use the tool. > As per you suggestion I've introduced a simple function and tested in my > local machine which has

Query regarding stackoverflow question (Run million of list in PBS with parallel tool)

Dear Ole Tange, Thanks for this great tool and for helping me out on this. We, Computational chemist widely run long/large scale calculations on biological data and GNU parallel is very helpful in achieving it. As per you suggestion I've introduced a simple function and tested in my local

Re: Question on copying files to AWS

You might pipe ls -R into that command but you’ll want access to multiple machines to run a slew of parallel cp jobs. GNU parallel can use a hosts file to start remote jobs. Each of those jobs needs a supply of files to copy > On Nov 16, 2018, at 12:13 PM, Michael A Nesmith > wrote: > > Hi,

Question on copying files to AWS

Hi, everyone, I am new to both AWS and GNU Parallel software. Please pardon a beginner's questions. I need to copy/move files from my AWS Linux EC2 instance (Redhat 6.10) to an S3 bucket that was previously created. Normally the command to copy a file (for example, messages) would look

Re: [EXTERNAL] Re: Linux kernel question, pre 2.6.23 vs later kernel versions

On Mon, Oct 22, 2018 at 7:10 PM Groom, George wrote: > Actual output from my 2 HP systems are below. Note execution time > differences between later and older kernels. Are you saying you are comparing two completely different systems (one of the of the differences being the kernel version)

RE: [EXTERNAL] Re: Linux kernel question, pre 2.6.23 vs later kernel versions

Subject: [EXTERNAL] Re: Linux kernel question, pre 2.6.23 vs later kernel versions On Wed, Oct 17, 2018 at 10:25 PM Groom, George wrote: > I understand that kernel process scheduling changed at 2.6.23… run queue > based to Completely Fair Scheduling (CFS). Has anyone experienced

Re: Linux kernel question, pre 2.6.23 vs later kernel versions

On Wed, Oct 17, 2018 at 10:25 PM Groom, George wrote: > I understand that kernel process scheduling changed at 2.6.23… run queue > based to Completely Fair Scheduling (CFS). Has anyone experienced longer > parallel script execute times on systems with later versions of the Linux > kernel? >

Linux kernel question, pre 2.6.23 vs later kernel versions

All, I understand that kernel process scheduling changed at 2.6.23... run queue based to Completely Fair Scheduling (CFS). Has anyone experienced longer parallel script execute times on systems with later versions of the Linux kernel? I've noticed longer execute times where I'm generating

Re: Thank you to Ole, and Question 1 (choice of colon operators)

On Wed, May 17, 2017 at 10:41 PM, paralleluser wrote: > I want to begin by thanking Ole Tange for all his work and continuing efforts > with GNU Parallel. It is a very impressive set of work. Thanks. > I've read over all the parallel docs, the man pages, the

Re: Question 2 (argfile input syntax)

On Wed, May 17, 2017 at 10:42 PM, paralleluser <parallelu...@fastmail.net> wrote: > Question 2: > There are a multitude of ways to give GNU parallel arguments contained in a > file. > > 1. cat argfile | parallel > 2. parallel < argfile > 3. parallel argfile

Re: Thank you to Ole, and Question 1 (choice of colon operators)

On Wed, May 17, 2017 at 10:41 PM, paralleluser <parallelu...@fastmail.net> wrote: : > Question 1: > The choice of ::: and are unique. Yes, they are arbitrary and they can > be changed with parallel command line arguments. But how/why where they > chosen? I have a go

Question 2 (argfile input syntax)

Friends, Question 2: There are a multitude of ways to give GNU parallel arguments contained in a file. 1. cat argfile | parallel 2. parallel < argfile 3. parallel argfile 4. parallel ::: `cat argfile` 5. parallel -a argfile Am I missing any from this list? I am curious as to which

Thank you to Ole, and Question 1 (choice of colon operators)

, and the parallel design choices document. An amazing set of documents! I have a few questions of curiosity and hope you will allow me to post them over the next few days. Question 1: The choice of ::: and are unique. Yes, they are arbitrary and they can be changed with parallel command

Re: Question on optimizing GNU Parallel with multiple lines of search parameters

The '&' control operator might be what you are looking for. Excerpt from `man 1 bash`: SHELL GRAMMAR Lists If a command is terminated by the control operator &, the shell exe‐ cutes the command in the background in a subshell. The shell does not wait for the

Question on optimizing GNU Parallel with multiple lines of search parameters

Hi, I have a program that has 4 individual lines of code that are searching through multiple files. I'd like to speed the program up by running those 4 lines simultaneously with Parallel. How would I structure my bash code to achieve this? Eg: | parallel | parallel >> file | parallel |

Question regarding changing $TMPDIR in parallel processing

Dear all, I run a batch job on a high-performance computing system to sort multiple SAM files ( 600GB) and used parallel to speed up the task, but my job failed with the following reasons:  parallel: Error: Output is incomplete. Cannot append to buffer file in $TMPDIR. Is the disk

Question relating to GNU parallel Tool

I want to ask that How with the Help of using Xarg and tee can we make GNU parallel run very fast. Can you give any elaborate Information regarding this. Sir I am not cleared with the concept of Xarg. I want to make the project on parallel processing. Can i may get any help. With Regards --

Re: ssh/parallel question

On Thu, Jun 27, 2013 at 6:20 PM, James Ward jimw...@us.ibm.com wrote: Let's say I want to run the same program on multiple servers. Which way is better? cat ServerList | parallel ssh -p1602 {} program and arguments or parallel -S server1,server2,server3,server4 program and arguments If

Re: {//} question

of 'test'? Read the manual for -k and {//} of parallel, and the man page for the UNIX command dirname. Then try: parallel -k dirname {} ::: test/one test/. test/ test If that does not answer your question, please elaborate your question further. /Ole