On Fri, 4 Feb 2022 at 11:56, Neal Becker wrote:
> My purpose is to queue up a bunch of tasks > #cpus, and have #cpus run at
> a time in parallel.
> So if I have 120 jobs to run, and 32 cores, I want to queue them all up
> and run 32 in parallel at a time.
> Or, maybe I need to set --ncpus=16 so
My purpose is to queue up a bunch of tasks > #cpus, and have #cpus run at a
time in parallel.
So if I have 120 jobs to run, and 32 cores, I want to queue them all up and
run 32 in parallel at a time.
Or, maybe I need to set --ncpus=16 so schedule 16 parallel jobs instead of
32 (my scheduler is
On 2022-02-04 09:04, Neal Becker wrote:
After this discussion, I needed a simple batch scheduling system. I
tried installing and starting condor on F35. Never saw so many
selinux problems. Couldn't dnf remove it fast enough.
After a bit of searching, I found the system I wrote 11 years
After this discussion, I needed a simple batch scheduling system. I tried
installing and starting condor on F35. Never saw so many selinux
problems. Couldn't dnf remove it fast enough.
After a bit of searching, I found the system I wrote 11 years ago.
https://pypi.org/project/batch-queue/
I
On Wed, 26 Jan 2022 12:59:23 -0500
Neal Becker wrote:
> I've needed this over the years but all the ones I've seen appeared
> much too complex for my simple use case. I ended up writing my own
> using pyxmlrpc. Unfortunately haven't used it for years and don't
> know if I could find it again
I've needed this over the years but all the ones I've seen appeared much
too complex for my simple use case. I ended up writing my own using
pyxmlrpc. Unfortunately haven't used it for years and don't know if I
could find it again (was uploaded to pypi at one time).
Are any of these batch
On Fri, Jan 21, 2022 at 11:31:25AM -0700, linux guy wrote:
> Is there anything simpler than Torque ?
Yeah, these schedulers do get kind of complex. You might be happy with the
simple "batch" command.
On the other hand, if this is your field, it's probably worth your time to
learn a bit about the
This is a simple shell script I wrote a long time ago which
is invoked by a CGI script on a local web page and notices
files that show up in a queue directory.
#!/bin/bash
# This script is started by the setuid program start-queue so that the
# CGI script which makes queue entries can have the
On Fri, 21 Jan 2022 at 13:40, linux guy wrote:
> Hi people.
>
> I'm using a server to run a bunch of simulations. By bunch I mean
> hundreds. Each simulation takes from 10 minutes to 10 hours to run. All
> of the simulations are run from the command line. Every day I generate
> more
On Fri, 21 Jan 2022 11:31:25 -0700
linux guy wrote:
> Is there anything simpler than Torque ?
There is the standard UNIX batch command. It is about as simple as
can be. Certainly much simpler than the VMS and MVS batch systems
back in the day.
There also seem to be several Node.JS batch
On Fri, Jan 21, 2022 at 12:19 PM Cameron Simpson wrote:
> If you can define a task in a single line of text
I can define my tasks in a single command line.
> you could run
> something like this on the server:
>
> tail -f task_list.txt | while read -r spec; do run the task from
> $spec;
Thought: I'll write a simple one in nodejs and make the user interface a
webpage. That way I can log into the webpage from anywhere and check on
the status of my simulations as well as add and delete them.
I'm not running a cluster. Just my little ole server.
Thoughts ?
On 21Jan2022 10:39, linux guy wrote:
>I'm using a server to run a bunch of simulations. By bunch I mean
>hundreds. Each simulation takes from 10 minutes to 10 hours to run. All
>of the simulations are run from the command line. Every day I generate
>more simulation cases.
>
>I'm looking for a
Is there anything simpler than Torque ?
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
Thanks for the replies, I'll look into the mentioned packages.
I have never heard of Torque.
___
users mailing list -- users@lists.fedoraproject.org
To unsubscribe send an email to users-le...@lists.fedoraproject.org
Fedora Code of Conduct:
On Jan 21, 2022, at 13:08, Roger Heflin wrote:
>
> In the past I have used this one:
> one called Torque that is in the repo. It has a client piece and a
> server piece. You would have to define the queue such that it would
> only run a single job at a time and then submit them in order.
In the past I have used this one:
one called Torque that is in the repo. It has a client piece and a
server piece. You would have to define the queue such that it would
only run a single job at a time and then submit them in order.
On Fri, Jan 21, 2022 at 11:40 AM linux guy wrote:
>
> Hi
Hi people.
I'm using a server to run a bunch of simulations. By bunch I mean
hundreds. Each simulation takes from 10 minutes to 10 hours to run. All
of the simulations are run from the command line. Every day I generate
more simulation cases.
I'm looking for a method/system/app that I can
18 matches
Mail list logo
