Anyone know how to submit jobs to at or anything else that allows jobs submitted to a queue to be executed consecutively? I have a series of servers that submits a job via an ssh background job but I can only have one execute at any given time. Possibly some clever bash work? Thanks! jlc
On Wed, Apr 07, 2010 at 03:57:14AM +0000, Joseph L. Casale wrote:> Anyone know how to submit jobs to at or anything else that allows jobs > submitted to a queue to be executed consecutively? > > I have a series of servers that submits a job via an ssh background > job but I can only have one execute at any given time.Are you looking for a real job scheduler? If so, it might be overkill, but you might want to look into software like Sun Grid Engine, Torque, or Condor (there are quite a few other schedulers out there). If those aren't what you're hoping for, perhaps you could give more details about what you're trying to accomplish. --keith -- kkeller at speakeasy.net -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 197 bytes Desc: not available URL: <http://lists.centos.org/pipermail/centos/attachments/20100406/bd76925b/attachment-0003.sig>
>Are you looking for a real job scheduler? If so, it might be overkill, >but you might want to look into software like Sun Grid Engine, Torque, >or Condor (there are quite a few other schedulers out there). If those >aren't what you're hoping for, perhaps you could give more details about >what you're trying to accomplish.Based on John and Les's reco for a different cluster need, I am reading up on Torque etc now, but this just a trivial need I want to plug asap. It really is as simple as I wrote out earlier, multiple servers ssh a background job at nearly the same time consisting of an rsync command. The destination host for this target gets overwhelmed with more than one at a time... Thanks, jlc
On Wed, Apr 07, 2010 at 03:57:14AM +0000, Joseph L. Casale wrote:> Anyone know how to submit jobs to at or anything else that allows jobs > submitted to a queue to be executed consecutively? > > I have a series of servers that submits a job via an ssh background > job but I can only have one execute at any given time.Probably batch will do it: batch executes commands when system load levels permit; in other words, when the load average drops below 0.8, or the value specified in the invocation of atd. Mihai
> Anyone know how to submit jobs to at or anything else that allows jobs > submitted to a queue to be executed consecutively?This could be of some help: http://www.theillien.com/Sys_Admin_v12/html/v14/i08/a8.htm Chris
please take this email address off your mail list..... Bob has died so he will no longer use this site....thank you -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.centos.org/pipermail/centos/attachments/20100407/858b46ae/attachment-0002.html>
"Joseph L. Casale" <jcasale at activenetwerx.com> wrote:>>It really is as simple as I wrote out earlier, multiple servers ssh a background job at nearly the same time consisting of an rsync command. The destination host for this target gets overwhelmed with more than one at a time... << This isn't a complete answer, but a possible approach: I'd use a named pipe on the destination host. Here's a little experiment to demonstrate. [user at dhost temp]$ mkfifo pipe [user at dhost temp]$ while true ; do ` < pipe` ; done Now, in another xterm: [user at dhost temp]$ echo date > pipe [user at dhost temp]$ echo 'ls -l' > pipe You can 'echo' commands to the pipe in multiple windows; the while loop will only read and execute one command at a time off the pipe. You can see where this is going - now your multiple servers just ssh those echo commands to the destination host and the corresponding commands are executed. I'll leave it to you to make it suitably robust if you go this way; you'll need to add some error handling, possibly signal handling, etc. but that's just standard shell scripting. Best, --- Les Bell [http://www.lesbell.com.au] Tel: +61 2 9451 1144