From - Sat Jan 30 12:12:39 1999 Path: reader1.news.rcn.net!feed1.news.rcn.net!rcn!netnews.com!newsswitch.lcs.mit.edu!eecs-usenet-02.mit.edu!bloom-beacon.mit.edu!senator-bedfellow.mit.edu!gnu.org!gnu From: Werner Krebs Newsgroups: gnu.announce,comp.os.linux.misc,alt.sources.d Subject: Re: [werner.krebs@yale.edu: Queue 1.11 announcement] Date: Thu, 28 Jan 1999 20:13:38 -0500 Organization: Yale University Lines: 169 Approved: info-gnu@gnu.org Distribution: world Message-ID: References: <199901282238.RAA11065@delysid.gnu.org> NNTP-Posting-Host: churchy.ai.mit.edu Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Mailer: Mozilla 3.01Gold (Win95; U) To: GNU Mailing List Maintenance Xref: reader1.news.rcn.net gnu.announce:1011 comp.os.linux.misc:341161 alt.sources.d:2153 GNU Queue 1.11 is available by ftp from ftp.gnu.org/pub/gnu/queue/ and mirrors of that site (see list below). GNU Queue is a UNIX process network load-balancing system that features an innovative proxy daemon mechanism which allows users to control their remote jobs in a nearly seamless and transparent fashion. When an interactive remote job is launched, such as say Octave, or EMACS interfacing Common Lisp, a proxy daemon runs on the local end. By sending signals to the remote side - including control signals like hitting the suspend key - the process on the remote end may be controlled just as easily as if it were a local process. Resuming the stub resumes the remote job. The user's environment is almost completely replicated, including not only environmental variables, but nice values, rlimits, terminal settings are all replicated on the remote end. Together with MIT_MAGIC_COOKIE_1 (or xhost +) the system is X-windows transparent as well, provided the users local DISPLAY variable is set to the fully qualified pathname of the local machine. One of the most appealing features of the stub system even with experienced users is that asynchronous job control of remote jobs by the shell is possible and intuitive. One simply runs the proxy job in the background under the local shell; the shell notifies the user when the remote job has a change in status by monitoring the proxy daemon. Want to migrate that CPU guzzling interactive job to another machine? Run queue -- jobname, and it behaves as if it were local. Want to suspend that job? Control-Z, and you're back to the local shell; the job is suspended on the remote machine as well. Type bg or fg and the job is seemingly running on the local machine again; except it's not! It's running on a remote CPU. This feature is especially practical when you wish to run many cpu-intensive jobs simultaneously throughout the cluster --- you can control them all effortlessly through the local shell. When the remote process has terminated, the proxy returns the exit value to the shell; otherwise, the proxy job simulates a death by the same signal as that which terminated or suspended the remote job. In this way, control of the remote process is intuitive even to novice users, as it is just like controlling a local job from the shell. Many of my original users had to be reminded that their jobs were, in fact, running remotely. In addition, Queue also features a more traditional distributed batch processing environment, with results returned to the user via email. In addition, traditional batch processing limitations may be placed on jobs running in either environment (proxy process or with the email mechanism) such as suspension of jobs if the system exceeds a certain load average, limits on CPU time, disk free requirements, limits on the times in which jobs may run, etc. (These are documented in the sample profile file included.) Queue may be installed by any user on the system; root privileges are not required. GNU Queue supports the GNU/Linux, Solaris, SunOS, HP-UX, IRIX, Digital Unix, and, most recently, FreeBSD platforms. The homepages for GNU Queue are http://www.gnu.org/software/queue (official) and http://bioinfo.mbb.yale.edu/~wkrebs/queue.html (frequently updated). Planned improvements for GNU Queue include adding support for heterogenuous clusters and adding checkpoint process migration (to allow processes migrate from host to host dynamically after startup). Volunteers are sought to assist with these and other development projects; information on subscribing to the development list is available off the homepages. [ Most GNU software is compressed using the GNU `gzip' compression program. Source code is available on most sites distributing GNU software. Executables for various systems and information about using gzip can be found at the URL http://www.gzip.org. For information on how to order GNU software on CD-ROM and printed GNU manuals, see http://www.gnu.org/order/order.html or e-mail a request to: gnu@gnu.org By ordering your GNU software from the FSF, you help us continue to develop more free software. Media revenues are our primary source of support. Donations to FSF are deductible on US tax returns. The above software will soon be at these ftp sites as well. Please try them before ftp.gnu.org as ftp.gnu.org is very busy! A possibly more up-to-date list is at the URL http://www.gnu.org/order/ftp.html thanx -gnu@gnu.org Here are the mirrored ftp sites for the GNU Project, listed by country: United States: California - labrea.stanford.edu/pub/gnu, gatekeeper.dec.com/pub/GNU Hawaii - ftp.hawaii.edu/mirrors/gnu Illinois - uiarchive.cso.uiuc.edu/pub/gnu (Internet address 128.174.5.14) Kentucky - ftp.ms.uky.edu/pub/gnu Maryland - ftp.digex.net/pub/gnu (Internet address 164.109.10.23) Michigan - gnu.egr.msu.edu/pub/gnu Missouri - wuarchive.wustl.edu/systems/gnu New Mexico - ftp.cs.unm.edu/pub/mirrors/gnu New York - ftp.cs.columbia.edu/archives/gnu/prep Ohio - ftp.cis.ohio-state.edu/mirror/gnu Tennessee - ftp.skyfire.net/pub/gnu Virginia - ftp.uu.net/archive/systems/gnu Washington - ftp.nodomainname.net/pub/mirrors/gnu Africa: South Africa - ftp.sun.ac.za/gnu The Americas: Brazil - ftp.unicamp.br/pub/gnu Canada - ftp.cs.ubc.ca/mirror2/gnu Chile - ftp.inf.utfsm.cl/pub/gnu (Internet address 146.83.198.3) Costa Rica - sunsite.ulatina.ac.cr/GNU Mexico - ftp.uaem.mx/pub/gnu Asia and Australia: Australia - archie.au/gnu (archie.oz or archie.oz.au for ACSnet) Australia - ftp.progsoc.uts.edu.au/pub/gnu Australia - mirror.aarnet.edu.au/pub/gnu Japan - tron.um.u-tokyo.ac.jp/pub/GNU/prep Japan - ftp.cs.titech.ac.jp/pub/gnu Korea - cair-archive.kaist.ac.kr/pub/gnu (Internet address 143.248.186.3) Thailand - ftp.nectec.or.th/pub/mirrors/gnu (Internet address - 192.150.251.32) Europe: Austria - ftp.univie.ac.at/packages/gnu Austria - gd.tuwien.ac.at/gnu/gnusrc Austria - http://gd.tuwien.ac.at/gnu/gnusrc/ Czech Republic - ftp.fi.muni.cz/pub/gnu/ Denmark - ftp.denet.dk/mirror/ftp.gnu.org/pub/gnu Denmark - ftp.dkuug.dk/pub/gnu/ Finland - ftp.funet.fi/pub/gnu France - ftp.univ-lyon1.fr/pub/gnu France - ftp.irisa.fr/pub/gnu Germany - ftp.informatik.tu-muenchen.de/pub/comp/os/unix/gnu/ Germany - ftp.informatik.rwth-aachen.de/pub/gnu Germany - ftp.de.uu.net/pub/gnu Greece - ftp.forthnet.gr/pub/gnu Greece - ftp.ntua.gr/pub/gnu Greece - ftp.aua.gr/pub/mirrors/GNU (Internet address 143.233.187.61) Hungary - ftp.kfki.hu/pub/gnu Ireland - ftp.ieunet.ie/pub/gnu (Internet address 192.111.39.1) Netherlands - ftp.eu.net/gnu (Internet address 192.16.202.1) Netherlands - ftp.nluug.nl/pub/gnu Netherlands - ftp.win.tue.nl/pub/gnu (Internet address 131.155.70.19) Norway - ugle.unit.no/pub/gnu (Internet address 129.241.1.97) Poland - ftp.task.gda.pl/pub/gnu Portugal - ftp.ci.uminho.pt/pub/mirrors/gnu Portugal - http://ciumix.ci.uminho.pt/mirrors/gnu/ Slovenia - ftp.arnes.si/pub/software/gnu Spain - ftp.etsimo.uniovi.es/pub/gnu Sweden - ftp.isy.liu.se/pub/gnu Sweden - ftp.stacken.kth.se Sweden - ftp.luth.se/pub/unix/gnu Sweden - ftp.sunet.se/pub/gnu (Internet address 130.238.127.3) Also mirrors the Mailing List Archives. Switzerland - ftp.eunet.ch/mirrors4/gnu Switzerland - sunsite.cnlab-switch.ch/mirror/gnu (Internet address 193.5.24.1) United Kingdom - ftp.mcc.ac.uk/pub/gnu (Internet address 130.88.203.12) United Kingdom - unix.hensa.ac.uk/mirrors/gnu United Kingdom - ftp.warwick.ac.uk (Internet address 137.205.192.14) United Kingdom - SunSITE.doc.ic.ac.uk/gnu (Internet address 193.63.255.4) ]