[Cook] Running with parallel

[Jody Hagins]

Sorry to be a bother...  I am still having this parallel problem.  Does
anyone know of a solution or workaround (other than not using parallel
4)?



Date: Fri, 6 Jun 2003 09:54:19 -0500 (CDT)
From: Jerry Pendergraft <jerry at endocardial.com>
To: Peter Miller <millerp at canb.auug.org.au>
Cc: Jody Hagins <jody at atdesk.com>
Subject: Re: [Cook] Running with parallel


Attached is a simple cook file using some of Jody's recipes.
For a test I created /tmp/d and /tmp/t and populated /tmp/t with
aa.ymd -- ee.ymd to provide the "sources"

Interesting results.
$ cook -book hp.cook -parallel 2           works
$ cook -book hp.cook -parallel 3           works
$ cook -book hp.cook -parallel 4           (default) does not work 
It gives 
 cook: wait(): No child processes
And if you notice in hp.list.2.21 at line 6 there is a thread 4 which
does
nothing and has no "after command" counterpart.

I also ran with cook.2.23 with same results except different thread
numbers.

Ideas?
-- 
Jerry Pendergraft                       
jerry.pendergraft at endocardial.com
Endocardial Solutions                    voice: 651-523-6935
1350 Energy Lane, Suite 110                fax: 651-644-7897
St Paul, MN 55108-5254                  mobile: 651-491-0163

On Thu, 5 Jun 2003, Jody Hagins wrote:

> On Thu, 5 Jun 2003 20:20:45 -0400
> Jody Hagins <jody at atdesk.com> wrote:
> 
> > 
> > It looks like some internal "tee" process is hanging...
> > 
> > shandalle:jody> ps axe | grep cook
> >  5452 ?        S      0:02 gvim Howto.cook _=/usr/bin/X11/gvim
> > SSH_CONNECTION=17
> >  7542 pts/30   S      0:00 cook -parallel _=/usr/bin/cook
> > SSH_CONNECTION=172.30.
> >  7543 pts/30   S      0:00 tee Howto.list _=/usr/bin/cook
> > SSH_CONNECTION=172.30.
> >  7586 pts/27   S      0:00 grep cook _=/bin/grep PAGER=less
> > GDM_LANG=en_US.iso88
> 
> 
> I did some more looking, and found that "tee" is used to redirect
> logging to stdout as well as the Howto.list file.  So, I naturally
> tried to run it in parallel without the listing.  Unfortunately, the
> cook ended early (instead of hanging).  Note that in this case, none
> of the final targets were even attempted (though sometimes some subset
> of the final targets are created).  Apparantly, it is trying to wait,
> but no processes have been spawned (though there are 4 threads of
> execution which are terminated when wait() fails.
> 
> 
> shandalle:jody> cook -No_List -parallel
> Line: 157 , thread: 1
> cook: touch /tmp/MMMM.19650107 /tmp/IIII.19650107 /tmp/CCCC.19650107
>         /tmp/JJJJ.19650107 /tmp/SSSS.19650107
> Line: 159 , thread: 1
> Line: 134 , thread: 1
> cook: gzip -c /tmp/MMMM.19650107 > /tmp/MMMM.19650107.gz
> Line: 134 , thread: 2
> cook: gzip -c /tmp/IIII.19650107 > /tmp/IIII.19650107.gz
> Line: 134 , thread: 3
> cook: gzip -c /tmp/CCCC.19650107 > /tmp/CCCC.19650107.gz
> Line: 134 , thread: 4
> cook: gzip -c /tmp/JJJJ.19650107 > /tmp/JJJJ.19650107.gz
> Line: 136 , thread: 3
> Line: 134 , thread: 3
> cook: gzip -c /tmp/SSSS.19650107 > /tmp/SSSS.19650107.gz
> Line: 136 , thread: 3
> cook: wait(): No child processes
> 
> 
> 
> 



-- 
Jody Hagins

QOTD:
	"He eats like a bird... five times his own weight each day."
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: hp.cook
URL: <http://lists.auug.org.au/pipermail/cook-users/attachments/20030706/f81f583b/attachment.txt>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: hp.list.2.21
URL: <http://lists.auug.org.au/pipermail/cook-users/attachments/20030706/f81f583b/attachment.asc>