Yes, that would work, it just needs someone to spend the time going through the source and fixing the logging code. It's a bigger -- and less critical -- job than for the rest of the output, so hasn't been done yet.
Couldn't you queue the stderr logging to solve this issue?
--
Taylor Rose
Machine Translation Intern
Language Intelligence
On Wed, 2011-09-14 at 08:55 +0000, Phil Williams wrote:
> Hi Tom,
>
>
> yes, that's right. In multithreaded moses / moses_chart, the
> translations, n-best, and trace output for sentence n are all queued
> until the output from sentence n-1 has been written. The queueing
> doesn't happen for the logging output that goes to stderr -- it's
> written immediately -- so it will appear out of order and out of sync
> with the rest of the output.
>
>
> Phil
>
> On 14 Sep, 2011,at 01:33 AM, Tom Hoar
> <[email protected]> wrote:
>
>
> > Phil,
> >
> > Re "output to stderr will be messed up"... do you mean that the
> > order and timing of stderr output will be out of synch with the
> > output to stdout? I found this to be the case with multi-threaded
> > moses and therefore stderr output can not be used to monitor
> > progress and/or control workflows.
> >
> > Tom
> >
> >
> >
> > On Tue, 13 Sep 2011 19:27:47 +0000 (GMT), Phil Williams
> > <[email protected]> wrote:
> >
> > > I think GENERAL:cores sets the maximum number of active EMS steps,
> > > it doesn't change the number of threads used for decoding. You
> > > need to set the decoder's -threads N option in
> > > TUNING:decoder-settings and/or EVALUATION:decoder-settings.
> > >
> > >
> > > A caveat is that the output to stderr will be messed up, though
> > > that's true for multi-threaded moses as well.
> > >
> > >
> > > Phil
> > >
> > >
> > > On 13 Sep, 2011,at 08:11 PM, Hieu Hoang wrote:
> > >
> > >
> > > > Is it as simple as setting the
> > > > [GENERAL]
> > > > cores = 8
> > > > in the config file, and making sure the decoding was compiled
> > > > with threads?
> > > >
> > > > _______________________________________________
> > > > Moses-support mailing list
> > > > [email protected]
> > > > http://mailman.mit.edu/mailman/listinfo/moses-support
> > _______________________________________________
> > Moses-support mailing list
> > [email protected]
> > http://mailman.mit.edu/mailman/listinfo/moses-support
> >
> _______________________________________________
> Moses-support mailing list
> [email protected]
> http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
