So what exactly is the issue? Progress can be monitored with stdout. If stderr is queued, then you won't get sub-sentential progress anyway.
I'd rather stderr tell me what it's doing so if/when there's a segfault, I have a place to start. Kenneth On 09/14/11 13:32, Phil Williams wrote: > Yes, that would work, it just needs someone to spend the time going > through the source and fixing the logging code. It's a bigger -- and > less critical -- job than for the rest of the output, so hasn't been > done yet. > > Phil > > On 14 Sep, 2011,at 01:12 PM, Taylor Rose > <[email protected]> wrote: > >> Couldn't you queue the stderr logging to solve this issue? >> -- >> Taylor Rose >> Machine Translation Intern >> Language Intelligence >> >> >> On Wed, 2011-09-14 at 08:55 +0000, Phil Williams wrote: >> > Hi Tom, >> > >> > >> > yes, that's right. In multithreaded moses / moses_chart, the >> > translations, n-best, and trace output for sentence n are all queued >> > until the output from sentence n-1 has been written. The queueing >> > doesn't happen for the logging output that goes to stderr -- it's >> > written immediately -- so it will appear out of order and out of sync >> > with the rest of the output. >> > >> > >> > Phil >> > >> > On 14 Sep, 2011,at 01:33 AM, Tom Hoar >> > <[email protected] >> <mailto:[email protected]>> wrote: >> > >> > >> > > Phil, >> > > >> > > Re "output to stderr will be messed up"... do you mean that the >> > > order and timing of stderr output will be out of synch with the >> > > output to stdout? I found this to be the case with multi-threaded >> > > moses and therefore stderr output can not be used to monitor >> > > progress and/or control workflows. >> > > >> > > Tom >> > > >> > > >> > > >> > > On Tue, 13 Sep 2011 19:27:47 +0000 (GMT), Phil Williams >> > > <[email protected] <mailto:philip.williams@maccom>> wrote: >> > > >> > > > I think GENERAL:cores sets the maximum number of active EMS steps, >> > > > it doesn't change the number of threads used for decoding. You >> > > > need to set the decoder's -threads N option in >> > > > TUNING:decoder-settings and/or EVALUATION:decoder-settings. >> > > > >> > > > >> > > > A caveat is that the output to stderr will be messed up, though >> > > > that's true for multi-threaded moses as well. >> > > > >> > > > >> > > > Phil >> > > > >> > > > >> > > > On 13 Sep, 2011,at 08:11 PM, Hieu Hoang wrote: >> > > > >> > > > >> > > > > Is it as simple as setting the >> > > > > [GENERAL] >> > > > > cores = 8 >> > > > > in the config file, and making sure the decoding was compiled >> > > > > with threads? >> > > > > >> > > > > _______________________________________________ >> > > > > Moses-support mailing list >> > > > > [email protected] <mailto:[email protected]> >> > > > > http://mailman.mit.edu/mailman/listinfo/moses-support >> > > _______________________________________________ >> > > Moses-support mailing list >> > > [email protected] <mailto:Moses-support@mitedu> >> > > http://mailman.mit.edu/mailman/listinfo/moses-support >> > > >> > _______________________________________________ >> > Moses-support mailing list >> > [email protected] <mailto:[email protected]> >> > http://mailman.mit.edu/mailman/listinfo/moses-support >> >> _______________________________________________ >> Moses-support mailing list >> [email protected] <mailto:[email protected]> >> http://mailman.mit.edu/mailman/listinfo/moses-support >> <http://mailmanmit.edu/mailman/listinfo/moses-support> > > > _______________________________________________ > Moses-support mailing list > [email protected] > http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
