[Moses-support] factored training data question

2014-03-28 Thread Viktor Pless
Hi everyone, How can I produce factored training data like below? You will have to provide training data in the format word0factor0|word0factor1|word0factor2 word1factor0|word1factor1|word1factor2 ... Could you please tell me the what program produces this format? Neither MXPOST nor treetagger

Re: [Moses-support] tools for factored corpora

2014-03-25 Thread Viktor Pless
...@linguacustodia.com: Hi Viktor, As far I know, you can use the wrapper scripts (treetagger or mxpost) located at /mosesdecoder/scripts/training/wrappers for this purpose. Regards Massinissa 2014-03-20 17:37 GMT+01:00 Viktor Pless viktor.pl...@gmail.com: Hi, what tools can be used to lemmatize/POS

[Moses-support] tools for factored corpora

2014-03-20 Thread Viktor Pless
Hi, what tools can be used to lemmatize/POS-tag/etc. a corpus in moses format (with the pipes)? I need them regarding Spanish, English, Hungarian. Thanks in advance. Viktor ___ Moses-support mailing list Moses-support@mit.edu

Re: [Moses-support] phrase limit at bracket signs?

2014-03-17 Thread Viktor Pless
=Moses.AdvancedFeatures#ntoc9 -phi On Fri, Mar 14, 2014 at 4:23 AM, Viktor Pless viktor.pl...@gmail.com wrote: Hi, is it possible to tell the algorithm which generates phrase pairs from the word aligments by growing them - to stop growing at brackets? It seems that brackets, wherever they turn up, confuse

[Moses-support] phrase limit at bracket signs?

2014-03-14 Thread Viktor Pless
Hi, is it possible to tell the algorithm which generates phrase pairs from the word aligments by growing them - to stop growing at brackets? It seems that brackets, wherever they turn up, confuse translation, perhaps because they are too numerous in the overall text and thus carry no information.

[Moses-support] train-model log file?

2014-03-11 Thread Viktor Pless
Hi, does the train-model.perl script (or more specifically, mgiza) create a log file? thanks, ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] mgiza tools not found

2014-03-05 Thread Viktor Pless
Hello, I'm getting an error from train-model.perl. my command: train-model.perl -root-dir ~/0301 -corpus ~/0301/0102.clean -f es -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm 0:3:/home/ubuntu/0301/0102.blm.en:8 --mgiza --mgiza-cpus 2 --parallel --external-bin-dir

Re: [Moses-support] mgiza tools not found

2014-03-05 Thread Viktor Pless
Please disregard, I solved it. Seems that the manual doesn't mention I need a subdirerctory tools/mgiza. thanks, Viktor 2014-03-05 13:00 GMT+01:00 Viktor Pless viktor.pl...@gmail.com: Hello, I'm getting an error from train-model.perl. my command: train-model.perl -root-dir ~/0301

Re: [Moses-support] mgiza tools not found

2014-03-05 Thread Viktor Pless
get from here: http://www.kyloo.net/software/doku.php/mgiza:overview cheers - Barry On 05/03/14 12:30, Viktor Pless wrote: Please disregard, I solved it. Seems that the manual doesn't mention I need a subdirerctory tools/mgiza. thanks, Viktor 2014-03-05 13:00 GMT+01:00 Viktor Pless

[Moses-support] why compile moses with irstlm?

2014-02-19 Thread Viktor Pless
Hi, what is the significance of the option of installing moses with IRSTLM? I did not give the option --with-irstlm=... but it still seems to be working. with Thanks, V ___ Moses-support mailing list Moses-support@mit.edu

[Moses-support] Fwd: moses decoder build failure

2014-02-14 Thread Viktor Pless
Hi all, I can't compile Moses with bjam as I always get a failed warning, and there is no moses executable in the resulting bin folder (the decoder itself). I can't tell if any other file is missing from bin, seems to be OK to me. command: sudo ./bjam -j8 error msg: ...failed gcc.link