Re: [Moses-support] placeholders for numbers - extract step

2014-11-19 Thread Hieu Hoang
hi vito On 18 November 2014 11:30, Vito Mandorino vito.mandor...@linguacustodia.com wrote: Hello everyone, I am trying to use placeholders for numbers in phrase-based MT, according to http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc75 The above page says --- During

Re: [Moses-support] placeholders for numbers - extract step

2014-11-19 Thread Vito Mandorino
Thank you Hieu, that worked very well. I am now tackling the decoding part and I have two questions. 1) Sometimes, I get the following error message during decoding: terminate called after throwing an instance of 'util::Exception' what(): moses-cmd/IOWrapper.cpp:213 in std::maplong unsigned

Re: [Moses-support] Placeholders

2013-10-16 Thread Achim Ruopp
: [Moses-support] Placeholders A change from anytag/ will no-doubt disrupt existing pipelines. Communicating the change with the new release will be a great help. On 2013-10-15 01:35, Hieu Hoang wrote: they're good ideas. I'll have a think if I get round to doing it. Would also want

Re: [Moses-support] Placeholders

2013-10-16 Thread Tom Hoar
...@precisiontranslationtools.com *Sent:* Tuesday, October 15, 2013 10:25 PM *To:* moses-support@mit.edu *Subject:* Re: [Moses-support] Placeholders A change from anytag/ will no-doubt disrupt existing pipelines. Communicating the change with the new release will be a great help. On 2013-10-15 01:35, Hieu Hoang wrote

Re: [Moses-support] Placeholders

2013-10-15 Thread Hieu Hoang
they're good ideas. I'll have a think if I get round to doing it. Would also want to minimise the work I have to do, and minimize the disruption to people's existing pipeline. On 15 October 2013 01:33, Tom Hoar tah...@precisiontranslationtools.comwrote: I agree that anytag/ could cause

Re: [Moses-support] Placeholders

2013-10-15 Thread support
A change from anytag/ will no-doubt disrupt existing pipelines. Communicating the change with the new release will be a great help. On 2013-10-15 01:35, Hieu Hoang wrote: they're good ideas. I'll have a think if I get round to doing it. Would also want to minimise the work I have to

Re: [Moses-support] Placeholders

2013-10-14 Thread Hieu Hoang
Hi tom Sent while bumping into things On 13 Oct 2013, at 17:01, Tom Hoar tah...@precisiontranslationtools.com wrote: Thanks Hieu and Achim for the new feature. I think it's great. Some questions: 1) When envoking mert-moses.pl to tune a model prepared with placeholders, and the dev

Re: [Moses-support] Placeholders

2013-10-14 Thread Tom Hoar
I agree that anytag/ could cause problems, especially with the growing list of reserved tag names (ne, wall, zone). I wholeheartedly support a fixed tag, but I'm not sure option is it. What about np/ (already in the manual) or xml-markup/ or xml-input/ or moses/? Here's another idea. The

Re: [Moses-support] Placeholders

2013-10-13 Thread Tom Hoar
Thanks Hieu and Achim for the new feature. I think it's great. Some questions: 1) When envoking mert-moses.pl to tune a model prepared with placeholders, and the dev set includes placeholders, it looks like the new moses command line options (-placeholder-factor 1 -xml-input exclusive)

Re: [Moses-support] Placeholders

2013-10-11 Thread Per Tunedal
Hi, place holders would be useful. What's the implication of it just needs the XML parsing to run? Does this mean that the option could only be used with html-input? Not with plain text? Yours, Per Tunedal On Thu, Oct 10, 2013, at 15:30, Hieu Hoang wrote: On 10 October 2013 13:33, Nicola

Re: [Moses-support] Placeholders

2013-10-11 Thread Hieu Hoang
it doesn't process HTML. Just plain text, and XML markups to indicate the placeholder For example, your original sentence is you owe me $ 100 . After running it through the placeholder script, the sentence become you owe me $ ne translation=@num@ entity=100@num@/ne . The XML processing is

Re: [Moses-support] Placeholders

2013-10-11 Thread Per Tunedal
Hi Hieu, Excellent! Thank you for your explanation. Yours, Per Tunedal On Fri, Oct 11, 2013, at 13:24, Hieu Hoang wrote: it doesn't process HTML. Just plain text, and XML markups to indicate the placeholder For example, your original sentence is you owe me $ 100 . After running it through

Re: [Moses-support] Placeholders

2013-10-10 Thread Nicola Bertoldi
Hi Hieu I read the documentation and you mention that you enable the exclusive mode of xml-input I see few issues: - you mention that you enable the exclusive mode of xml-input; this can conflict with other usage of xml-input which instead require the inclusive mode. do you have any

Re: [Moses-support] Placeholders

2013-10-10 Thread Hieu Hoang
On 10 October 2013 13:33, Nicola Bertoldi berto...@fbk.eu wrote: Hi Hieu I read the documentation and you mention that you enable the exclusive mode of xml-input I see few issues: - you mention that you enable the exclusive mode of xml-input; this can conflict with other usage of

Re: [Moses-support] Placeholders missed

2012-07-31 Thread Henry Hu
Thanks Daniel and Tomas. I solved the issue with a PHP script as following. The solution is like Daniel's, to delete the blank space in the placeholders. The result is that the placeholder is treated as a whole in decoding process. I executed the script just before running decoding. ?php $fp =

Re: [Moses-support] Placeholders missed

2012-07-10 Thread Tomas Hudik
Hi Henry, This answer is coming late probably, but: We have developed small sw for placeholder translation. It is under the same license as Moses. http://code.google.com/p/m4loc/ If you want to try it - download sources (it is perl mostly, so you do not need to compile it). The input should be

Re: [Moses-support] Placeholders missed

2012-07-02 Thread Barry Haddow
Hi Henry Either use Moses xml-input feature http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc5 or choose a place holder that does not appear in your phrase table, cheers - Barry On Monday 02 July 2012 10:40:17 Henry Hu wrote: Hi guys, I'm attempting to translate English to French.

Re: [Moses-support] Placeholders missed

2012-07-02 Thread Tom Hoar
Henry, you might also change your tokenization so your placeholders remain one token. On Mon, 2 Jul 2012 10:50:11 +0100, Barry Haddow bhad...@staffmail.ed.ac.uk wrote: Hi Henry Either use Moses xml-input feature http://www.statmt.org/moses/?n=Moses.AdvancedFeatures#ntoc5 or choose a

Re: [Moses-support] Placeholders missed

2012-07-02 Thread Daniel Schaut
Hi Henry, can also try to exclude the placeholders from the tokenization process so that your example would look like this: buy {70} and enjoy unlimited Trainings sessions This worked pretty well for me. This means however that you might need to train new models. Best, Daniel