Re: [Moses-support] Output Loglinear score with n-best outputs

2016-11-23 Thread Vito Mandorino
> On Wed, Nov 23, 2016 at 6:05 PM, Vito Mandorino <vito.mandorino@ > linguacustodia.com> wrote: > >> Hi Nat, >> >> this is obtained by adding 'distinct' in the command i.e. >> >> ./moses -f moses.ini -n-best-list filename 10 distinct >> >> Vit

Re: [Moses-support] Output Loglinear score with n-best outputs

2016-11-23 Thread Vito Mandorino
, >> >> When decoding, is there a way to output the loglinear score of each >> hypothesis together with the n-best output? >> >> Regards, >> Nat >> > > > ___ > Moses-support mailing list > Moses-support@mit.

Re: [Moses-support] Does PhraseDictionaryMultiModel require all models to contain all phrases?

2016-11-16 Thread Vito Mandorino
iModel handle the situation where a > translation option is present in one table but not the other(s)? > > Thanks, > Lane > > > ___ > Moses-support mailing list > Moses-support@mit.edu > http://mailman.mit.edu/mailman/listi

Re: [Moses-support] verbosity moses2 in server mode

2016-11-07 Thread Vito Mandorino
ings > > On 7 Nov 2016 9:26 a.m., "Vito Mandorino" <vito.mandorino@ > linguacustodia.com> wrote: > >> Hi, >> >> is there a way to make moses2 more verbose in server mode? I tried >> launching it with --verbose option but that didn't work. >&g

[Moses-support] verbosity moses2 in server mode

2016-11-07 Thread Vito Mandorino
Hi, is there a way to make moses2 more verbose in server mode? I tried launching it with --verbose option but that didn't work. Best regards, Vito -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1

Re: [Moses-support] differences between moses and moses2 output

2016-10-13 Thread Vito Mandorino
y standard Moses and converted into newline by Moses2. Best, Vito 2016-10-07 17:24 GMT+02:00 Hieu Hoang <hieuho...@gmail.com>: > yep, it should give you a big speedup compared to probingpt + minlexr model > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 7 Oct

[Moses-support] merge lader preordering models for Japanese MT

2016-10-12 Thread Vito Mandorino
http://www.phontron.com/lader/ Best regards, Vito -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux* *Tel : +33 1 30 44 04 23 Mobile : +33

Re: [Moses-support] differences between moses and moses2 output

2016-10-07 Thread Vito Mandorino
t; moses.ini file slightly > > [feature] > LexicalReordering … path=reordering-table.msd- > bidirectional-fe.0.5.0-0.gz > to > [feature] > LexicalReordering … property-index=0 > > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 7 October 2016 at 15:02, V

Re: [Moses-support] differences between moses and moses2 output

2016-10-07 Thread Vito Mandorino
he > -rw-rw-r-- 1 hieu hieu 76 Oct 4 10:42 config > -rw-rw-r-- 1 hieu hieu 3146720 Oct 4 10:42 probing_hash.dat > -rw-rw-r-- 1 hieu hieu 333856 Oct 4 10:42 source_vocabids > -rw-rw-r-- 1 hieu hieu 18429920 Oct 4 10:42 TargetColl.dat > -rw-rw-r-- 1 hieu hieu 121401 Oct 4 10:

Re: [Moses-support] differences between moses and moses2 output

2016-10-03 Thread Vito Mandorino
before. If you can make the data file available for > download, it would be much appreciated > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 30 September 2016 at 09:11, Vito Mandorino <vito.mandorino@ > linguacustodia.com> wrote: > >> I tried the following c

Re: [Moses-support] differences between moses and moses2 output

2016-09-30 Thread Vito Mandorino
t; > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 29 September 2016 at 15:19, Vito Mandorino <vito.mandorino@ > linguacustodia.com> wrote: > >> Ok thank you, I'll check that. Do you know how to perform the >> integration? Juxtaposing the 4 phrase-table

Re: [Moses-support] differences between moses and moses2 output

2016-09-29 Thread Vito Mandorino
Hieu Hoang <hieuho...@gmail.com>: > you will get another big speedup fromm integrating the lexro into the pt > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 29 September 2016 at 15:03, Vito Mandorino <vito.mandorino@ > linguacustodia.com> wrote: > >

Re: [Moses-support] differences between moses and moses2 output

2016-09-29 Thread Vito Mandorino
aster now, the client can't feed it fast enough. You should see that >> moses2 command line will max out the CPU, whereas the server won't. I'm >> thinking of extending the server to processing multiple sentences at a time >> to speed it up >> >> Hieu Hoang >&g

Re: [Moses-support] differences between moses and moses2 output

2016-09-29 Thread Vito Mandorino
, for both Moses and Moses2? Best regards, Vito 2016-09-28 18:52 GMT+02:00 Hieu Hoang <hieuho...@gmail.com>: > cool. do you have any indications of speed, especially when using multiple > threads? model sizes and average input sentence length are also relevant. > > > --

Re: [Moses-support] differences between moses and moses2 output

2016-09-28 Thread Vito Mandorino
code for >> pugixml 'cos it's an imported library that we don't control and we may >> reimport in future if there are new releases. The problem seems to be >> Moses2' use of the library so it should be fixed in Moses2 >> >> Hieu Hoang >> http://www.hoang.co.uk

Re: [Moses-support] differences between moses and moses2 output

2016-09-28 Thread Vito Mandorino
oses and Moses2 aren't guaranteed to give exactly the same answer. > However, they should be the same quality overall > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 28 September 2016 at 09:53, Vito Mandorino <vito.mandorino@ > linguacustodia.com> wrote: > >> Hi,

[Moses-support] differences between moses and moses2 output

2016-09-28 Thread Vito Mandorino
regards, Vito -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux* *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89* *Email

Re: [Moses-support] create probing phrase-tables

2016-09-23 Thread Vito Mandorino
tent-Length header value was wrong, fixed at > /usr/local/share/perl/5.18.2/LWP/Protocol/http.pm line 258. > > > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 22 September 2016 at 13:54, Vito Mandorino <vito.mandorino@ > linguacustodia.com> wrote

Re: [Moses-support] create probing phrase-tables

2016-09-22 Thread Vito Mandorino
Thank you. Does moses2 can be run in server mode? I tried calling it with the --server switch but I cannot manage to make it work as the usual mosesserver. Best regards, Vito Mandorino 2016-09-22 12:56 GMT+02:00 Hieu Hoang <hieuho...@gmail.com>: > run > ./bin/Cre

[Moses-support] create probing phrase-tables

2016-09-22 Thread Vito Mandorino
Dear all, do you know how to convert a phrase-table into ProbingPT format ? I didn't find documentation on this. Best regards, Vito Mandorino -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1

[Moses-support] duplicate lines in phrase-table recaser

2016-08-03 Thread Vito Mandorino
109 109 ||| ||| Thanks, Vito Mandorino -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux* *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89

[Moses-support] trace information with hierarchical decoding

2016-07-21 Thread Vito Mandorino
Hello everyone, is there a way to get trace information with hierarchical decoding? I mean something like the -t option for phrase-based decoding. I did try both -t and -T options, as well as high verbosity, but I haven't noticed anything special in the output. Thanks, Vito -- *M**. Vito

Re: [Moses-support] mosesserver and placeholder compatibility with tree-based models

2016-06-30 Thread Vito Mandorino
gt; This is what i run for the server: >>/bin/mosesserver -f moses.ini -xml-input inclusive >> -placeholder-factor 1 -verbose 6 >> >> and this is what i run for the client: >>./test_mosesserver.perl in.txt >> I've attached the file in.txt for you to

Re: [Moses-support] mosesserver and placeholder compatibility with tree-based models

2016-06-28 Thread Vito Mandorino
in normal (not mosesserver) mode no such error occurs. If you have the chance could you please try to have a look at it? Thanks, Vito 2016-06-24 17:16 GMT+02:00 Vito Mandorino <vito.mandor...@linguacustodia.com >: > Thank you, I changed [inputtype] in the moses.ini from 3 --> 0 and now t

Re: [Moses-support] mosesserver and placeholder compatibility with tree-based models

2016-06-24 Thread Vito Mandorino
models. Change [inputtype] in the moses.ini file from 3 -> 0. > if that doesn't work, let me know and i'll debug it > > On 24/06/2016 11:31, Vito Mandorino wrote: > > Hi, > > I am trying to debug by running the decoder with high verbosity. > I have found that the se

Re: [Moses-support] mosesserver and placeholder compatibility with tree-based models

2016-06-24 Thread Vito Mandorino
maybe it's dropped out. > > The placeholder feature just tacks the translation on at the very end, > just before outputting the translation. > > Run it in a debugger to see where it segfault and change that part of the > code > > Hieu Hoang > http://www.hoang.co.uk/hieu > > O

Re: [Moses-support] mosesserver and placeholder compatibility with tree-based models

2016-06-23 Thread Vito Mandorino
regards, Vito 2016-06-03 11:43 GMT+02:00 Vito Mandorino <vito.mandor...@linguacustodia.com >: > Hi Hieu, > > There is also the mosesserver issue so I cannot say that's the only > difficulty from using tree-based models. If you can have a look it would be > great anyway. S

Re: [Moses-support] mosesserver and placeholder compatibility with tree-based models

2016-06-03 Thread Vito Mandorino
issues, such as speed and memory > consumption which may make these models unsuitable for commercial use. > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 2 June 2016 at 11:48, Vito Mandorino <vito.mandor...@linguacustodia.com > > wrote: > >> Dear all, >>

[Moses-support] mosesserver and placeholder compatibility with tree-based models

2016-06-02 Thread Vito Mandorino
oses_chart -f moses.ini -xml-input inclusive which got me a Segmentation Fault. Is there any additional preprocessing step needed to make them work together? Thank you, Vito -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final

Re: [Moses-support] english-japanese translation

2016-04-07 Thread Vito Mandorino
Mandorino 2016-03-29 13:59 GMT+02:00 Vito Mandorino <vito.mandor...@linguacustodia.com >: > Thank you all for your comments and ressources. I will go through them and > let you know if I stumble upon something interesting during the process. > > Vito Mandorino > > 2016-03-28 9:47

Re: [Moses-support] english-japanese translation

2016-03-29 Thread Vito Mandorino
Thank you all for your comments and ressources. I will go through them and let you know if I stumble upon something interesting during the process. Vito Mandorino 2016-03-28 9:47 GMT+02:00 Graham Neubig <neu...@is.naist.jp>: > Hello Vishal, > > Yes, that's what pre-ordering mean

[Moses-support] english-japanese translation

2016-03-25 Thread Vito Mandorino
it is a good idea to keep different alphabets (Kanji, Hiragana, Katakana, ...) in the corpus, or should one try to convert Kanji into one of the other alphabets? Best regards, Vito Mandorino -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final

Re: [Moses-support] monotone-at-ponctuation questions

2016-02-16 Thread Vito Mandorino
nput sentence. > The code is in moses/ReorderingConstraint.cpp > > You may also use zones: > > this a ( small ) test . > > This allows movement of the whole parenthetical expression, with local > walls within to ensure proper placement of the parentheses. > > -phi >

Re: [Moses-support] unexpected reordering with xml-input exclusive

2016-01-27 Thread Vito Mandorino
t; > Best regards, > > Miguel > > On Tue, Jan 26, 2016 at 3:38 PM, Vito Mandorino < > vito.mandor...@linguacustodia.com> wrote: > >> Dear all, >> >> running the decoder with the following command and the '-xml-input >> exclusive' opti

[Moses-support] unexpected reordering with xml-input exclusive

2016-01-26 Thread Vito Mandorino
oor The translation has been reordered with respect to the content of the xml markup. Is this kind of reordering allowed by the '-xml-input exclusive' option? This seems to happen especially for fairly long sentences. Best regards, Vito Mandorino -- *M**. Vito MANDORINO -- Chief Scientist* [im

Re: [Moses-support] different versions of moses yielding different translations

2015-11-26 Thread Vito Mandorino
Haddow <bhad...@inf.ed.ac.uk>: > Hi Vito > > The 0.2 difference is after retuning? That's normal then. > > But a difference of 5 bleu without retuning suggests a bug. Did you say > that this only happens with PhraseDictionaryMultiModel? > > cheers - Barry > > >

Re: [Moses-support] different versions of moses yielding different translations

2015-11-26 Thread Vito Mandorino
14 bleu should be quite visible in > the output. What do the outputs look like? > > cheers - Barry > > > On 26/11/15 09:58, Vito Mandorino wrote: > > Hi Barry, > > actually with OnDisk table there is virtually no difference (0.2 average > difference no matter if re-

Re: [Moses-support] different versions of moses yielding different translations

2015-11-25 Thread Vito Mandorino
1m10.137s > sys 1m17.194s sys 1m22.912s sys 1m25.948s sys 1m26.247s > However, the hypotheses are now added to the stack in a different order so > there will be slight differences in results > > > On 24/11/2015 13:53, Vito Mandorino wrote: > > Hi, > > in some

[Moses-support] different versions of moses yielding different translations

2015-11-24 Thread Vito Mandorino
is going on? The only possibility which come to mind is maybe a different handling of the PhraseDictionaryMultiModel feature. The moses.ini is in attachment. Best regards, Vito -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo

Re: [Moses-support] use placeholder with mosesserver

2015-11-17 Thread Vito Mandorino
d, (or do it the same >> way). >> >> It would be fantastic if a few people could design and contribute test >> cases so that we can do some regression testing for the server. Ideally a >> test case should provide: >> >> - tiny models to work with (or we may b

Re: [Moses-support] use placeholder with mosesserver

2015-11-17 Thread Vito Mandorino
/mosesdecoder/bin/mosesserver -f moses.ini --server-port 8080 /mosesdecoder/bin/moses --server -f moses.ini --server-port 8080 give a Segmentation Fault error. More details are in the attached log.txt file. What could have possibly gone wrong ? Vito 2015-11-17 17:53 GMT+01:00 Vito Mandorino <vito.man

Re: [Moses-support] use placeholder with mosesserver

2015-11-10 Thread Vito Mandorino
ddition, our team is currently discussing whether it makes sense to make > available our patches to the mosesserver code either on the version we are > using, or on a more recent version, available end of this week. > > Best, > > Gregor > > > > > From: <moses-su

[Moses-support] use placeholder with mosesserver

2015-11-06 Thread Vito Mandorino
Dear all, I have been unsuccessful so far in using the placeholder approach with mosesserver. The translated segments contain the placeholder token @num@ instead of numbers. Do you know how to get the numbers in the output? Many thanks, Vito Mandorino -- *M**. Vito MANDORINO -- Chief

Re: [Moses-support] use placeholder with mosesserver

2015-11-06 Thread Vito Mandorino
translated with mosesserver called with the option -xml-input inclusive : note @num@ : the information specific to subsidiaries Thanks Vito 2015-11-06 16:22 GMT+01:00 Vito Mandorino <vito.mandor...@linguacustodia.com >: > Dear all, > > I have been unsuccessful so far in using

Re: [Moses-support] Faster decoding with multiple moses instances

2015-10-08 Thread Vito Mandorino
N'. >>>> >>>> Below is a benchmark on WMT fr-en data (2M training sentences, 400M >>>> words mono, suffix array PT, compact reordering, 5-gram KenLM) testing >>>> default stack decoding vs cube pruning without and with the parallelization >>&g

Re: [Moses-support] placeholder error with compact phrase-table

2015-06-08 Thread Vito Mandorino
, and there were no problems with plain or onDisk phrase-tables. Thank you and best regards, Vito Mandorino 2015-05-29 1:45 GMT+02:00 Marcin Junczys-Dowmunt junc...@amu.edu.pl: Hi, Oops, missed that post, should set-up some filter based on compact. Looks like another alignment-based error in my pt. I

[Moses-support] placeholder error with compact phrase-table

2015-05-27 Thread Vito Mandorino
tables? Thank you and best regards, Vito Mandorino -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux* *Tel : +33 1 30 44 04 23 Mobile

Re: [Moses-support] keep some features fixed when tuning

2015-05-23 Thread Vito Mandorino
to MERT). This may be more suitable for some cases. Code contributions for a better way of having fixed weights (that also works for PRO and MIRA) are welcome. best wishes, Rico On 22.05.2015 17:07, Vito Mandorino wrote: Thank you all. Can you explain further what does it mean that MERT

Re: [Moses-support] keep some features fixed when tuning

2015-05-22 Thread Vito Mandorino
___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1, Place

[Moses-support] keep some features fixed when tuning

2015-05-20 Thread Vito Mandorino
-0.01 0.25 0.19' to the mert-moses.pl command. Best regards, Vito Mandorino -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux* *Tel : +33 1

Re: [Moses-support] missing .gz files at the end of mgiza

2015-02-24 Thread Vito Mandorino
: WARNING: The following sentence pair has source/target sentence length ration more than or ERROR: Forbidden zero sentence length 0 or a line beginning with ERROR: The fact that your corpus has placeholders makes me suspect you probably have a bad ratio. On 02/20/2015 06:18 PM, Vito Mandorino

[Moses-support] missing .gz files at the end of mgiza

2015-02-20 Thread Vito Mandorino
, whereas the French-English training stops at fr-en.A3.final.partC. Thank you, Vito Mandorino -- [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux* *Tel : +33 1 30 44 04 23 Mobile

Re: [Moses-support] placeholders for numbers - extract step

2014-11-19 Thread Vito Mandorino
the number if I use the option '-placeholder-factor 0'. The model that I am using is a phrase-based, non-factored model. Vito 2014-11-19 10:32 GMT+01:00 Hieu Hoang hieu.ho...@ed.ac.uk: hi vito On 18 November 2014 11:30, Vito Mandorino vito.mandor...@linguacustodia.com wrote: Hello