Ok thank you, I'll check that. Do you know how to perform the integration? Juxtaposing the 4 phrase-table scores and the 6 reordering scores before calling CreateProbingPT2 would be enough?
(I have used the CreateProbingPT2 binary and not CreateProbingPT so far) Vito 2016-09-29 16:07 GMT+02:00 Hieu Hoang <[email protected]>: > you will get another big speedup fromm integrating the lexro into the pt > > Hieu Hoang > http://www.hoang.co.uk/hieu > > On 29 September 2016 at 15:03, Vito Mandorino <vito.mandorino@ > linguacustodia.com> wrote: > >> Yes the model includes a lexicalised reordering model but is not >> integrated into the probingPT. The size of the LM is 1.8G. >> >> 2016-09-29 15:59 GMT+02:00 Hieu Hoang <[email protected]>: >> >>> ps. how big is your LM? >>> >>> Hieu Hoang >>> http://www.hoang.co.uk/hieu >>> >>> On 29 September 2016 at 14:58, Hieu Hoang <[email protected]> wrote: >>> >>>> great, thanks. Do you use the lexicalised reordering model, and is it >>>> integrated into the phrase-table in Moses2? >>>> >>>> There is latency in communicating with the server. As Moses2 is much >>>> faster now, the client can't feed it fast enough. You should see that >>>> moses2 command line will max out the CPU, whereas the server won't. I'm >>>> thinking of extending the server to processing multiple sentences at a time >>>> to speed it up >>>> >>>> Hieu Hoang >>>> http://www.hoang.co.uk/hieu >>>> >>>> On 29 September 2016 at 14:49, Vito Mandorino < >>>> [email protected]> wrote: >>>> >>>>> Yes, here are some data: >>>>> >>>>> Average source sentence length: 29 tokens >>>>> Phrase-table size, probingPT: 11G >>>>> Phrase-table size, compact phrase-table: 2.1G >>>>> >>>>> Translation time Moses2 with 32 threads: 1m36.511s >>>>> Translation time Moses with 32 threads: 6m14.248s >>>>> Translation time Moses2 with 32 threads in server mode: 16m30.137s >>>>> Translation time Moses with 32 threads in server mode: 62m33.208s >>>>> >>>>> Ram consumption during decoding: 4G for Moses2, 5G for Moses >>>>> >>>>> So Moses2 is 4 times faster, and 3 times faster in server mode. >>>>> >>>>> Do you know why in server mode the speed is so much slower with >>>>> respect to batch mode, for both Moses and Moses2? >>>>> >>>>> Best regards, >>>>> Vito >>>>> >>>>> 2016-09-28 18:52 GMT+02:00 Hieu Hoang <[email protected]>: >>>>> >>>>>> cool. do you have any indications of speed, especially when using >>>>>> multiple threads? model sizes and average input sentence length are also >>>>>> relevant. >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> *M**. Vito MANDORINO -- Chief Scientist* >>>>> >>>>> >>>>> [image: Description : Description : lingua_custodia_final full logo] >>>>> >>>>> *The Translation Trustee* >>>>> >>>>> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux* >>>>> >>>>> *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89 >>>>> <%2B33%206%2084%2065%2068%2089>* >>>>> >>>>> *Email :* *[email protected] >>>>> <[email protected]>* >>>>> >>>>> *Website :* >>>>> *www.linguacustodia.finance <http://www.linguacustodia.com/>* >>>>> >>>> >>>> >>> >> >> >> -- >> *M**. Vito MANDORINO -- Chief Scientist* >> >> >> [image: Description : Description : lingua_custodia_final full logo] >> >> *The Translation Trustee* >> >> *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux* >> >> *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89 >> <%2B33%206%2084%2065%2068%2089>* >> >> *Email :* *[email protected] >> <[email protected]>* >> >> *Website :* >> *www.linguacustodia.finance <http://www.linguacustodia.com/>* >> > > -- *M**. Vito MANDORINO -- Chief Scientist* [image: Description : Description : lingua_custodia_final full logo] *The Translation Trustee* *1, Place Charles de Gaulle, **78180 Montigny-le-Bretonneux* *Tel : +33 1 30 44 04 23 Mobile : +33 6 84 65 68 89* *Email :* *[email protected] <[email protected]>* *Website :* *www.linguacustodia.finance <http://www.linguacustodia.com/>*
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
