[Moses-support] Help

2012-08-02 Thread Mohadeseh Sheikhoveisi
Hi, I'm running following command: ./train-model.perl -scripts-root-dir /opt/tools/scripts-20120707-0326 -root-dir /home/msho/Parallel-Corpus/New -corpus /home/msho/Parallel-Corpus/clean/Clean-Corpus -f en -e fa -alignment grow-diag-final-and -reordering msd-bidirectional-fe -lm

Re: [Moses-support] Ems: interpolating LM using IrstLM

2012-08-02 Thread Daniel Schaut
Hi Mauro, IRSTLM provides a special tool for that. Here you can find more information about how to interpolate LMs using IRSTLM http://sourceforge.net/apps/mediawiki/irstlm/index.php?title=LM_interpolatio n Daniel Von: moses-support-boun...@mit.edu

Re: [Moses-support] Help

2012-08-02 Thread Barry Haddow
Hi Mohadeseh I think the problem is that you added this: -giza-option m1=5,m2=0,m3=0,m4=0,mh=0,t1=5,nodumps=0 You are telling GIZA not to run the higher IBM models, yet train-model.perl is looking for their output. Try removing the giza-option and it should work, cheers - Barry On 02/08/12

Re: [Moses-support] How to debug the function of GlobalLexicalModel(.h/.cpp) in the Moses

2012-08-02 Thread MT NLP
HI,Koehn: my questions follow: 1.I want to figure out what is GlobalLexicalModel in the Moses? 2.when reading source code of the folder GlobalLexicalModel.cpp/.h, I want to intuitionistic see how the GlobalLexicalModel play a role and print some information relate with GlobalLexicalModel during

[Moses-support] adding new model to MOses

2012-08-02 Thread saeed farzi
Hi all, I am going to add new reordering model to MOSES. Could anybody tell me how to add new model to MOSES. Tnx in advance, -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of Electrical and Computer Eng., Tehran University Tel:

Re: [Moses-support] How to debug the function of GlobalLexicalModel(.h/.cpp) in the Moses

2012-08-02 Thread Barry Haddow
Hi Chen You should look at this paper to find out what the GlobalLexicalModel is http://aclweb.org/anthology-new/D/D09/D09-1022.pdf cheers - Barry On 02/08/12 09:32, MT NLP wrote: HI,Koehn: my questions follow: 1.I want to figure out what is GlobalLexicalModel in the Moses? 2.when reading

Re: [Moses-support] Ems: interpolating LM using IrstLM

2012-08-02 Thread Pratyush Banerjee
Hi Mauro, Alongside the documentation pointed out by Daniel (which is the official IRSTLM documentation), you would need a few more things in order to interpolate LMs using IRSTLM... The interpolate-lm script would create a config file (lets say interp.wt.final) of the following format

Re: [Moses-support] adding new model to MOses

2012-08-02 Thread Marwen AZOUZI
On 08/02/2012 11:23 AM, saeed farzi wrote: Hi all, I am going to add new reordering model to MOSES. Could anybody tell me how to add new model to MOSES. Tnx in advance, Hi Saeed, Imagine you have this configuration in your moses.ini file: # distortion (reordering) files [distortion-file]

[Moses-support] Filtering for tree-based models

2012-08-02 Thread rasul
Hi all, I was wondering which script is used for filtering tree-based rule tables, including hierarchical, tree-to-string, string-to-tree, and tree-to-tree. There are two filtering scripts in training scripts directory. Thanks in advance. Regards, Rasul.

Re: [Moses-support] adding new model to MOses

2012-08-02 Thread saeed farzi
Thank you Marwen, I wanna add some models no just reordering model to MOses. I am looking for some documents about howto add extra models to Moses. I wonder if you could help me. tnx On 8/2/12, Marwen AZOUZI marwen.azo...@gmail.com wrote: On 08/02/2012 11:23 AM, saeed farzi wrote: Hi all,

Re: [Moses-support] adding new model to MOses

2012-08-02 Thread Barry Haddow
Hi Saeed You add extra models by creating new feature functions. See here for a guide http://www.statmt.org/moses/?n=Moses.FeatureFunctions cheers - Barry On 02/08/12 12:45, saeed farzi wrote: Thank you Marwen, I wanna add some models no just reordering model to MOses. I am looking for some

[Moses-support] Moses server installation problem

2012-08-02 Thread DUYGU ARALIOGLU
Hi, I have installed moses successfully, I have also install xmlrpc-c via --sudo apt-get install libxmlrpc-core-c3-- then I have built the moses via --./bjam --with-xmlrpc-c=[/path/to/xmlrpc-c-config]--. While doing these I have followed the instructions in

Re: [Moses-support] Moses server installation problem

2012-08-02 Thread Barry Haddow
Hi Duygu The executables should land in the bin directory by default, cheers - Barry On 02/08/12 13:33, DUYGU ARALIOGLU wrote: Hi, I have installed moses successfully, I have also install xmlrpc-c via --sudo apt-get install libxmlrpc-core-c3-- then I have built the moses via --./bjam

Re: [Moses-support] Moses server installation problem

2012-08-02 Thread Kenneth Heafield
Hi, If you installed xmlrpc-c at the system level, then no --with-xmlrpc-c argument should be required. Also, pay attention to this message from --help: --with-xmlrpc-c=/path/to/xmlrpc-c for libxmlrpc-c (used by server) Note that, like language models, this is the --prefix where the

Re: [Moses-support] Ems: interpolating LM using IrstLM

2012-08-02 Thread Mauro Zanotti
Thank you Pratyush and thank you all, I installed new version of Irstlm and Moses, but when I try to interpolate the LMs I get the following error: Reading /opt/tools/moses/scripts/ems/example/data-iw/lm-interpol/lmlist.init... Wrong input format. For my lmlist.init i took your example...

Re: [Moses-support] Ems: interpolating LM using IrstLM

2012-08-02 Thread Pratyush Banerjee
Hi Mauro, When you try to interpolate the LMs using the interpolate-LM script in IRSTLM, the initial file should not have the 'LMINTERPOLATION' flag... Only the final version should have it... So initially your init file should look like: 2 0.5

Re: [Moses-support] Ems: interpolating LM using IrstLM

2012-08-02 Thread Nicola Bertoldi
Dear Mauro, could you please send me the command line you use? Probably, there is a mismatch in the versions. I would check immediately. Which version of IRSTLM and MOSES did you actually installed? Meanwhile could you try to edit the configuration file and remove the keyword LMINTERPOLATION

Re: [Moses-support] Ems: interpolating LM using IrstLM

2012-08-02 Thread Mauro Zanotti
Thank you Pratyush and Nicola, I removed the keyword LMINTERPOLATION and all seems to work fine. Thank you Mauro On Thu, Aug 2, 2012 at 4:24 PM, Nicola Bertoldi berto...@fbk.eu wrote: Dear Mauro, could you please send me the command line you use? Probably, there is a mismatch in the

[Moses-support] No moses executable

2012-08-02 Thread Patrick Bessler
Hi there, I am working with an Ubuntu 12.04 32bit machine. I have installed GIZA++, IRSTLM and SRILM. Now, I cloned the mosesdecoder from github. That went very well. I executed the bjam script and pointed to giza, irst and sri. bjam finished but I didn't have any dist or bin folder, there was

Re: [Moses-support] No moses executable

2012-08-02 Thread Daniel Schaut
Hi Patrick, I had the same problem about six months before: http://www.mail-archive.com/moses-support@mit.edu/msg05119.html Unfortunately I can't remember how I fixed it, but the thread points to the problem. Could you please provide your bjam command? Daniel -Ursprüngliche Nachricht-

Re: [Moses-support] No moses executable

2012-08-02 Thread Patrick Bessler
Hi Daniel, sure, here is the call (it is very close to the baseline tutorial) ./bjam --with-giza=/project/tools/bin --with-irstlm=/project/tools/irstlm --with-srilm=/project/tools/srilm I don't use the j -X option because I install Moses on a Virtual Machine with 32bit. Patrick Am 02.08.2012

Re: [Moses-support] No moses executable

2012-08-02 Thread Pratyush Banerjee
HI Patrick, This may be a wild guess but are you sure that your system has the latest boost libraries ? I had faced a sort of similar issue some time back and that was because of the lack of boost libs in the system... Thanks and Regards, Pratyush On Thu, Aug 2, 2012 at 5:55 PM, Patrick

Re: [Moses-support] Fwd: Re: No moses executable

2012-08-02 Thread Patrick Bessler
Hi, where can I see the git revision? I cloned it today about 2pm. Am 02.08.2012 20:47, schrieb Kenneth Heafield: Hi Hieu, It looks like Hieu tried to fix this in https://github.com/moses-smt/mosesdecoder/commit/80d8592ef8abd66d617ebd8858dd9569e70d1996 . What git revision are you

Re: [Moses-support] Fwd: Re: No moses executable

2012-08-02 Thread Patrick Bessler
Here is the revision: 276b76798423d8ef331efa8d7eca1f3a638e97f2 Patrick Am 02.08.2012 20:56, schrieb Kenneth Heafield: git rev-parse --verify HEAD Anyway, if you git pull and it still doesn't compile, this is due to inconsistencies in the Boost filesystem API. Sorry Hieu, that falls in

Re: [Moses-support] Fwd: Re: No moses executable

2012-08-02 Thread Kenneth Heafield
Yep, Hieu checked in two fixes since then. A git pull followed by recompile will probably fix this for you. On 08/02/2012 03:02 PM, Patrick Bessler wrote: Here is the revision: 276b76798423d8ef331efa8d7eca1f3a638e97f2 Patrick Am 02.08.2012 20:56, schrieb Kenneth Heafield: git rev-parse

Re: [Moses-support] Fwd: Re: No moses executable

2012-08-02 Thread Hieu Hoang
Ah sorry. I thought I'll save some time by using boost, but there seems to be differences between different versions. Hopefully, it'll work now Hieu Sent from my flying horse On 2 Aug 2012, at 08:43 PM, Patrick Bessler wil...@googlemail.com wrote: Hi there, I got a new clone and recompiled

Re: [Moses-support] Fwd: Re: No moses executable

2012-08-02 Thread Patrick Bessler
Yes, I tested with the sample-models and it works. Thank you. Am 02.08.2012 21:53, schrieb Hieu Hoang: Ah sorry. I thought I'll save some time by using boost, but there seems to be differences between different versions. Hopefully, it'll work now Hieu Sent from my flying horse On 2 Aug

Re: [Moses-support] help with filtering the noise enties in phrase-table.

2012-08-02 Thread Tom Hoar
All entries in a phrase table are meaningless. There are merely a mappings with probabilities (et al) between groupings of tokens in your your source target data. I suggest better corpus preparation and management is a better way to manage the content in the tables rather than directly editing

Re: [Moses-support] help with filtering the noise enties in phrase-table.

2012-08-02 Thread Jun.Tan
I think I got your meaning. The phrase table just creates a relationship between source and target. It doesn’t have an impact on the translation quality. Actually, the corpus data determines the translation quality entirely. Due to all of corpus data may be from various channels, it’s critical

Re: [Moses-support] Moses-support Digest, Vol 70, Issue 9

2012-08-02 Thread MT NLP
/mailman/private/moses-support/attachments/20120802/7342ae43/attachment-0001.htm -- Message: 5 Date: Thu, 02 Aug 2012 20:32:39 +0200 From: Patrick Bessler wil...@googlemail.com Subject: Re: [Moses-support] No moses executable To: Kenneth Heafield mo...@kheafield.com

[Moses-support] Best IDE for manipulate

2012-08-02 Thread saeed farzi
Hi all, I am working on MOses source code to add new features. So I am looking for best IDE(Interface Development Environment )( Linux-version) that i can implement, compile and run my source codes easily. tnx -- S.Farzi, Ph.D. Student Natural Language Processing Lab, School of

Re: [Moses-support] moses installation problem

2012-08-02 Thread ygraham
Hi Kenneth, Both the following commands are in the list of processes for top: util/bin/gcc-4.3/release/debug-symbols-on/link-static/probing_hash_table_test /bin/sh -c ? LD_LIBRARY_PATH=/usr/bin:/usr/lib:/usr/lib32:usr/lib64:$LD_LIBRARY_PATH?export LD_LIBRARY_PATH?? Not sure what to try