Hi Prashant, Thanks for the response.
The manual no where mentions anything about iARPA as mentioned by you. It says that these 5 steps should provide me a *.arpa.en file, which is binarized using KenLM in the next step. But I fail to get the .arpa file due to the Warning. I am currently using the 5.80.03 version of IRSTLM. I think this is the latest one. --------------- Renu On December 5, 2013 at 4:51 PM Prashant Mathur <[email protected]> wrote: > The command is correct, so it should work. You are using compile-lm to > convert from iARPA to ARPA format. > Try updating irstlm toolkit to latest version. > > -- > Prashant > > On 12/04/2013 04:58 PM, renubalyan wrote: > > > > Hi, > > > > I am building the baseline system based on Moses manual instructions. > > > > I have installed Moses, GIZA++ and IRSTLM as mentioned in the manual. > > The corpus preparation (tokenization, ...cleaning) steps also goes > > well. > > > > However when I move to Language Model Training: I have some problems > > > > I am following these steps: > > > > 1. mkdir ~/lm > > > > 2. cd ~/lm > > > > 3. /home/renu/Desktop/irstlm/bin/add-start-end.sh < > > /home/renu/Desktop/corpus/news-commentary-v8.fr-en.true.en> > > news-commentary-v8.fr-en.sb.en > > > > 4. export IRSTLM=/home/renu/Desktop/irstlm; > > /home/renu/Desktop/irstlm/bin/build-lm.sh -i news-commentary-v8.fr-en.sb.en > > -t ./tmp -p -s improved-kneser-ney -o news-commentary-v8.fr-en.lm.en > > > > 5. /home/renu/Desktop/irstlm/bin/compile-lm --text yes > > news-commentary-v8.fr-en.lm.en.gz news-commentary-v8.fr-en.arpa.en > > > > Steps 1-4 work well but step 5 gives me -------(Warning:Too many > > parameters) > > > > I have searched the web for any possible solution but could not find > > any. > > > > I am not able to move ahead, kindly help. > > > > Thanks > > Renu > > > > > > > > ------------------------------------------------------------------------------------------------------------------------------- > > This e-mail is for the sole use of the intended recipient(s) and may > > contain confidential and privileged information. If you are not the > > intended recipient, please contact the sender by reply e-mail and > > destroy > > all copies and the original message. Any unauthorized review, use, > > disclosure, dissemination, forwarding, printing or copying of this > > email > > is strictly prohibited and appropriate legal action will be taken. > > > > > > ------------------------------------------------------------------------------------------------------------------------------- > > > > > > _______________________________________________ > > Moses-support mailing list > > [email protected] <mailto:[email protected]> > > http://mailman.mit.edu/mailman/listinfo/moses-support > > <http://mailman.mit.edu/mailman/listinfo/moses-support> > > > > > ------------------------------------------------------------------------------------------------------------------------------- This e-mail is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies and the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email is strictly prohibited and appropriate legal action will be taken. -------------------------------------------------------------------------------------------------------------------------------
_______________________________________________ Moses-support mailing list [email protected] http://mailman.mit.edu/mailman/listinfo/moses-support
