Dear Germán Sanchis
Thanks for your help.
I'm finding europarl-v3.en now. I downloaded Monolingual language model
training data and i only see europarl-v3.de file after training-lm.tgz file is
extracted.
Where can I download europarl-v3.en file???
Thanks in advance.
Huy.
> Date: Fri, 9 Nov 2007 09:42:44 +0100> From: [EMAIL PROTECTED]> To: [EMAIL
> PROTECTED]> Subject: Re: [Moses-support] Prepare Data - Filter out long
> sentences> > Hi Huy.> > Moses uses the '|' character as delimitation
> character between > factors. This means that, if your corpus contains a '|'
> character, the > Moses scripts will think it is such a delimiter, and hence
> the error.> > In order to avoid this problem you should replace all
> occurrences of > this character by something else, e.g.:> > sed
> 's/|/_V_BAR_/g' < corpus > newcorpus> > However, remember to perform this
> operation on all the corpus subsets > (i.e. training, development, devtest
> and test) and also on the set you > used to train your language model.> >
> Good luck,> > Germán Sanchis> > Quoting Nguyen Tien Huy <[EMAIL PROTECTED]>:>
> > > Dear Moses-support> >> > I saw message "There is a blank factor in > >
> working-dir/corpus/europarl.tok.en..." after I run > >
> "bin/moses-scripts/scripts-YYYYMMDD-HHMM/training
/clean-corpus-n.perl > > working-dir/corpus/europarl.tok fr en > >
working-dir/corpus/europarl.clean 1 40" command.> >> > What is message mean? Is
europarl.tok.en file error or something?> > Can I run "Lowercase training
data"?> >> > Thanks in advance.> > Huy.> >> >
_________________________________________________________________> > Connect to
the next generation of MSN Messenger > >
http://imagine-msn.com/messenger/launch80/default.aspx?locale=en-us&source=wlmailtagline>
> > > ----------------------------------------------------------------> This
message was sent using IMP, the Internet Messaging Program.> >
_________________________________________________________________
Invite your mail contacts to join your friends list with Windows Live Spaces.
It's easy!
http://spaces.live.com/spacesapi.aspx?wx_action=create&wx_url=/friends.aspx&mkt=en-us
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
