I think it's
-glue-grammar-file path/name
eg.
http://www.statmt.org/moses/RELEASE-3.0/models/en-cs/steps/2/TRAINING_extract-phrases.2
On 18/06/2015 15:35, Alefya Fida Ali wrote:
i used this command for training. a rule table is generated in the
training folder but no glue grammer. M i missing something here?
nohup nice
/share/apps/packages/MosesSMT/mosesdecoder-master/scripts/training/train-model.perl
-root-dir train -corpus $HOME/USMT/data/training/train.clean -f ur -e
en -alignment grow-diag-final-and -hierarchical –glue-grammar -lm
0:5:$HOME/USMT/HSMT/lm-ur-en/train-ur-en.lm.en.arpa.gz:8
-external-bin-dir $HOME/USMT/PBSMT/tools >& training.out &
------------------------------------------------------------------------
From: [email protected]
To: [email protected]
Subject: RE: Moses-support post from [email protected] requires
approval
Date: Thu, 18 Jun 2015 16:02:37 +0500
I had already subscribed there before mailing, but haven't received
any confirmation yet. I was in bit hurry so I posted before
confirmation. sorry for inconvenience.
i had done some experimenting with command. but still it gives me the
same error about run1.best100.out empty. attached is the mosses file
generated. and also my input file isn't empty. i have also attached my
input file
------------------------------------------------------------------------
Date: Thu, 18 Jun 2015 13:59:51 +0400
Subject: Fwd: Moses-support post from [email protected] requires
approval
From: [email protected]
To: [email protected]
Please subscribe to the mailing list before posting to it. You can
subscribe here:
http://mailman.mit.edu/mailman/listinfo/moses-support
Can you please send the moses.ini file so we can have a look at it.
Also, is your input file empty?
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu
---------- Forwarded message ----------
From: <[email protected] <mailto:[email protected]>>
Date: 17 June 2015 at 09:53
Subject: Moses-support post from [email protected]
<mailto:[email protected]> requires approval
To: [email protected] <mailto:[email protected]>
As list administrator, your authorization is requested for the
following mailing list posting:
List: [email protected] <mailto:[email protected]>
From: [email protected] <mailto:[email protected]>
Subject: tuning failed to complete for hierarchical SMT
Reason: Post by non-member to a members-only list
At your convenience, visit:
http://mailman.mit.edu/mailman/admindb/moses-support
to approve or deny the request.
---------- Forwarded message ----------
From: Alefya Fida Ali <[email protected]
<mailto:[email protected]>>
To: "[email protected] <mailto:[email protected]>"
<[email protected] <mailto:[email protected]>>
Cc:
Date: Wed, 17 Jun 2015 10:53:45 +0500
Subject: tuning failed to complete for hierarchical SMT
I m trying to built and urdu-english Hierarchical system. but tuning
fails at "Line empty in nbestlist 'run1.best100.out' at
/share/apps/packages/MosesSMT/mosesdecoder-master/scripts/training/mert-moses.pl
<http://mert-moses.pl> line 1452." it gives me empty run1.out and
run1.best100.out files.
i have used the following script for tuning
nohup nice
/share/apps/packages/MosesSMT/mosesdecoder-master/scripts/training/mert-moses.pl
<http://mert-moses.pl> $HOME/USMT/data/tuning/tune.true.ur
$HOME/USMT/data/tuning/tune.true.en
/share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_charttrain/model.filtered/dev/moses.ini--nbest
100 --working-dir ~/USMT/HSMT/working-ur-en/tuning --decoder-flags
"-threads 8 -v 0 " --rootdir
/share/apps/packages/MosesSMT/mosesdecoder-master/scripts/--inputtype
3 -mertdir
/share/apps/packages/MosesSMT/mosesdecoder-master/bin/-threads 10
--no-filter-phrase-table >& mert.out&
this is what mert.out says :
nohup: ignoring input
Using SCRIPTS_ROOTDIR:
/share/apps/packages/MosesSMT/mosesdecoder-master/scripts/
Asking moses for feature names and values from
/export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
Executing:
/share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
-threads 8 -v 0 -config
/export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
-inputtype 3 -show-weights
exec:
/share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
-threads 8 -v 0 -config
/export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
-inputtype 3 -show-weights
Executing:
/share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
-threads 8 -v 0 -config
/export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
-inputtype 3 -show-weights > ./features.list 2> /dev/null
MERT starting values and ranges for random generation:
LM0 = 0.500 ( 0.00 .. 1.00)
WordPenalty0 = -1.000 ( 0.00 .. 1.00)
PhrasePenalty0 = 0.200 ( 0.00 .. 1.00)
TranslationModel0 = 0.200 ( 0.00 .. 1.00)
TranslationModel0 = 0.200 ( 0.00 .. 1.00)
TranslationModel0 = 0.200 ( 0.00 .. 1.00)
TranslationModel0 = 0.200 ( 0.00 .. 1.00)
featlist: LM0=0.500000
featlist: WordPenalty0=-1.000000
featlist: PhrasePenalty0=0.200000
featlist: TranslationModel0=0.200000
featlist: TranslationModel0=0.200000
featlist: TranslationModel0=0.200000
featlist: TranslationModel0=0.200000
run 1 start at Wed Jun 17 05:57:56 PKT 2015
Parsing --decoder-flags: |-threads 8 -v 0 |
Saving new config to: ./run1.moses.ini
Saved: ./run1.moses.ini
Normalizing lambdas: 0.500000 -1.000000 0.200000 0.200000 0.200000
0.200000 0.200000
DECODER_CFG = -weight-overwrite 'PhrasePenalty0= 0.080000
WordPenalty0= -0.400000 TranslationModel0= 0.080000 0.080000 0.080000
0.080000 LM0= 0.200000'
Executing:
/share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
-threads 8 -v 0 -config
/export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
-inputtype 3 -weight-overwrite 'PhrasePenalty0= 0.080000 WordPenalty0=
-0.400000 TranslationModel0= 0.080000 0.080000 0.080000 0.080000 LM0=
0.200000' -n-best-list run1.best100.out 100 distinct -input-file
/export/home3/fjwu/sadaf.rauf/USMT/data/tuning/tune.true.ur > run1.out
Executing:
/share/apps/packages/MosesSMT/mosesdecoder-master/bin/moses_chart
-threads 8 -v 0 -config
/export/home3/fjwu/sadaf.rauf/USMT/HSMT/working-ur-en/train/model.filtered/dev/moses.ini
-inputtype 3 -weight-overwrite 'PhrasePenalty0= 0.080000 WordPenalty0=
-0.400000 TranslationModel0= 0.080000 0.080000 0.080000 0.080000 LM0=
0.200000' -n-best-list run1.best100.out 100 distinct -input-file
/export/home3/fjwu/sadaf.rauf/USMT/data/tuning/tune.true.ur > run1.out
1-10.20.2 0.2 0.2 0.20.5(1) run decoder to produce n-best lists
params = -threads 8 -v 0
decoder_config = -weight-overwrite 'PhrasePenalty0= 0.080000
WordPenalty0= -0.400000 TranslationModel0= 0.080000 0.080000 0.080000
0.080000 LM0= 0.200000'
Line empty in nbestlist 'run1.best100.out' at
/share/apps/packages/MosesSMT/mosesdecoder-master/scripts/training/mert-moses.pl
<http://mert-moses.pl> line 1452.
---------- Forwarded message ----------
From: [email protected] <mailto:[email protected]>
To:
Cc:
Date:
Subject: confirm 45ed6af19dfe664c09e0209730a0b5d1b3c78afc
If you reply to this message, keeping the Subject: header intact,
Mailman will discard the held message. Do this if the message is
spam. If you reply to this message and include an Approved: header
with the list password in it, the message will be approved for posting
to the list. The Approved: header can also appear in the first line
of the body of the reply.
--
Hieu Hoang
Researcher
New York University, Abu Dhabi
http://www.hoang.co.uk/hieu
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
