Actually my experience with significance pruning in case of phrase-based
models is usually very positive, also in terms of translation quality,
but maybe I just have messy corpora :)
I will see what I can cook up, if it proves useful I''l contribute.
Thanks Hieu,
Best,
Marcin
W dniu 24.07.2013 14:05, Hieu Hoang pisze:
The tree-to-string model is faster for decoding, compared to hiero
model, and much faster compared to string-to-tree.
therefore, imo, you don't need to prune because pruning always causes
search errors.
if you mean filtering by input sentences to get rid of rules you know
will never apply (ie. not pruning bad rules which may apply), then I
think you can hack filter-pt to do it.
I don't think no-one done it 'cos not a lot of people work on
tree-to-string
On 23 July 2013 23:11, Marcin Junczys-Dowmunt <[email protected]
<mailto:[email protected]>> wrote:
Hi list,
If I am not mistaken, there is currently no functionality to prune
tree-to-string rule tables. Do you think it makes sense to use
filter-pt
for hierarchical rules instead, for instance by replacing category
symbols with the generic [X]. After pruning I would have to
reintroduce
the syntactic categories. I think in the worst case this should result
in under-pruning, keeping more rules than neccessary. Any thoughts why
this might be a bad idea before I start implementing this?
Thanks,
Marcin
_______________________________________________
Moses-support mailing list
[email protected] <mailto:[email protected]>
http://mailman.mit.edu/mailman/listinfo/moses-support
--
Hieu Hoang
Research Associate
University of Edinburgh
http://www.hoang.co.uk/hieu
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
