[
https://issues.apache.org/jira/browse/JOSHUA-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lewis John McGibbney updated JOSHUA-169:
----------------------------------------
Fix Version/s: (was: 6.0)
6.1
> LanguageModelFF should compute partial n-grams
> ----------------------------------------------
>
> Key: JOSHUA-169
> URL: https://issues.apache.org/jira/browse/JOSHUA-169
> Project: Joshua
> Issue Type: Bug
> Reporter: Matt Post
> Fix For: 6.1
>
>
> Incomplete n-grams have no estimate, which creates a problem when comparing
> small phrases (early in decoding) and for short sentences. To fix this, the
> LanguageModelFF should compute partial n-gram scores, caching the result and
> the n-gram length in the DP state so that it can be subtracted off later.
> Another advantage of this is that it would likely allow a large
> simplification of the FeatureFunction interface, since we would no longer
> need a computeFinal distinction
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
