m_transScore is just the 5 scores from the translation model. m_fullScore is all the scores that can be calculate for a particular phrase pair, eg. translation + LM + word penalty, ...

On 02/06/2012 13:09, kehai chen wrote:
Could you explain the difference bettween m_transScore and m_fullScore in the folder moses/src/TargetPhrase.h for me? Thanks.

2012/6/1 <[email protected] <mailto:[email protected]>>

    Send Moses-support mailing list submissions to
    [email protected] <mailto:[email protected]>

    To subscribe or unsubscribe via the World Wide Web, visit
    http://mailman.mit.edu/mailman/listinfo/moses-support
    or, via email, send a message with subject or body 'help' to
    [email protected] <mailto:[email protected]>

    You can reach the person managing the list at
    [email protected] <mailto:[email protected]>

    When replying, please edit your Subject line so it is more specific
    than "Re: Contents of Moses-support digest..."


    Today's Topics:

      1. Re: Sparse moses (Barry Haddow)
      2. changes to the training scripts (Hieu Hoang)
      3. Re: changes to the training scripts (Lane Schwartz)
4. Machine Translation Marathon 2012 (MTM2012): First Call for
         Participation (Barry Haddow)
      5. Second Call for Papers for the Open Source        Convention
    held at
         the MT Marathon 2012 (MTM2012) (Barry Haddow)
      6. Re: Sparse moses (Tetsuo Kiso)


    ----------------------------------------------------------------------

    Message: 1
    Date: Thu, 31 May 2012 20:19:24 +0100
    From: Barry Haddow <[email protected]
    <mailto:[email protected]>>
    Subject: Re: [Moses-support] Sparse moses
    To: Tetsuo Kiso <[email protected] <mailto:[email protected]>>
    Cc: [email protected] <mailto:[email protected]>
    Message-ID: <[email protected]
    <mailto:[email protected]>>
    Content-Type: Text/Plain;  charset="iso-8859-1"

    Hi Tetsuo

    Sorry about the delay!

    Yes, I'd like to merge the miramerge back into to trunk. At the
    moment though,
    I have concerns about the performance of the sparse features (time
    and space),
    so I'd like to address these before the merge. I'm going to have a
    look at it
    over the summer, and probably solicit help at the mt marathon,

    cheers - Barry

    On Saturday 26 May 2012 15:03:48 Tetsuo Kiso wrote:
    > Hi Barry,
    >
    > > I've updated the sparse features branch of Moses (miramerge),
    merging all
    > > the recent changes from trunk. It passes all the unit tests,
    and all the
    > > regression tests (apart from small number of rounding errors)
    but I
    > > have't run any other tests on this branch.
    >
    > I'm just wondering is there any plan to merge the branch "miramerge"
    > into "master" in the future?
    >
    >
    > Tetsuo
    >


    ------------------------------

    Message: 2
    Date: Thu, 31 May 2012 20:42:56 +0100
    From: Hieu Hoang <[email protected]
    <mailto:[email protected]>>
    Subject: [Moses-support] changes to the training scripts
    To: moses-support <[email protected]
    <mailto:[email protected]>>
    Message-ID: <[email protected]
    <mailto:[email protected]>>
    Content-Type: text/plain; charset=ISO-8859-1; format=flowed

    Hi all

    if you're checking out the latest github code, there are some changes
    you should be aware of:
       1. There is a new argument to train-model.perl
               -external-bin-dir [path]
            This points to the directory where Giza++/mgiza lives. Setting
    this is MANDATORY if you're using train-model.perl to do the word
    alignment. It used to be hardcoded in the perl code itself.
       2. All the training programs have been moved into the directory
              [MOSES-ROOT]/bin
           They should be run from there, not from wherever the source
    code is.
       3. To roll out, simply copy the 2 directories
              [MOSES-ROOT]/bin
              [MOSES-ROOT]/scripts
           to wherever you want, eg.
              /home/hieu/moses/bin
              /home/hieu/moses/scripts
       4. If you don't want to move it anywhere, you can run it from where
    you downloaded.
       5. The EMS and example files have been updated.

    Hope this is ok for everyone. It may break some people's setup. If
    possible, please change your setup. It's gonna help us all in the long
    run. If not, flame me & i'll see what I can do

    HH




    ------------------------------

    Message: 3
    Date: Thu, 31 May 2012 16:06:47 -0400
    From: Lane Schwartz <[email protected] <mailto:[email protected]>>
    Subject: Re: [Moses-support] changes to the training scripts
    To: Hieu Hoang <[email protected]
    <mailto:[email protected]>>
    Cc: moses-support <[email protected]
    <mailto:[email protected]>>
    Message-ID:
    <CABv3vZ=wQZ62XBGOV39pt+3UUV2dvoZEs90J+SfDpO8X1=g...@mail.gmail.com 
<mailto:[email protected]>>
    Content-Type: text/plain; charset=UTF-8

    Thank you, Hieu. This is an excellent change.

    On Thu, May 31, 2012 at 3:42 PM, Hieu Hoang
    <[email protected] <mailto:[email protected]>> wrote:
    > Hi all
    >
    > if you're checking out the latest github code, there are some
    changes
    > you should be aware of:
    > ? ?1. There is a new argument to train-model.perl
    > ? ? ? ? ? ?-external-bin-dir [path]
    > ? ? ? ? This points to the directory where Giza++/mgiza lives.
    Setting
    > this is MANDATORY if you're using train-model.perl to do the word
    > alignment. It used to be hardcoded in the perl code itself.
    > ? ?2. All the training programs have been moved into the directory
    > ? ? ? ? ? [MOSES-ROOT]/bin
    > ? ? ? ?They should be run from there, not from wherever the
    source code is.
    > ? ?3. To roll out, simply copy the 2 directories
    > ? ? ? ? ? [MOSES-ROOT]/bin
    > ? ? ? ? ? [MOSES-ROOT]/scripts
    > ? ? ? ?to wherever you want, eg.
    > ? ? ? ? ? /home/hieu/moses/bin
    > ? ? ? ? ? /home/hieu/moses/scripts
    > ? ?4. If you don't want to move it anywhere, you can run it from
    where
    > you downloaded.
    > ? ?5. The EMS and example files have been updated.
    >
    > Hope this is ok for everyone. It may break some people's setup. If
    > possible, please change your setup. It's gonna help us all in
    the long
    > run. If not, flame me & i'll see what I can do
    >
    > HH
    >
    >
    > _______________________________________________
    > Moses-support mailing list
    > [email protected] <mailto:[email protected]>
    > http://mailman.mit.edu/mailman/listinfo/moses-support



    --
    When a place gets crowded enough to require ID's, social collapse
    is not
    far away.? It is time to go elsewhere.? The best thing about space
    travel
    is that it made it possible to go elsewhere.
    ? ? ? ? ? ? ? ? -- R.A. Heinlein, "Time Enough For Love"



    ------------------------------

    Message: 4
    Date: Thu, 31 May 2012 21:13:51 +0100
    From: Barry Haddow <[email protected]
    <mailto:[email protected]>>
    Subject: [Moses-support] Machine Translation Marathon 2012 (MTM2012):
           First   Call for Participation
    To: [email protected] <mailto:[email protected]>, [email protected]
    <mailto:[email protected]>, [email protected]
    <mailto:[email protected]>,
    [email protected] <mailto:[email protected]>,
    [email protected] <mailto:[email protected]>
    Message-ID: <[email protected]
    <mailto:[email protected]>>
    Content-Type: Text/Plain;  charset="us-ascii"

    (Apologies if you receive multiple copies. Please, distribute it among
    potentially interested colleagues.)

    MT MARATHON 2012
    http://www.statmt.org/mtm12

    CALL FOR PARTICIPATION

    The MosesCore (http://www.mosescore.eu) consortium invites
    researchers,
    developers, students and users of machine translation to
    participate in the
    Machine Translation Marathon 2012.

    This is the seventh time that this event has been held, and this
    year's MT
    Marathon will take place on 3-8 September 2012 in the Informatics
    Forum,
    Edinburgh, Scotland. It is organised by the Statistical MT group
    of the School
    of Informatics of the University of Edinburgh.

    The MT Marathon will include

    - Week-long open source hacking projects, led by experienced
    developers and
    researchers
    - A "summer" school providing a complete introductory course on
    statistical
    machine translation, including hands-on labs. This will cover
    phrase-based and
    syntax-based MT, and computer-aided translation
    - Talks from leading MT researchers and practitioners
    - Technical talks about open source tools for MT.

    New for this year: The MT Marathon particularly welcomes
    participants from
    the MT developer/user community. As well as providing a forum for
    researchers,
    developers and users to meet, collaborate and share ideas, this
    years MT
    Marathon will feature projects run by the MosesCore commercial
    partners (ALS
    and TAUS) as well as presentations from leading MT deployers, and
    a round-
    table discussion on the needs and requirements for open-source MT.

    Registration is now open. It's free, but strictly limited to 100
    people. For
    more information, see: http://www.statmt.org/mtm12

    CALL FOR PAPERS

    The MT Marathon will again host an Open Source Convention to
    advance the
    state of the art in machine translation. We invite developers of
    open source
    tools to present their work and submit a paper of up to 10 pages  that
    describes the underlying methodology and includes instructions on
    how to use the tools.

    We are looking for stand-alone tools and extensions of existing
    tools, such as
    the Moses open source system. Accepted papers will be presented
    during the MT
    Marathon and published in the Prague Bulletin of Mathematical
    Linguistics
    (http://ufal.mff.cuni.cz/pbml).

    Possible Topics:

      *   Training of Machine Translation models
      *   Machine Translation decoders
      *   Tuning of Machine Translation systems
      *   Evaluation of Machine Translation
      *   Visualisation, annotation or debugging tools
      *   Tools for human translators
      *   Interfaces for web-based services or APIs
      *   Extensions of existing tools
      *   Other tools for Machine Translation

    The papers from previous Marathons are available online among
    other PBML
    articles (http://ufal.mff.cuni.cz/pbml-91-100.html).

    Papers will be reviewed by two reviewers appointed by the program
    committee. Most of the accepted papers will be printed in PBML in time
    for the MT Marathon, some papers may require substantial revisions and
    may be postponed to subsequent PBML issues.

    Important Dates

    Abstract submission: July 3, 2012 (1 paragraph, to allocate reviewers)
    Paper submission: July 17, 2012
    Notification of acceptance: July 31, 2012
    Camera-ready: August 7, 2012
    Presentations: September 3-8, 2012 (at the MT Marathon in Edinburgh)

    Author Instructions

    Please send full non-anonymous submissions in PDF to Philipp Koehn
    (pkoehn AT inf DOT ed DOT ac DOT uk) and the full Xe(La)TeX source
    for a
    technical pre-review to Ondrej Bojar (bojar AT ufal DOT mff DOT
    cuni DOT
    cz).

    The maximum length for submissions is 10 pages, including references.
    This limit will be strictly enforced. If your paper has been accepted,
    please send your camera-ready version in both PDF and Xe(La)TeX format
    to Ondrej Bojar.

    Submissions will be accepted only in the PBML Xe(La)TeX format
    (http://ufal.mff.cuni.cz/pbml-instructions.html) for short papers
    (i.e.
    MS Word and other formats or a PDF without source files will not be
    accepted).


    Best regards,

    Barry Haddow

    (on behalf of the program and organising committees)


    ------------------------------

    Message: 5
    Date: Thu, 31 May 2012 21:20:36 +0100
    From: Barry Haddow <[email protected]
    <mailto:[email protected]>>
    Subject: [Moses-support] Second Call for Papers for the Open Source
           Convention held at the MT Marathon 2012 (MTM2012)
    To: [email protected] <mailto:[email protected]>, [email protected]
    <mailto:[email protected]>, [email protected]
    <mailto:[email protected]>,
    [email protected] <mailto:[email protected]>,
    [email protected] <mailto:[email protected]>
    Message-ID: <[email protected]
    <mailto:[email protected]>>
    Content-Type: Text/Plain;  charset="us-ascii"

    (Apologies if you receive multiple copies. Please, distribute it among
    potentially interested colleagues.)

    CALL FOR PAPERS:

    OPEN SOURCE TOOLS FOR MACHINE TRANSLATION

    The Machine Translation Marathon 2012, MTM2012, will take place in
    Edinburgh,
    Scotland from September 3-8th 2012. Full details are available at
    http://www.statmt.org/mtm12

    The MT Marathon will again host an Open Source Convention to
    advance the
    state of the art in machine translation. We invite developers of
    open source
    tools to present their work and submit a paper of up to 10 pages  that
    describes the underlying methodology and includes instructions on
    how to use the tools.

    We are looking for stand-alone tools and extensions of existing
    tools, such as
    the Moses open source system. Accepted papers will be presented
    during the MT
    Marathon and published in the Prague Bulletin of Mathematical
    Linguistics
    (http://ufal.mff.cuni.cz/pbml).

    Possible Topics:

      *   Training of Machine Translation models
      *   Machine Translation decoders
      *   Tuning of Machine Translation systems
      *   Evaluation of Machine Translation
      *   Visualisation, annotation or debugging tools
      *   Tools for human translators
      *   Interfaces for web-based services or APIs
      *   Extensions of existing tools
      *   Other tools for Machine Translation

    The papers from previous Marathons are available online among
    other PBML
    articles (http://ufal.mff.cuni.cz/pbml-91-100.html).

    Papers will be reviewed by two reviewers appointed by the program
    committee. Most of the accepted papers will be printed in PBML in time
    for the MT Marathon, some papers may require substantial revisions and
    may be postponed to subsequent PBML issues.

    Important Dates

    Abstract submission: July 3, 2012 (1 paragraph, to allocate reviewers)
    Paper submission: July 17, 2012
    Notification of acceptance: July 31, 2012
    Camera-ready: August 7, 2012
    Presentations: September 3-8, 2012 (at the MT Marathon in Edinburgh)

    Author Instructions

    Please send full non-anonymous submissions in PDF to Philipp Koehn
    (pkoehn AT inf DOT ed DOT ac DOT uk) and the full Xe(La)TeX source
    for a
    technical pre-review to Ondrej Bojar (bojar AT ufal DOT mff DOT
    cuni DOT
    cz).

    The maximum length for submissions is 10 pages, including references.
    This limit will be strictly enforced. If your paper has been accepted,
    please send your camera-ready version in both PDF and Xe(La)TeX format
    to Ondrej Bojar.

    Submissions will be accepted only in the PBML Xe(La)TeX format
    (http://ufal.mff.cuni.cz/pbml-instructions.html) for short papers
    (i.e.
    MS Word and other formats or a PDF without source files will not be
    accepted).


    Best regards,

    Barry Haddow

    (on behalf of the program committee)


    ------------------------------

    Message: 6
    Date: Fri, 1 Jun 2012 05:49:45 +0900
    From: Tetsuo Kiso <[email protected] <mailto:[email protected]>>
    Subject: Re: [Moses-support] Sparse moses
    To: Barry Haddow <[email protected]
    <mailto:[email protected]>>
    Cc: [email protected] <mailto:[email protected]>
    Message-ID: <[email protected]
    <mailto:[email protected]>>
    Content-Type: text/plain; charset=iso-8859-1

    Hi Barry,

    I see.
    It seems that there're couple of things to try out such as feature
    selection or the size of tuning dataset before merging.

    Tetsuo

    On Jun 1, 2012, at 4:19 AM, Barry Haddow wrote:

    > Hi Tetsuo
    >
    > Sorry about the delay!
    >
    > Yes, I'd like to merge the miramerge back into to trunk. At the
    moment though,
    > I have concerns about the performance of the sparse features
    (time and space),
    > so I'd like to address these before the merge. I'm going to have
    a look at it
    > over the summer, and probably solicit help at the mt marathon,
    >
    > cheers - Barry
    >
    > On Saturday 26 May 2012 15:03:48 Tetsuo Kiso wrote:
    >> Hi Barry,
    >>
    >>> I've updated the sparse features branch of Moses (miramerge),
    merging all
    >>> the recent changes from trunk. It passes all the unit tests,
    and all the
    >>> regression tests (apart from small number of rounding errors)
    but I
    >>> have't run any other tests on this branch.
    >>
    >> I'm just wondering is there any plan to merge the branch
    "miramerge"
    >> into "master" in the future?
    >>
    >>
    >> Tetsuo
    >>




    ------------------------------

    _______________________________________________
    Moses-support mailing list
    [email protected] <mailto:[email protected]>
    http://mailman.mit.edu/mailman/listinfo/moses-support


    End of Moses-support Digest, Vol 67, Issue 74
    *********************************************




_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support
_______________________________________________
Moses-support mailing list
[email protected]
http://mailman.mit.edu/mailman/listinfo/moses-support

Reply via email to