[Moses-support] specified output, xml-input and p(f|e)

I did that the result from Moses doesn't appear to be using the actual weights from the phrase table - p(f|e) is zero in the result returned by Moses. Is there a way to find out what score Moses would give to a specific target sentence? Thanks, Lane Schwartz Uni

Re: [Moses-support] specified output, xml-input and p(f|e)

tion option selection: > only allow options that generate the expected output. > > The xml input introduces new translation options, so that would not work. > The language model score will be accurate, but the translation model > score will not. > > -phi > > On Wed, May 28, 2008

[Moses-support] Multiple phrase tables

Is there a way to specify more than one phrase table for moses to load? Thanks, Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] Beam thresholding

Is there a way to completely turn off beam thresholding? Thanks, Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Moses-support Digest, Vol 29, Issue 2

> Date: Wed, 04 Mar 2009 14:39:28 +0100 > From: "J.Tiedemann" > Subject: [Moses-support] hiero > To: moses-support@mit.edu > Message-ID: > Content-Type: text/plain;charset=utf-8;format="flowed" > > > one more question: > I somehow remember that someone once said that a kind of Hiero system > was

[Moses-support] Hierarchical rule extraction

Hieu (or whoever else knows), Philipp mentioned that there is a branch that has hierarchical rule extraction working. I was wondering which branch, and if there are instructions on using it anywhere. Cheers, Lane ___ Moses-support mailing list Mose

[Moses-support] Hierarchical rule extraction

Hieu / Philipp, I'd like to extract a hierarchical grammar using the Moses tools (which Philipp helpfully pointed out have some documentation at http://www.statmt.org/moses/?n=Moses.ChartDecoding) . Here's the catch: I already have run train-factored-phrase-model.perl to extract a regular M

[Moses-support] Suffix arrays in Moses

Hi all, I'm just wanting to double-check the current state of the suffix array code in Moses. Can it be used to extract translation table entries on- the-fly? Also, has anyone written up a paper on this in Moses? I'd like to know who to cite if this has been written up. ;) Cheers, Lane ___

Re: [Moses-support] Suffix arrays in Moses

> Hope it helps > Greetings > -- > Felipe. > > > El vie, 27-11-2009 a las 14:36 -0600, Lane Schwartz escribió: >> Hi all, >> >> I'm just wanting to double-check the current state of the suffix >> array >> code in Moses. Can it be used to extract tran

Re: [Moses-support] Moses-support Digest, Vol 41, Issue 36

On 28 Mar 2010, at 11:02 AM, moses-support-requ...@mit.edu wrote: > Hiya Mosers and Mosettes, > > It's been a year since the last release& there's been lots of changes, by > lots of people, that we thought you should know about. > > A new release tar ball and zip file are on sourceforge, or sv

[Moses-support] Threads, moses, and expensive features

Barry, Hieu may have mentioned that I'm working on a (more or less) stateful new feature that uses an incremental parser as a syntactic language model. In this feature, calculating the next state from a word and the previous state is not ridiculously expensive, but it certainly takes longer tha

Re: [Moses-support] Threads, moses, and expensive features

nd one is the additional state splitting > which hurts recombination is the beam search. The first cost > is easy to measure, but the second one is more tricky - a different > trade-off between search errors and speed has to be found. > > -phi > > On Tue, Mar 30, 2010 at 8:36

[Moses-support] Experiment.perl publications & documentation

Hi, At the MT Marathon, Jon and the other LoonyBin folks presented a paper describing the LoonyBin workflow manager. I was wondering if there's any similar publication describing the experiment.perl workflow manager, and if there's any tutorial or documentation on using it. Thanks, Lane

[Moses-support] Running MERT on SGE

I was wondering if there are instructions anywhere describing how to set up and run Moses MERT in an SGE environment. The closest that I've found is an old post from Ondrej, making it look like setting things up for SGE can be rather difficult and treacherous: http://article.gmane.org/gmane.comp

Re: [Moses-support] Running MERT on SGE

On 8 Jun 2010, at 2:32 PM, Lane Schwartz wrote: > I was wondering if there are instructions anywhere describing how to set up > and run Moses MERT in an SGE environment. > > The closest that I've found is an old post from Ondrej, making it look like > setting things up f

Re: [Moses-support] Running MERT on SGE

On 8 Jun 2010, at 2:32 PM, Lane Schwartz wrote: > I was wondering if there are instructions anywhere describing how to set up > and run Moses MERT in an SGE environment. > > The closest that I've found is an old post from Ondrej, making it look like > setting things up f

[Moses-support] Patch for qsub-wrapper.pl

I've found a problem with qsub-wrapper.pl. I found the problem when I tried to use the --jobs flag to run MERT using SGE. My jobs kept dying, with very little in the way of helpful errors. It turned out that the job systems' default shell was csh, not bash. qsub ignores the shebang line in the scr

[Moses-support] Proposal to replace vertical bar as factor delimeter

I'd like to propose changing the current factor delimiter to something other than the single vertical bar | Looking through the mailing archives, it seems that the failure to properly purge your corpus of vertical bars is a frequent source of headaches for users. I know I've encountered this probl

Re: [Moses-support] Proposal to replace vertical bar as factor delimeter

t's a good idea. In the decoder, there's 4 places that has to be > > changed cos it's hardcoded > > ConfusionNet > >GenerationDictionary > > LanguageModelJoint > >Word::createFromString > > > > However, the train-model.perl is more

Re: [Moses-support] Proposal to replace vertical bar as factor delimeter

vent vertical bar related problems for most users, but (as far as I can see) should not disrupt existing toolchains, regression tests, or users who use factors. If you voted for the status quo, please let me know whether the above would satisfy your concerns. Thanks, Lane On Mon, Nov 15, 2010 at 3:55

[Moses-support] MERT problems, added new feature

I'm encountering a problem running MERT after I added a new feature (my syntactic language model). When I run MERT, the decoder runs, then I get an error that shows up in cmert.log: read_data(): wrong number of fields in line in feats.opt - expected 10 + 9 and found 18 on line 4 I followed the i

[Moses-support] allow-unknown-lambdas fails in mert-moses-new.pl

In the 2010-08-13 release, I tried to use mert-moses-new.pl, in conjuction with an older decoder binary. If I run mert-moses-new.pl, I get told, "The decoder also produced some 'tm' scores, but we do not know the ranges for them, no way to optimize them" If I specify lambdas, I get told "lambdas

Re: [Moses-support] allow-unknown-lambdas fails in mert-moses-new.pl

t quite compatible. > > Cheers, O. > > On 11/27/2010 03:59 AM, Lane Schwartz wrote: >> In the 2010-08-13 release, I tried to use mert-moses-new.pl >> <http://mert-moses-new.pl>, in conjuction with an older decoder binary. >> If I run mert-moses-new.pl <http://mert-

[Moses-support] Update Moses.FeatureFunctions tutorial

Following Barry's introduction of TranslationSystem.cpp in r3394, the Moses "Adding Feature Functions" tutorial ( http://www.statmt.org/moses/?n=Moses.FeatureFunctions) needs to be updated. I just hit my head against this while attempting to bring my syntactic LM branch up to date with trunk. Nam

[Moses-support] Skipping not yet supported in new moses-mert.pl

I'm running mert using moses-mert.pl in trunk (using the --jobs flag to use SGE). MERT died after the second iteration of decoding, during optimization. Normally, I would call moses-mert.pl again, using the --continue and --skip-decoder flags. When I try to do this, mert-moses.pl immediately dies

Re: [Moses-support] Forced translation with Moses

> > Hi all, > > I'm trying to figure out if Moses, in its current state, allows for > forced decoding? > > I've understood that Lane Schwartz implemented it for his multi-source > translation (Schwartz, 2008) > and it is used by Auli et al. (2009). Is this impl

[Moses-support] MERT dies during Optimizer::LineOptimize

I've got a MERT run (decoding took quite a while) that died during the run2 optimization. I pinned down where it dies. If anyone could help figure out what's going on here, I would really appreciate it. :) For reference, I've put the .dat and .opt files that mert is using at http://www.cs.umn.edu/~

Re: [Moses-support] MERT dies during Optimizer::LineOptimize

. This is what is > causing > mert to crash. Apologies for the lack of a meaningful error message, > > cheers > Barry > > On Wednesday 01 Dec 2010 17:18:21 Lane Schwartz wrote: > > I've got a MERT run (decoding took quite a while) that died during the > run2 >

[Moses-support] Sentence-level BLEU approximation

Is anyone aware of any available script that calculates sentence-level BLEU approximation for each sentence in an input file? Thanks, Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] Skipping not yet supported in new moses-mert.pl

g, as a > parallelised decode never takes more than an hour or so. > > cheers > Barry > > On Wednesday 01 December 2010 15:02, Lane Schwartz wrote: > > I'm running mert using moses-mert.pl in trunk (using the --jobs flag to > use > > SGE). > > > >

Re: [Moses-support] MERT dies during Optimizer::LineOptimize

finite(score)' failed. > Aborted > > which I think is an improvement. I don't know if this is portable though. > > cheers > Barry > > On Wednesday 01 Dec 2010 21:00:25 Lane Schwartz wrote: > > Thank you for taking a look so quickly. :) > > > > Is this so

[Moses-support] Use of qsub array in moses-parallel.pl

I was wondering if any consideration has been given to using qsub's job array functionality in moses-parallel.pl. Using the qsub -t flag, jobs can be tied together, so that if the parent job is killed via qdel, all of the children are also killed. Currently, if a parallel job needs to be killed, t

Re: [Moses-support] Use of qsub array in moses-parallel.pl

ilipp Koehn wrote: > Hi, > > I think the existing implementation was just trying to keep it > simple, since different installations of Sun GridEngine exist. > > -phi > > On Tue, Dec 14, 2010 at 9:07 PM, Lane Schwartz wrote: > > I was wondering if any consideration

Re: [Moses-support] Use of qsub array in moses-parallel.pl

m/torquedocs21/commands/qsub.shtml ) > > > > Suzy > > > > On 15/12/10 8:44 AM, Hieu Hoang wrote: > >> I think it's a good idea. The current implementation no longer works on > >> our cluster. Array is possibly a better way than sync jobs > >>

Re: [Moses-support] Use of qsub array in moses-parallel.pl

John, I assume you are saying that you like the current qsub submission mechanism used by moses-parallel.pl, and would like any changes to allow the script to keep working exactly how it is now. Is that correct? Lane On Thu, Dec 16, 2010 at 10:30 AM, John Burger wrote: > Chris Dyer wrote: > > Wo

Re: [Moses-support] Use of qsub array in moses-parallel.pl

I'm open to doing so, but I don't know any reason why the current method would be preferable to the proposed method. Lane On Thu, Dec 16, 2010 at 1:16 PM, John Burger wrote: > Lane Schwartz wrote: > > John, >> >> I assume you are saying that you like the current qsu

Re: [Moses-support] Use of qsub array in moses-parallel.pl

maintain the old naming scheme. Thanks, Lane On Tue, Dec 14, 2010 at 4:07 PM, Lane Schwartz wrote: > I was wondering if any consideration has been given to using qsub's job > array functionality in moses-parallel.pl. > > Using the qsub -t flag, jobs can be tied together, so tha

Re: [Moses-support] Use of qsub array in moses-parallel.pl

_TASK_ID]} is also "". >> >> I'm also not sure whether I have a $TASK_ID. Is it an SGE variable? >> >> Second problem: This if statement: >> if [ "" == "$SGE_TASK_ID" ]; then >> echo "Job was not submitted as an array job >>

[Moses-support] Merging branch

Just a heads up. I have some changes from my branch that I'm ready to commit to trunk. The changes are: * Implementation of a syntactic language model. By default, this code is not compiled. You have to tell configure to enable it. * Changes to moses-parallel.pl to submit queue jobs as array jo

[Moses-support] Switch to git?

I was wondering what other developer's thought are on the possibility of switching from subversion to git. I know this has been discussed at various points, at least since Adam's MT Marathon talk in Wandlitz. I've lived though a svn->git transition on another open source project. The transition th

Re: [Moses-support] Switch to git?

On Wed, Jan 19, 2011 at 4:13 PM, Barry Haddow wrote: > > > For me, the ability to make commits on a standalone network is a big > reason > > to move to git. > > > > Hi Lane > > Do you mean that you can 'commit' without connecting to the repository? I > can > see the advantage of this if you want

Re: [Moses-support] Switch to git?

On Wed, Jan 19, 2011 at 4:13 PM, Barry Haddow wrote: > Are there any other advantages? I can't see this as enough of a reason to > switch - learn a whole new set of commands, rewrite tutorials, deal with > the > ensuing mailing list queries etc. I've heard that merging is better in git, > but I

Re: [Moses-support] Switch to git?

Bazaar is another distributed version control system (DVCS), similar to git. Mercurial is another similar DVCS. As has been mentioned, there are bridges to allow some level of interaction between an SVN repository and local DVCS. Using these bridges, a user could check out code from an existing SV

Re: [Moses-support] running moses on a cluster with sge

I recall Barry working on the LM server at the Dublin MT Marathon. What is the current status of that? On Wed, Feb 2, 2011 at 3:29 AM, Miles Osborne wrote: > to add to Barry's excellent answer, we are currently working on a > client-server language model. this will mean that a cluster of > mach

[Moses-support] mosesserver configuration switching

I was thinking about trying out the mosesserver, and I was wondering if there's been any work done on allowing a running moses server to change any aspects of its configuration. This was mentioned as a point of future work in Barry's "Adding Multi-Threaded Decoding to Moses" Dublin marathon paper (

[Moses-support] Nondeterminism during decoding: same config, different n-best lists

While re-running an experiment (using the exact same configuration, same models, translating the same data) I noticed that occasionally, I get a slightly different 1-best list. Upon further examination, running Moses with the same config multiple times often (but not always) produces slightly diff

Re: [Moses-support] Nondeterminism during decoding: same config, different n-best lists

On Thu, Mar 24, 2011 at 9:26 AM, Lane Schwartz wrote: > This is a bit odd, but terribly worrisome. > Sorry, meant to say "not terribly worrisome". Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailma

Re: [Moses-support] Nondeterminism during decoding: same config, different n-best lists

On Thu, Mar 24, 2011 at 10:07 AM, Barry Haddow wrote: > Hi Lane > > Ideally, moses should return the same output for the same input data. > However, > as Christian already noted, there are points in the code where pointer > comparison is used to determine the order in which the search graph is >

Re: [Moses-support] Nondeterminism during decoding: same config, different n-best lists

On Thu, Mar 24, 2011 at 10:15 AM, Lane Schwartz wrote: > On Thu, Mar 24, 2011 at 10:07 AM, Barry Haddow wrote: > >> Hi Lane >> >> Ideally, moses should return the same output for the same input data. >> However, >> as Christian already noted, there

Re: [Moses-support] Nondeterminism during decoding: same config, different n-best lists

ctable-seeds. > > >>> > > >>> Tom > > >>> > > >>> > > >>> > > >>> -Original Message- > > >>> *From*: Hieu Hoang > >>> <mailto:hieu%20hoang%20%3chieuho...@gmail.com%3e>

Re: [Moses-support] Suffix arrays in Moses

On Sat, Nov 28, 2009 at 2:48 PM, Lane Schwartz wrote: > I know that during the 2nd MT Marathon in Wandlitz in May 2008, work was > done on implementing a suffix array data structure so that Moses could > extract phrase pairs directly from an aligned parallel corpus at runtime, >

[Moses-support] Implementation of Lattice MERT

Does anyone know if there's an open implementation of Lattice MERT (Macherey, et al, 2008)? Strangely, the authors seem to have forgotten to include the URL to download their implementation. :) Just to be clear, I don't mean running MERT where you give Moses a source-language lattice to decode. C

Re: [Moses-support] Suffix arrays in Moses

Thanks Philipp. :) Abby, is the suffix array code just in a branch, or has it been moved into trunk? Cheers, Lane On Fri, Mar 25, 2011 at 3:22 PM, Philipp Koehn wrote: > Hi, > > Abby implemented the suffix array code, and it is in Moses, > but not very well documented. It should be possible

Re: [Moses-support] error with kenlm in compiling moses

On Tue, Mar 29, 2011 at 5:46 AM, Yang Gao wrote: > When compiling moses after an unsuccessful compiling (due to disk space > limitation), I get this error with kenlm: > If you have an unsuccessful compile, you should probably run make clean before attempting to compile again. This is especially

Re: [Moses-support] Forced translation with Moses

ng function is interesting. Before several > days, I have tried this "-constraint" setting of moses. It can do force > decoding mostly with one bug. > For example, if target sentence is "ABCDE". I have got one forced > translation by "ABCD".

Re: [Moses-support] Forced translation with Moses

example, if target sentence is "ABCDE". I have got > >> one forced translation by "ABCD". I guess it is caused by no length > >> limit of translated sentence by the last hypothesis. > >> Anyway, such functionality is very useful. Thank y

Re: [Moses-support] Recommended citation for moses MERT?

Check the Prague Bulletin. I thought that's where they published the description. On Sat, Apr 23, 2011 at 2:35 PM, Chris Dyer wrote: > Hi all, is there a particular citation that should be used for the > moses MERT implementation? I seem to recall that there might have been > a paper when the ol

Re: [Moses-support] Versions of Moses

Unless you have a specific reason to use srilm or irstlm, I recommend starting out with kenlm. It has some nice properties, but the main reason I recommend it is that it's now bundled with moses by default, and you should have fewer problems compiling moses against it than against srilm. Lane On

[Moses-support] Syntactic LM merged

The code implementing an incremental syntactic language model (previously in branch lane-syntax) has been merged into trunk (r3971-r3977). This code accompanies the forthcoming ACL 2011 paper "Incremental Syntactic Language Models for Phrase-based Translation". Instructions on how to use the new

Re: [Moses-support] Syntactic LM merged

makes > > the code harder to read. Maybe the ideal is to have sort of plugin > mechanism > > for extra features, although I'm not sure how this would work, > > > > cheers > > Barry > > > > On Friday 13 May 2011 22:11:27 Lane Schwartz wrote: > >&

Re: [Moses-support] Syntactic LM merged

ive. Any better ideas out there? > > Cheers - Barry > > Sent from my ZX81 > > > - Reply message - > From: "Lane Schwartz" > Date: Sat, May 14, 2011 01:02 > Subject: [Moses-support] Syntactic LM merged > To: "Philipp Koehn" > Cc: "

[Moses-support] What happened to --with-boost-libdir?

I'm running on Centos 5, and as such have an older version of boost 1.39 in /usr/include, with the boost libraries in /usr/lib64. In older versions of Moses, I was able to compile Moses with boost by providing a flag to configure --with-boost-libdir=/usr/lib64. This option is no longer present in

[Moses-support] Beam thresholding

I'm trying to understand how to set the beam-threshold parameter. The default value is 0.1f. If I want this parameter to prune less, should I make the value large (for example, 0.1) or make it smaller (for example 0.1f)? Thanks, Lane ___ Mos

Re: [Moses-support] What happened to --with-boost-libdir?

at the macro, it should check /usr/lib64, so I don't know why > it's > > not finding the boost libraries for you. > > > > The usual problem with centos is that it has a very old automake - did > you > > install an up-to-date one? > > > > Could

Re: [Moses-support] Beam thresholding

eamWidth > m_worstScore ) >m_worstScore = m_bestScore + m_beamWidth; > > where m_beamWidth are the log of the value you specify. > If you set it to 0, then it is -inf. > > -phi > > On Mon, May 23, 2011 at 11:48 PM, Lane Schwartz > wrote: > > So would it

Re: [Moses-support] what are the fields in the Moses generated Phrase Table?

Hieu, Could you elaborate on what the counts mean? How do they relate to the number of source and target phrases extracted during training? Thanks, Lane On Fri, May 27, 2011 at 11:31 AM, Hieu Hoang wrote: > hi pratyush > > the 4th column contains alignment info if you had switched that option

Re: [Moses-support] what are the fields in the Moses generated Phrase Table?

the fractional counts. The only time you can't work > backwards like that is if you had used GT discounting. > > > > On 27/05/2011 22:35, Lane Schwartz wrote: > > Hieu, > > Could you elaborate on what the counts mean? > > How do they relate to the number of sourc

Re: [Moses-support] Parallel Europarl across 3+ languages

I've done some work with multilingual translation. I don't remember if I have that kind of script. If I do, it would most likely be in one of the "lane" branches in the svn repository. Look for something with a multilingual sounding title. Cheers, Lane On Wed, Jul 6, 2011 at 10:57 AM, Nicholas Ru

[Moses-support] Wrap XML scripts

Does anyone have a good script for taking plain-text versions of source, reference, and hypothesis files and wrapping them in XML for use by metric tools like TERp and the NIST scripts that require XML? I'm aware of the WMT wrap-xml.pl script (http://www.statmt.org/wmt11/wrap-xml.perl), but AFAIK

[Moses-support] XML input and multiple translations

When using the XML input option, is there a way to provide multiple possible translations for a given input phrase? Thanks, Lane ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

[Moses-support] make install and libz.so.1

I've got an odd situation. I just compiled moses from trunk on Scientific Linux 6 (a RHEL clone). I then did a make install. When I run moses from the source dir on SL6, everything is fine. When I run the copy that got installed in $PREFIX, I get the following error: bin/moses: error while loadin

Re: [Moses-support] XML input and multiple translations

e. > Hope it helps, > Thomas > > On Aug 10, 2011, at 8:29 PM, Lane Schwartz wrote: > > When using the XML input option, is there a way to provide multiple > possible translations for a given input phrase? > > Thanks, > Lane > ___

Re: [Moses-support] make install and libz.so.1

nd Moses is > linking to 1 but running te other. > > When I'm on a 64 bit machine, I only install 64bit libs > > Hieu > Sent from my flying horse > > On 11 Aug 2011, at 04:06 AM, Lane Schwartz wrote: > >> I've got an odd situation. I just compiled moses fr

Re: [Moses-support] Finite-State Language Models

On Sun, Aug 28, 2011 at 12:48 PM, Graham Neubig wrote: > Hi, > > Has anyone used/implemented language models in Moses expressed as > finite state machines? Basically what I want to do is define an > arbitrary weighted machine (in say OpenFST format) and use it to score > my translation hypotheses.

Re: [Moses-support] build 5 gram with SRILM and moses

Yes. On Tue, Sep 6, 2011 at 12:28 PM, Cyrine NASRI wrote: > Hi all, > Is it possible tu uses 5 gram Language model built bu SRILM with MOses? > Thanks > Best > > Cyrine > > -- > Cyrine > Ph.D. Student in Computer Science > > ___ > Moses-support mailing

[Moses-support] Moses git repository (was Sparse phrase table?)

Barry, I wasn't aware that there was a Moses git repository. Is it just a mirror of the subversion repo? Are there plans to move primary development to the git repo? Thanks, Lane On Wed, Sep 7, 2011 at 3:49 AM, Barry Haddow wrote: > Hi Anne > > Yes, there is a version of moses which supports s

Re: [Moses-support] Moses git repository (was Sparse phrase table?)

n't push to any branches which track svn branches. Otherwise BAD > things will happen, > > cheers - Barry > > > Quoting Lane Schwartz on Wed, 7 Sep 2011 08:54:55 > -0400: > >> Barry, >> >> I wasn't aware that there was a Moses git repository. Is

Re: [Moses-support] Forced decoding in Moses

2011/9/8 Kun Wang : > Hi, all, > > From the roadmap of Moses, I notice that Forced Decoding is a planned > extension. > Does anyone knows whether this module has been finished or not? Thanks. I implemented a version of this a couple years ago. It's in Moses trunk. Use the "-constraint" flag. The

Re: [Moses-support] Translation "Goodness"

On Thu, Sep 15, 2011 at 1:26 PM, Taylor Rose wrote: > ** > Hey all, > > I've been researching how to judge the quality of a machine translation. I > found this > article

Re: [Moses-support] Phrase probabilities

Taylor, If you don't have a background in NLP or CL (or even if you do), I highly recommend taking a look at Philipp's book "Statistical Machine Translation" I hope this doesn't come across as RTFM. That's not what I mean. :) Cheers, Lane On Tue, Sep 20, 2011 at 3:45 PM, Taylor Rose wrote: > W

Re: [Moses-support] Phrase probabilities

t.  So you should take logs yourself before multiplying by >> the feature weights. >> If you don't have feature weights, using uniform weights is >> reasonable. >> And regarding your original question above: since the phrase penalty >> feature has the same value for

Re: [Moses-support] Multi-threading / Boost lib / compile error for threaded Moses

I typically compile with Boost. That said, I do have a couple of (relatively minor) concerns. Would requiring Boost complicate/prevent the compiling and use of Moses on smaller mobile platforms, such as iOS, Android, and OLPC? When I was working with Hieu on the iPhone port, I don't remember havin

Re: [Moses-support] Multi-threading / Boost lib / compile error for threaded Moses

ost versions, single & multi-threaded etc. > > baz has a point about retaining single-thread in though. For 50 > sentences with hiero model (1000 pop-limit), time taken was 218sec > (multi-threaded, 1 thread) v. 192sec (single-threaded), ie. > multi-threading overhead makes decoding 1

Re: [Moses-support] Multi-threading / Boost lib / compile error for threaded Moses

On Thu, Sep 22, 2011 at 10:39 AM, Kenneth Heafield wrote: > On 09/22/11 15:15, Hieu Hoang wrote: >> OLPC - no problem, it's standard linux. >> iOS - depends on the boost libraries used, but probably gonna make it a >> no go for a while. >> Android - no chance. Not really good for C++ apps @ the mo

Re: [Moses-support] Multi-threading / Boost lib / compile error for threaded Moses

Kenneth, I think that new functionality such as what you're implementing is a strong argument for requiring Boost. You and other active developers should not be put into the situation where you have to reimplement Boost functionality. Would a requirement on Boost headers get you the tools that yo

Re: [Moses-support] Multi-threading / Boost lib / compile error for threaded Moses

On Thu, Sep 22, 2011 at 2:57 PM, Kenneth Heafield wrote: > There are probably many similarly trapped people.  I remember the pain > that Tim Anderson went through with MEMT.  Few of them seem to be taking > the survey, but they'll probably start shouting if/when Moses starts > depending on Boost.

Re: [Moses-support] Calculate probability of a sentence

You could use forced translation. It won't be perfect, but it might help you catch some of these errors. In forced translation, you give the source sentence and a proposed translation, and Moses attempts to translate the source sentence into the proposed translation. If it succeeds, it will give y

Re: [Moses-support] i need ter and analize tool

http://www.umiacs.umd.edu/~snover/terp On Mon, Sep 26, 2011 at 9:33 AM, saeed farzi wrote: > Hi all, > > Can anybody introduce me a tool for calculating TER, and a tool for > analysizing ouput of moses. > -- >           S.Farzi, Ph.D. Student >    Natural Language Processing lab, >  School of Ele

Re: [Moses-support] i need ter and analize tool

If the TER code isn't working properly for your language, your best bet would be to contact the authors of that code directly. On Mon, Sep 26, 2011 at 9:38 AM, saeed farzi wrote: > Dear Lane, It is not work with Persian languages (Unicode) correctly. > > On Mon, Sep 26, 2011 at

Re: [Moses-support] New branch

Marcin, If you have write permission as a Moses developer on sourceforge, then you can just make a new subversion branch. If you don't, you'll need one of the Moses admins to grant you that permission. Cheers, Lane On Mon, Sep 26, 2011 at 11:08 AM, Marcin Junczys-Dowmunt wrote: > > Hi all, >

Re: [Moses-support] Improved build system (was Failed to run mert at ./mert-moses-new.pl line 752.)

I would like to see a true make install option. I don't care what the default location is, as long as it's configurable. At the least, I would prefer to see the binaries (and preferably scripts, too) installed to a bin directory within the moses dir instead of being spread throughout the source di

Re: [Moses-support] Improved build system (was Failed to run mert at ./mert-moses-new.pl line 752.)

with >> "configure --prefix=..." ; I dont understand if you want more than >> this. >> >> Raphael >> >> 2011/9/27 Lane Schwartz : >> > I would like to see a true make install option. I don't care what the >> > default location is, as long as

Re: [Moses-support] Improved build system (was Failed to run mert at ./mert-moses-new.pl line 752.)

gt; I like your idea of a VERSION.txt file. Maybe containing also the >>> configure line. >>> >>> By the way, there is already a make install which is configurable with >>> "configure --prefix=..." ; I dont understand if you want more than >&g

Re: [Moses-support] Improved build system (was Failed to run mert at ./mert-moses-new.pl line 752.)

ifdef or macro to get it embedded into the appropriate binary. You can get similar info from git by using the following: git show-branch --sha1-name Cheers, Lane On Thu, Sep 29, 2011 at 9:02 AM, Lane Schwartz wrote: > I know there's a way to put in the svn revision number. Not sure a

Re: [Moses-support] Improved build system (was Failed to run mert at ./mert-moses-new.pl line 752.)

#x27;ve never tried this, though. > > /Christian > > On 29.09.2011, at 15:55, Lane Schwartz wrote: > >> This info is available for svn by calling svnversion. One way to embed >> this would be as follows: >> >> In the Makefile, add a line like this: >> >&g

Re: [Moses-support] Tips for creating a well rounded translation module?

How best to procede depends on what you plan on doing. What domains do you want your system to translate? Does a single system need to be able to handle multiple domains? On Fri, Sep 30, 2011 at 10:17 AM, Taylor Rose wrote: > Hello, > > I'm currently working with a translation module that is trai

Re: [Moses-support] Tips for creating a well rounded translation module?

gt; > > On Fri, 2011-09-30 at 10:21 -0400, Lane Schwartz wrote: >> How best to procede depends on what you plan on doing. What domains do >> you want your system to translate? Does a single system need to be >> able to handle multiple domains? >> >> On Fri, Sep

[Moses-support] OT: Summer 2012 research internship opportunity (Dayton, OH)

e off-list. The position is restricted to U.S. citizens. Cheers, Lane Schwartz ___ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support

Re: [Moses-support] cube-pruning-diversity for moses-chart

Wait - seriously? Cube pruning is not implemented in the hierarchical model? On Sat, Oct 15, 2011 at 1:42 AM, Hieu Hoang wrote: > hi baskaran > > no, it's not presently used it hierarchical pb models. It would be > interesting to try it, especially for syntax models, as arguably the lack of > div

Re: [Moses-support] cube-pruning-diversity for moses-chart

Ah, that makes more sense. On Mon, Oct 17, 2011 at 8:56 AM, Hieu Hoang wrote: > cube pruning *diversity*. I think philipp koehn added some heuristics to > phrase-based, not sure how it works > > On 17 October 2011 19:53, Lane Schwartz wrote: >> >> Wait - seriou

  1   2   3   4   >