Re: [VOTE] Graduate the Apache Joshua (Incubating) Project

+1 (binding) On Thu, Apr 26, 2018 at 7:06 PM, Mattmann, Chris A (1761) < chris.a.mattm...@jpl.nasa.gov> wrote: > +1! > > Sent from my iPhone > > On Apr 26, 2018, at 5:04 PM, Tom Barber spicule.co.uk>> wrote: > > +1 > > On Fri, 27 Apr 2018, 00:58 Thamme Gowda,

RE: problems with LM loading

The feature function initialization message is just a general purpose exception handler. I’ve seen this quite often when language models fail to load. The most interesting part of the log to me is: > Caused by: java.lang.RuntimeException: Something wrong with I/O. > > at

Re: merging 7 branch to master

Sounds like a good plan to me as well. +1 On Sep 20, 2017 8:05 PM, "Mattmann, Chris A (3010)" < chris.a.mattm...@jpl.nasa.gov> wrote: > +1 from me! > > ++ > Chris Mattmann, Ph.D. > Principal Data Scientist, Engineering

Re: [VOTE] Release Apache Joshua 6.1 (Incubating)

st failure. > > Hence -1 from me too. > I'll roll it back, fix the issues and create RC4. > > Regards, > Tommaso > > > > Il giorno mer 1 mar 2017 alle ore 17:54 kellen sunderland < > kellen.sunderl...@gmail.com> ha scritto: > > > I have to -1 this rele

Re: [VOTE] Release Apache Joshua 6.1 (Incubating)

I have to -1 this release for the time being. For me the signatures and hashes don't seem to match the binaries downloaded. Could you double check that they match for you Tommaso? I'm also getting a unit test that fails when I run 'mvn clean package'. I'm digging a little more into this one,

Re: Cutting RC3

Thanks for taking this on Tommaso. I've blocked some time off for myself tomorrow to help review the RC. -Kellen On Fri, Feb 24, 2017 at 12:26 PM, Tommaso Teofili wrote: > cool, release:perform succeeded, now the artifacts are on a single Nexus > staging repo. >

Re: Issues to Fix with Apache Joshua 6.1 RC#2

[7] has been fixed. Tom's comments lead me to think that [8][9][10] can be removed from the release. I'm not totally clear on what we need to do to resolve the licensing issues [5] and [6]. Do we simply need to give attribution to these projects in our LICENSE.txt file? On Thu, Dec 1, 2016

[jira] [Comment Edited] (JOSHUA-324) Address Apache Joshua 6.1 RC#2 Issues

[ https://issues.apache.org/jira/browse/JOSHUA-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15708118#comment-15708118 ] Kellen Sunderland edited comment on JOSHUA-324 at 11/30/16 10:15 AM

Re: Translator Questions

1) it is usually not possible because a few components of a model are not symmetric. For example a language model is used with Joshua, but this language model is only modelling the target language. To translate German to English in your example you would need to download a separate German to

Re: Signing off a Joshua Release

Definitely guilty of this. I'll check the release checklist in the future. Thanks for the reminder Tom. On Nov 26, 2016 1:27 PM, "Tom Barber" wrote: Hello folks, I see plenty of +1's going through the release vote, which is great to see people taking an active role in

Re: Dockerhub hosted images

ote: > > > > Kellen, can I bother you to post a few first steps? I've successfully > pulled this down to my mac but now do not know how to find it, edit it, or > run it. I'm porting through the documentation and will find it eventually > but this would save me a

Re: Dockerhub hosted images

ov 22, 2016 at 1:57 PM, < > dev-digest-h...@joshua.incubator.apache.org> wrote: > > > From: kellen sunderland <kellen.sunderl...@gmail.com> > > To: "dev@joshua.incubator.apache.org" <dev@joshua.incubator.apache.org> > > Cc: > > Date: Tue,

Re: Dockerhub hosted images

Ok, the first image should be properly uploaded now. https://hub.docker.com/r/kellens/apache-joshua-es-en-2016-10-05/ -Kellen On Tue, Nov 22, 2016 at 9:09 PM, wrote: > Yeah sorry, the upload keeps failing for some reason. I’m trying again > now. > > > > -Kellen >

Re: Dockerfile Issue

Yep, looks like it's been applied in this PR, so nothing blocking on my side. https://github.com/apache/incubator-joshua/pull/77 -Kellen On Tue, Nov 22, 2016 at 10:53 PM, lewis john mcgibbney wrote: > Hi Kellen, > Have you fixed your Dockerfile issue? If so then please

Re: language packs blog post

Looks good to me, no objection to tweeting it. Nice work putting them all together. On Mon, Nov 21, 2016 at 9:00 PM, Matt Post wrote: > Hi folks, > > I just drafted this; any objections to tweeting it? > > https://cwiki.apache.org/confluence/display/JOSHUA/ >

Re: [VOTE] Release Apache Joshua (Incubating) 6.1

I'd vote for a respin fixing Henry's changes. There's also a small break in the Dockerfile which I can fix at some point today (we need to switch it to use mvn package I believe). On Mon, Nov 21, 2016 at 10:40 AM, Tommaso Teofili wrote: > I think this settles for a

Re: [VOTE] Release Apache Joshua (Incubating) 6.1

+1 . Thanks to Lewis and Matt for all the recent work. On Nov 14, 2016 7:11 PM, "Matt Post" wrote: +1 Thanks for starting this off, Lewis! > On Nov 14, 2016, at 12:54 PM, Ramirez, Paul M (398M) < paul.m.rami...@jpl.nasa.gov> wrote: > > +1, let's get it released!!! > >

Re: Lewis Volunteering for 6.1 Release Manager

Sounds great to me Lewis, thanks for taking this on. On Thu, Nov 10, 2016 at 10:55 PM, Matt Post wrote: > Just landing back in the states from Berlin. This sounds great Lewis! > > matt (from my phone) > > > Le 10 nov. 2016 à 12:02, lewis john mcgibbney a >

Re: Joshua Model Input Format(s) and LM Loading

I've done fair amount of measurement and profiling in this area over the last year, so I can offer a little bit of advice as well. First of all make sure you're not just using a Java profiler if you're looking at a model with KenLM. The perf impact of language model calls will be under-reported.

Re: moses2 vs. joshua

gt; Joshua (hiero) > Moses2 (hiero) > Phrase rate > Hiero rate > 1 > 178 > 65 > 2116 > 1137 > 2.74 > 1.86 > 2 > 109 > 42 > 1014 > 389 > 2.60 > 2.61 > 4 > 78 > 29 > 596 > 213 > 2.69 > 2.80 > 6 > 72 > 25 >

Re: moses2 vs. joshua

Very nice results. I think getting to within 25% of a optimized c++ decoder from a Java decoder is impressive. Great that Hieu has put in the work to make moses2 so fast as well, that gives organizations two quite nice decoding engines to choose from, both with reasonable performance. Matt: I

Heads up if you're getting JVM Crashes

Hello everyone, Just wanted to give a heads up that as of this commit https://github.com/apache/incubator-joshua/commit/90fff5ab1de3da23c0f64f90e69ce0da2392fd49 the abi for libkenlm.so has changed. That means you may have to recompile it or it could crash when causing probRule. -Kellen

[jira] [Resolved] (JOSHUA-296) Refactor threading code

[ https://issues.apache.org/jira/browse/JOSHUA-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland resolved JOSHUA-296. -- Resolution: Fixed Fixed in this PR https://github.com/apache/incubator-joshua/pull/45

[jira] [Commented] (JOSHUA-307) Java-based tokenization and normalization

[ https://issues.apache.org/jira/browse/JOSHUA-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447105#comment-15447105 ] Kellen Sunderland commented on JOSHUA-307: -- +1. This would be great, and could go into the CLI

[jira] [Commented] (JOSHUA-285) Not all RuntimeExceptions are caught

[ https://issues.apache.org/jira/browse/JOSHUA-285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446080#comment-15446080 ] Kellen Sunderland commented on JOSHUA-285: -- This is fixed in PR https://github.com/apache

[jira] [Commented] (JOSHUA-95) Vocabulary locking

[ https://issues.apache.org/jira/browse/JOSHUA-95?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426055#comment-15426055 ] Kellen Sunderland commented on JOSHUA-95: - Yes, all the contention on Vocabulary has been removed

[jira] [Updated] (JOSHUA-295) Revamp dependency organization in Joshua

[ https://issues.apache.org/jira/browse/JOSHUA-295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland updated JOSHUA-295: - Affects Version/s: 6.2 > Revamp dependency organization in Jos

[jira] [Created] (JOSHUA-303) Simplify feature handling code within Joshua

Kellen Sunderland created JOSHUA-303: Summary: Simplify feature handling code within Joshua Key: JOSHUA-303 URL: https://issues.apache.org/jira/browse/JOSHUA-303 Project: Joshua Issue

[jira] [Commented] (JOSHUA-221) ArrayIndexOutOfBoundsException when passing arguments to JoshuaDecoder.main

[ https://issues.apache.org/jira/browse/JOSHUA-221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426045#comment-15426045 ] Kellen Sunderland commented on JOSHUA-221: -- Maybe we could resolve this by using args4j

[jira] [Resolved] (JOSHUA-287) KenLM.java catches UnsatisfiedLinkError when attempting to load libken.so (libken.dylib on OSX)

[ https://issues.apache.org/jira/browse/JOSHUA-287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland resolved JOSHUA-287. -- Resolution: Fixed UnsatisfiedLinkErrors are now wrapped with a descriptive

Re: Podling Report Reminder - August 2016

ing enabling > Travis-CI for continual integration testing. > > Date of last release: > > N/A > > When were the last committers or PMC members elected? > > April 11, 2016 (Kellen Sunderland and Felix Hieber) > > Signed-off-by: > > [ ](joshua) Paul Ramirez

Re: master pushes

Ahh, I see we don't yet have a travis.yml. Let me try and create one ... Pull request should be coming soon. -Kellen On Thu, Jul 28, 2016 at 5:30 PM, kellen sunderland < kellen.sunderl...@gmail.com> wrote: > Hey Matt, what still needs to be setup? I can try and help out. > >

[jira] [Comment Edited] (JOSHUA-287) KenLM.java catches UnsatisfiedLinkError when attempting to load libken.so (libken.dylib on OSX)

[ https://issues.apache.org/jira/browse/JOSHUA-287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397701#comment-15397701 ] Kellen Sunderland edited comment on JOSHUA-287 at 7/28/16 3:42 PM: --- I

[jira] [Commented] (JOSHUA-287) KenLM.java catches UnsatisfiedLinkError when attempting to load libken.so (libken.dylib on OSX)

[ https://issues.apache.org/jira/browse/JOSHUA-287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397701#comment-15397701 ] Kellen Sunderland commented on JOSHUA-287: -- I should have addressed this in my latest PR. https

Re: master pushes

Hey Matt, what still needs to be setup? I can try and help out. On Thu, Jul 28, 2016 at 4:49 PM, Matt Post wrote: > Hi folks, > > Sorry for the continued pushes to master. We have had Travis-CI enabled, > but I haven't taken the time to get it setup. Someone else should feel

Re: Issue Building LM on master branch

Hey Lewis, as an alternative you can try fast_align. It's been working well for us. 10 minutes seems a little bit faster than what I'd expect. IIRC it may take a few hours (4-8?) to align that much data. https://github.com/clab/fast_align -Kellen On Sun, Jul 17, 2016 at 12:01 AM, Lewis John

Re: Avoiding master failures with CI

> > > > matt > > > > > >> On Jul 13, 2016, at 8:21 AM, kellen sunderland < > kellen.sunderl...@gmail.com> wrote: > >> > >> Would everyone be ok with tomorrow at 5PM UTC? > >> > >> -Kellen > >> > >> On Tu

Re: joshua - Build # 49 - Still Failing!

igner/ > > > goal, but you can always help by sponsoring the project > <http://www.meteorite.bi/products/saiku/sponsorship>) > > On 13 July 2016 at 13:41, kellen sunderland <kellen.sunderl...@gmail.com> > wrote: > > > To me it reads as if it failed when t

Re: joshua - Build # 49 - Still Failing!

joshua/6.0.6-SNAPSHOT/ > > Snapshots are uploading, its just missing the version you're looking for. > > On Wed, Jul 13, 2016 at 1:20 PM, kellen sunderland < > kellen.sunderl...@gmail.com> wrote: > > > Strange, https://builds.apache.org/job/joshua_master/78/ is p

Re: joshua - Build # 49 - Still Failing!

Strange, https://builds.apache.org/job/joshua_master/78/ is passing. Looks like the analysis CI is getting an 401 when trying to upload a build artifact to here:

Re: [IMPORTANT] Roadmap for 6.1 Release

Thanks for organizing Lewis, sorry for the late replies. Looking at the frequency of our updates I'd suggest quarterly, or bi-annual releases. If we can keep the master branch stable (which should really be a goal of ours) then hopefully it's not too much work to create the releases.I do

[jira] [Commented] (JOSHUA-279) Cannot build Joshua master branch

[ https://issues.apache.org/jira/browse/JOSHUA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15370387#comment-15370387 ] Kellen Sunderland commented on JOSHUA-279: -- Hey Lewis, sorry about these tests failing. We should

[jira] [Commented] (JOSHUA-274) Use another HTTPServer other than Suns

[ https://issues.apache.org/jira/browse/JOSHUA-274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307596#comment-15307596 ] Kellen Sunderland commented on JOSHUA-274: -- I would propose we don't put anything web server

[jira] [Updated] (JOSHUA-275) Revamp the Configuration System

[ https://issues.apache.org/jira/browse/JOSHUA-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland updated JOSHUA-275: - Description: I'd like to propose we centralize Joshua's configuration system to make use

[jira] [Updated] (JOSHUA-275) Revamp the Configuration System

[ https://issues.apache.org/jira/browse/JOSHUA-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland updated JOSHUA-275: - Description: I'd like to propose we centralize Joshua's configuration system to make use

[jira] [Updated] (JOSHUA-275) Revamp the Configuration System

[ https://issues.apache.org/jira/browse/JOSHUA-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland updated JOSHUA-275: - Description: I'd like to propose we centralize Joshua's configuration system to make use

[jira] [Updated] (JOSHUA-275) Revamp the Configuration System

[ https://issues.apache.org/jira/browse/JOSHUA-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland updated JOSHUA-275: - Description: I'd like to propose we centralize Joshua's configuration system to make use

Re: too many emails

I'd +1 as well. Your breakdown looks good to me Chris. On Thu, May 26, 2016 at 4:12 PM, Mattmann, Chris A (3980) < chris.a.mattm...@jpl.nasa.gov> wrote: > +1 to a separate list for GitHub stuff. Many communities (Kudu, > Spark, etc.) end up doing this. > > How about: > >

[jira] [Created] (JOSHUA-266) Refactor key interfaces and core code for a future release.

Kellen Sunderland created JOSHUA-266: Summary: Refactor key interfaces and core code for a future release. Key: JOSHUA-266 URL: https://issues.apache.org/jira/browse/JOSHUA-266 Project: Joshua

[jira] [Created] (JOSHUA-265) Refactor key interfaces and core code for a future release.

Kellen Sunderland created JOSHUA-265: Summary: Refactor key interfaces and core code for a future release. Key: JOSHUA-265 URL: https://issues.apache.org/jira/browse/JOSHUA-265 Project: Joshua

[jira] [Created] (JOSHUA-264) Remove system exits and replace with RuntimeExceptions

Kellen Sunderland created JOSHUA-264: Summary: Remove system exits and replace with RuntimeExceptions Key: JOSHUA-264 URL: https://issues.apache.org/jira/browse/JOSHUA-264 Project: Joshua

Re: Language Pack size

> > matt > > > > On May 13, 2016, at 4:45 PM, Matt Post <p...@cs.jhu.edu> wrote: > > > > Oh, yes, of course. That's in build_binary. > > > > > >> On May 13, 2016, at 4:39 PM, kellen sunderland < > kellen.sunderl...@gmail.com> wrote

[jira] [Closed] (JOSHUA-263) Standardize logging across Joshua

[ https://issues.apache.org/jira/browse/JOSHUA-263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland closed JOSHUA-263. Resolution: Duplicate > Standardize logging across Jos

[jira] [Updated] (JOSHUA-263) Standardize logging across Joshua

[ https://issues.apache.org/jira/browse/JOSHUA-263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland updated JOSHUA-263: - Description: (was: We would like to standardize logging across Joshua. The purpose

[jira] [Created] (JOSHUA-263) Standardize logging across Joshua

Kellen Sunderland created JOSHUA-263: Summary: Standardize logging across Joshua Key: JOSHUA-263 URL: https://issues.apache.org/jira/browse/JOSHUA-263 Project: Joshua Issue Type

[jira] [Assigned] (JOSHUA-260) Integrate IoC (Inversion of Control) into Joshua

[ https://issues.apache.org/jira/browse/JOSHUA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellen Sunderland reassigned JOSHUA-260: Assignee: Kellen Sunderland > Integrate IoC (Inversion of Control) into Jos

Re: ApacheCon Meetup

t; > About logging. Are you proposing to use log4j interface in the code? I > > would recommend to use slf4j [1] > > > > > > [ > > > > On Thu, May 12, 2016 at 2:30 PM, kellen sunderland < > > kellen.sunderl...@gmail.com> wrote: > > > >

Re: ApacheCon Meetup

Thanks for organizing Lewis, Here's some topics for discussion I've been noting while working with Joshua. None of these are high priority issues for me, but if we are all in agreement on them it might make sense to log them. Boring code convention stuff: Logging with log4j, throw Runtime

[jira] [Commented] (JOSHUA-260) Integrate IoC (Inversion of Control) into Joshua

[ https://issues.apache.org/jira/browse/JOSHUA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267687#comment-15267687 ] Kellen Sunderland commented on JOSHUA-260: -- This isn't the kind of change that can be made

[jira] [Commented] (JOSHUA-172) Speed up grammar file reading with memory-mapped files

[ https://issues.apache.org/jira/browse/JOSHUA-172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267193#comment-15267193 ] Kellen Sunderland commented on JOSHUA-172: -- This ticket shouldn't be open should

[jira] [Created] (JOSHUA-259) Integration tests are failing

Kellen Sunderland created JOSHUA-259: Summary: Integration tests are failing Key: JOSHUA-259 URL: https://issues.apache.org/jira/browse/JOSHUA-259 Project: Joshua Issue Type: Bug

Re: [GitHub] incubator-joshua pull request: More work on structuring translatio...

Hey Matt. I'd suggest we hook up the unit test runs in Vancouver (only a week away). They should be runnable with junit. On Apr 28, 2016 9:55 PM, "mjpost" wrote: > Github user mjpost commented on the pull request: > > >

Re: joshua_api

e multiple places where the "output-format" string > has to get edited (KBestExtractor and in Translation). After you push your > changes in, I'm going to make some edits so that this all occurs in one > place. > > matt > > > > On Apr 27, 2016, at 2:25 PM, kellen sund

Re: joshua_api

ntain basically > all of it (apart from the recapitalization fix, which I see should be > applied more selectively, maybe only when a -recapitalize flag is present, > to save on time). > > matt > > > > On Apr 26, 2016, at 1:56 AM, kellen sunderland < > kellen.sunderl...@gmail.c

Re: joshua_api

Hey Matt, Sorry for the late reply. The Joshua-6 folder and tst may have just been artifacts of some symlinks I have locally. Sorry they may have been pushed by mistake, I can clean that up. Good idea to have the api code in a separate branch. We can merge the work that we've done some time

Re: programmatic API usage?

Yes we’re using Joshua as a library and will be sharing some more code soon (hopefully tomorrow) that should help a little for this. I think it might make sense to come up with a simple v0.1 API that we could start using to call Joshua in an interoperable manner. A simple API could look like

Apologies for the late replies

Looks like my emails from amazon.de are getting filtered (are they stuck in a moderation queue?), so sorry for the late replies everyone. First of all thanks to everyone for inviting me as a committer. Great to be working on an interesting project. Some quick background about me: I've been a

Re: ApacheCon 2016 and Joshua

My use case for Joshua involves creating internal scalable web services to translate text across several language arcs. Most of the code changes I (and others on my team) aim to contribute focus on Joshua stability and performance. So far my work has been mostly around speeding up decoding and