[jira] [Commented] (JOSHUA-331) Address Apache Joshua 6.1 RC#3 Issues
[
https://issues.apache.org/jira/browse/JOSHUA-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900200#comment-15900200
]
Hudson commented on JOSHUA-331:
---
SUCCESS: Integrated in Jenkins build joshua_master #195 (See
[https://builds.apache.org/job/joshua_master/195/])
JOSHUA-331 - added IDEA project files to .gitignore (tommaso: rev
f198d664de20df94eb9aa1c4fb33c2a94e9a6d73)
* (edit) .gitignore
> Address Apache Joshua 6.1 RC#3 Issues
> -
>
> Key: JOSHUA-331
> URL: https://issues.apache.org/jira/browse/JOSHUA-331
> Project: Joshua
> Issue Type: Task
> Components: release
>Reporter: Tommaso Teofili
>Assignee: Tommaso Teofili
> Fix For: 6.1
>
>
> Address the following issues:
> {quote}
> Every ASF release MUST contain one or more source packages, which MUST be
> sufficient for a user to build and test the release provided they have
> access to the appropriate platform and tools. - NO
> -Not building due to failing test (BerkleyLM failure). I'm digging a
> bit more into this.
> {quote}
> {quote}
> Every artifact distributed to the public through Apache channels MUST be
> accompanied by one file containing an OpenPGP compatible ASCII armored
> detached signature and another file containing an MD5 checksum.
> - .asc - NO
> I get warning:
> "gpg --verify joshua-incubating-6.1-src.tar.gz.asc
> joshua-incubating-6.1-src.tar.gz
> gpg: Signature made Thu Feb 23 09:15:17 2017 CET using RSA key ID
> 891768A5
> gpg: Good signature from "Tommaso Teofili "
> [unknown]
> gpg: WARNING: This key is not certified with a trusted signature!
> gpg: There is no indication that the signature belongs to the
> owner."
> - .md5 - NO
> My md5 of joshua-incubating-6.1-src.tar.gz is
> 504976876b01294811293aa45b5400f5, the joshua-incubating-6.1-src.tar.gz.md5
> indicates it should be 22b738eeae45757715080702a5bd2789
> - .sha - NO
> My sha of joshua-incubating-6.1-src.tar.gz is
> 4AB5BA24301590F36AE6452DACC3F21CBD8B3FEC, the
> joshua-incubating-6.1-src.tar.gz.md5 indicates it should be
> 2a55b6d341dddc5369b22a4802a86ec40accd0a1
> - KEYS - YES
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (JOSHUA-331) Address Apache Joshua 6.1 RC#3 Issues
[
https://issues.apache.org/jira/browse/JOSHUA-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898018#comment-15898018
]
Hudson commented on JOSHUA-331:
---
SUCCESS: Integrated in Jenkins build joshua_master #192 (See
[https://builds.apache.org/job/joshua_master/192/])
JOSHUA-331 - reverted to 6.1-SNAPSHOT (tommaso: rev
7a3e957497d856609b2d1531a1a2ceba54fb8e7b)
* (edit) pom.xml
> Address Apache Joshua 6.1 RC#3 Issues
> -
>
> Key: JOSHUA-331
> URL: https://issues.apache.org/jira/browse/JOSHUA-331
> Project: Joshua
> Issue Type: Task
> Components: release
>Reporter: Tommaso Teofili
>Assignee: Tommaso Teofili
> Fix For: 6.1
>
>
> Address the following issues:
> {quote}
> Every ASF release MUST contain one or more source packages, which MUST be
> sufficient for a user to build and test the release provided they have
> access to the appropriate platform and tools. - NO
> -Not building due to failing test (BerkleyLM failure). I'm digging a
> bit more into this.
> {quote}
> {quote}
> Every artifact distributed to the public through Apache channels MUST be
> accompanied by one file containing an OpenPGP compatible ASCII armored
> detached signature and another file containing an MD5 checksum.
> - .asc - NO
> I get warning:
> "gpg --verify joshua-incubating-6.1-src.tar.gz.asc
> joshua-incubating-6.1-src.tar.gz
> gpg: Signature made Thu Feb 23 09:15:17 2017 CET using RSA key ID
> 891768A5
> gpg: Good signature from "Tommaso Teofili "
> [unknown]
> gpg: WARNING: This key is not certified with a trusted signature!
> gpg: There is no indication that the signature belongs to the
> owner."
> - .md5 - NO
> My md5 of joshua-incubating-6.1-src.tar.gz is
> 504976876b01294811293aa45b5400f5, the joshua-incubating-6.1-src.tar.gz.md5
> indicates it should be 22b738eeae45757715080702a5bd2789
> - .sha - NO
> My sha of joshua-incubating-6.1-src.tar.gz is
> 4AB5BA24301590F36AE6452DACC3F21CBD8B3FEC, the
> joshua-incubating-6.1-src.tar.gz.md5 indicates it should be
> 2a55b6d341dddc5369b22a4802a86ec40accd0a1
> - KEYS - YES
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (JOSHUA-324) Address Apache Joshua 6.1 RC#2 Issues
[
https://issues.apache.org/jira/browse/JOSHUA-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15873206#comment-15873206
]
Hudson commented on JOSHUA-324:
---
SUCCESS: Integrated in Jenkins build joshua_master #180 (See
[https://builds.apache.org/job/joshua_master/180/])
JOSHUA-324 - added exclude for IDEA files (tommaso: rev
e6cd6adb1678f9c69d4c28c71203811db1b16560)
* (edit) src/main/assembly/src.xml
JOSHUA-324 - added exclude for release files (tommaso: rev
3b51467090cfe57e10265e8d5646e14d906ce30c)
* (edit) src/main/assembly/src.xml
> Address Apache Joshua 6.1 RC#2 Issues
> -
>
> Key: JOSHUA-324
> URL: https://issues.apache.org/jira/browse/JOSHUA-324
> Project: Joshua
> Issue Type: Task
>Affects Versions: 6.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Blocker
> Fix For: 6.1
>
>
> Feedback from [~jmclean] (thank you Justin) on our RC#2 is as follows
> {code}
> ==
> - Your missing incubating in the release artifacts name. [1]
> - There are a number of binary files in the source release that look to be
> compiled source code.
> I checked:
> - name doesn’t include incubating
> - signatures and hashes correct
> - DISCLAIMER exists
> - LICENSE is missing a few things (see below)
> - a source file is missing an Apache header [7]
> - Several unexpected binary files are contained in the source release
> [8][9][10][11]
> - Can compile from source
> License is missing:
> - MIT licensed normalize.css v3.0.3 bundled in [5]
> - glyph icon fonts [6]
> Not an issue but it's a little odd to have LICENSE and NOTICE.txt - usually
> both are bare or both have .txt extension.
> Also while looking at your site I noticed that the download links of you
> incubating site [2] points to github, please change to point to the offical
> release area.
> Also the 6.1 release has already been tagged and it available for public
> download on github [4] before this vote is finished. This is IMO against
> Apache release policy [3] please remove.
> I also notice you recently released the language packs (18th Nov) but there
> doesn’t seem to have been a vote for that? Any reason for this?
> ===
> [1] http://incubator.apache.org/incubation/Incubation_Policy.html#Releases
> [2]
> https://cwiki.apache.org/confluence/display/JOSHUA/Apache+Joshua+%28Incubating%29+Home
> [3] http://www.apache.org/dev/release.html#what
> [4] https://github.com/apache/incubator-joshua/releases
> [5] ./demo/bootstrap/css/bootstrap.min.css
> [6] apache-joshua-6.1/demo/bootstrap/fonts/*
> [7] ./src/test/java/org/apache/joshua/decoder/ff/tm/OwnerMapTest.java
> [8] ./bin/GIZA++
> [9] ./bin/mkcls
> [10 ]./bin/snt2cooc.out
> [11] ,/src/test/resources/berkeley_lm/lm.berkeleylm.gz
> [12] http://www.mail-archive.com/general%40incubator.apache.org/msg57543.html
> [13] http://www.mail-archive.com/general%40incubator.apache.org/msg57551.html
> {code}
> This is a blocking issue and until addressed we cannot release 6.1-incubating
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (JOSHUA-324) Address Apache Joshua 6.1 RC#2 Issues
[
https://issues.apache.org/jira/browse/JOSHUA-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15873135#comment-15873135
]
Hudson commented on JOSHUA-324:
---
SUCCESS: Integrated in Jenkins build joshua_master #179 (See
[https://builds.apache.org/job/joshua_master/179/])
JOSHUA-324 - added missing rat exclude (tommaso: rev
0693aea73a598a976163d793dd0b3af44e67c3ab)
* (edit) pom.xml
> Address Apache Joshua 6.1 RC#2 Issues
> -
>
> Key: JOSHUA-324
> URL: https://issues.apache.org/jira/browse/JOSHUA-324
> Project: Joshua
> Issue Type: Task
>Affects Versions: 6.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Blocker
> Fix For: 6.1
>
>
> Feedback from [~jmclean] (thank you Justin) on our RC#2 is as follows
> {code}
> ==
> - Your missing incubating in the release artifacts name. [1]
> - There are a number of binary files in the source release that look to be
> compiled source code.
> I checked:
> - name doesn’t include incubating
> - signatures and hashes correct
> - DISCLAIMER exists
> - LICENSE is missing a few things (see below)
> - a source file is missing an Apache header [7]
> - Several unexpected binary files are contained in the source release
> [8][9][10][11]
> - Can compile from source
> License is missing:
> - MIT licensed normalize.css v3.0.3 bundled in [5]
> - glyph icon fonts [6]
> Not an issue but it's a little odd to have LICENSE and NOTICE.txt - usually
> both are bare or both have .txt extension.
> Also while looking at your site I noticed that the download links of you
> incubating site [2] points to github, please change to point to the offical
> release area.
> Also the 6.1 release has already been tagged and it available for public
> download on github [4] before this vote is finished. This is IMO against
> Apache release policy [3] please remove.
> I also notice you recently released the language packs (18th Nov) but there
> doesn’t seem to have been a vote for that? Any reason for this?
> ===
> [1] http://incubator.apache.org/incubation/Incubation_Policy.html#Releases
> [2]
> https://cwiki.apache.org/confluence/display/JOSHUA/Apache+Joshua+%28Incubating%29+Home
> [3] http://www.apache.org/dev/release.html#what
> [4] https://github.com/apache/incubator-joshua/releases
> [5] ./demo/bootstrap/css/bootstrap.min.css
> [6] apache-joshua-6.1/demo/bootstrap/fonts/*
> [7] ./src/test/java/org/apache/joshua/decoder/ff/tm/OwnerMapTest.java
> [8] ./bin/GIZA++
> [9] ./bin/mkcls
> [10 ]./bin/snt2cooc.out
> [11] ,/src/test/resources/berkeley_lm/lm.berkeleylm.gz
> [12] http://www.mail-archive.com/general%40incubator.apache.org/msg57543.html
> [13] http://www.mail-archive.com/general%40incubator.apache.org/msg57551.html
> {code}
> This is a blocking issue and until addressed we cannot release 6.1-incubating
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (JOSHUA-324) Address Apache Joshua 6.1 RC#2 Issues
[
https://issues.apache.org/jira/browse/JOSHUA-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827366#comment-15827366
]
Hudson commented on JOSHUA-324:
---
SUCCESS: Integrated in Jenkins build joshua_master #166 (See
[https://builds.apache.org/job/joshua_master/166/])
JOSHUA-324 Address Apache Joshua 6.1 RC#2 Issues (lewis.mcgibbney: rev
ae755a8bc0b1de9475285fcc8d35d8a8b5f00a6f)
* (add) LICENSE.txt
* (edit) CHANGES.md
* (delete) LICENSE
* (edit) src/main/assembly/src.xml
* (edit) doap_joshua.rdf
> Address Apache Joshua 6.1 RC#2 Issues
> -
>
> Key: JOSHUA-324
> URL: https://issues.apache.org/jira/browse/JOSHUA-324
> Project: Joshua
> Issue Type: Task
>Affects Versions: 6.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Blocker
> Fix For: 6.1
>
>
> Feedback from [~jmclean] (thank you Justin) on our RC#2 is as follows
> {code}
> ==
> - Your missing incubating in the release artifacts name. [1]
> - There are a number of binary files in the source release that look to be
> compiled source code.
> I checked:
> - name doesn’t include incubating
> - signatures and hashes correct
> - DISCLAIMER exists
> - LICENSE is missing a few things (see below)
> - a source file is missing an Apache header [7]
> - Several unexpected binary files are contained in the source release
> [8][9][10][11]
> - Can compile from source
> License is missing:
> - MIT licensed normalize.css v3.0.3 bundled in [5]
> - glyph icon fonts [6]
> Not an issue but it's a little odd to have LICENSE and NOTICE.txt - usually
> both are bare or both have .txt extension.
> Also while looking at your site I noticed that the download links of you
> incubating site [2] points to github, please change to point to the offical
> release area.
> Also the 6.1 release has already been tagged and it available for public
> download on github [4] before this vote is finished. This is IMO against
> Apache release policy [3] please remove.
> I also notice you recently released the language packs (18th Nov) but there
> doesn’t seem to have been a vote for that? Any reason for this?
> ===
> [1] http://incubator.apache.org/incubation/Incubation_Policy.html#Releases
> [2]
> https://cwiki.apache.org/confluence/display/JOSHUA/Apache+Joshua+%28Incubating%29+Home
> [3] http://www.apache.org/dev/release.html#what
> [4] https://github.com/apache/incubator-joshua/releases
> [5] ./demo/bootstrap/css/bootstrap.min.css
> [6] apache-joshua-6.1/demo/bootstrap/fonts/*
> [7] ./src/test/java/org/apache/joshua/decoder/ff/tm/OwnerMapTest.java
> [8] ./bin/GIZA++
> [9] ./bin/mkcls
> [10 ]./bin/snt2cooc.out
> [11] ,/src/test/resources/berkeley_lm/lm.berkeleylm.gz
> [12] http://www.mail-archive.com/general%40incubator.apache.org/msg57543.html
> [13] http://www.mail-archive.com/general%40incubator.apache.org/msg57551.html
> {code}
> This is a blocking issue and until addressed we cannot release 6.1-incubating
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (JOSHUA-324) Address Apache Joshua 6.1 RC#2 Issues
[
https://issues.apache.org/jira/browse/JOSHUA-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15766912#comment-15766912
]
Hudson commented on JOSHUA-324:
---
SUCCESS: Integrated in Jenkins build joshua_master #165 (See
[https://builds.apache.org/job/joshua_master/165/])
JOSHUA-324 - added missing incubating suffix (tommaso: rev
5aa5308cd108c60c19b883dade54d810d1e0966e)
* (edit) pom.xml
> Address Apache Joshua 6.1 RC#2 Issues
> -
>
> Key: JOSHUA-324
> URL: https://issues.apache.org/jira/browse/JOSHUA-324
> Project: Joshua
> Issue Type: Task
>Affects Versions: 6.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Blocker
> Fix For: 6.1
>
>
> Feedback from [~jmclean] (thank you Justin) on our RC#2 is as follows
> {code}
> ==
> - Your missing incubating in the release artifacts name. [1]
> - There are a number of binary files in the source release that look to be
> compiled source code.
> I checked:
> - name doesn’t include incubating
> - signatures and hashes correct
> - DISCLAIMER exists
> - LICENSE is missing a few things (see below)
> - a source file is missing an Apache header [7]
> - Several unexpected binary files are contained in the source release
> [8][9][10][11]
> - Can compile from source
> License is missing:
> - MIT licensed normalize.css v3.0.3 bundled in [5]
> - glyph icon fonts [6]
> Not an issue but it's a little odd to have LICENSE and NOTICE.txt - usually
> both are bare or both have .txt extension.
> Also while looking at your site I noticed that the download links of you
> incubating site [2] points to github, please change to point to the offical
> release area.
> Also the 6.1 release has already been tagged and it available for public
> download on github [4] before this vote is finished. This is IMO against
> Apache release policy [3] please remove.
> I also notice you recently released the language packs (18th Nov) but there
> doesn’t seem to have been a vote for that? Any reason for this?
> ===
> [1] http://incubator.apache.org/incubation/Incubation_Policy.html#Releases
> [2]
> https://cwiki.apache.org/confluence/display/JOSHUA/Apache+Joshua+%28Incubating%29+Home
> [3] http://www.apache.org/dev/release.html#what
> [4] https://github.com/apache/incubator-joshua/releases
> [5] ./demo/bootstrap/css/bootstrap.min.css
> [6] apache-joshua-6.1/demo/bootstrap/fonts/*
> [7] ./src/test/java/org/apache/joshua/decoder/ff/tm/OwnerMapTest.java
> [8] ./bin/GIZA++
> [9] ./bin/mkcls
> [10 ]./bin/snt2cooc.out
> [11] ,/src/test/resources/berkeley_lm/lm.berkeleylm.gz
> [12] http://www.mail-archive.com/general%40incubator.apache.org/msg57543.html
> [13] http://www.mail-archive.com/general%40incubator.apache.org/msg57551.html
> {code}
> This is a blocking issue and until addressed we cannot release 6.1-incubating
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (JOSHUA-324) Address Apache Joshua 6.1 RC#2 Issues
[
https://issues.apache.org/jira/browse/JOSHUA-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15708848#comment-15708848
]
Hudson commented on JOSHUA-324:
---
SUCCESS: Integrated in Jenkins build joshua_master #161 (See
[https://builds.apache.org/job/joshua_master/161/])
JOSHUA-324 Included correct license for OwnerMapTest (kellens: rev
142c403c3345a372ed8f7975599fa24d2a81961c)
* (edit) src/test/java/org/apache/joshua/decoder/ff/tm/OwnerMapTest.java
> Address Apache Joshua 6.1 RC#2 Issues
> -
>
> Key: JOSHUA-324
> URL: https://issues.apache.org/jira/browse/JOSHUA-324
> Project: Joshua
> Issue Type: Task
>Affects Versions: 6.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Blocker
> Fix For: 6.1
>
>
> Feedback from [~jmclean] (thank you Justin) on our RC#2 is as follows
> {code}
> ==
> - Your missing incubating in the release artifacts name. [1]
> - There are a number of binary files in the source release that look to be
> compiled source code.
> I checked:
> - name doesn’t include incubating
> - signatures and hashes correct
> - DISCLAIMER exists
> - LICENSE is missing a few things (see below)
> - a source file is missing an Apache header [7]
> - Several unexpected binary files are contained in the source release
> [8][9][10][11]
> - Can compile from source
> License is missing:
> - MIT licensed normalize.css v3.0.3 bundled in [5]
> - glyph icon fonts [6]
> Not an issue but it's a little odd to have LICENSE and NOTICE.txt - usually
> both are bare or both have .txt extension.
> Also while looking at your site I noticed that the download links of you
> incubating site [2] points to github, please change to point to the offical
> release area.
> Also the 6.1 release has already been tagged and it available for public
> download on github [4] before this vote is finished. This is IMO against
> Apache release policy [3] please remove.
> I also notice you recently released the language packs (18th Nov) but there
> doesn’t seem to have been a vote for that? Any reason for this?
> ===
> [1] http://incubator.apache.org/incubation/Incubation_Policy.html#Releases
> [2]
> https://cwiki.apache.org/confluence/display/JOSHUA/Apache+Joshua+%28Incubating%29+Home
> [3] http://www.apache.org/dev/release.html#what
> [4] https://github.com/apache/incubator-joshua/releases
> [5] ./demo/bootstrap/css/bootstrap.min.css
> [6] apache-joshua-6.1/demo/bootstrap/fonts/*
> [7] ./src/test/java/org/apache/joshua/decoder/ff/tm/OwnerMapTest.java
> [8] ./bin/GIZA++
> [9] ./bin/mkcls
> [10 ]./bin/snt2cooc.out
> [11] ,/src/test/resources/berkeley_lm/lm.berkeleylm.gz
> [12] http://www.mail-archive.com/general%40incubator.apache.org/msg57543.html
> [13] http://www.mail-archive.com/general%40incubator.apache.org/msg57551.html
> {code}
> This is a blocking issue and until addressed we cannot release 6.1-incubating
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (JOSHUA-316) run_bundler.py returning JOB FAILED (return code 1) TypeError: memoryview: a bytes-like object is required, not 'str'
[
https://issues.apache.org/jira/browse/JOSHUA-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687466#comment-15687466
]
Hudson commented on JOSHUA-316:
---
SUCCESS: Integrated in Jenkins build joshua_master #155 (See
[https://builds.apache.org/job/joshua_master/155/])
JOSHUA-316 run_bundler.py returning JOB FAILED (return code 1)
(lewis.mcgibbney: rev d137f2970d1eace1dcec576d287712cd5b88)
* (edit) scripts/support/run_bundler.py
* (edit) scripts/language-pack/README.template
> run_bundler.py returning JOB FAILED (return code 1) TypeError: memoryview: a
> bytes-like object is required, not 'str'
> -
>
> Key: JOSHUA-316
> URL: https://issues.apache.org/jira/browse/JOSHUA-316
> Project: Joshua
> Issue Type: Bug
> Components: bundler
>Affects Versions: 6.0.5
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Critical
> Fix For: 6.2
>
>
> {code}
> [glue-tune] rebuilding...
>
> dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_0.source
> [CHANGED]
>
> dep=/usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
> [NOT FOUND]
> cmd=/usr/local/incubator-joshua/scripts/support/create_glue_grammar.sh
> /usr/local/joshua_resources/russian_experiments/exp2/grammar.packed >
> /usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
> took 1 seconds (1s)
> [tune-bundle] rebuilding...
>
> dep=/usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config
> [CHANGED]
>
> dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_0.source
> [CHANGED]
>
> dep=/usr/local/joshua_resources/russian_experiments/exp2/tune/model/run-joshua.sh
> [NOT FOUND]
> cmd=/usr/local/incubator-joshua/scripts/support/run_bundler.py --force
> --symlink --absolute --verbose -T /usr/local/hadoop-2.5.2/hadoop_tmp_dir
> /usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config
> /usr/local/joshua_resources/russian_experiments/exp2/tune/model
> --copy-config-options '-top-n 300 -output-format "%i ||| %s ||| %f ||| %c"
> -mark-oovs false -search cky -weights "lm_0 1 tm_pt_0 1 tm_pt_1 1 tm_pt_2 1
> tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 " -feature-function
> "StateMinimizingLanguageModel -lm_order 5 -lm_file
> /usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm" -tm0/type
> hiero -tm0/owner pt -tm0/maxspan 20 -tm1/owner glue' --pack-tm
> /usr/local/joshua_resources/russian_experiments/exp2/grammar.packed --tm
> /usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
> JOB FAILED (return code 1)
> * Running the copy-config.pl script with the command:
> /usr/local/incubator-joshua/scripts/copy-config.pl -top-n 300 -output-format
> "%i ||| %s ||| %f ||| %c" -mark-oovs false -search cky -weights "lm_0 1
> tm_pt_0 1 tm_pt_1 1 tm_pt_2 1 tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 "
> -feature-function "StateMinimizingLanguageModel -lm_order 5 -lm_file
> /usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm" -tm0/type
> hiero -tm0/owner pt -tm0/maxspan 20 -tm1/owner glue
> Traceback (most recent call last):
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 748, in main
> operations = collect_operations(opts)
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 637, in collect_operations
> opts.copy_config_options
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 202, in filter_through_copy_config_script
> result, err = p.communicate(config_text)
> File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1072,
> in communicate
> stdout, stderr = self._communicate(input, endtime, timeout)
> File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1700,
> in _communicate
> input_view = memoryview(self._input)
> TypeError: memoryview: a bytes-like object is required, not 'str'
> During handling of the above exception, another exception occurred:
> Traceback (most recent call last):
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 760, in
> main(sys.argv)
> File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line
> 751, in main
> error_quit(e.message)
> AttributeError: 'TypeError' object has no attribute 'message'
> * WARNING: no key 'outputformat' found in config file (appending to end)
> * WARNING: no key 'search' found in config file (appending to end)
> * WARNING: no key 'topn' found in config file (appending to end)
> * WARNING: no key 'markoovs' found in config file (appending to end)
> {code}
--
This message was sent by Atlassian JIRA
[jira] [Commented] (JOSHUA-317) SyntaxError: invalid syntax scripts/training/run_tuner.py", line 391
[
https://issues.apache.org/jira/browse/JOSHUA-317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687467#comment-15687467
]
Hudson commented on JOSHUA-317:
---
SUCCESS: Integrated in Jenkins build joshua_master #155 (See
[https://builds.apache.org/job/joshua_master/155/])
JOSHUA-317 - SyntaxError: invalid syntax scripts/training/run_tuner.py
(lewis.mcgibbney: rev 000298e555fbc71315b1d8719f5c3918a2102e5b)
* (edit) scripts/training/run_tuner.py
* (edit) scripts/support/run_bundler.py
> SyntaxError: invalid syntax scripts/training/run_tuner.py", line 391
>
>
> Key: JOSHUA-317
> URL: https://issues.apache.org/jira/browse/JOSHUA-317
> Project: Joshua
> Issue Type: Bug
> Components: tuner
>Affects Versions: 6.0.5
> Environment: Python 3.5
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 6.2
>
>
> {code}
> [tune-bundle] rebuilding...
>
> dep=/usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config
> [CHANGED]
>
> dep=/usr/local/joshua_resources/russian_experiments/exp3/grammar.packed/slice_0.source
> [CHANGED]
>
> dep=/usr/local/joshua_resources/russian_experiments/exp3/tune/model/run-joshua.sh
> [NOT FOUND]
> cmd=/usr/local/incubator-joshua/scripts/support/run_bundler.py --force
> --symlink --absolute --verbose -T /usr/local/hadoop-2.5.2/hadoop_tmp_dir
> /usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config
> /usr/local/joshua_resources/russian_experiments/exp3/tune/model
> --copy-config-options '-top-n 300 -output-format "%i ||| %s ||| %f ||| %c"
> -mark-oovs false -search cky -weights "lm_0 1 tm_pt_0 1 tm_pt_1 1 tm_pt_2 1
> tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 " -feature-function
> "StateMinimizingLanguageModel -lm_order 5 -lm_file
> /usr/local/joshua_resources/russian_experiments/exp3/lm.kenlm" -tm0/type
> hiero -tm0/owner pt -tm0/maxspan 20 -tm1/owner glue' --pack-tm
> /usr/local/joshua_resources/russian_experiments/exp3/grammar.packed --tm
> /usr/local/joshua_resources/russian_experiments/exp3/data/tune/grammar.glue
> took 0 seconds (0s)
> [mert-1] rebuilding...
>
> dep=/usr/local/joshua_resources/russian_experiments/exp3/data/tune/corpus.en
> [CHANGED]
> dep=/usr/local/joshua_resources/russian_experiments/exp3/tune/joshua.config
> [CHANGED]
> dep=tune/model/grammar.packed/slice_0.source [CHANGED]
>
> dep=/usr/local/joshua_resources/russian_experiments/exp3/tune/joshua.config.final
> [NOT FOUND]
> cmd=/usr/local/incubator-joshua/scripts/training/run_tuner.py
> /usr/local/joshua_resources/russian_experiments/exp3/data/tune/corpus.en
> /usr/local/joshua_resources/russian_experiments/exp3/data/tune/corpus.ru
> --tunedir /usr/local/joshua_resources/russian_experiments/exp3/tune --tuner
> mert --decoder
> /usr/local/joshua_resources/russian_experiments/exp3/tune/decoder_command
> --decoder-config
> /usr/local/joshua_resources/russian_experiments/exp3/tune/joshua.config
> --decoder-output-file
> /usr/local/joshua_resources/russian_experiments/exp3/tune/output.nbest
> --decoder-log-file
> /usr/local/joshua_resources/russian_experiments/exp3/tune/joshua.log
> --iterations 10 --metric 'BLEU 4 closest'
> JOB FAILED (return code 1)
> File "/usr/local/incubator-joshua/scripts/training/run_tuner.py", line 391
> 'ITERATIONS': `iterations`,
> ^
> SyntaxError: invalid syntax
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (JOSHUA-323) Joshua 6.1 Release Management
[ https://issues.apache.org/jira/browse/JOSHUA-323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657871#comment-15657871 ] Hudson commented on JOSHUA-323: --- SUCCESS: Integrated in Jenkins build joshua_master #145 (See [https://builds.apache.org/job/joshua_master/145/]) JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev 51027e1dabae62ea5823f0cc64631c0f307317a8) * (edit) pom.xml * (add) src/main/assembly/src.xml > Joshua 6.1 Release Management > - > > Key: JOSHUA-323 > URL: https://issues.apache.org/jira/browse/JOSHUA-323 > Project: Joshua > Issue Type: Task > Components: build, release >Reporter: Lewis John McGibbney >Assignee: Lewis John McGibbney >Priority: Blocker > Fix For: 6.1 > > > This is a governing ticket for reference more than anything else. We need to > add all release specific build additions to parent pom.xml which enable us to > roll a release candidate. > The process is also being documented over at > https://cwiki.apache.org/confluence/display/JOSHUA/Joshua+Release+Management+Procedure -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-323) Joshua 6.1 Release Management
[ https://issues.apache.org/jira/browse/JOSHUA-323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656815#comment-15656815 ] Hudson commented on JOSHUA-323: --- SUCCESS: Integrated in Jenkins build joshua_master #143 (See [https://builds.apache.org/job/joshua_master/143/]) JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev f45c3fd39ae74604a40046a97b98bb3154ca5ba7) * (add) NOTICE.txt * (add) KEYS * (delete) CHANGELOG * (add) CHANGES.md * (edit) README.md JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev 7f2ef263cbaee94ba82cff4e8145a288180a3afa) * (edit) pom.xml * (add) doap_joshua.rdf JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev 10bfa31993a8859adc06b200fa173fb5f18e7919) * (edit) pom.xml JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev c733f45a020034bd05318a8dd31ff4d84aebe19a) * (edit) pom.xml JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev c2c59d8435ebb8d7d5dd8191ff2dec24352a4838) * (edit) pom.xml * (edit) .gitignore JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev eb994e311a0c7593ad1899df6153b65585760cc8) * (edit) download-deps.sh * (edit) LICENSE * (edit) distribution/docker/ar-en-phrase/Dockerfile * (edit) demo/scripts/joshua.sh * (edit) src/main/java/org/apache/joshua/decoder/LanguageModelStateManager.java * (edit) demo/bootstrap/js/npm.js * (edit) demo/scripts/web_server.py * (edit) demo/index.html * (edit) distribution/docker/zh-en-hiero/Dockerfile * (edit) src/main/java/org/apache/joshua/decoder/LmPool.java * (edit) demo/demo.js * (edit) demo/demo.config * (edit) pom.xml JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev 4d3e86b2758517eebefe98d9a32c8d7463116ba6) * (edit) scripts/distributedLM/get_grammar_eng_voc.pl * (edit) scripts/preparation/tokenize.pl * (edit) scripts/distributedLM/get_grammar_eng_voc_from_cn_voc.pl * (edit) scripts/preparation/lowercase.pl * (edit) scripts/training/run-giza.pl * (edit) scripts/training/add-OOVs.pl * (edit) scripts/support/moses2joshua.pl * (edit) scripts/support/bbn2plf.pl * (edit) scripts/distributedLM/filter_lm.pl * (edit) scripts/support/score-hypothesis.pl * (edit) scripts/distributedLM/config.template * (edit) scripts/analysis/tree_visualizer * (edit) scripts/training/pipeline.pl * (edit) scripts/distributedLM/create_remote_sym_tbl.pl * (edit) scripts/support/moses2joshua_grammar.pl * (edit) scripts/support/grammar-packer.pl * (edit) scripts/training/get_grammar_features.pl * (edit) scripts/preparation/detokenize.pl * (edit) scripts/training/filter-rules.pl * (edit) scripts/training/unmap-html.pl * (edit) scripts/preparation/normalize.pl * (edit) scripts/training/build-vocab.pl * (edit) scripts/training/summarize.pl * (edit) scripts/training/paralign.pl * (edit) scripts/training/trim_parallel_corpus.pl * (edit) scripts/training/lowercase-leaves.pl * (edit) scripts/training/filter-empty-lines.pl * (edit) scripts/analysis/sentence-by-sentence.pl * (edit) scripts/copy-config.pl JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev 8c21101c48bcefe302ec7422c6c737b73a0bceed) * (edit) scripts/training/templates/hadoop/hdfs-site.xml * (edit) scripts/training/templates/thrax-hiero.conf * (edit) scripts/training/templates/thrax-phrase-gt.conf * (edit) scripts/training/templates/thrax-phrase.conf * (edit) pom.xml * (edit) scripts/training/templates/hadoop/core-site.xml * (edit) scripts/training/templates/hadoop/mapred-site.xml * (edit) scripts/training/templates/thrax-phrasal.conf * (edit) scripts/training/templates/thrax-samt.conf JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev fe482e9aac23986e22cd59bdbf85f88626238b70) * (edit) scripts/training/templates/tune/joshua.config * (edit) scripts/language-pack/build_lp.sh * (edit) scripts/support/phrase2hiero.py * (edit) scripts/training/parallelize/sentclient.c * (edit) scripts/support/split2files * (edit) scripts/training/cachepipe/CachePipe.pm * (edit) scripts/training/mira/feature_label_munger.pl * (edit) pom.xml * (edit) scripts/misc/iso639 * (edit) scripts/support/extract-1best * (edit) scripts/training/parallelize/parallelize.pl * (edit) scripts/training/parallelize/sentserver.c * (edit) scripts/training/parallelize/sentserver.h * (edit) scripts/ems/config.hiero * (edit) scripts/training/mira/run-mira.pl * (edit) scripts/training/templates/alignment/word-align.conf * (edit) scripts/training/parallelize/Makefile * (edit) scripts/ems/config.phrase * (edit) scripts/ems/experiment.meta * (edit) scripts/training/paste * (edit) scripts/training/parallelize/LocalConfig.pm * (edit) scripts/ems/config.ghkm * (edit) scripts/misc/canonical_path * (edit) scripts/training/scat * (edit) scripts/training/cachepipe/bashrc JOSHUA-323 Joshua 6.1 Release Management (lewis.mcgibbney: rev 7e35e484688f43238474be96f803e5a315f47927) * (edit) pom.xml > Joshua 6.1 Release Management > - > > Key:
[jira] [Commented] (JOSHUA-322) extract-1best script references non-existent execution paths
[ https://issues.apache.org/jira/browse/JOSHUA-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15652479#comment-15652479 ] Hudson commented on JOSHUA-322: --- SUCCESS: Integrated in Jenkins build joshua_master #142 (See [https://builds.apache.org/job/joshua_master/142/]) JOSHUA-322 extract-1best script references non-existent execution paths (lewis.mcgibbney: rev bc50c94ebf657314e09d880ae0bb297bf9e205fc) * (edit) bin/extract-1best Fix path in JOSHUA-322 (lewis.mcgibbney: rev fab09632776f37f94827195b73e84318c4151c81) * (edit) bin/extract-1best > extract-1best script references non-existent execution paths > > > Key: JOSHUA-322 > URL: https://issues.apache.org/jira/browse/JOSHUA-322 > Project: Joshua > Issue Type: Bug >Affects Versions: 6.0.5 >Reporter: Lewis John McGibbney >Assignee: Lewis John McGibbney >Priority: Trivial > Fix For: 6.1 > > > The extract-1best script has simply not been updated to accommodate the > Mavenization of the Joshua codebase (woops!!!), this issue will fix that. > https://github.com/apache/incubator-joshua/blob/master/bin/extract-1best -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-321) Add JOSHUA env to ./bin/bleu and ./bin/extract-1best bash scripts
[ https://issues.apache.org/jira/browse/JOSHUA-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15652478#comment-15652478 ] Hudson commented on JOSHUA-321: --- SUCCESS: Integrated in Jenkins build joshua_master #142 (See [https://builds.apache.org/job/joshua_master/142/]) JOSHUA-321 Add JOSHUA env to ./bin/bleu and ./bin/extract-1best bash (lewis.mcgibbney: rev 2f3e752969a2bacc17aa029595c9a56b93331e9e) * (edit) bin/extract-1best * (edit) bin/bleu > Add JOSHUA env to ./bin/bleu and ./bin/extract-1best bash scripts > - > > Key: JOSHUA-321 > URL: https://issues.apache.org/jira/browse/JOSHUA-321 > Project: Joshua > Issue Type: Bug >Affects Versions: 6.0.5 >Reporter: Lewis John McGibbney >Assignee: Lewis John McGibbney >Priority: Trivial > Fix For: 6.1 > > > Right now both bleu and extract-1best do not have the required $JOSHUA env > variable which will result in an error if it is not set within the users > environment. This currently breaks the Homebrew install amongst other things > so we should add it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-299) Move regression tests to proper unit tests
[ https://issues.apache.org/jira/browse/JOSHUA-299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529664#comment-15529664 ] Hudson commented on JOSHUA-299: --- FAILURE: Integrated in Jenkins build joshua_master #122 (See [https://builds.apache.org/job/joshua_master/122/]) JOSHUA-299 Move regression tests to proper unit tests (lewis.mcgibbney: rev 5dd80a37217f4f61ca00aedd256947a412e13771) * (delete) src/test/java/org/apache/joshua/packed/test.sh * (add) src/test/java/org/apache/joshua/decoder/package-info.java * (edit) pom.xml * (add) src/test/java/org/apache/joshua/decoder/TestTranslation.java * (delete) src/test/java/org/apache/joshua/packed/VocabTest.java * (edit) src/main/java/org/apache/joshua/decoder/segment_file/Sentence.java * (edit) src/test/resources/decoder/moses-compat/output.expected * (edit) src/main/java/org/apache/joshua/decoder/Translation.java > Move regression tests to proper unit tests > -- > > Key: JOSHUA-299 > URL: https://issues.apache.org/jira/browse/JOSHUA-299 > Project: Joshua > Issue Type: Bug >Reporter: Matt Post >Assignee: Lewis John McGibbney > Fix For: 6.1 > > Time Spent: 2m > Remaining Estimate: 0h > > Many of the regression tests (test*.sh under src/test/resources) have been > moved to proper unit tests, but this move should be completed, and the > regression tests should be deleted. This should be done for 6.1 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-291) Improve code quality via static analysis
[ https://issues.apache.org/jira/browse/JOSHUA-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529058#comment-15529058 ] Hudson commented on JOSHUA-291: --- SUCCESS: Integrated in Jenkins build joshua_master #121 (See [https://builds.apache.org/job/joshua_master/121/]) JOSHUA-291 - minor fixes to AdaGradCore (tommaso: rev 402b08a8715b9121ca15b1732310e66a01926e50) * (edit) src/main/java/org/apache/joshua/adagrad/AdaGradCore.java > Improve code quality via static analysis > > > Key: JOSHUA-291 > URL: https://issues.apache.org/jira/browse/JOSHUA-291 > Project: Joshua > Issue Type: Improvement > Components: core >Reporter: Tommaso Teofili >Assignee: Tommaso Teofili > Fix For: 6.1 > > > We can improve code quality / readability leveraging code analysis from tools > like FindBugs and others integrated in IDEs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-301) Add findbugs plugin to maven build
[ https://issues.apache.org/jira/browse/JOSHUA-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432060#comment-15432060 ] Hudson commented on JOSHUA-301: --- FAILURE: Integrated in Jenkins build joshua_master #94 (See [https://builds.apache.org/job/joshua_master/94/]) JOSHUA-301 - Add findbugs plugin. (max: rev d235f9b09ec41698c6d9784dcc05926ee55a03a1) * (edit) pom.xml > Add findbugs plugin to maven build > -- > > Key: JOSHUA-301 > URL: https://issues.apache.org/jira/browse/JOSHUA-301 > Project: Joshua > Issue Type: Sub-task > Components: build >Reporter: Max Thomas >Priority: Minor > Fix For: 6.1 > > > Add the findbugs maven plugin to the build. This will allow the build to > report on issues found via the popular Findbugs static analysis tool. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-291) Improve code quality via static analysis
[ https://issues.apache.org/jira/browse/JOSHUA-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426112#comment-15426112 ] Hudson commented on JOSHUA-291: --- SUCCESS: Integrated in Jenkins build joshua_master #92 (See [https://builds.apache.org/job/joshua_master/92/]) JOSHUA-291 - static analysis based code improvements on adagrad package (tommaso: rev 233818d6ce526f3a77b33110d67314b723371743) * (edit) src/main/java/org/apache/joshua/adagrad/Optimizer.java * (edit) src/main/java/org/apache/joshua/adagrad/AdaGradCore.java JOSHUA-291 - static analysis based code improvements on corpus package (tommaso: rev 356b173d4fa3f0efa4ea53809e46c9e04c8c1ca5) * (edit) src/main/java/org/apache/joshua/corpus/SymbolTable.java * (edit) src/main/java/org/apache/joshua/corpus/Span.java * (edit) src/main/java/org/apache/joshua/corpus/Phrase.java * (edit) src/main/java/org/apache/joshua/corpus/ContiguousPhrase.java * (edit) src/main/java/org/apache/joshua/corpus/Vocabulary.java * (edit) src/main/java/org/apache/joshua/corpus/syntax/ArraySyntaxTree.java * (edit) src/main/java/org/apache/joshua/corpus/syntax/SyntaxTree.java * (edit) src/main/java/org/apache/joshua/corpus/BasicPhrase.java JOSHUA-291 - static analysis based code improvements on decoder package (tommaso: rev 029cbbcc156d4939ebe503cc58962ab24728f653) * (edit) src/main/java/org/apache/joshua/decoder/ff/SourceDependentFF.java * (edit) src/main/java/org/apache/joshua/decoder/hypergraph/OutputStringExtractor.java * (edit) src/main/java/org/apache/joshua/decoder/ff/lm/bloomfilter_lm/BloomFilterLanguageModel.java * (edit) src/main/java/org/apache/joshua/decoder/phrase/Coverage.java * (edit) src/main/java/org/apache/joshua/decoder/ff/tm/hash_based/ExtensionIterator.java * (edit) src/main/java/org/apache/joshua/decoder/ff/tm/CreateGlueGrammar.java * (edit) src/main/java/org/apache/joshua/decoder/ff/tm/GrammarReader.java * (edit) src/main/java/org/apache/joshua/decoder/Decoder.java * (edit) src/main/java/org/apache/joshua/decoder/ff/tm/format/MosesFormatReader.java * (edit) src/main/java/org/apache/joshua/decoder/phrase/Hypothesis.java * (edit) src/main/java/org/apache/joshua/decoder/phrase/PhraseChart.java * (edit) src/main/java/org/apache/joshua/decoder/ArgsParser.java * (edit) src/main/java/org/apache/joshua/decoder/BLEU.java * (edit) src/main/java/org/apache/joshua/decoder/ff/lm/bloomfilter_lm/BloomFilter.java * (edit) src/main/java/org/apache/joshua/decoder/chart_parser/ComputeNodeResult.java * (edit) src/main/java/org/apache/joshua/decoder/ff/fragmentlm/Trees.java * (edit) src/main/java/org/apache/joshua/decoder/phrase/Header.java * (edit) src/main/java/org/apache/joshua/decoder/ff/fragmentlm/FragmentLMFF.java * (edit) src/main/java/org/apache/joshua/decoder/Translation.java * (edit) src/main/java/org/apache/joshua/decoder/ff/LexicalFeatures.java * (edit) src/main/java/org/apache/joshua/decoder/StructuredTranslation.java * (edit) src/main/java/org/apache/joshua/decoder/JoshuaConfiguration.java * (edit) src/main/java/org/apache/joshua/decoder/hypergraph/ViterbiExtractor.java * (edit) src/main/java/org/apache/joshua/decoder/chart_parser/Chart.java * (edit) src/main/java/org/apache/joshua/decoder/phrase/PhraseTable.java * (edit) src/main/java/org/apache/joshua/decoder/ff/TargetBigram.java * (edit) src/main/java/org/apache/joshua/decoder/phrase/Candidate.java * (edit) src/main/java/org/apache/joshua/decoder/phrase/Stacks.java * (edit) src/main/java/org/apache/joshua/decoder/ff/SourcePathFF.java * (edit) src/main/java/org/apache/joshua/decoder/ff/lm/buildin_lm/TrieLM.java * (edit) src/main/java/org/apache/joshua/decoder/ff/FeatureVector.java * (edit) src/main/java/org/apache/joshua/decoder/ff/LabelCombinationFF.java * (edit) src/main/java/org/apache/joshua/decoder/ff/RuleShape.java * (edit) src/main/java/org/apache/joshua/decoder/ff/tm/OwnerMap.java * (edit) src/main/java/org/apache/joshua/decoder/ff/tm/Rule.java * (edit) src/main/java/org/apache/joshua/decoder/ff/lm/KenLM.java * (edit) src/main/java/org/apache/joshua/decoder/ff/PhraseModel.java * (edit) src/main/java/org/apache/joshua/decoder/ff/phrase/Distortion.java * (edit) src/main/java/org/apache/joshua/decoder/segment_file/Sentence.java * (edit) src/main/java/org/apache/joshua/decoder/NbestMinRiskReranker.java * (edit) src/main/java/org/apache/joshua/decoder/ff/fragmentlm/Tree.java * (edit) src/main/java/org/apache/joshua/decoder/ff/tm/AbstractGrammar.java * (edit) src/main/java/org/apache/joshua/decoder/ff/tm/hash_based/MemoryBasedBatchGrammar.java * (edit) src/main/java/org/apache/joshua/decoder/ff/tm/SentenceFilteredGrammar.java * (edit) src/main/java/org/apache/joshua/decoder/DecoderThread.java * (edit) src/main/java/org/apache/joshua/decoder/ff/lm/LanguageModelFF.java * (edit) src/main/java/org/apache/joshua/decoder/io/JSONMessage.java * (edit) src/main/java/org/apache/joshua/decoder/chart_parser/Cell.java * (edit)
[jira] [Commented] (JOSHUA-301) Add findbugs plugin to maven build
[ https://issues.apache.org/jira/browse/JOSHUA-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425750#comment-15425750 ] Hudson commented on JOSHUA-301: --- SUCCESS: Integrated in Jenkins build joshua_master #91 (See [https://builds.apache.org/job/joshua_master/91/]) JOSHUA-301 - Add findbugs plugin. (max: rev dccb48bcc0ab76faaa3b9f3e58823b5fa66ea983) * (edit) pom.xml > Add findbugs plugin to maven build > -- > > Key: JOSHUA-301 > URL: https://issues.apache.org/jira/browse/JOSHUA-301 > Project: Joshua > Issue Type: Sub-task > Components: build >Reporter: Max Thomas >Priority: Minor > > Add the findbugs maven plugin to the build. This will allow the build to > report on issues found via the popular Findbugs static analysis tool. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-302) Remove concurrent package and replace with builtins
[ https://issues.apache.org/jira/browse/JOSHUA-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425203#comment-15425203 ] Hudson commented on JOSHUA-302: --- SUCCESS: Integrated in Jenkins build joshua_master #90 (See [https://builds.apache.org/job/joshua_master/90/]) JOSHUA-302 - Remove dependency on concurrent/concurrent package; replace (max: rev 19fe7561aa516b1a7eba63473e8d26111a708c33) * (edit) src/main/java/org/apache/joshua/adagrad/AdaGradCore.java * (edit) pom.xml * (edit) src/main/java/org/apache/joshua/pro/PROCore.java > Remove concurrent package and replace with builtins > --- > > Key: JOSHUA-302 > URL: https://issues.apache.org/jira/browse/JOSHUA-302 > Project: Joshua > Issue Type: Improvement >Reporter: Max Thomas >Priority: Minor > > According to this site: > http://gee.cs.oswego.edu/dl/classes/EDU/oswego/cs/dl/util/concurrent/intro.html > this package is essentially replaced by SDK builtins from JDK5.0+. > Is there a reason this is still a dependency and cannot be replaced with > default library code (which, according to the site, "includes improved, more > efficient, standardized versions of the main components in this package")? > It seems to only be used in 2 places, one of which is about 3000 lines of > copy/pasted code. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-294) Remove CommandLineParser class
[ https://issues.apache.org/jira/browse/JOSHUA-294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420082#comment-15420082 ] Hudson commented on JOSHUA-294: --- SUCCESS: Integrated in joshua_master #88 (See [https://builds.apache.org/job/joshua_master/88/]) JOSHUA-294 - Remove CommandLineParser class, which was untested and (max: rev fcaf0bf8e4ad487ee26c5276ddbecd0ef323eed7) * src/main/java/org/apache/joshua/util/CommandLineParser.java > Remove CommandLineParser class > -- > > Key: JOSHUA-294 > URL: https://issues.apache.org/jira/browse/JOSHUA-294 > Project: Joshua > Issue Type: Improvement >Reporter: Max Thomas >Priority: Trivial > Original Estimate: 5m > Remaining Estimate: 5m > > The CommandLineParser class is a couple hundred of lines of untested code, > with inner classes, that is never called anywhere else in the project. > Perhaps it should be removed, especially given its similarity to ArgsParser > in the decoder package. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-287) KenLM.java catches UnsatisfiedLinkError when attempting to load libken.so (libken.dylib on OSX)
[
https://issues.apache.org/jira/browse/JOSHUA-287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399809#comment-15399809
]
Hudson commented on JOSHUA-287:
---
SUCCESS: Integrated in joshua_master #84 (See
[https://builds.apache.org/job/joshua_master/84/])
JOSHUA-287 Refactored unit tests to all use TestNG, removed no longer (kellens:
rev 94e863b810f5caebdaf92f89f1fe723d6f58dc9c)
* src/test/java/org/apache/joshua/decoder/ff/lm/ArpaFileTest.java
* src/test/java/org/apache/joshua/decoder/ff/lm/LanguageModelFFTest.java
* src/test/java/org/apache/joshua/lattice/ArcTest.java
* src/main/java/org/apache/joshua/decoder/ff/lm/KenLM.java
* resources/kenlm/oilers.kenlm
*
src/main/java/org/apache/joshua/decoder/ff/lm/StateMinimizingLanguageModel.java
* src/test/java/org/apache/joshua/decoder/io/TranslationRequestTest.java
* src/test/java/org/apache/joshua/corpus/CorpusArrayTest.java
*
src/test/java/org/apache/joshua/decoder/phrase/constrained/ConstrainedPhraseDecodingTest.java
*
src/test/java/org/apache/joshua/decoder/ff/lm/class_lm/ClassBasedLanguageModelTest.java
* src/test/java/org/apache/joshua/corpus/vocab/VocabularyTest.java
*
src/test/java/org/apache/joshua/decoder/ff/lm/berkeley_lm/LMGrammarBerkeleyTest.java
* src/test/java/org/apache/joshua/decoder/TranslationsTest.java
* src/test/java/org/apache/joshua/decoder/phrase/decode/PhraseDecodingTest.java
* src/test/java/org/apache/joshua/util/FormatUtilsTest.java
* src/test/java/org/apache/joshua/corpus/SpanTest.java
* src/test/java/org/apache/joshua/decoder/ff/ArityPhrasePenaltyFFTest.java
* pom.xml
* src/test/java/org/apache/joshua/system/AlignmentMapTest.java
* src/test/java/org/apache/joshua/decoder/JoshuaDecoderTest.java
* src/test/java/org/apache/joshua/system/MultithreadedTranslationTests.java
* src/test/java/org/apache/joshua/decoder/io/TranslationRequestStreamTest.java
* src/test/java/org/apache/joshua/decoder/phrase/CoverageTest.java
*
src/test/java/org/apache/joshua/decoder/kbest_extraction/KBestExtractionTest.java
* src/test/java/org/apache/joshua/system/KenLmTest.java
* src/test/java/org/apache/joshua/corpus/VocabularyTest.java
* src/test/java/org/apache/joshua/decoder/TestConfigFileCreater.java
* src/test/java/org/apache/joshua/decoder/ArtificialGrammarAndCorpusCreater.java
* src/test/java/org/apache/joshua/decoder/DecoderThreadTest.java
* src/test/java/org/apache/joshua/util/io/KenLmTestUtil.java
* src/test/java/org/apache/joshua/system/StructuredTranslationTest.java
* src/test/java/org/apache/joshua/system/StructuredOutputTest.java
> KenLM.java catches UnsatisfiedLinkError when attempting to load libken.so
> (libken.dylib on OSX)
> ---
>
> Key: JOSHUA-287
> URL: https://issues.apache.org/jira/browse/JOSHUA-287
> Project: Joshua
> Issue Type: Bug
> Components: core, kenlm
>Affects Versions: 6.0.5
>Reporter: Lewis John McGibbney
> Fix For: 6.1
>
>
> As explained in
> http://www.mail-archive.com/dev%40joshua.incubator.apache.org/msg01189.html
> currently we have an issue, where, when checked out from master the following
> RuntimeException is thrown.
> {code}
> ---
> T E S T S
> ---
> Running TestSuite
> WARN - sentence 0 too long 401, truncating to length 200
> WARN - sentence 0 too long 401, truncating to length 200
> WARN - sentence 0 too long 401, truncating to length 200
> WARN - sentence 0 too long 401, truncating to length 200
> tm_pt_0=-2.000 tm_glue_0=3.000 lm_0=-206.718 lm_0_oov=2.000
> OOVPenalty=-200.000 | -198.000
> ERROR - * FATAL: Can't find libken.so (libken.dylib on OS X) in $JOSHUA/lib
> ERROR - *This probably means that the KenLM library didn't compile.
> ERROR - *Make sure that BOOST_ROOT is set to the root of your boost
> ERROR - *installation (it's not /opt/local/, the default), change to
> ERROR - *$JOSHUA, and type 'ant kenlm'. If problems persist, see the
> ERROR - *website (joshua-decoder.org).
> WARN - no grammars supplied! Supplying dummy glue grammar.
> WARN - no grammars supplied! Supplying dummy glue grammar.
> WARN - no grammars supplied! Supplying dummy glue grammar.
> WARN - no grammars supplied! Supplying dummy glue grammar.
> WARN - no grammars supplied! Supplying dummy glue grammar.
> WARN - no grammars supplied! Supplying dummy glue grammar.
> WARN - no grammars supplied! Supplying dummy glue grammar.
> WARN - no grammars supplied! Supplying dummy glue grammar.
> {code}
> We need to fix this such that we can run static source code analysis via
> sonar and have our results available on analysis.apache.org.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (JOSHUA-252) Make it possible to use Maven to build Joshua
[ https://issues.apache.org/jira/browse/JOSHUA-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301504#comment-15301504 ] Hudson commented on JOSHUA-252: --- SUCCESS: Integrated in joshua_maven #12 (See [https://builds.apache.org/job/joshua_maven/12/]) JOSHUA-252 Make it possible to use Maven to build Joshua (lewis.mcgibbney: rev fdf20e20aebe8d39a9046ffab0c36f1f918818b9) * src/main/java/org/apache/joshua/decoder/Decoder.java JOSHUA-252 Make it possible to use Maven to build Joshua (lewis.mcgibbney: rev a3a2522f52ace0b9241e3ebfa59cdb80003664ad) * scripts/training/pipeline.pl * bin/extract-1best * bin/meteor * bin/joshua-decoder * bin/bleu * jni/kenlm_wrap.cc JOSHUA-252 Make it possible to use Maven to build Joshua (lewis.mcgibbney: rev 9475d9432d6b389748d6103243f5a99ec3433192) * ext/giza-pp/mkcls-v2/KategProblemKBC.cpp * ext/giza-pp/GIZA++-v2/ATables.cpp * ext/giza-pp/mkcls-v2/GDAOptimization.cpp * ext/giza-pp/GIZA++-v2/snt2plain.cpp * ext/giza-pp/GIZA++-v2/transpair_model3.h * ext/giza-pp/GIZA++-v2/hmm.h * ext/giza-pp/GIZA++-v2/MoveSwapMatrix.h * ext/giza-pp/GIZA++-v2/model3_viterbi.cpp * ext/giza-pp/GIZA++-v2/ForwardBackward.cpp * ext/giza-pp/GIZA++-v2/mystl.h * ext/giza-pp/mkcls-v2/SAOptimization.h * ext/giza-pp/mkcls-v2/TAOptimization.cpp * ext/giza-pp/mkcls-v2/RRTOptimization.h * ext/giza-pp/GIZA++-v2/Vector.h * ext/giza-pp/mkcls-v2/IterOptimization.cpp * examples/README.md * docker/zh-en-hiero/Dockerfile * ext/giza-pp/GIZA++-v2/transpair_model3.cpp * .gitmodules * ext/giza-pp/GIZA++-v2/myassert.h * ext/giza-pp/GIZA++-v2/TTables.cpp * ext/giza-pp/GIZA++-v2/alignment.h * ext/giza-pp/GIZA++-v2/plain2snt.cpp * ext/giza-pp/mkcls-v2/KategProblemKBC.h * ext/giza-pp/mkcls-v2/mystl.h * ext/giza-pp/GIZA++-v2/logprob.cpp * ext/giza-pp/mkcls-v2/PopOptimization.h * ext/giza-pp/GIZA++-v2/getSentence.h * ext/giza-pp/mkcls-v2/Problem.h * ext/giza-pp/GIZA++-v2/Makefile.src * ext/giza-pp/GIZA++-v2/utility.h * ext/giza-pp/GIZA++-v2/FlexArray.h * ext/giza-pp/GIZA++-v2/model2.h * ext/giza-pp/mkcls-v2/RRTOptimization.cpp * ext/giza-pp/GIZA++-v2/snt2cooc.cpp * ext/giza-pp/mkcls-v2/ProblemTest.h * ext/giza-pp/GIZA++-v2/model3.h * ext/giza-pp/GIZA++-v2/reports.cpp * examples/docker/ar-en-phrase/Dockerfile * ext/giza-pp/GIZA++-v2/HMMTables.cpp * ext/giza-pp/mkcls-v2/makePackage.sh * ext/giza-pp/mkcls-v2/StatVar.cpp * ext/giza-pp/mkcls-v2/Makefile * ext/giza-pp/GIZA++-v2/Parameter.cpp * ext/giza-pp/mkcls-v2/MSBOptimization.h * ext/symal/Makefile * ext/giza-pp/mkcls-v2/myleda.h * docker/Dockerfile * ext/giza-pp/GIZA++-v2/collCounts.h * ext/giza-pp/GIZA++-v2/parse.cpp * ext/giza-pp/GIZA++-v2/TTables.h * ext/giza-pp/GIZA++-v2/model345-peg.cpp * ext/giza-pp/GIZA++-v2/vocab.h * ext/giza-pp/mkcls-v2/KategProblemTest.h * ext/giza-pp/GIZA++-v2/Perplexity.cpp * ext/giza-pp/GIZA++-v2/trainGIZA++.sh * ext/giza-pp/mkcls-v2/general.h * Dockerfile * ext/symal/cmd.h * ext/giza-pp/GIZA++-v2/vocab.cpp * examples/README.sp_to_en * ext/berkeleylm * ext/giza-pp/mkcls-v2/README * ext/giza-pp/GIZA++-v2/README * ext/giza-pp/mkcls-v2/MSBOptimization.cpp * ext/giza-pp/GIZA++-v2/WordClasses.h * docker/ar-en-phrase/Dockerfile * ext/symal/symal.cpp * ext/giza-pp/mkcls-v2/ProblemTest.cpp * ext/giza-pp/mkcls-v2/LICENSE * ext/giza-pp/mkcls-v2/FixedArray.h * ext/giza-pp/GIZA++-v2/file_spec.h * ext/giza-pp/mkcls-v2/TAOptimization.h * ext/giza-pp/GIZA++-v2/D5Tables.h * ext/giza-pp/GIZA++-v2/AlignTables.cpp * ext/giza-pp/GIZA++-v2/mymath.h * ext/giza-pp/README * ext/giza-pp/mkcls-v2/KategProblemTest.cpp * ext/giza-pp/mkcls-v2/MYOptimization.h * ext/giza-pp/mkcls-v2/PopOptimization.cpp * ext/giza-pp/mkcls-v2/mkcls.cpp * ext/giza-pp/GIZA++-v2/alignment.cpp * ext/giza-pp/mkcls-v2/Problem.cpp * ext/giza-pp/mkcls-v2/KategProblemWBC.cpp * ext/giza-pp/GIZA++-v2/dependencies * ext/giza-pp/GIZA++-v2/model3.cpp * examples/docker/zh-en-hiero/Dockerfile * ext/giza-pp/GIZA++-v2/Array2.h * ext/giza-pp/GIZA++-v2/model1.h * ext/giza-pp/GIZA++-v2/model2to3.cpp * ext/giza-pp/GIZA++-v2/utility.cpp * ext/giza-pp/mkcls-v2/GDAOptimization.h * ext/giza-pp/GIZA++-v2/Array4.h * ext/giza-pp/GIZA++-v2/Dictionary.h * ext/giza-pp/GIZA++-v2/model2.cpp * ext/giza-pp/mkcls-v2/Optimization.h * ext/giza-pp/GIZA++-v2/D4Tables.h * ext/giza-pp/GIZA++-v2/Array.h * ext/giza-pp/GIZA++-v2/model1.cpp * ext/giza-pp/GIZA++-v2/NTables.cpp * ext/giza-pp/GIZA++-v2/ForwardBackward.h * ext/giza-pp/GIZA++-v2/Parameter.h * ext/giza-pp/GIZA++-v2/Perplexity.h * ext/giza-pp/mkcls-v2/StatVar.h * ext/giza-pp/GIZA++-v2/logprob.h * ext/giza-pp/GIZA++-v2/Makefile * ext/giza-pp/GIZA++-v2/Makefile.definitions * ext/giza-pp/GIZA++-v2/transpair_modelhmm.h * ext/giza-pp/GIZA++-v2/HMMTables.h * ext/giza-pp/GIZA++-v2/Pointer.h * ext/giza-pp/GIZA++-v2/transpair_model4.h * ext/giza-pp/GIZA++-v2/collCounts.cpp * ext/giza-pp/mkcls-v2/myassert.h * ext/giza-pp/GIZA++-v2/Globals.h * ext/giza-pp/GIZA++-v2/ATables.h * ext/giza-pp/GIZA++-v2/myassert.cpp *
[jira] [Commented] (JOSHUA-252) Make it possible to use Maven to build Joshua
[ https://issues.apache.org/jira/browse/JOSHUA-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300774#comment-15300774 ] Hudson commented on JOSHUA-252: --- FAILURE: Integrated in joshua_maven #11 (See [https://builds.apache.org/job/joshua_maven/11/]) JOSHUA-252 Make it possible to use Maven to build Joshua (lewis.mcgibbney: rev d8a68df396d086c75a26133ea3011e4de6bd54b9) * src/main/java/org/apache/joshua/util/Regex.java * src/main/java/org/apache/joshua/tools/TestSetFilter.java * src/main/java/org/apache/joshua/util/ExtractTopCand.java * src/main/java/org/apache/joshua/util/io/BinaryOut.java * src/main/java/org/apache/joshua/ui/tree_visualizer/browser/Browser.java * src/main/java/org/apache/joshua/util/encoding/EncoderConfiguration.java * src/main/java/org/apache/joshua/util/ChartSpan.java * src/main/java/org/apache/joshua/tools/GrammarPacker.java * src/main/java/org/apache/joshua/util/Ngram.java * src/main/java/org/apache/joshua/util/io/Reader.java * src/main/java/org/apache/joshua/util/ListUtil.java * src/main/java/org/apache/joshua/tools/LabelPhrases.java * src/main/java/org/apache/joshua/ui/tree_visualizer/tree/Tree.java * src/main/java/org/apache/joshua/util/Bits.java * src/main/java/org/apache/joshua/util/Counts.java * src/main/java/org/apache/joshua/util/FormatUtils.java * src/main/java/org/apache/joshua/util/io/LineReader.java * src/main/java/org/apache/joshua/util/io/IndexedReader.java * src/main/java/org/apache/joshua/util/FileUtility.java * src/main/java/org/apache/joshua/util/Algorithms.java * src/main/java/org/apache/joshua/util/CompareGrammars.java * src/main/java/org/apache/joshua/util/Counted.java > Make it possible to use Maven to build Joshua > - > > Key: JOSHUA-252 > URL: https://issues.apache.org/jira/browse/JOSHUA-252 > Project: Joshua > Issue Type: Improvement > Components: build >Reporter: Tommaso Teofili >Assignee: Tommaso Teofili > Fix For: 6.1 > > > As per discussion on the dev@ list for now Ant is the official build tool for > Joshua however we would like to possibly switch to Maven if / when someone is > able to do so. > Assigning to me for now as I could be able to look into this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-252) Make it possible to use Maven to build Joshua
[ https://issues.apache.org/jira/browse/JOSHUA-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286168#comment-15286168 ] Hudson commented on JOSHUA-252: --- FAILURE: Integrated in joshua_maven #6 (See [https://builds.apache.org/job/joshua_maven/6/]) JOSHUA-252 Make it possible to use Maven to build Joshua (lewis.mcgibbney: rev ae47ca151ddc9464bd64906a94cbc043288dbd64) * src/test/resources/lm/berkeley/lm * src/test/resources/decoder/target-bigram/test.sh * src/test/resources/bn-en/samt/reference.en.3 * test/decoder/num_translation_options/joshua.config.packed * test/decoder/segment-oovs/input.txt * test/decoder/k-best-extraction/grammar * src/test/resources/decoder/fragmentlm/joshua.config * test/joshua/README.broken * src/test/resources/thrax/filtering/exact.gold * src/test/resources/bn-en/hiero/reference.en.1 * src/test/resources/decoder/dont-crash/test.sh * test/bn-en/samt/lm.gz * src/test/resources/decoder/regexp-grammar-both-rule-types/weights * test/decoder/tree-output/fragment-map.txt * test/decoder/num_translation_options/grammar.packed/slice_0.features * src/test/resources/bn-en/hiero/class_lm_2gram.gz * src/test/resources/decoder/n-ary/glue-grammar * test/decoder/empty-test/test.sh * src/test/resources/decoder/phrase/include-align-index/lm.1.gz * src/test/resources/decoder/num_translation_options/grammar.packed/slice_0.features * test/thrax/filtering/input.de * src/test/resources/decoder/left-state/output.scores.gold * test/scripts/.gitignore * test/packed-grammar/.gitignore * test/decoder/phrase/decode/output.gold * test/decoder/regexp-grammar/glue-grammar * src/test/resources/scripts/support/moses_grammar/test.sh * test/decoder/left-state/joshua.config * test/decoder/phrase/include-align-index/output.gold * src/main/java/org/apache/joshua/decoder/segment_file/Sentence.java * src/test/resources/lattice/joshua.config * src/test/resources/bn-en/hiero/test-berkeleylm.sh * src/test/resources/thrax/extraction/test.sh * test/parser/test.sh * src/test/resources/decoder/lowercaser/config * test/decoder/fragmentlm/grammar * src/test/resources/bn-en/samt/reference.en.0 * test/parser/input * test/decoder/num_translation_options/lm.gz * src/test/resources/decoder/segment-oovs/input.txt * test/decoder/regexp-grammar-both-rule-types/README * test/pipeline/input/train.en * src/test/resources/thrax/filtering/test-fast.sh * test/decoder/k-best-extraction/glue-grammar * test/thrax/extraction/input/train.en * test/decoder/constrained/output.gold * src/test/resources/thrax/filtering/grammar.de * test/packed-grammar/README * src/test/resources/grammar/sparse-features/grammar.packed/slice_0.source * test/bn-en/samt/input.bn * test/decoder/phrase/decode/config * test/lm/berkeley/lm.berkeleylm * src/test/resources/grammar/sparse-features/joshua.config * src/test/resources/lattice/test.lm * src/test/resources/decoder/fragmentlm/grammar * test/grammar/sparse-features/test.sh * test/decoder/constrained/weights * test/decoder/dont-crash/test.sh * src/test/resources/bn-en/packed/grammar.glue * src/test/resources/decoder/phrase/constrained/corpus.es * src/test/resources/grammar/sparse-features/grammar.packed/slice_0.target.lookup * src/test/resources/bn-en/hiero/reference.en.3 * src/main/java/org/apache/joshua/corpus/Vocabulary.java * src/test/resources/bn-en/packed/grammar.packed/slice_0.features * test/decoder/regexp-grammar-both-rule-types/test.sh * test/pipeline/.gitignore * src/test/resources/thrax/extraction/input/train.ps * test/lm/berkeley/lm.gz * src/test/resources/decoder/phrase/include-align-index/log * src/test/resources/bn-en/samt/output.gold * test/parser/parse.config * test/lattice/output.expected * src/test/resources/bn-en/hiero/output.scores.gold * src/test/resources/bn-en/packed/reference.en.0 * test/decoder/source-annotations/test.sh * test/decoder/oov-list/output.gold * src/test/resources/decoder/phrase/decode/config * src/test/resources/decoder/k-best-extraction/input.txt * test/bn-en/hiero/lm.gz * test/thrax/filtering/dev.hi-en.hi.1 * src/test/resources/decoder/n-ary/test.sh * test/decoder/phrase/constrained/test.sh * src/test/resources/packed-grammar/lm.gz * test/decoder/phrase/decode/rules.1.gz * test/grammar/sparse-features/test-packed.sh * test/decoder/source-annotations/grammar.glue * src/test/resources/decoder/tree-output/grammar.gz * test/bn-en/packed/reference.en.1 * src/test/resources/decoder/num_translation_options/grammar.gz * src/test/resources/decoder/phrase/unique-hypotheses/README * src/test/resources/lattice/grammar.test * test/decoder/n-ary/output.bleu * src/test/resources/lm/berkeley/lm.berkeleylm.gz * test/lattice/grammar.test * src/test/resources/decoder/phrase/decode/rules.packed/config * test/grammar/sparse-features/grammar * src/test/resources/thrax/filtering/grammar.filtered.gz * test/lattice-short/glue-grammar * src/test/resources/bn-en/hiero/output.gold.bleu * test/bn-en/packed/grammar.gz
[jira] [Commented] (JOSHUA-252) Make it possible to use Maven to build Joshua
[ https://issues.apache.org/jira/browse/JOSHUA-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284197#comment-15284197 ] Hudson commented on JOSHUA-252: --- FAILURE: Integrated in joshua_maven #5 (See [https://builds.apache.org/job/joshua_maven/5/]) JOSHUA-252 correctly specify test dependency in NodeTest.java (lewis.mcgibbney: rev 7c8e8566d1c6ca5b1c519163302b8ce2b0eb02cb) * src/test/java/org/apache/joshua/lattice/NodeTest.java > Make it possible to use Maven to build Joshua > - > > Key: JOSHUA-252 > URL: https://issues.apache.org/jira/browse/JOSHUA-252 > Project: Joshua > Issue Type: Improvement > Components: build >Reporter: Tommaso Teofili >Assignee: Tommaso Teofili > Fix For: 6.1 > > > As per discussion on the dev@ list for now Ant is the official build tool for > Joshua however we would like to possibly switch to Maven if / when someone is > able to do so. > Assigning to me for now as I could be able to look into this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-257) Add license headers to all Python scripts
[
https://issues.apache.org/jira/browse/JOSHUA-257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263305#comment-15263305
]
Hudson commented on JOSHUA-257:
---
FAILURE: Integrated in joshua_master #29 (See
[https://builds.apache.org/job/joshua_master/29/])
JOSHUA-257 Add license headers to all Python scripts (lewis.j.mcgibbney: rev
051cc489d0bce3ad928f3383f2b57f0193ae6a0d)
* test/prune-equivalent-translations.py
* scripts/samt/selectFeatures.py
* scripts/training/class-lm/replaceTokensWithClasses.py
* scripts/toolkit/extract_references.py
* scripts/training/run_thrax.py
* scripts/toolkit/joini.py
* scripts/support/merge_lms.py
* scripts/features/addSparseFeatures.py
* scripts/lm/compile_berkeley.py
* scripts/samt/lexprob2samt.py
* scripts/samt/filterGrammar.py
* scripts/toolkit/chunki.py
* test/scripts/run_bundler_test.py
* scripts/training/run_tuner.py
* test/scripts/merge_lms_test.py
* scripts/support/run_bundler.py
* scripts/toolkit/shorti.py
> Add license headers to all Python scripts
> -
>
> Key: JOSHUA-257
> URL: https://issues.apache.org/jira/browse/JOSHUA-257
> Project: Joshua
> Issue Type: Task
>Affects Versions: 6.0.5
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Critical
> Fix For: 6.1
>
>
> Simple case of adding license headers to all Python scripts as below
> {code}
> ./ext/kenlm/python/example.py
> ./ext/kenlm/setup.py
> ./scripts/features/addSparseFeatures.py
> ./scripts/lm/compile_berkeley.py
> ./scripts/samt/filterGrammar.py
> ./scripts/samt/lexprob2samt.py
> ./scripts/samt/selectFeatures.py
> ./scripts/support/merge_lms.py
> ./scripts/support/run_bundler.py
> ./scripts/toolkit/chunki.py
> ./scripts/toolkit/extract_references.py
> ./scripts/toolkit/joini.py
> ./scripts/toolkit/shorti.py
> ./scripts/training/class-lm/replaceTokensWithClasses.py
> ./scripts/training/run_thrax.py
> ./scripts/training/run_tuner.py
> ./test/prune-equivalent-translations.py
> ./test/scripts/merge_lms_test.py
> ./test/scripts/run_bundler_test.py
> ./thrax/scripts/berant_to_reference.py
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (JOSHUA-256) Note that Joshua builds and runs with >= Java 1.8
[ https://issues.apache.org/jira/browse/JOSHUA-256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260657#comment-15260657 ] Hudson commented on JOSHUA-256: --- SUCCESS: Integrated in joshua_master #27 (See [https://builds.apache.org/job/joshua_master/27/]) JOSHUA-256 Note that Joshua builds and runs with >= Java 1.8 (lewis.j.mcgibbney: rev 6f45d19b1f9c7bc33c57b7485d99f27bd2e2eda6) * README.md > Note that Joshua builds and runs with >= Java 1.8 > - > > Key: JOSHUA-256 > URL: https://issues.apache.org/jira/browse/JOSHUA-256 > Project: Joshua > Issue Type: Improvement >Reporter: Lewis John McGibbney >Assignee: Lewis John McGibbney >Priority: Critical > Fix For: 6.1 > > > Since the Joshua code was transitioned into the Incubator, code has been > committed which requires Java 1.8 minimum to compile and run. > We should note this within the README and also on the Website once we move > towards out first 6.1 Incubating release. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (JOSHUA-252) Make it possible to use Maven to build Joshua
[ https://issues.apache.org/jira/browse/JOSHUA-252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236966#comment-15236966 ] Hudson commented on JOSHUA-252: --- SUCCESS: Integrated in joshua_master #13 (See [https://builds.apache.org/job/joshua_master/13/]) JOSHUA-252 - fixed Maven compilation phase (tommaso: rev 9e48d125393fa53cd52b52bdbb480c97fd3a4aad) * pom.xml JOSHUA-252 - fixed groupId, set the version to snapshot (tommaso: rev 3c9984d59b646cdb86d8325608245d9e2ee12216) * pom.xml JOSHUA-252 - upgraded snapshot version as it looks 6.0.5 has been (tommaso: rev 044a4e69513e30c3e1be6c9988958506d4afa996) * pom.xml > Make it possible to use Maven to build Joshua > - > > Key: JOSHUA-252 > URL: https://issues.apache.org/jira/browse/JOSHUA-252 > Project: Joshua > Issue Type: Improvement >Reporter: Tommaso Teofili >Assignee: Tommaso Teofili > Fix For: 6.1 > > > As per discussion on the dev@ list for now Ant is the official build tool for > Joshua however we would like to possibly switch to Maven if / when someone is > able to do so. > Assigning to me for now as I could be able to look into this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
