Lewis John McGibbney created JOSHUA-311:
-------------------------------------------
Summary: Improve pipeline logging to indicate location on berkeley
alignment log(s)
Key: JOSHUA-311
URL: https://issues.apache.org/jira/browse/JOSHUA-311
Project: Joshua
Issue Type: Improvement
Components: logging, alignment, pipeline
Affects Versions: 6.0.5
Reporter: Lewis John McGibbney
Fix For: 6.1
When one runs a pipeline using --aligner berkeley, no log location is provided
for user to follow progress of alignment.
{code}
[berkeley-aligner-chunk-0] rebuilding...
dep=alignments/0/word-align.conf [CHANGED]
dep=/usr/local/jpl/xdata/joshua_experiments/russian_experiments/0/data/train/splits/corpus.en.0
[NOT FOUND]
dep=/usr/local/jpl/xdata/joshua_experiments/russian_experiments/0/data/train/splits/corpus.ru.0
[NOT FOUND]
dep=alignments/0/training.align [NOT FOUND]
cmd=java -d64 -Xmx10g -jar
/usr/local/jpl/xdata/joshua_experiments/incubator-joshua/ext/berkeleyaligner/distribution/berkeleyaligner.jar
++alignments/0/word-align.conf
{code}
We could add something like
{code}
[berkeley-aligner-chunk-0] rebuilding...
dep=alignments/0/word-align.conf [CHANGED]
dep=/usr/local/jpl/xdata/joshua_experiments/russian_experiments/0/data/train/splits/corpus.en.0
[NOT FOUND]
dep=/usr/local/jpl/xdata/joshua_experiments/russian_experiments/0/data/train/splits/corpus.ru.0
[NOT FOUND]
dep=alignments/0/training.align [NOT FOUND]
cmd=java -d64 -Xmx10g -jar
/usr/local/jpl/xdata/joshua_experiments/incubator-joshua/ext/berkeleyaligner/distribution/berkeleyaligner.jar
++alignments/0/word-align.conf logs being written to /path/to/log
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
