Lewis John McGibbney created JOSHUA-316:
-------------------------------------------
Summary: run_bundler.py returning JOB FAILED (return code 1)
Key: JOSHUA-316
URL: https://issues.apache.org/jira/browse/JOSHUA-316
Project: Joshua
Issue Type: Bug
Components: bundler
Affects Versions: 6.0.5
Reporter: Lewis John McGibbney
Priority: Critical
Fix For: 6.2
{code}
[glue-tune] rebuilding...
dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_00000.source
[CHANGED]
dep=/usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
[NOT FOUND]
cmd=/usr/local/incubator-joshua/scripts/support/create_glue_grammar.sh
/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed >
/usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
took 1 seconds (1s)
[tune-bundle] rebuilding...
dep=/usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config
[CHANGED]
dep=/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed/slice_00000.source
[CHANGED]
dep=/usr/local/joshua_resources/russian_experiments/exp2/tune/model/run-joshua.sh
[NOT FOUND]
cmd=/usr/local/incubator-joshua/scripts/support/run_bundler.py --force
--symlink --absolute --verbose -T /usr/local/hadoop-2.5.2/hadoop_tmp_dir
/usr/local/incubator-joshua/scripts/training/templates/tune/joshua.config
/usr/local/joshua_resources/russian_experiments/exp2/tune/model
--copy-config-options '-top-n 300 -output-format "%i ||| %s ||| %f ||| %c"
-mark-oovs false -search cky -weights "lm_0 1 tm_pt_0 1 tm_pt_1 1 tm_pt_2 1
tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 " -feature-function
"StateMinimizingLanguageModel -lm_order 5 -lm_file
/usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm" -tm0/type hiero
-tm0/owner pt -tm0/maxspan 20 -tm1/owner glue' --pack-tm
/usr/local/joshua_resources/russian_experiments/exp2/grammar.packed --tm
/usr/local/joshua_resources/russian_experiments/exp2/data/tune/grammar.glue
JOB FAILED (return code 1)
* Running the copy-config.pl script with the command:
/usr/local/incubator-joshua/scripts/copy-config.pl -top-n 300 -output-format
"%i ||| %s ||| %f ||| %c" -mark-oovs false -search cky -weights "lm_0 1 tm_pt_0
1 tm_pt_1 1 tm_pt_2 1 tm_pt_3 1 tm_pt_4 1 tm_pt_5 1 tm_glue_0 1 "
-feature-function "StateMinimizingLanguageModel -lm_order 5 -lm_file
/usr/local/joshua_resources/russian_experiments/exp2/lm.kenlm" -tm0/type hiero
-tm0/owner pt -tm0/maxspan 20 -tm1/owner glue
Traceback (most recent call last):
File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 748,
in main
operations = collect_operations(opts)
File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 637,
in collect_operations
opts.copy_config_options
File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 202,
in filter_through_copy_config_script
result, err = p.communicate(config_text)
File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1072, in
communicate
stdout, stderr = self._communicate(input, endtime, timeout)
File "/Users/lmcgibbn/miniconda3/lib/python3.5/subprocess.py", line 1700, in
_communicate
input_view = memoryview(self._input)
TypeError: memoryview: a bytes-like object is required, not 'str'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 760,
in <module>
main(sys.argv)
File "/usr/local/incubator-joshua/scripts/support/run_bundler.py", line 751,
in main
error_quit(e.message)
AttributeError: 'TypeError' object has no attribute 'message'
* WARNING: no key 'outputformat' found in config file (appending to end)
* WARNING: no key 'search' found in config file (appending to end)
* WARNING: no key 'topn' found in config file (appending to end)
* WARNING: no key 'markoovs' found in config file (appending to end)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
