Hello,

Well, I ran that command and it went fine: build 100%

However, now I ran the tutorial command again and I get:

* Packing grammar at "grammar.gz" to
"../joshua-tutorial/runs/1/tune/model/grammar.gz.packed"
* Running the grammar-packer.pl script with the command:
$JOSHUA/scripts/support/grammar-packer.pl -a -T /tmp -g grammar.gz -o
../joshua-tutorial/runs/1/tune/model/grammar.gz.packed
Exception in thread "main" java.util.NoSuchElementException
at org.apache.joshua.util.io.LineReader.next(LineReader.java:276)
at
org.apache.joshua.tools.GrammarPacker.getGrammarReader(GrammarPacker.java:239)
at org.apache.joshua.tools.GrammarPacker.pack(GrammarPacker.java:184)
at org.apache.joshua.tools.GrammarPackerCli.run(GrammarPackerCli.java:120)
at org.apache.joshua.tools.GrammarPackerCli.main(GrammarPackerCli.java:137)
* FATAL: Couldn't pack the grammar.
* Copying sorted grammars (/tmp/grammar.gzR7NI) to current directory.
* __init__() takes at least 3 arguments (2 given)

One thing I noticed is this "error" message when compiling:

-- Could NOT find Eigen3 (missing:  EIGEN3_INCLUDE_DIR EIGEN3_VERSION_OK)
(Required is at least version "2.91.0")
CMake Warning at lm/interpolate/CMakeLists.txt:65 (message):
  Not building interpolation.  Eigen3 was not found.

Is Eigen3 really necessary?

Cheers,
Fernando

On 18 November 2016 at 18:15, Matt Post <p...@cs.jhu.edu> wrote:

> Okay, it looks like KenLM is not building. This is a perennial pain. You
> can see the KenLM build lines in download_deps.sh. What is output when you
> run
>
> ./jni/build_kenlm.sh
>
> matt
>
>
>
> On Nov 18, 2016, at 12:24 PM, Fernando E Alva Manchego <
> fealvamanche...@sheffield.ac.uk> wrote:
>
> Hello,
>
> UPDATE:  I added $JOSHUA/lib to LD_LIBRARY_PATH  because I saw that libken.so
> is there. Now, I run the command again and what I get is the same error
> that Lewis pointed out:
>
> [lm-sort-uniq] rebuilding...
>   dep= ../joshua-tutorial/runs/1/data/train/corpus.en [CHANGED]
>   dep= ../joshua-tutorial/runs/1/data/train/corpus.en.uniq [NOT FOUND]
>   cmd= $JOSHUA/scripts/training/scat /export/data/falva/joshua-
> tutorial/runs/1/data/train/corpus.en | sort -u -T /tmp -S 8G | gzip -9n
> >.../joshua-tutorial/runs/1/data/train/corpus.en.uniq
>   took 1 seconds (1s)
> * FATAL: $JOSHUA/bin/lmplz (for building LMs) does not exist.
>   This is often a problem with the boost libraries (particularly threaded
>   versus unthreaded).
>
> Cheers,
> Fernando
>
> On 18 November 2016 at 16:40, Fernando E Alva Manchego <
> fealvamanche...@sheffield.ac.uk> wrote:
>
>> Hello,
>>
>> Sorry for the late reply. I have downloaded joshua again and followed the
>> updated procedure, but I still get the same error when running the
>> following command:
>>
>> $JOSHUA/bin/pipeline.pl \
>>  --rundir 1 \
>>  --readme "Baseline Hiero run" \
>>  --source es \
>>  --target en \
>>  --type hiero \
>>  --corpus $FISHER/corpus/asr/fisher_train \
>>  --tune $FISHER/corpus/asr/fisher_dev \
>>  --test $FISHER/corpus/asr/fisher_dev2 \
>>  --maxlen 11 \
>>  --maxlen-tune 11 \
>>  --maxlen-test 11 \
>>  --tuner-iterations 1 \
>>  --lm-order 3
>>
>> The error is still:
>> [pack-grammar] rebuilding...
>>   dep= $HOME/joshua-tutorial/runs/1/grammar.packed/vocabulary [NOT FOUND]
>>   dep= $HOME/joshua-tutorial/runs/1/grammar.packed/encoding [NOT FOUND]
>>   dep= $HOME/joshua-tutorial/runs/1/grammar.packed/slice_00000.source
>> [NOT FOUND]
>>   cmd= $JOSHUA/scripts/support/grammar-packer.pl -a -T /tmp -m 8g -g
>> grammar.gz -o $HOME/joshua-tutorial/runs/1/grammar.packed
>>   JOB FAILED (return code 1)
>> Exception in thread "main" java.util.NoSuchElementException
>> at org.apache.joshua.util.io.LineReader.next(LineReader.java:276)
>> at org.apache.joshua.tools.GrammarPacker.getGrammarReader(Gramm
>> arPacker.java:239)
>> at org.apache.joshua.tools.GrammarPacker.pack(GrammarPacker.java:184)
>> at org.apache.joshua.tools.GrammarPackerCli.run(GrammarPackerCl
>> i.java:120)
>> at org.apache.joshua.tools.GrammarPackerCli.main(GrammarPackerC
>> li.java:137)
>> * FATAL: Couldn't pack the grammar.
>> * Copying sorted grammars (/tmp/grammar.gzTQzG) to current directory.
>>
>> What I have noticed now is that, when running the tests after
>> compilation, this error message appears:
>>
>> ERROR - Can't find libken.so (libken.dylib on OS X) on the Java library
>> path.
>> WARN - No glue grammar found! Creating dummy glue grammar.
>>
>> Could that be the source of the error? Thank you.
>>
>> @Lewis: I'll make sure to given them your regards.
>>
>> Best
>> Fernando
>>
>> On 18 November 2016 at 13:42, Matt Post <p...@cs.jhu.edu> wrote:
>>
>>> I just updated that page to use "mvn package" instead of the old "mvn
>>> compile assembly:single". So Fernando, please make sure you follow the
>>> updated instructions.
>>>
>>>
>>>
>>>
>>> On Nov 17, 2016, at 10:10 PM, lewis john mcgibbney <lewi...@apache.org>
>>> wrote:
>>>
>>> Hi Fernando,
>>> First and foremost please give y regards to the GATE team at Sheffield.
>>> I spent a great week down there a number of years back and I am fond of the
>>> place.
>>> Are you following the tutorial at https://cwiki.apache.org/confl
>>> uence/display/JOSHUA/Joshua+Tutorial ?
>>> If so then I'll try it out and see if I can reproduce.
>>> Lewis
>>>
>>> On Thu, Nov 17, 2016 at 9:38 AM, <user-digest-help@joshua.incub
>>> ator.apache.org> wrote:
>>>
>>>> From: Fernando E Alva Manchego <fealvamanche...@sheffield.ac.uk>
>>>> To: user@joshua.incubator.apache.org
>>>> Cc:
>>>> Date: Thu, 17 Nov 2016 17:37:53 +0000
>>>> Subject: Error while running the tutorial
>>>> Hello!
>>>>
>>>> I'm running the tutorial (phrase) and the following error came up:
>>>>
>>>> Error: Could not find or load main class org.apache.joshua.tools.Gramma
>>>> rPackerCli
>>>>
>>>> When I installed Joshua, I ran the tests and everything was OK. Do you
>>>> have any idea what might be happening? Thank you.
>>>>
>>>>
>>>>
>>>
>>
>
>

Reply via email to