Re: Error while running the tutorial

2016-12-01 Thread Fernando E Alva Manchego
Hi! I used your files and I got the same error. I'll check the hadoop environment again. Apparently, it's all pointing out to that as the source of the problem. Thank you! Best, Fernando On 29 November 2016 at 14:11, Matt Post wrote: > I just tried this on my machine and everything worked fine

Re: Error while running the tutorial

2016-11-29 Thread Matt Post
I just tried this on my machine and everything worked fine (using your exact command). I suspect something is wrong with your Hadoop environment. Also, however, my files have fewer lines: $ wc -l alignments/training.align data/train/corpus.{en,es} 76690 alignments/training.align 76690 data/t

Re: Error while running the tutorial

2016-11-29 Thread Fernando E Alva Manchego
Hello, The output is: 77457 data/train/corpus.en 77457 data/train/corpus.es 77457 alignments/training.align 232371 total Best, Fernando On 28 November 2016 at 16:13, Matt Post wrote: > This is strange — I'm not sure why the AnnotationJob would fail. > > What is the output of > > wc

Re: Error while running the tutorial

2016-11-28 Thread Matt Post
This is strange — I'm not sure why the AnnotationJob would fail. What is the output of wc -l data/train/corpus.* alignments/training.align matt > On Nov 22, 2016, at 6:34 PM, Fernando E Alva Manchego > wrote: > > Hi, > > The number is 0. The corpus I'm using is the one pro

Re: Error while running the tutorial

2016-11-22 Thread Fernando E Alva Manchego
Hi, The number is 0. The corpus I'm using is the one provided with the download: ASR. Well, I tried with Hadoop 2.7.3, 2.6.5 and 2.5.2 and I get the exact same error. What could be wrong with its setup? It's just adding the $HADOOP_HOME/bin to the PATH. By the way, I really appreciate all the he

Re: Error while running the tutorial

2016-11-22 Thread Matt Post
It looks like you have a very small corpus. Can you tell me what number this command reports? gzip -cd grammar.gz | grep Infinity | wc -l matt > On Nov 22, 2016, at 5:28 PM, Fernando E Alva Manchego > wrote: > > Hello, > > I'm using Hadoop 2.7.3 and Java 8. Apparently, the Hadoop se

Re: Error while running the tutorial

2016-11-22 Thread Fernando E Alva Manchego
Hello, I'm using Hadoop 2.7.3 and Java 8. Apparently, the Hadoop setup is OK, according to the instructions given in: https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-common/SingleCluster.html#Standalone_Operation I'll try and earlier version of Hadoop and see how it goes. Cheer

Re: Error while running the tutorial

2016-11-22 Thread John Hewitt
Grepping through the log file, I found the following problem: class edu.jhu.thrax.hadoop.features.annotation.AnnotationFeatureJob FAILED This is a prereq of OutputJob, hence OutputJob failed. Here's a link to a useful closed issue with an almost identical problem. https://issues.apache.org/jira/

Re: Error while running the tutorial

2016-11-22 Thread Matt Post
Okay, that is the size of a compressed empty file. So the grammar did not extract properly. Did you setup Hadoop properly? Can you paste the contents of thrax.log? What is the file size of data/train/thrax-input-file? > On Nov 22, 2016, at 1:12 PM, Fernando E Alva Manchego > wrote: > > Hel

Re: Error while running the tutorial

2016-11-22 Thread Fernando E Alva Manchego
Hello, It's 20 Bytes. Best, Fernando On 22 November 2016 at 18:00, Matt Post wrote: > eigen3 is not necessary. What is the file size of grammar.gz? > > > On Nov 22, 2016, at 7:54 AM, Fernando E Alva Manchego < > fealvamanche...@sheffield.ac.uk> wrote: > > Hello, > > Well, I ran that command an

Re: Error while running the tutorial

2016-11-22 Thread Matt Post
eigen3 is not necessary. What is the file size of grammar.gz? > On Nov 22, 2016, at 7:54 AM, Fernando E Alva Manchego > wrote: > > Hello, > > Well, I ran that command and it went fine: build 100% > > However, now I ran the tutorial command again and I get: > > * Packing grammar at "grammar.

Re: Error while running the tutorial

2016-11-22 Thread Fernando E Alva Manchego
Hello, Well, I ran that command and it went fine: build 100% However, now I ran the tutorial command again and I get: * Packing grammar at "grammar.gz" to "../joshua-tutorial/runs/1/tune/model/grammar.gz.packed" * Running the grammar-packer.pl script with the command: $JOSHUA/scripts/support/gra

Re: Error while running the tutorial

2016-11-18 Thread Matt Post
Okay, it looks like KenLM is not building. This is a perennial pain. You can see the KenLM build lines in download_deps.sh. What is output when you run ./jni/build_kenlm.sh matt > On Nov 18, 2016, at 12:24 PM, Fernando E Alva Manchego > wrote: > > Hello, > > UPDATE: I added $JOSH

Re: Error while running the tutorial

2016-11-18 Thread Fernando E Alva Manchego
Hello, UPDATE: I added $JOSHUA/lib to LD_LIBRARY_PATH because I saw that libken.so is there. Now, I run the command again and what I get is the same error that Lewis pointed out: [lm-sort-uniq] rebuilding... dep= ../joshua-tutorial/runs/1/data/train/corpus.en [CHANGED] dep= ../joshua-tutori

Re: Error while running the tutorial

2016-11-18 Thread Fernando E Alva Manchego
Hello, Sorry for the late reply. I have downloaded joshua again and followed the updated procedure, but I still get the same error when running the following command: $JOSHUA/bin/pipeline.pl \ --rundir 1 \ --readme "Baseline Hiero run" \ --source es \ --target en \ --type hiero \ --corpus $

Re: Error while running the tutorial

2016-11-18 Thread Matt Post
I just updated that page to use "mvn package" instead of the old "mvn compile assembly:single". So Fernando, please make sure you follow the updated instructions. > On Nov 17, 2016, at 10:10 PM, lewis john mcgibbney wrote: > > Hi Fernando, > First and foremost please give y regards to the G

Re: Error while running the tutorial

2016-11-17 Thread lewis john mcgibbney
Hi Folks, I submitted a PR to implement OS compatibility running on Mac OSX. https://github.com/joshua-decoder/fisher-callhome-corpus/pull/1 @Fernando I cannot reproduce your issue... I do however encounter the following issue lmcgibbn@LMC-056430 /usr/local/joshua_resources/joshua-tutorial $ $JOSH

Re: Error while running the tutorial

2016-11-17 Thread lewis john mcgibbney
Hi Fernando, First and foremost please give y regards to the GATE team at Sheffield. I spent a great week down there a number of years back and I am fond of the place. Are you following the tutorial at https://cwiki.apache.org/confluence/display/JOSHUA/Joshua+Tutorial ? If so then I'll try it out a

Re: Error while running the tutorial

2016-11-17 Thread Fernando E Alva Manchego
Hello, 1. Here's the list requested: archive-tmp classes generated-sources joshua-6.2-SNAPSHOT.jar joshua-6.2-SNAPSHOT-jar-with-dependencies.jar joshua-6.2-SNAPSHOT-src.tar.gz joshua-6.2-SNAPSHOT-src.zip maven-archiver maven-shared-archive-resources rat.txt surefire-reports test-classes 2. After

Re: Error while running the tutorial

2016-11-17 Thread Matt Post
Please send a listing of the contents of the "$JOSHUA/target" directory. Try running "mvn package" in $JOSHUA, and see if that helps. > On Nov 17, 2016, at 12:59 PM, Fernando E Alva Manchego > wrote: > > Hello, > > Thanks for the quick reply: > > (a) I followed the instructions in the Getti

Re: Error while running the tutorial

2016-11-17 Thread Fernando E Alva Manchego
Hello, Thanks for the quick reply: (a) I followed the instructions in the Getting Started page. I didn't have Maven in my computer, so I downloaded Maven 3.3.9. When I ran mvn test the message I got at the end was: Tests run: 151, Failures: 0, Errors: 0, Skipped: 0 So that's why I assume everyt

Re: Error while running the tutorial

2016-11-17 Thread Matt Post
Hello, Thanks for the note. Can you please tell us: (a) how you installed Joshua? (b) the command you typed that failed? matt > On Nov 17, 2016, at 12:37 PM, Fernando E Alva Manchego > wrote: > > Hello! > > I'm running the tutorial (phrase) and the following error came up: > > Error: Cou