Hello Good afternoon ,
My input file contains full of text words delimited by space.
I want to do using Pig..I already did it with map and reduce.
*I have to do:*
#get the size of words #counts for words of particular size.
Here are commands::
a = load '/user/manish/word/word.txt' as line;
b = foreach a generate flatten(TOKENIZE(line)) as word;
c = group b by word;
d = foreach c generate group, SIZE(b.word) as size;
e = foreach c generate COUNT(b.word) as countword, group;
while i execute join command job failed....
f = join d by b.word,e by b.word;
*Error:*
ERROR 1066: Unable to open iterator for alias f
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
open iterator for alias f
at org.apache.pig.PigServer.openIterator(PigServer.java:857)
at
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:682)
at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:189)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
at org.apache.pig.Main.run(Main.java:490)
at org.apache.pig.Main.main(Main.java:111)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Caused by: java.io.IOException: Job terminated with anomalous status FAILED
at org.apache.pig.PigServer.openIterator(PigServer.java:849)
... 12 more
================================================================================
--
What to do?
Can u help me to figure this out..
Regards
Manish Dunani
skype id : manish.dunani
