ok.. how to pass the argument to the pig file ? i tried.. Its not working.. can v pass arguments to that py file.. please help
On Thu, Jan 12, 2012 at 2:40 PM, Daniel Dai <[email protected]> wrote: > Oh, we have an issue of dump (PIG-2291). Please use store. > > Daniel > > On Thu, Jan 12, 2012 at 12:54 AM, rahul raghavendhra < > [email protected]> wrote: > > > when i run the similar one(without store, just load and dump) it raise > > the exception.. so i replaced raise statement by print 'pig job failed'.. > > then i get the output of the dump command but it is append with pig job > > failed.. > > why this so ? > > i tried to pass the name of the dataset using command line to py file.. > its > > showing error.. > > > > please help > > > > > > > > > > On Thu, Jan 12, 2012 at 12:40 PM, Daniel Dai <[email protected]> > > wrote: > > > > > Yes, you can use "java -cp", or you can use $PIG_HOME/bin/pig. Your > > command > > > "pig sample.py" is right. However, your sample.py only contains import > > > statement, there is nothing to run, so it exit quickly. The minimal > > python > > > script you can run is: > > > > > > #!/usr/bin/python > > > > > > # explicitly import Pig class > > > from org.apache.pig.scripting import Pig > > > > > > # COMPILE: compile method returns a Pig object that represents the > > pipeline > > > P = Pig.compile("a = load '$in'; store a into '$out';") > > > > > > input = 'original' > > > output = 'output' > > > > > > # BIND and RUN > > > result = P.bind({'in':input, 'out':output}).runSingle() > > > > > > if result.isSuccessful() : > > > print 'Pig job succeeded' > > > else : > > > raise 'Pig job failed' > > > > > > > > > Check http://pig.apache.org/docs/r0.9.1/cont.html for detail. > > > > > > Daniel > > > > > > On Wed, Jan 11, 2012 at 10:59 PM, Jonathan Coveney <[email protected] > > > >wrote: > > > > > > > java -cp > /usr/local/pig/pig-0.9.1.jar:/usr/local/jython2.5.2/jython.jar > > > > org.apache.pig.Main sample.py, I believe > > > > > > > > 2012/1/11 rahul raghavendhra <[email protected]> > > > > > > > > > when i run using java -cp > > > > > > > > > > $>java -cp > > > /usr/local/pig/pig-0.9.1.jar:/usr/local/jython2.5.2/jython.jar > > > > > sample.py > > > > > Exception in thread "main" java.lang.NoClassDefFoundError: > sample/py > > > > > Caused by: java.lang.ClassNotFoundException: sample.py > > > > > at java.net.URLClassLoader$1.run(URLClassLoader.java:217) > > > > > at java.security.AccessController.doPrivileged(Native Method) > > > > > at java.net.URLClassLoader.findClass(URLClassLoader.java:205) > > > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:321) > > > > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) > > > > > at java.lang.ClassLoader.loadClass(ClassLoader.java:266) > > > > > Could not find the main class: sample.py. Program will exit. > > > > > > > > > > please help > > > > > > > > > > > > > > > On Thu, Jan 12, 2012 at 12:11 PM, rahul raghavendhra < > > > > > [email protected]> wrote: > > > > > > > > > > > > > > > > > How to run as a script file > > > > > > > > > > > > pig script.py ?? > > > > > > > > > > > > please help > > > > > > ./rahul > > > > > > > > > > > > On Thu, Jan 12, 2012 at 12:06 PM, rahul raghavendhra < > > > > > > [email protected]> wrote: > > > > > > > > > > > >> I am a newbie.. please make it so clear.. > > > > > >> > > > > > >> > > > > > >> when i inside bin as > > > > > >> pig sample.py > > > > > >> > > > > > >> i got this error.. > > > > > >> > > > > > >> hadoop1@karthi-ericsson:/usr/ > > > > > >> local/pig/bin$ pig sample.py > > > > > >> 2012-01-12 11:53:14,475 [main] INFO org.apache.pig.Main - > > Logging > > > > > error > > > > > >> messages to: /usr/local/pig/bin/pig_1326349394473.log > > > > > >> 2012-01-12 11:53:14,485 [main] INFO org.apache.pig.Main - Run > > > > embedded > > > > > >> script: jython > > > > > >> 2012-01-12 11:53:14,597 [main] INFO > > > > > >> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - > > > > > Connecting > > > > > >> to hadoop file system at: hdfs://localhost:54310 > > > > > >> 2012-01-12 11:53:14,736 [main] INFO > > > > > >> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - > > > > > Connecting > > > > > >> to map-reduce job tracker at: localhost:54311 > > > > > >> hadoop1@karthi-ericsson:/usr/local/pig/bin$ > > > > > >> > > > > > >> how to run as a script file > > > > > >> > > > > > >> > > > > > >> On Thu, Jan 12, 2012 at 12:01 PM, Daniel Dai < > > [email protected] > > > > > >wrote: > > > > > >> > > > > > >>> Hi, Rahul, > > > > > >>> Embedding mode does not work with grunt. Please run as a script > > > file. > > > > > >>> > > > > > >>> Daniel > > > > > >>> > > > > > >>> On Wed, Jan 11, 2012 at 10:24 PM, rahul raghavendhra < > > > > > >>> [email protected]> wrote: > > > > > >>> > > > > > >>> > i have downloaded jython jar and installed it.. but i couldnt > > run > > > > pig > > > > > >>> > scripts using py script... i have created a .py in pig/bin > > > forder.. > > > > > >>> how to > > > > > >>> > run the pig.. pig wiki is not so clear..please help. > > > > > >>> > > > > > > >>> > when i run the script inside grunt as run sample.py > > > > > >>> > > > > > > >>> > i got the following error > > > > > >>> > > > > > > >>> > grunt> #!/usr/bin/python > > > > > >>> > grunt> from org.apache.pig.scripting import Pig > > > > > >>> > 2012-01-12 11:50:18,637 [main] ERROR > > > > > org.apache.pig.tools.grunt.Grunt > > > > > >>> - > > > > > >>> > ERROR 1000: Error during parsing. Encountered " <IDENTIFIER> > > > "from > > > > "" > > > > > >>> at > > > > > >>> > line 2, column 1. > > > > > >>> > > > > > > >>> > > > > > > >>> > when i inside bin as pig sample.py > > > > > >>> > i got this error.. > > > > > >>> > hadoop1@karthi-ericsson:/usr/local/pig/bin$ pig sample.py > > > > > >>> > 2012-01-12 11:53:14,475 [main] INFO org.apache.pig.Main - > > > Logging > > > > > >>> error > > > > > >>> > messages to: /usr/local/pig/bin/pig_1326349394473.log > > > > > >>> > 2012-01-12 11:53:14,485 [main] INFO org.apache.pig.Main - > Run > > > > > >>> embedded > > > > > >>> > script: jython > > > > > >>> > 2012-01-12 11:53:14,597 [main] INFO > > > > > >>> > > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine > > - > > > > > >>> Connecting > > > > > >>> > to hadoop file system at: hdfs://localhost:54310 > > > > > >>> > 2012-01-12 11:53:14,736 [main] INFO > > > > > >>> > > org.apache.pig.backend.hadoop.executionengine.HExecutionEngine > > - > > > > > >>> Connecting > > > > > >>> > to map-reduce job tracker at: localhost:54311 > > > > > >>> > hadoop1@karthi-ericsson:/usr/local/pig/bin$ > > > > > >>> > > > > > > >>> > > > > > > >>> > please help > > > > > >>> > ./rahul > > > > > >>> > > > > > > >>> > > > > > >> > > > > > >> > > > > > > > > > > > > > > > > > > > > >
