[
https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067912#comment-14067912
]
Amit Mor commented on PIG-3445:
-------------------------------
odd, I'm getting this:
2014-07-20 15:28:03,900 [main] INFO org.apache.pig.Main - Apache Pig version
0.12.1 (r1585011) compiled Apr 05 2014, 01:41:34
2014-07-20 15:28:03,900 [main] INFO org.apache.pig.Main - Logging error
messages to:
/home/amit/Projects/sql.hg/mapreduce/pigx/scripts/pig_1405859283897.log
2014-07-20 15:28:04,176 [main] INFO org.apache.pig.impl.util.Utils - Default
bootup file /home/amit/.pigbootup not found
2014-07-20 15:28:04,320 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to
hadoop file system at: file:///
2014-07-20 15:28:06,175 [main] ERROR org.apache.pig.PigServer - exception
during parsing: Error during parsing. Cannot instantiate class
org.apache.pig.builtin.ParquetStorer (parquet.pig.ParquetStorer)
Failed to parse: Pig script failed to parse:
<file xaff_mr_cgrp.pig, line 205, column 0> pig script failed to validate:
java.lang.RuntimeException: could not instantiate 'ParquetStorer' with
arguments 'null'
at
org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:196)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1678)
at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1411)
at org.apache.pig.PigServer.parseAndBuild(PigServer.java:344)
at org.apache.pig.PigServer.executeBatch(PigServer.java:369)
at org.apache.pig.PigServer.executeBatch(PigServer.java:355)
at
org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:140)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:202)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:607)
at org.apache.pig.Main.main(Main.java:156)
Caused by:
<file xaff_mr_cgrp.pig, line 205, column 0> pig script failed to validate:
java.lang.RuntimeException: could not instantiate 'ParquetStorer' with
arguments 'null'
at
org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:969)
at
org.apache.pig.parser.LogicalPlanGenerator.store_clause(LogicalPlanGenerator.java:7780)
at
org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1669)
at
org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1102)
at
org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:560)
at
org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421)
at
org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:188)
... 11 more
Caused by: java.lang.RuntimeException: could not instantiate 'ParquetStorer'
with arguments 'null'
at
org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:748)
at
org.apache.pig.parser.LogicalPlanBuilder.buildStoreOp(LogicalPlanBuilder.java:948)
... 17 more
Caused by: org.apache.pig.impl.logicalLayer.FrontendException: ERROR 2259:
Cannot instantiate class org.apache.pig.builtin.ParquetStorer
(parquet.pig.ParquetStorer)
at org.apache.pig.builtin.ParquetStorer.<init>(ParquetStorer.java:38)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at java.lang.Class.newInstance(Class.java:374)
at
org.apache.pig.impl.PigContext.instantiateFuncFromSpec(PigContext.java:718)
... 18 more
Caused by: java.lang.NoClassDefFoundError: parquet/pig/ParquetStorer
at org.apache.pig.builtin.ParquetStorer.<init>(ParquetStorer.java:34)
... 24 more
Caused by: java.lang.ClassNotFoundException: parquet.pig.ParquetStorer
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 25 more
2014-07-20 15:28:06,182 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR
2259: Cannot instantiate class org.apache.pig.builtin.ParquetStorer
(parquet.pig.ParquetStorer)
Details at logfile:
/home/amit/Projects/sql.hg/mapreduce/pigx/scripts/pig_1405859283897.log
when calling:
STORE cgrp_renamed INTO '$OUTPUT' USING ParquetStorer();
> Make Parquet format available out of the box in Pig
> ---------------------------------------------------
>
> Key: PIG-3445
> URL: https://issues.apache.org/jira/browse/PIG-3445
> Project: Pig
> Issue Type: Improvement
> Reporter: Julien Le Dem
> Assignee: Lorand Bendig
> Fix For: 0.12.0
>
> Attachments: PIG-3445-2.patch, PIG-3445-3.patch, PIG-3445-4.patch,
> PIG-3445-5.patch, PIG-3445.patch
>
>
> We would add the Parquet jar in the Pig packages to make it available out of
> the box to pig users.
> On top of that we could add the parquet.pig package to the list of packages
> to search for UDFs. (alternatively, the parquet jar could contain classes
> name or.apache.pig.builtin.ParquetLoader and ParquetStorer)
> This way users can use Parquet simply by typing:
> A = LOAD 'foo' USING ParquetLoader();
> STORE A INTO 'bar' USING ParquetStorer();
--
This message was sent by Atlassian JIRA
(v6.2#6252)
