[
https://issues.apache.org/jira/browse/PIG-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13766515#comment-13766515
]
Lorand Bendig commented on PIG-3445:
------------------------------------
Yes, that's definitely a drawback of this patch.
Is it an option here to utilize pig.additional.jars and udf.import.list?
If so, I can think of the following:
pig.properties:
{code}
pig.additional.jars.parquet.column=/path/to/parquet-column.jar
pig.additional.jars.parquet.common=
pig.additional.jars.parquet.encoding=
...
or: pig.additional.jars.parquet=parquet-column.jar:parquet-common.jar
udf.import.list.parquet=parquet.pig.
{code}
At the point where 3rd party jars and import packages are initialized an
additional code could take care of these grouped properties. If some checks
(can be defined per group) succeed, like valid paths..etc then these props
would be merged to pig.additional.jars and udf.import.list.
The rest is the same as before.
However, this might be silly solution which may not address all the issues that
can arise, I'm curious if it can be an option.
> Make Parquet format available out of the box in Pig
> ---------------------------------------------------
>
> Key: PIG-3445
> URL: https://issues.apache.org/jira/browse/PIG-3445
> Project: Pig
> Issue Type: Improvement
> Reporter: Julien Le Dem
> Attachments: PIG-3445.patch
>
>
> We would add the Parquet jar in the Pig packages to make it available out of
> the box to pig users.
> On top of that we could add the parquet.pig package to the list of packages
> to search for UDFs. (alternatively, the parquet jar could contain classes
> name or.apache.pig.builtin.ParquetLoader and ParquetStorer)
> This way users can use Parquet simply by typing:
> A = LOAD 'foo' USING ParquetLoader();
> STORE A INTO 'bar' USING ParquetStorer();
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
