[
https://issues.apache.org/jira/browse/PIG-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajay Kidave updated PIG-1331:
-----------------------------
Affects Version/s: 0.8.0
Release Note: Contrib project for the Owl Hadoop table management
service
Status: Patch Available (was: Open)
The patch is attached as a compressed tar. Couple of dependencies are not yet
pulled through ivy, they need to be copied in manually after applying the
patch. Some scripts need to be made executable before the tests within
contrib/owl can be run. The manual steps are
cp jetty-runner-7.0.0.pre5.jar contrib/owl/ci
cp log4j-1.2.15.jar contrib/owl/java/lib
chmod +x contrib/owl/bin/owl.sh contrib/owl/ci/derby_initialize_schema.sh
contrib/owl/ci/derby_cleanup.sh contrib/owl/ci/jetty_check.sh
contrib/owl/ci/jetty_start.sh contrib/owl/ci/jetty_stop.sh
The contents of the tar file are :
owl.patch - the patch file
jetty-runner-7.0.0.pre5.jar and log4j-1.2.15.jar - the dependency jars
antrun.txt - output of a test run
owl.svnaddlist - output of a svn add contrib/owl command
> Owl Hadoop Table Management Service
> -----------------------------------
>
> Key: PIG-1331
> URL: https://issues.apache.org/jira/browse/PIG-1331
> Project: Pig
> Issue Type: New Feature
> Affects Versions: 0.8.0
> Reporter: Jay Tang
>
> This JIRA is a proposal to create a Hadoop table management service: Owl.
> Today, MapReduce and Pig applications interacts directly with HDFS
> directories and files and must deal with low level data management issues
> such as storage format, serialization/compression schemes, data layout, and
> efficient data accesses, etc, often with different solutions. Owl aims to
> provide a standard way to addresses this issue and abstracts away the
> complexities of reading/writing huge amount of data from/to HDFS.
> Owl has a data access API that is modeled after the traditional Hadoop
> !InputFormt and a management API to manipulate Owl objects. This JIRA is
> related to Pig-823 (Hadoop Metadata Service) as Owl has an internal metadata
> store. Owl integrates with different storage module like Zebra with a
> pluggable architecture.
> Initially, the proposal is to submit Owl as a Pig contrib project. Over
> time, it makes sense to move it to a Hadoop subproject.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
