[
https://issues.apache.org/jira/browse/PIG-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851230#action_12851230
]
Jay Tang commented on PIG-1331:
-------------------------------
Ashish, the goal of Owl is to provide a table-like abstraction to manage
Hadoop data. The design would allow any customer MapReduce applications, Pig
Latin, and even Hive query language to consume data via Owl's interface. Our
vision is to build a full data life cycle management stack that encompasses
data creation, notification, consumption, retention, and security management,
etc. Owl would make things easier for a MapReduce application writer or for
someone to build another query processing language on top of it. We will
update Owl wikie page with more detailed information.
> Owl Hadoop Table Management Service
> -----------------------------------
>
> Key: PIG-1331
> URL: https://issues.apache.org/jira/browse/PIG-1331
> Project: Pig
> Issue Type: New Feature
> Affects Versions: 0.8.0
> Reporter: Jay Tang
> Attachments: owl.contrib.3.tgz
>
>
> This JIRA is a proposal to create a Hadoop table management service: Owl.
> Today, MapReduce and Pig applications interacts directly with HDFS
> directories and files and must deal with low level data management issues
> such as storage format, serialization/compression schemes, data layout, and
> efficient data accesses, etc, often with different solutions. Owl aims to
> provide a standard way to addresses this issue and abstracts away the
> complexities of reading/writing huge amount of data from/to HDFS.
> Owl has a data access API that is modeled after the traditional Hadoop
> !InputFormt and a management API to manipulate Owl objects. This JIRA is
> related to Pig-823 (Hadoop Metadata Service) as Owl has an internal metadata
> store. Owl integrates with different storage module like Zebra with a
> pluggable architecture.
> Initially, the proposal is to submit Owl as a Pig contrib project. Over
> time, it makes sense to move it to a Hadoop subproject.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
