Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-16 Thread sebb
It looks like the version [1] of the Wiki page that was active at the
time of the vote was:

https://wiki.apache.org/incubator/LensProposal?rev=4

[1] https://wiki.apache.org/incubator/LensProposal?action=info

For the record, the current contents of that version are appended below:

-- cut here 

Lens

Abstract

Lens is a platform that enables multi-dimensional queries in a unified
way over datasets stored in multiple warehouses. Lens integrates
Apache Hive with other data warehouses by tiering them together to
form logical data cubes.

Proposal

Lens provides a unified Cube abstraction for data stored in different
stores. Lens tiers multiple data warehouses for unified representation
and efficient access. It provides SQL-like Cube query language to
query and describe data sets organized in data cubes. It enables users
to run queries against Facts and Dimensions that can span multiple
physical tables stored in different stores.

The primary use cases that Lens aims to solve:

Facilitate analytical queries by providing the OLAP like Cube abstraction
Data Discovery by providing single metadata layer for data stored in
different stores
Unified access to data by integrating Hive with other traditional data
warehouses

Background

Apache Hive is a data warehouse that facilitates querying and managing
large datasets stored in distributed storage systems like HDFS. It
provides SQL like language called HiveQL aka HQL. Apache Hive is a
widely used platform in various organizations for doing adhoc
analytical queries. In a typical Data warehouse scenario, the data is
multi-dimensional and organized into Facts and Dimensions to form Data
Cubes. Lens provides this logical layer to enable querying and manage
data as Cubes. The Lens project is actively being developed at InMobi
to provide the higher level of analytical abstraction to query data
stored in different storages including Hive and beyond seamlessly.

Rationale

The Lens project aims to ease the analytical querying capabilities and
cut the data-silos by providing a single view of data across multiple
data stores. Conceiving data as a cube with hierarchical dimensions
leads to conceptually straightforward operations to facilitate
analysis. Integrating Apache Hive with other traditional warehouses
provides the opportunity to optimize on the query execution cost by
tiering the data across multiple warehouses. Lens provides

Access to data Cubes via Cube Query language similar to HiveQL.
Driver based architecture to allow for plugging systems like Hive and
other warehouses such as columnar data RDBMS.
Cost based engine selection that provides optimal use of resources by
selecting the best execution engine for a given query.

In a typical Data warehouse, data is organized in Cubes with multiple
dimensions and measures. This facilitates the analysis by conceiving
the data in terms of Facts and Dimensions instead of physical tables.
Lens aims to provide this logical Cube abstraction on Data warehouses
like Hive and other traditional warehouses.

Initial Goals

Donate the Lens source code and documentation to Apache Software Foundation
Build a user and developer community
Support Hive and other Columnar data warehouses
Support full query life cycle management
Add authentication for querying cubes
Provide detailed query statistics

Long Term Goals

Here are some longer-term capabilities that would be added to Lens

Add authorization for managing and querying Cubes
Provide REST and CLI for full Admin controls
Capability to schedule queries
Query caching
Integrate with Apache Spark. Creating Spark RDD from Lens query
Integrate with Apache Optiq

Current Status

The project is actively developed at InMobi. The first version is
deployed at InMobi 4 months back. This version allows querying
dimension and fact data stored in Hive over CLI. The source code and
documentation is hosted at GitHub.

Meritocracy

We intend to build a diverse developer and user community for the
project following the Apache meritocracy model. We want to encourage
contributors from multiple organizations, provide plenty of support to
new developers and welcome them to be committers.

Community

Currently the project is being developed at InMobi. We hope to extend
our contributor and user base significantly in the future and build a
solid open source community around Lens. Core Developers Lens is
currently being developed by Amareshwari Sriramadasu, Sharad Agarwal
and Jaideep Dhok from InMobi, and Sreekanth Ramakrishnan who is
currently employed by SoftwareAG. Raghavendra Singh from InMobi has
built the QA automation for Lens.

Alignment

The ASF is a natural home to Lens as it is for Apache Hadoop, Apache
Hive, Apache Spark and other emerging projects in Big Data space. We
believe in any enterprise, multiple data warehouses will co-exist, as
not all workloads are cost effective to run on single one. Apache Hive
is one of the crucial data warehouse along with upcoming 

Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-08 Thread Joe Brockmeier
On Mon, Oct 6, 2014, at 06:51 AM, Sharad Agarwal wrote:
  [ ] +1 accept Lens in the Incubator

+1 (binding)

Best,

jzb
-- 
Joe Brockmeier
j...@zonker.net
Twitter: @jzb
http://www.dissociatedpress.net/

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-08 Thread Vinod Kumar Vavilapalli
Tx for starting this, Sharad!

+1, binding.

Thanks,
+Vinod

On Oct 6, 2014, at 4:51 AM, Sharad Agarwal sha...@apache.org wrote:

 Following the discussion earlier in the thread
 https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
 I would like to call a Vote for accepting Lens as a new incubator project.
 
 The proposal is available at:
 https://wiki.apache.org/incubator/LensProposal
 
 Vote is open till Oct 09, 2014 4 PM PST.
 
 [ ] +1 accept Lens in the Incubator
 [ ] +/-0
 [ ] -1 because...
 
 Only Votes from Incubator PMC members are binding, but all are welcome to
 express their thoughts.
 I am +1 (non-binding).
 
 Thanks
 Sharad



signature.asc
Description: Message signed with OpenPGP using GPGMail


Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-08 Thread Suresh Srinivas
+1 (binding)

Sent from phone

 On Oct 8, 2014, at 12:20 PM, Joe Brockmeier j...@zonker.net wrote:
 
 On Mon, Oct 6, 2014, at 06:51 AM, Sharad Agarwal wrote:
 [ ] +1 accept Lens in the Incubator
 
 +1 (binding)
 
 Best,
 
 jzb
 -- 
 Joe Brockmeier
 j...@zonker.net
 Twitter: @jzb
 http://www.dissociatedpress.net/
 
 -
 To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
 For additional commands, e-mail: general-h...@incubator.apache.org
 

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



RE: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-07 Thread Srikanth Sundarrajan
+1 (non-binding)

Srikanth Sundarrajan

 Date: Mon, 6 Oct 2014 17:21:41 +0530
 Subject: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)
 From: sha...@apache.org
 To: general@incubator.apache.org
 
 Following the discussion earlier in the thread
 https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
 I would like to call a Vote for accepting Lens as a new incubator project.
 
 The proposal is available at:
 https://wiki.apache.org/incubator/LensProposal
 
 Vote is open till Oct 09, 2014 4 PM PST.
 
  [ ] +1 accept Lens in the Incubator
  [ ] +/-0
  [ ] -1 because...
 
 Only Votes from Incubator PMC members are binding, but all are welcome to
 express their thoughts.
 I am +1 (non-binding).
 
 Thanks
 Sharad
  

Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-07 Thread Roman Shaposhnik
On Mon, Oct 6, 2014 at 4:51 AM, Sharad Agarwal sha...@apache.org wrote:
 Following the discussion earlier in the thread
 https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
 I would like to call a Vote for accepting Lens as a new incubator project.

 The proposal is available at:
 https://wiki.apache.org/incubator/LensProposal

 Vote is open till Oct 09, 2014 4 PM PST.

  [ ] +1 accept Lens in the Incubator
  [ ] +/-0
  [ ] -1 because...

+1 (binding)

Thanks,
Roman.

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-07 Thread Ashish
+1 (non-binding)

On Mon, Oct 6, 2014 at 5:21 PM, Sharad Agarwal sha...@apache.org wrote:

 Following the discussion earlier in the thread
 https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
 I would like to call a Vote for accepting Lens as a new incubator project.

 The proposal is available at:
 https://wiki.apache.org/incubator/LensProposal

 Vote is open till Oct 09, 2014 4 PM PST.

  [ ] +1 accept Lens in the Incubator
  [ ] +/-0
  [ ] -1 because...

 Only Votes from Incubator PMC members are binding, but all are welcome to
 express their thoughts.
 I am +1 (non-binding).

 Thanks
 Sharad




-- 
thanks
ashish

Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal


Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-06 Thread Jean-Baptiste Onofré

+1 (binding)

Regards
JB

On 10/06/2014 01:51 PM, Sharad Agarwal wrote:

Following the discussion earlier in the thread
https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
I would like to call a Vote for accepting Lens as a new incubator project.

The proposal is available at:
https://wiki.apache.org/incubator/LensProposal

Vote is open till Oct 09, 2014 4 PM PST.

  [ ] +1 accept Lens in the Incubator
  [ ] +/-0
  [ ] -1 because...

Only Votes from Incubator PMC members are binding, but all are welcome to
express their thoughts.
I am +1 (non-binding).

Thanks
Sharad



--
Jean-Baptiste Onofré
jbono...@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-06 Thread jan i
On Oct 6, 2014 1:51 PM, Sharad Agarwal sha...@apache.org wrote:

 Following the discussion earlier in the thread
 https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
 I would like to call a Vote for accepting Lens as a new incubator project.

 The proposal is available at:
 https://wiki.apache.org/incubator/LensProposal

 Vote is open till Oct 09, 2014 4 PM PST.

  [ ] +1 accept Lens in the Incubator
  [ ] +/-0
  [ ] -1 because...

 Only Votes from Incubator PMC members are binding, but all are welcome to
 express their thoughts.
 I am +1 (non-binding).
+1 binding.
Jan i

 Thanks
 Sharad


Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-06 Thread Alan D. Cabrera
+1 - binding


Regards,
Alan

On Oct 6, 2014, at 4:51 AM, Sharad Agarwal sha...@apache.org wrote:

 Following the discussion earlier in the thread
 https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
 I would like to call a Vote for accepting Lens as a new incubator project.
 
 The proposal is available at:
 https://wiki.apache.org/incubator/LensProposal
 
 Vote is open till Oct 09, 2014 4 PM PST.
 
 [ ] +1 accept Lens in the Incubator
 [ ] +/-0
 [ ] -1 because...
 
 Only Votes from Incubator PMC members are binding, but all are welcome to
 express their thoughts.
 I am +1 (non-binding).
 
 Thanks
 Sharad


-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-06 Thread Jakob Homan
+1 (binding)

On Mon, Oct 6, 2014 at 6:59 AM, Alan D. Cabrera l...@toolazydogs.com
wrote:

 +1 - binding


 Regards,
 Alan

 On Oct 6, 2014, at 4:51 AM, Sharad Agarwal sha...@apache.org wrote:

  Following the discussion earlier in the thread
  https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
  I would like to call a Vote for accepting Lens as a new incubator
 project.
 
  The proposal is available at:
  https://wiki.apache.org/incubator/LensProposal
 
  Vote is open till Oct 09, 2014 4 PM PST.
 
  [ ] +1 accept Lens in the Incubator
  [ ] +/-0
  [ ] -1 because...
 
  Only Votes from Incubator PMC members are binding, but all are welcome to
  express their thoughts.
  I am +1 (non-binding).
 
  Thanks
  Sharad


 -
 To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
 For additional commands, e-mail: general-h...@incubator.apache.org




Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-06 Thread Amareshwari Sriramdasu
+1

Thanks
Amareshwari

On Mon, Oct 6, 2014 at 9:10 PM, Jakob Homan jgho...@gmail.com wrote:

 +1 (binding)

 On Mon, Oct 6, 2014 at 6:59 AM, Alan D. Cabrera l...@toolazydogs.com
 wrote:

  +1 - binding
 
 
  Regards,
  Alan
 
  On Oct 6, 2014, at 4:51 AM, Sharad Agarwal sha...@apache.org wrote:
 
   Following the discussion earlier in the thread
  
 https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
   I would like to call a Vote for accepting Lens as a new incubator
  project.
  
   The proposal is available at:
   https://wiki.apache.org/incubator/LensProposal
  
   Vote is open till Oct 09, 2014 4 PM PST.
  
   [ ] +1 accept Lens in the Incubator
   [ ] +/-0
   [ ] -1 because...
  
   Only Votes from Incubator PMC members are binding, but all are welcome
 to
   express their thoughts.
   I am +1 (non-binding).
  
   Thanks
   Sharad
 
 
  -
  To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
  For additional commands, e-mail: general-h...@incubator.apache.org
 
 



Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-06 Thread Chris Douglas
+1 (binding) -C

On Mon, Oct 6, 2014 at 4:51 AM, Sharad Agarwal sha...@apache.org wrote:
 Following the discussion earlier in the thread
 https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
 I would like to call a Vote for accepting Lens as a new incubator project.

 The proposal is available at:
 https://wiki.apache.org/incubator/LensProposal

 Vote is open till Oct 09, 2014 4 PM PST.

  [ ] +1 accept Lens in the Incubator
  [ ] +/-0
  [ ] -1 because...

 Only Votes from Incubator PMC members are binding, but all are welcome to
 express their thoughts.
 I am +1 (non-binding).

 Thanks
 Sharad

-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org



Re: [VOTE] Accept Lens into the Apache Incubator (earlier called Grill)

2014-10-06 Thread Seetharam Venkatesh
+1 (non-binding).

Thanks!

On Mon, Oct 6, 2014 at 10:05 AM, Chris Douglas cdoug...@apache.org wrote:

 +1 (binding) -C

 On Mon, Oct 6, 2014 at 4:51 AM, Sharad Agarwal sha...@apache.org wrote:
  Following the discussion earlier in the thread
  https://www.mail-archive.com/general@incubator.apache.org/msg45208.html
  I would like to call a Vote for accepting Lens as a new incubator
 project.
 
  The proposal is available at:
  https://wiki.apache.org/incubator/LensProposal
 
  Vote is open till Oct 09, 2014 4 PM PST.
 
   [ ] +1 accept Lens in the Incubator
   [ ] +/-0
   [ ] -1 because...
 
  Only Votes from Incubator PMC members are binding, but all are welcome to
  express their thoughts.
  I am +1 (non-binding).
 
  Thanks
  Sharad

 -
 To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
 For additional commands, e-mail: general-h...@incubator.apache.org




-- 
Regards,
Venkatesh

“Perfection (in design) is achieved not when there is nothing more to add,
but rather when there is nothing more to take away.”
- Antoine de Saint-Exupéry