Hi Lens Experts ,
I have come through this project while looking for an OLAP solution on
Hadoop Stack for my product. I have few queries , please someone answer them.
To give background of my requirement.
1. My system is collecting performance KPIs which we collect and
calculate and want to store in HBase.
2. Frequency and size of my data is every 5 minutes around 5 million
rows and each row about 30 - 40 KPIs (this is current load and can increase in
future)
3. I need to support following type of queries
a) Querying raw KPI data based on filters and joins and order by clauses -
Expected latency < 2 seconds
b) OLAP queries with groupby and aggregators like sum , max , avg etc. -
Expected latency < 2 seconds
c) TOP N , Bottom N
d) For large scans paging
4. Large scans based on filters for Machine Learning and analytics Job
Now my questions are ; (I have read the Lens documents but I still have some
confusions)
1. Lens is ROLAP solution ? - Which is the primary source of meta data
and real data
2. Lens is MOLAP solution ? - How do I build cubes ? whats the latency of
building cubes (any benchmarking available)
3. Which of my requirements can be met by Lens ?
4. Are there any commercial deployment with Lens ?
Thanks in advance.
Regards,
Santosh Akhilesh
