Hey Li Yang, Thanks for your reply. I am new to Kylin and current we are considering using that for the data analyzing. We use storm and store result into mysql for low-latency query now, but as you said, it is quite low level and need custom storm jobs. May I ask whether Kylin can have any custom hooks into the cube build process?
Thank you! George On Mon, Sep 14, 2015 at 4:53 PM, Li Yang <[email protected]> wrote: > The Streaming OLAP feature comes with Kylin 2.x that is to be released this > year. Document is limited at the moment. Watch related JIRAs if you want to > track our progress. KYLIN-972 > <https://issues.apache.org/jira/browse/KYLIN-972> > > Storm + Kafka are just low level components and is far from a query engine > that accepts ad-hoc queries [1]. While Kylin Streaming OLAP provides full > SQL interface on historic and real-time data in seconds response time. > > [1] > > http://nguyentantrieu.info/blog/building-an-query-engine-for-time-series-data-using-redis-kafka-and-storm/ > > > > > On Mon, Sep 14, 2015 at 4:28 PM, George Lu <[email protected]> wrote: > > > Hey all, > > > > Currently, storm and kafka can be used to achieve near real-time query. > > Can you share any doc on how to use streaming in Kylin and how does Kylin > > Streaming differs to Storm + Kafka? > > > > Thanks! > > > > George Lu > > > > On Mon, Sep 14, 2015 at 3:33 PM, Li Yang <[email protected]> wrote: > > > > > Streaming OLAP provides Near-Realtime analysis where data delay can be > as > > > short as a few minutes. > > > > > > Traditional daily build allows user to analyze yesterday's data. If > > > increase the frequency to hourly, then user can analyze last hour's > data. > > > Further down the line, how about incremental build every 5 minutes > from a > > > streaming source? Then user can analyze data 5 minutes ago. That's > > > Streaming OLAP! > > > > > > On Mon, Sep 14, 2015 at 12:43 AM, Henry Saputra < > [email protected] > > > > > > wrote: > > > > > > > Hi Luke, > > > > > > > > Could you clarify again what is the streaming OLAP means here? > > > > > > > > By definition OLAP work with historical data. > > > > > > > > Maybe I missed it but was there any discussions or proposed design > for > > > it? > > > > > > > > Thanks, > > > > > > > > - Henry > > > > > > > > On Monday, August 3, 2015, Luke Han <[email protected]> wrote: > > > > > > > > > Hi Siddharth, > > > > > Kylin's next majority release (0.8.x) will support Streaming > OLAP > > > > which > > > > > will coming in Q4 since it still under development now, as Hongbin > > > > > mentioned above. > > > > > Could you please drop me a mail about your case? I would like > to > > > > > better understand your scenario to well manage coming features? > > > > > > > > > > Thanks. > > > > > > > > > > > > > > > > > > > > > > > > > Best Regards! > > > > > --------------------- > > > > > > > > > > Luke Han > > > > > > > > > > On Wed, Jul 29, 2015 at 2:08 PM, hongbin ma <[email protected] > > > > > <javascript:;>> wrote: > > > > > > > > > > > For current 0.7 releases, you cannot. > > > > > > > > > > > > Real time data processing and querying will be added in 0.8 > > release. > > > It > > > > > is > > > > > > still under development and testing. We have achieved good > progress > > > on > > > > > it, > > > > > > please wait for announcements. > > > > > > > > > > > > On Wed, Jul 29, 2015 at 2:02 PM, Siddharth Ubale < > > > > > > [email protected] <javascript:;>> wrote: > > > > > > > > > > > > > Hi , > > > > > > > > > > > > > > I would like to ask whether Kylin can be used as a real time > > > querying > > > > > > > system? > > > > > > > The process of building a cube , makes it look like a batch > > process > > > > > after > > > > > > > which the queries are with low latency.. however can > > > > > > > We get a real time idea of what the OLAP system's state is at > the > > > > query > > > > > > > instance? > > > > > > > > > > > > > > Thanks, > > > > > > > Siddharth > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Regards, > > > > > > > > > > > > *Bin Mahone | 马洪宾* > > > > > > Apache Kylin: http://kylin.io > > > > > > Github: https://github.com/binmahone > > > > > > > > > > > > > > > > > > > > >
