Just to add more colors. The 2.0 rc1 has been stabilizing in the 2.0-rc branch for a few month. The 2.0 rc1 contains:
- A plugin-able architecture, to allow alternative cube engine / storage engine / data source. - A better MR cubing algorithm, about 1.5 times faster than 1.x by comparing hundreds of jobs. - A better storage engine, makes query roughly 2 times faster (especially for slow queries) than 1.x by comparing tens of thousands sqls. - Streaming cubing experimental support, source from kafka, build cube in-mem at minutes interval - TopN pre-calculation (more UDFs coming) - ODBC compatible with Tableau 9.1, MS Excel, MS PowerBI - SAML authentication support As the release manager, I will kickoff the release process in two weeks (once back from vacation). ETA by end of Feb. Would love to hear more feedback from our community. :-) Yang On Monday, February 1, 2016, Adunuthula, Seshu <sadunuth...@ebay.com> wrote: > Hello Folks, > > We are actively working towards Apache Kylin 2.0 Release and would like a > discussion with the community on what they would like to see in 2.0 release > of the product. We have three big rock items we are working towards in 2.0 > and lot of additional minor feature enhancements. > > Streaming Data Source support. > This feature is semi baked in where the source of Kylin Cubes is Kafka > Topics. Cube Segment are built on micro batches of messages arriving on > Kafka topics. Currently a lot of work is going on to productize this > feature. Primary areas of work are Stream Processing Engines/Frameworks to > process the micro batches and UI to support out of the box integration of > Kafka topics with Kylin Cubes. > > Spark based Cube building Engine. > The initial performance numbers for a Spark based cubing engine did not > show substantial improvement over MR based engine, but would like this > feature to be baked in for the 2.0 Release. Lot of work underway to > stabilize this feature. > > Amazon EMR Integration > We had initial conversations with Amazon EMR to support Apache Kylin on > Amazon EMR which was received well. With Kylin 2.0 Apache Kylin will be > enabled feature on Amazon EMR. Limited work has gone into this area, but > this will be an important milestone for 2.0 > > We are also working towards creating an area for community driven > improvements page similar to Apache Kafka’s KIP > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals. > Stay tuned. > > Regards > Seshu Adunuthula > > > > >
