What about our idea of using the Siddhi language for the long-running map reduce side as well?
Paul On 5 September 2014 09:57, Srinath Perera <[email protected]> wrote: > Hi All, > > Hazelcast now also have a MapReduce implementation. May be we can change > hive so it can also submit jobs to Hazelcast in addition to MapReduce. Then > users can load lot of data to hazelcast and process them with HiveSQL. > > 1. It will enable users to also do in memory computing using Hive SQL > 2. It will enable ad-hoc queries that return fast results over a large > dataset using HiveSQL > > IMO it will be a pretty tool In-memory computing scenario. > > WDYT? > > --Srinath > > p.s. One concern is when we support Spark, it will also have much similar > support via .cache() in RDDs. So this might be a redundant feature at the > time. > > > > -- > ============================ > Director, Research, WSO2 Inc. > Visiting Faculty, University of Moratuwa > Member, Apache Software Foundation > Research Scientist, Lanka Software Foundation > Blog: http://srinathsview.blogspot.com twitter:@srinath_perera > Site: http://people.apache.org/~hemapani/ > Photos: http://www.flickr.com/photos/hemapani/ > Phone: 0772360902 > -- Paul Fremantle CTO and Co-Founder, WSO2 OASIS WS-RX TC Co-chair, Apache Member UK: +44 207 096 0336 blog: http://pzf.fremantle.org twitter.com/pzfreo [email protected] wso2.com Lean Enterprise Middleware Disclaimer: This communication may contain privileged or other confidential information and is intended exclusively for the addressee/s. If you are not the intended recipient/s, or believe that you may have received this communication in error, please reply to the sender indicating that fact and delete the copy you received and in addition, you should not print, copy, retransmit, disseminate, or otherwise use the information contained in this communication. Internet communications cannot be guaranteed to be timely, secure, error or virus-free. The sender does not accept liability for any errors or omissions.
_______________________________________________ Architecture mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
