Michael i was thinking about this too but from slighly different angle let's assume client application is running on windows platform and is accessing database through ado.net driver. ( simular case can be made for odbc connections or java jdbc drivers) suppose we had replaced the standard ado.net driver with our own custom one which instead of going to relational database directly first sees if query can be satisfied from fastbit caching storage and if not passes the query to database, else translates ado.net sql query into fastbit calls and returns standard ado,net recordset in both cases. such architecture would admit multiple caching layers including fastbit, materalized views, cubes, column (vertica) or array stores (scidb), maybe even hadoop based clouds and finally relational dbs
John what do you think? > > > > Today's Topics: > > 1. creating in-memory tables ([email protected]) > 2. Re: creating in-memory tables (K. John Wu) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 15 Jun 2011 12:11:34 +0100 > From: <[email protected]> > Subject: [FastBit-users] creating in-memory tables > To: <[email protected]> > Message-ID: > > <9ef406c06d92c8429bdd1fca60487adf02699b0...@ldnpcmmgmb09.intranet.barcapint.com> > > Content-Type: text/plain; charset="us-ascii" > > Hi, > > I've only just downloaded fastbit: so please excuse the newbie question .. > I'd like to find out how feasible/thoughts on the following: > > I have a large Oracle db with star-schema, I query this and get back result > sets - On the client side as a cache, I'd like to create tablex objects > that hold the result sets and then build interface using query objects. > Any potential problems with this? Can I create tables on-the-fly like this? > (i.e. don't need to read them from a flat file). > > In essence on a powerful client, I can use fastbit to essentially replace > what would have been an OLAP Cube, Materialised View or less efficient > c-store than > Fastbit. > > Rds, > Mike > > > > _______________________________________________ > > This e-mail may contain information that is confidential, privileged or > otherwise protected from disclosure. If you are not an intended recipient of > this e-mail, do not duplicate or redistribute it by any means. Please delete > it and any attachments and notify the sender that you have received it in > error. Unless specifically indicated, this e-mail is not an offer to buy or > sell or a solicitation to buy or sell any securities, investment products or > other financial product or service, an official confirmation of any > transaction, or an official statement of Barclays. Any views or opinions > presented are solely those of the author and do not necessarily represent > those of Barclays. This e-mail is subject to terms available at the following > link: www.barcap.com/emaildisclaimer. By messaging with Barclays you consent > to the foregoing. Barclays Capital is the investment banking division of > Barclays Bank PLC, a company registered in England (number 1026167) with its > registered off ic > e at 1 Churchill Place, London, E14 5HP. This email may relate to or be sent > from other members of the Barclays Group. > _______________________________________________ > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: > http://hpcrdm.lbl.gov/pipermail/fastbit-users/attachments/20110615/7d89a89d/attachment-0001.htm > > > ------------------------------ > > Message: 2 > Date: Wed, 15 Jun 2011 07:53:59 -0700 > From: "K. John Wu" <[email protected]> > Subject: Re: [FastBit-users] creating in-memory tables > To: FastBit Users <[email protected]> > Cc: [email protected] > Message-ID: <[email protected]> > Content-Type: text/plain; charset=windows-1252; format=flowed > > Hi, Mike, > > Thanks for your interest in FastBit. > > At this point, ibis::tablex has only functions that accept data, there > is no function that can perform queries. Looks like you are looking > to combine them. A simple thing for me to do might be to add a > function to convert an existing ibis::tablex object into an > ibis::table object. This will support the following scenario > > - Build an ibis::tablex object to receive the content from your Oracle > query, > - Convert the ibis::tablex object into an ibis::table object, > - Query the ibis::table object > > Is this something useful enough? Any alternative suggestions? > > John > > PS: It might take a week or two before the propose function can be > implemented. > > > On 6/15/11 4:11 AM, [email protected] wrote: >> Hi, >> >> I?ve only just downloaded fastbit: so please excuse the newbie >> question .. I?d like to find out how feasible/thoughts on the following: >> >> I have a large Oracle db with star-schema, I query this and get back >> result sets ? On the client side as a cache, I?d like to create tablex >> objects >> >> that hold the result sets and then build interface using query objects. >> >> Any potential problems with this? Can I create tables on-the-fly like >> this? (i.e. don?t need to read them from a flat file). >> >> In essence on a powerful client, I can use fastbit to essentially >> replace what would have been an OLAP Cube, Materialised View or less >> efficient c-store than >> >> Fastbit. >> >> Rds, >> >> Mike >> >> _______________________________________________ >> >> This e-mail may contain information that is confidential, privileged >> or otherwise protected from disclosure. If you are not an intended >> recipient of this e-mail, do not duplicate or redistribute it by any >> means. Please delete it and any attachments and notify the sender that >> you have received it in error. Unless specifically indicated, this >> e-mail is not an offer to buy or sell or a solicitation to buy or sell >> any securities, investment products or other financial product or >> service, an official confirmation of any transaction, or an official >> statement of Barclays. Any views or opinions presented are solely >> those of the author and do not necessarily represent those of >> Barclays. This e-mail is subject to terms available at the following >> link: www.barcap.com/emaildisclaimer >> <http://www.barcap.com/emaildisclaimer>. By messaging with Barclays >> you consent to the foregoing.Barclays Capital is the investment >> banking division of Barclays Bank PLC, a company registered in England >> (number 1026167) with its registered office at 1 Churchill Place, >> London, E14 5HP.This email may relate to or be sent from other members >> of the Barclays Group.// >> >> _______________________________________________ >> >> >> >> _______________________________________________ >> FastBit-users mailing list >> [email protected] >> https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users > > > ------------------------------ > > _______________________________________________ > FastBit-users mailing list > [email protected] > https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users > > > End of FastBit-users Digest, Vol 46, Issue 4 > ******************************************** _______________________________________________ FastBit-users mailing list [email protected] https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
