Harshal, As David said, while working on Datapress, Edward Benson and I have been thinking about this problem. We're working on building an apache module/python script that will turn datasets into sqllite databases on the server side, so that if a dataset is too large to send across the network, all queries can hit the server. The benefit of using sqllite is that it's also what is used by both gears and is available in firefox (all html5-compliant browsers will have it soon), so we can also opt to send the dataset to the client for better client-side data processing.
The step after that will be to allow exhibit to speak with this data-aware webserver to decide whether to run the query remotely or locally. David Huynh was our inspiration for this idea, since he created a prototype of it before heading west. Hang in there, and we'll give more information as it comes out! -Adam On Thu, Apr 2, 2009 at 2:12 AM, David Huynh <[email protected]> wrote: > > Harshal, > > David Karger and his students have been pondering about that option, I > believe. We just need someone to roll up their sleeves and try it out. > Do note that, of course, those 10K-50K items still need to make their > way over HTTP each time. > > David > > harshal wrote: >> Hi, >> >> Is it possible to increase scalability of Exhibit by using Google >> Gears (or similar)? >> >> If I understand Google Gears and Exhibit enough, I think they can be >> fit together, at least to some extent, so that more elements can be >> processed through this approach. Most of the Exhibit users have 'large- >> scale' requirement to handle 10K-50K items. >> >> I would appreciate any view/comment on this. >> >> Thanks your time and efforts. >> >> With regards, >> ./harshal >> >> > >> > > > > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "SIMILE Widgets" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/simile-widgets?hl=en -~----------~----~----~----~------~----~------~--~---
