I would think it makes sense to move this to another list yes since most of the code discussion is around GAE runtime issues.
On Sat, May 26, 2012 at 10:30 AM, Erik Antelman <[email protected]> wrote: > This is very interesting and I for one would like to help. Especially if > eventually targeting accumulo. Is this discussion some that can be attached > to a new or existing JIRA? Maybe a forum in github? > On May 26, 2012 10:23 AM, "Marco Neumann" <[email protected]> wrote: > >> Patrick, ok had look at the code again and see have quite some >> customization of indexes and caches. I will take this thread offline >> here and get in touch with you directly to discuss further. sorry >> mixed up Patrick and Paolo earlier. >> >> >> On Sat, May 26, 2012 at 5:59 AM, Marco Neumann <[email protected]> >> wrote: >> > also the free GAE database Jena back-end is limited to a max of 1 GB of >> data :( >> > >> > On Fri, May 25, 2012 at 5:09 PM, Marco Neumann <[email protected]> >> wrote: >> >> Patrick, is that what you have found in the Jena documentation? I will >> take a look at my code over the weekend again .... The rows in the GAE >> datastore are referenced by keys for which we use URI, the GAE datastore >> has method for creating these keys called KeyFactory, all predicates and >> objects on this URI are stored in the same row. Here we encountered the >> problem that Google limits BigTable to 1000 columns per row. I remember >> that Taylor had a little sanfu with source code so it's a good time to >> review the project in any event and update to the latest version of Apache >> Jena. >> > Marco >> >> >> >> On Fri, May 25, 2012 at 4:19 PM, Patrick Thompson < >> [email protected]> wrote: >> >>> Thanks Marco, >> >>> I am looking to find the integration points to customize to enable my >> >>> model to persist to accumulo. Here is my impression of what I think >> needs >> >>> to be done. Please correct as necessary >> >>> >> >>> 1) provide a custom implementation of ModelMaker which will return my >> >>> CustomAccumuloModel::Model (:: --> is of type) >> >>> 2) Provide implementation of CustomAccumuloModel::Model that will also >> >>> implement ModelCon and possibly ModelGraphInterface. >> >>> >> >>> What I do understand is where to hook in my Accumulo DAO that actually >> >>> persists the model to Accumulo. The corresponding RDB code is as so: >> >>> conn = new DBConnection( DB_URL, DB_USER, DB_PASSWD, DB ); >> >>> ModelMaker maker = ModelFactory.createModelRDBMaker(conn) ; >> >>> Model model = maker.createDefaultModel(); >> >>> ... >> >>> model.commit() >> >>> >> >>> Guessing I will have to provide a custom AccumuloConnection class that >> will >> >>> be referenced by the model so that model.commit() can push the data to >> the >> >>> store ?? >> >>> >> >>> Thanks, >> >>> P. >> >>> >> >>> >> >>> >> >>> On Fri, May 25, 2012 at 5:54 AM, Marco Neumann < >> [email protected]>wrote: >> >>> >> >>>> Patrick , >> >>>> >> >>>> we basically have just extended the model interface in jena to bind >> >>>> the BigTable column store to the API. >> >>>> >> >>>> though the benefits of the Google App engine are obvious, free hosting >> >>>> and database scaling as web service etc, we have unfortunately >> >>>> observed significant performance issues and some limitations with the >> >>>> BIgTable database implementation for our needs. This might change with >> >>>> future release of Google App Engine framework. But for now I have >> >>>> switched my focus back to TDB which provides sufficient performance >> >>>> for some of our production systems. >> >>>> >> >>>> but if you want to go ahead with your own extension Andy had just >> >>>> posted a link to documentation. Andy can you please re-post the link >> >>>> again here? >> >>>> >> >>>> Marco >> >>>> >> >>>> >> >>>> >> >>>> On Thu, May 24, 2012 at 12:03 AM, Patrick Thompson >> >>>> <[email protected]> wrote: >> >>>> > That is awesome. >> >>>> ... >> >>>> > >> >>>> > On May 23, 2012 5:17 PM, "Marco Neumann" <[email protected]> >> >>>> wrote: >> >>>> >> >> >>>> >> do you want to make this a public or a commercial and private >> project? >> >>>> >> >> >>>> >> >> >>>> >> On Wed, May 23, 2012 at 6:06 PM, Marco Neumann < >> [email protected] >> >>>> > >> >>>> >> wrote: >> >>>> >> > we did a Jena implementation with a Google BigTable back-end >> back in >> >>>> >> > 2010. It's still running here >> >>>> >> > >> >>>> >> > http://geosparql.org/ >> >>>> >> > >> >>>> >> > I am going to publish the documentation hopefully soon, will >> keep you >> >>>> >> > posted. >> >>>> >> > >> >>>> >> > >> >>>> >> > >> >>>> >> > >> >>>> >> > On Wed, May 23, 2012 at 12:21 PM, Patrick Thompson >> >>>> >> > <[email protected]> wrote: >> >>>> >> >> Hello, >> >>>> >> >> I am looking to store the jena model to a cloud based >> >>>> >> >> datastore(accumulo). I have sifted through the documentation but >> >>>> >> >> haven't >> >>>> >> >> yet found information that would help me do that. So >> specifically I >> >>>> was >> >>>> >> >> looking at this architecture picture: >> >>>> >> >> http://jena.apache.org/about_jena/architecture.html and am >> looking >> >>>> to >> >>>> >> >> implement the '?' box. >> >>>> >> >> At least that is what I am hoping I need to do. >> >>>> >> >> >> >>>> >> >> Instead of going to mysql I want to write to a big table of >> sorts. >> >>>> Any >> >>>> >> >> pointers will be greatly helpful. Thanks. >> >>>> >> >> >> >>>> >> >> p. >> >>>> >> > >> >>>> >> > >> >>>> >> > >> >>>> >> > -- >> >>>> >> > >> >>>> >> > >> >>>> >> > --- >> >>>> >> > Marco Neumann >> >>>> >> > KONA >> >>>> >> > >> >>>> >> > Join us at SemTech Biz in San Francisco June 3-7 2012 and save >> 15% >> >>>> >> > with the lotico community discount code 'STMN' >> >>>> >> > http://www.lotico.com/evt/SemTechSF2012/ >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> -- >> >>>> >> >> >>>> >> >> >>>> >> --- >> >>>> >> Marco Neumann >> >>>> >> KONA >> >>>> >> >> >>>> >> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >> >>>> >> with the lotico community discount code 'STMN' >> >>>> >> http://www.lotico.com/evt/SemTechSF2012/ >> >>>> >> >>>> >> >>>> >> >>>> -- >> >>>> >> >>>> >> >>>> --- >> >>>> Marco Neumann >> >>>> KONA >> >>>> >> >>>> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >> >>>> with the lotico community discount code 'STMN' >> >>>> http://www.lotico.com/evt/SemTechSF2012/ >> >>>> >> >> >> >> >> >> >> >> -- >> >> >> >> >> >> --- >> >> Marco Neumann >> >> KONA >> >> >> >> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >> >> with the lotico community discount code 'STMN' >> >> http://www.lotico.com/evt/SemTechSF2012/ >> > >> > >> > >> > -- >> > >> > >> > --- >> > Marco Neumann >> > KONA >> > >> > Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >> > with the lotico community discount code 'STMN' >> > http://www.lotico.com/evt/SemTechSF2012/ >> >> >> >> -- >> >> >> --- >> Marco Neumann >> KONA >> >> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >> with the lotico community discount code 'STMN' >> http://www.lotico.com/evt/SemTechSF2012/ >> -- --- Marco Neumann KONA Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% with the lotico community discount code 'STMN' http://www.lotico.com/evt/SemTechSF2012/
