Patrick, ok had look at the code again and see have quite some customization of indexes and caches. I will take this thread offline here and get in touch with you directly to discuss further. sorry mixed up Patrick and Paolo earlier.
On Sat, May 26, 2012 at 5:59 AM, Marco Neumann <[email protected]> wrote: > also the free GAE database Jena back-end is limited to a max of 1 GB of data > :( > > On Fri, May 25, 2012 at 5:09 PM, Marco Neumann <[email protected]> > wrote: >> Patrick, is that what you have found in the Jena documentation? I will take >> a look at my code over the weekend again .... The rows in the GAE datastore >> are referenced by keys for which we use URI, the GAE datastore has method >> for creating these keys called KeyFactory, all predicates and objects on >> this URI are stored in the same row. Here we encountered the problem that >> Google limits BigTable to 1000 columns per row. I remember that Taylor had a >> little sanfu with source code so it's a good time to review the project in >> any event and update to the latest version of Apache Jena. > Marco >> >> On Fri, May 25, 2012 at 4:19 PM, Patrick Thompson <[email protected]> >> wrote: >>> Thanks Marco, >>> I am looking to find the integration points to customize to enable my >>> model to persist to accumulo. Here is my impression of what I think needs >>> to be done. Please correct as necessary >>> >>> 1) provide a custom implementation of ModelMaker which will return my >>> CustomAccumuloModel::Model (:: --> is of type) >>> 2) Provide implementation of CustomAccumuloModel::Model that will also >>> implement ModelCon and possibly ModelGraphInterface. >>> >>> What I do understand is where to hook in my Accumulo DAO that actually >>> persists the model to Accumulo. The corresponding RDB code is as so: >>> conn = new DBConnection( DB_URL, DB_USER, DB_PASSWD, DB ); >>> ModelMaker maker = ModelFactory.createModelRDBMaker(conn) ; >>> Model model = maker.createDefaultModel(); >>> ... >>> model.commit() >>> >>> Guessing I will have to provide a custom AccumuloConnection class that will >>> be referenced by the model so that model.commit() can push the data to the >>> store ?? >>> >>> Thanks, >>> P. >>> >>> >>> >>> On Fri, May 25, 2012 at 5:54 AM, Marco Neumann >>> <[email protected]>wrote: >>> >>>> Patrick , >>>> >>>> we basically have just extended the model interface in jena to bind >>>> the BigTable column store to the API. >>>> >>>> though the benefits of the Google App engine are obvious, free hosting >>>> and database scaling as web service etc, we have unfortunately >>>> observed significant performance issues and some limitations with the >>>> BIgTable database implementation for our needs. This might change with >>>> future release of Google App Engine framework. But for now I have >>>> switched my focus back to TDB which provides sufficient performance >>>> for some of our production systems. >>>> >>>> but if you want to go ahead with your own extension Andy had just >>>> posted a link to documentation. Andy can you please re-post the link >>>> again here? >>>> >>>> Marco >>>> >>>> >>>> >>>> On Thu, May 24, 2012 at 12:03 AM, Patrick Thompson >>>> <[email protected]> wrote: >>>> > That is awesome. >>>> ... >>>> > >>>> > On May 23, 2012 5:17 PM, "Marco Neumann" <[email protected]> >>>> wrote: >>>> >> >>>> >> do you want to make this a public or a commercial and private project? >>>> >> >>>> >> >>>> >> On Wed, May 23, 2012 at 6:06 PM, Marco Neumann <[email protected] >>>> > >>>> >> wrote: >>>> >> > we did a Jena implementation with a Google BigTable back-end back in >>>> >> > 2010. It's still running here >>>> >> > >>>> >> > http://geosparql.org/ >>>> >> > >>>> >> > I am going to publish the documentation hopefully soon, will keep you >>>> >> > posted. >>>> >> > >>>> >> > >>>> >> > >>>> >> > >>>> >> > On Wed, May 23, 2012 at 12:21 PM, Patrick Thompson >>>> >> > <[email protected]> wrote: >>>> >> >> Hello, >>>> >> >> I am looking to store the jena model to a cloud based >>>> >> >> datastore(accumulo). I have sifted through the documentation but >>>> >> >> haven't >>>> >> >> yet found information that would help me do that. So specifically I >>>> was >>>> >> >> looking at this architecture picture: >>>> >> >> http://jena.apache.org/about_jena/architecture.html and am looking >>>> to >>>> >> >> implement the '?' box. >>>> >> >> At least that is what I am hoping I need to do. >>>> >> >> >>>> >> >> Instead of going to mysql I want to write to a big table of sorts. >>>> Any >>>> >> >> pointers will be greatly helpful. Thanks. >>>> >> >> >>>> >> >> p. >>>> >> > >>>> >> > >>>> >> > >>>> >> > -- >>>> >> > >>>> >> > >>>> >> > --- >>>> >> > Marco Neumann >>>> >> > KONA >>>> >> > >>>> >> > Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >>>> >> > with the lotico community discount code 'STMN' >>>> >> > http://www.lotico.com/evt/SemTechSF2012/ >>>> >> >>>> >> >>>> >> >>>> >> -- >>>> >> >>>> >> >>>> >> --- >>>> >> Marco Neumann >>>> >> KONA >>>> >> >>>> >> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >>>> >> with the lotico community discount code 'STMN' >>>> >> http://www.lotico.com/evt/SemTechSF2012/ >>>> >>>> >>>> >>>> -- >>>> >>>> >>>> --- >>>> Marco Neumann >>>> KONA >>>> >>>> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >>>> with the lotico community discount code 'STMN' >>>> http://www.lotico.com/evt/SemTechSF2012/ >>>> >> >> >> >> -- >> >> >> --- >> Marco Neumann >> KONA >> >> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >> with the lotico community discount code 'STMN' >> http://www.lotico.com/evt/SemTechSF2012/ > > > > -- > > > --- > Marco Neumann > KONA > > Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% > with the lotico community discount code 'STMN' > http://www.lotico.com/evt/SemTechSF2012/ -- --- Marco Neumann KONA Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% with the lotico community discount code 'STMN' http://www.lotico.com/evt/SemTechSF2012/
