This is very interesting and I for one would like to help. Especially if eventually targeting accumulo. Is this discussion some that can be attached to a new or existing JIRA? Maybe a forum in github? On May 26, 2012 10:23 AM, "Marco Neumann" <[email protected]> wrote:
> Patrick, ok had look at the code again and see have quite some > customization of indexes and caches. I will take this thread offline > here and get in touch with you directly to discuss further. sorry > mixed up Patrick and Paolo earlier. > > > On Sat, May 26, 2012 at 5:59 AM, Marco Neumann <[email protected]> > wrote: > > also the free GAE database Jena back-end is limited to a max of 1 GB of > data :( > > > > On Fri, May 25, 2012 at 5:09 PM, Marco Neumann <[email protected]> > wrote: > >> Patrick, is that what you have found in the Jena documentation? I will > take a look at my code over the weekend again .... The rows in the GAE > datastore are referenced by keys for which we use URI, the GAE datastore > has method for creating these keys called KeyFactory, all predicates and > objects on this URI are stored in the same row. Here we encountered the > problem that Google limits BigTable to 1000 columns per row. I remember > that Taylor had a little sanfu with source code so it's a good time to > review the project in any event and update to the latest version of Apache > Jena. > > Marco > >> > >> On Fri, May 25, 2012 at 4:19 PM, Patrick Thompson < > [email protected]> wrote: > >>> Thanks Marco, > >>> I am looking to find the integration points to customize to enable my > >>> model to persist to accumulo. Here is my impression of what I think > needs > >>> to be done. Please correct as necessary > >>> > >>> 1) provide a custom implementation of ModelMaker which will return my > >>> CustomAccumuloModel::Model (:: --> is of type) > >>> 2) Provide implementation of CustomAccumuloModel::Model that will also > >>> implement ModelCon and possibly ModelGraphInterface. > >>> > >>> What I do understand is where to hook in my Accumulo DAO that actually > >>> persists the model to Accumulo. The corresponding RDB code is as so: > >>> conn = new DBConnection( DB_URL, DB_USER, DB_PASSWD, DB ); > >>> ModelMaker maker = ModelFactory.createModelRDBMaker(conn) ; > >>> Model model = maker.createDefaultModel(); > >>> ... > >>> model.commit() > >>> > >>> Guessing I will have to provide a custom AccumuloConnection class that > will > >>> be referenced by the model so that model.commit() can push the data to > the > >>> store ?? > >>> > >>> Thanks, > >>> P. > >>> > >>> > >>> > >>> On Fri, May 25, 2012 at 5:54 AM, Marco Neumann < > [email protected]>wrote: > >>> > >>>> Patrick , > >>>> > >>>> we basically have just extended the model interface in jena to bind > >>>> the BigTable column store to the API. > >>>> > >>>> though the benefits of the Google App engine are obvious, free hosting > >>>> and database scaling as web service etc, we have unfortunately > >>>> observed significant performance issues and some limitations with the > >>>> BIgTable database implementation for our needs. This might change with > >>>> future release of Google App Engine framework. But for now I have > >>>> switched my focus back to TDB which provides sufficient performance > >>>> for some of our production systems. > >>>> > >>>> but if you want to go ahead with your own extension Andy had just > >>>> posted a link to documentation. Andy can you please re-post the link > >>>> again here? > >>>> > >>>> Marco > >>>> > >>>> > >>>> > >>>> On Thu, May 24, 2012 at 12:03 AM, Patrick Thompson > >>>> <[email protected]> wrote: > >>>> > That is awesome. > >>>> ... > >>>> > > >>>> > On May 23, 2012 5:17 PM, "Marco Neumann" <[email protected]> > >>>> wrote: > >>>> >> > >>>> >> do you want to make this a public or a commercial and private > project? > >>>> >> > >>>> >> > >>>> >> On Wed, May 23, 2012 at 6:06 PM, Marco Neumann < > [email protected] > >>>> > > >>>> >> wrote: > >>>> >> > we did a Jena implementation with a Google BigTable back-end > back in > >>>> >> > 2010. It's still running here > >>>> >> > > >>>> >> > http://geosparql.org/ > >>>> >> > > >>>> >> > I am going to publish the documentation hopefully soon, will > keep you > >>>> >> > posted. > >>>> >> > > >>>> >> > > >>>> >> > > >>>> >> > > >>>> >> > On Wed, May 23, 2012 at 12:21 PM, Patrick Thompson > >>>> >> > <[email protected]> wrote: > >>>> >> >> Hello, > >>>> >> >> I am looking to store the jena model to a cloud based > >>>> >> >> datastore(accumulo). I have sifted through the documentation but > >>>> >> >> haven't > >>>> >> >> yet found information that would help me do that. So > specifically I > >>>> was > >>>> >> >> looking at this architecture picture: > >>>> >> >> http://jena.apache.org/about_jena/architecture.html and am > looking > >>>> to > >>>> >> >> implement the '?' box. > >>>> >> >> At least that is what I am hoping I need to do. > >>>> >> >> > >>>> >> >> Instead of going to mysql I want to write to a big table of > sorts. > >>>> Any > >>>> >> >> pointers will be greatly helpful. Thanks. > >>>> >> >> > >>>> >> >> p. > >>>> >> > > >>>> >> > > >>>> >> > > >>>> >> > -- > >>>> >> > > >>>> >> > > >>>> >> > --- > >>>> >> > Marco Neumann > >>>> >> > KONA > >>>> >> > > >>>> >> > Join us at SemTech Biz in San Francisco June 3-7 2012 and save > 15% > >>>> >> > with the lotico community discount code 'STMN' > >>>> >> > http://www.lotico.com/evt/SemTechSF2012/ > >>>> >> > >>>> >> > >>>> >> > >>>> >> -- > >>>> >> > >>>> >> > >>>> >> --- > >>>> >> Marco Neumann > >>>> >> KONA > >>>> >> > >>>> >> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% > >>>> >> with the lotico community discount code 'STMN' > >>>> >> http://www.lotico.com/evt/SemTechSF2012/ > >>>> > >>>> > >>>> > >>>> -- > >>>> > >>>> > >>>> --- > >>>> Marco Neumann > >>>> KONA > >>>> > >>>> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% > >>>> with the lotico community discount code 'STMN' > >>>> http://www.lotico.com/evt/SemTechSF2012/ > >>>> > >> > >> > >> > >> -- > >> > >> > >> --- > >> Marco Neumann > >> KONA > >> > >> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% > >> with the lotico community discount code 'STMN' > >> http://www.lotico.com/evt/SemTechSF2012/ > > > > > > > > -- > > > > > > --- > > Marco Neumann > > KONA > > > > Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% > > with the lotico community discount code 'STMN' > > http://www.lotico.com/evt/SemTechSF2012/ > > > > -- > > > --- > Marco Neumann > KONA > > Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% > with the lotico community discount code 'STMN' > http://www.lotico.com/evt/SemTechSF2012/ >
