also the free GAE database Jena back-end is limited to a max of 1 GB of data :(
On Fri, May 25, 2012 at 5:09 PM, Marco Neumann <[email protected]> wrote: > Patrick, is that what you have found in the Jena documentation? I will take > a look at my code over the weekend again .... The rows in the GAE datastore > are referenced by keys for which we use URI, the GAE datastore has method > for creating these keys called KeyFactory, all predicates and objects on this > URI are stored in the same row. Here we encountered the problem that Google > limits BigTable to 1000 columns per row. I remember that Taylor had a little > sanfu with source code so it's a good time to review the project in any event > and update to the latest version of Apache Jena. Marco > > On Fri, May 25, 2012 at 4:19 PM, Patrick Thompson <[email protected]> > wrote: >> Thanks Marco, >> I am looking to find the integration points to customize to enable my >> model to persist to accumulo. Here is my impression of what I think needs >> to be done. Please correct as necessary >> >> 1) provide a custom implementation of ModelMaker which will return my >> CustomAccumuloModel::Model (:: --> is of type) >> 2) Provide implementation of CustomAccumuloModel::Model that will also >> implement ModelCon and possibly ModelGraphInterface. >> >> What I do understand is where to hook in my Accumulo DAO that actually >> persists the model to Accumulo. The corresponding RDB code is as so: >> conn = new DBConnection( DB_URL, DB_USER, DB_PASSWD, DB ); >> ModelMaker maker = ModelFactory.createModelRDBMaker(conn) ; >> Model model = maker.createDefaultModel(); >> ... >> model.commit() >> >> Guessing I will have to provide a custom AccumuloConnection class that will >> be referenced by the model so that model.commit() can push the data to the >> store ?? >> >> Thanks, >> P. >> >> >> >> On Fri, May 25, 2012 at 5:54 AM, Marco Neumann >> <[email protected]>wrote: >> >>> Patrick , >>> >>> we basically have just extended the model interface in jena to bind >>> the BigTable column store to the API. >>> >>> though the benefits of the Google App engine are obvious, free hosting >>> and database scaling as web service etc, we have unfortunately >>> observed significant performance issues and some limitations with the >>> BIgTable database implementation for our needs. This might change with >>> future release of Google App Engine framework. But for now I have >>> switched my focus back to TDB which provides sufficient performance >>> for some of our production systems. >>> >>> but if you want to go ahead with your own extension Andy had just >>> posted a link to documentation. Andy can you please re-post the link >>> again here? >>> >>> Marco >>> >>> >>> >>> On Thu, May 24, 2012 at 12:03 AM, Patrick Thompson >>> <[email protected]> wrote: >>> > That is awesome. >>> ... >>> > >>> > On May 23, 2012 5:17 PM, "Marco Neumann" <[email protected]> >>> wrote: >>> >> >>> >> do you want to make this a public or a commercial and private project? >>> >> >>> >> >>> >> On Wed, May 23, 2012 at 6:06 PM, Marco Neumann <[email protected] >>> > >>> >> wrote: >>> >> > we did a Jena implementation with a Google BigTable back-end back in >>> >> > 2010. It's still running here >>> >> > >>> >> > http://geosparql.org/ >>> >> > >>> >> > I am going to publish the documentation hopefully soon, will keep you >>> >> > posted. >>> >> > >>> >> > >>> >> > >>> >> > >>> >> > On Wed, May 23, 2012 at 12:21 PM, Patrick Thompson >>> >> > <[email protected]> wrote: >>> >> >> Hello, >>> >> >> I am looking to store the jena model to a cloud based >>> >> >> datastore(accumulo). I have sifted through the documentation but >>> >> >> haven't >>> >> >> yet found information that would help me do that. So specifically I >>> was >>> >> >> looking at this architecture picture: >>> >> >> http://jena.apache.org/about_jena/architecture.html and am looking >>> to >>> >> >> implement the '?' box. >>> >> >> At least that is what I am hoping I need to do. >>> >> >> >>> >> >> Instead of going to mysql I want to write to a big table of sorts. >>> Any >>> >> >> pointers will be greatly helpful. Thanks. >>> >> >> >>> >> >> p. >>> >> > >>> >> > >>> >> > >>> >> > -- >>> >> > >>> >> > >>> >> > --- >>> >> > Marco Neumann >>> >> > KONA >>> >> > >>> >> > Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >>> >> > with the lotico community discount code 'STMN' >>> >> > http://www.lotico.com/evt/SemTechSF2012/ >>> >> >>> >> >>> >> >>> >> -- >>> >> >>> >> >>> >> --- >>> >> Marco Neumann >>> >> KONA >>> >> >>> >> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >>> >> with the lotico community discount code 'STMN' >>> >> http://www.lotico.com/evt/SemTechSF2012/ >>> >>> >>> >>> -- >>> >>> >>> --- >>> Marco Neumann >>> KONA >>> >>> Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% >>> with the lotico community discount code 'STMN' >>> http://www.lotico.com/evt/SemTechSF2012/ >>> > > > > -- > > > --- > Marco Neumann > KONA > > Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% > with the lotico community discount code 'STMN' > http://www.lotico.com/evt/SemTechSF2012/ -- --- Marco Neumann KONA Join us at SemTech Biz in San Francisco June 3-7 2012 and save 15% with the lotico community discount code 'STMN' http://www.lotico.com/evt/SemTechSF2012/
