On related note: Please also make on note on the client version of the libraries we are testing for both native and gora implementations.
On Tue, Jul 23, 2019 at 2:43 PM Kevin Ratnasekera <djkevincr1...@gmail.com> wrote: > Hi Sheriffo, > > Thank you for your findings and hard work on this. I agree on most of the > points you already mentioned. But I dont think we have consistent client > implementations across all data stores in Apache Gora. That means some > clients use async version of their API s as default, some uses sync. Some > clients have connection pooling implemented and some use single connection > to do all the data store work. These configurations will generally change > the behavior when these client s are performed under a huge load. I think > we will be good, if we do track the client setup/configurations in which > benchmarks are captured. > > Regards > Kevin > > On Tue, Jul 23, 2019 at 2:14 PM Sheriffo Ceesay <sneceesa...@gmail.com> > wrote: > >> **Sheriffo Ceesay** >> >> >> On Tue, Jul 23, 2019 at 6:52 AM Kevin Ratnasekera < >> djkevincr1...@gmail.com> >> wrote: >> >> > Hi Sheriffo, >> > >> > Adding to what Kamaci already mentioned, Have you tried Hbase-Store with >> > buffered mutator engaged? [1] It allows HBase operations Eg:- puts to be >> > batched and asynchronous. >> >> >> Hi Kevin, >> Yes I am using *gora.hbasestore.hbase.client.autoflush.enabled=true *in >> the >> gora.properties file. >> >> >> >> > On related note also have a look on points where >> > you flush() the datastore with native HBase implementation. >> > >> >> The native implementation is through Yahoo! Cloud Service Benchmark. I >> haven't gone through their implementation. I think it may be due to the >> default configuration that I am using. I will try to dig further to see if >> I can strike some improvement. >> >> >> > >> > [1] gora.hbasestore.hbase.client.autoflush.enabled=true >> > >> > Regards >> > Kevin >> > >> > On Tue, Jul 23, 2019 at 5:40 AM Furkan KAMACI <furkankam...@gmail.com> >> > wrote: >> > >> > > Hi Sheriffo, >> > > >> > > I've checked all the GSoC reports including your's. Thanks for filling >> > > your reports with time slot information about tasks. >> > > >> > > You have 3 benchmark result charts at your Week 8 Report. >> Hbase-native is >> > > dramatically slow compared to the others at 2 out of 3. Do you have >> any >> > > comment about it? >> > > >> > > Kind Regards, >> > > Furkan KAMACI >> > > >> > > On Sun, Jul 21, 2019 at 7:33 PM Sheriffo Ceesay < >> sneceesa...@gmail.com> >> > > wrote: >> > > >> > >> Week eight report is available at >> > >> >> > >> >> > >> https://cwiki.apache.org/confluence/display/GORA/%5BGORA-532%5D+Apache+Gora+Benchmark+Module+Weekly+Report >> > >> >> > >> I ran some workloads to compare Gora implementation of Mongo and >> HBase >> > to >> > >> the native implementations. Plots are provided in the reports and the >> > >> generated data is also available at [1]. This is a work in progress, >> I >> > >> have >> > >> done Workload A and Workload B [2]. >> > >> >> > >> Please let me know if you have any suggestions or questions. >> > >> >> > >> [1] https://github.com/sneceesay77/gora/tree/GORA-532 >> > >> [2] https://github.com/brianfrankcooper/YCSB/wiki/Core-Workloads >> > >> >> > >> >> > >> **Sheriffo Ceesay** >> > >> >> > > >> > >> >
