Hi Sheriffo, Thank you for your findings and hard work on this. I agree on most of the points you already mentioned. But I dont think we have consistent client implementations across all data stores in Apache Gora. That means some clients use async version of their API s as default, some uses sync. Some clients have connection pooling implemented and some use single connection to do all the data store work. These configurations will generally change the behavior when these client s are performed under a huge load. I think we will be good, if we do track the client setup/configurations in which benchmarks are captured.
Regards Kevin On Tue, Jul 23, 2019 at 2:14 PM Sheriffo Ceesay <sneceesa...@gmail.com> wrote: > **Sheriffo Ceesay** > > > On Tue, Jul 23, 2019 at 6:52 AM Kevin Ratnasekera <djkevincr1...@gmail.com > > > wrote: > > > Hi Sheriffo, > > > > Adding to what Kamaci already mentioned, Have you tried Hbase-Store with > > buffered mutator engaged? [1] It allows HBase operations Eg:- puts to be > > batched and asynchronous. > > > Hi Kevin, > Yes I am using *gora.hbasestore.hbase.client.autoflush.enabled=true *in the > gora.properties file. > > > > > On related note also have a look on points where > > you flush() the datastore with native HBase implementation. > > > > The native implementation is through Yahoo! Cloud Service Benchmark. I > haven't gone through their implementation. I think it may be due to the > default configuration that I am using. I will try to dig further to see if > I can strike some improvement. > > > > > > [1] gora.hbasestore.hbase.client.autoflush.enabled=true > > > > Regards > > Kevin > > > > On Tue, Jul 23, 2019 at 5:40 AM Furkan KAMACI <furkankam...@gmail.com> > > wrote: > > > > > Hi Sheriffo, > > > > > > I've checked all the GSoC reports including your's. Thanks for filling > > > your reports with time slot information about tasks. > > > > > > You have 3 benchmark result charts at your Week 8 Report. Hbase-native > is > > > dramatically slow compared to the others at 2 out of 3. Do you have any > > > comment about it? > > > > > > Kind Regards, > > > Furkan KAMACI > > > > > > On Sun, Jul 21, 2019 at 7:33 PM Sheriffo Ceesay <sneceesa...@gmail.com > > > > > wrote: > > > > > >> Week eight report is available at > > >> > > >> > > > https://cwiki.apache.org/confluence/display/GORA/%5BGORA-532%5D+Apache+Gora+Benchmark+Module+Weekly+Report > > >> > > >> I ran some workloads to compare Gora implementation of Mongo and HBase > > to > > >> the native implementations. Plots are provided in the reports and the > > >> generated data is also available at [1]. This is a work in progress, I > > >> have > > >> done Workload A and Workload B [2]. > > >> > > >> Please let me know if you have any suggestions or questions. > > >> > > >> [1] https://github.com/sneceesay77/gora/tree/GORA-532 > > >> [2] https://github.com/brianfrankcooper/YCSB/wiki/Core-Workloads > > >> > > >> > > >> **Sheriffo Ceesay** > > >> > > > > > >
