Hi Kevin, Thanks again for the input.
I have taken note of your comments and I will factor them in moving forward. Thank you. **Sheriffo Ceesay** On Tue, Jul 23, 2019 at 10:13 AM Kevin Ratnasekera <djkevincr1...@gmail.com> wrote: > Hi Sheriffo, > > Thank you for your findings and hard work on this. I agree on most of the > points you already mentioned. But I dont think we have consistent client > implementations across all data stores in Apache Gora. That means some > clients use async version of their API s as default, some uses sync. Some > clients have connection pooling implemented and some use single connection > to do all the data store work. These configurations will generally change > the behavior when these client s are performed under a huge load. I think > we will be good, if we do track the client setup/configurations in which > benchmarks are captured. > > Regards > Kevin > > On Tue, Jul 23, 2019 at 2:14 PM Sheriffo Ceesay <sneceesa...@gmail.com> > wrote: > > > **Sheriffo Ceesay** > > > > > > On Tue, Jul 23, 2019 at 6:52 AM Kevin Ratnasekera < > djkevincr1...@gmail.com > > > > > wrote: > > > > > Hi Sheriffo, > > > > > > Adding to what Kamaci already mentioned, Have you tried Hbase-Store > with > > > buffered mutator engaged? [1] It allows HBase operations Eg:- puts to > be > > > batched and asynchronous. > > > > > > Hi Kevin, > > Yes I am using *gora.hbasestore.hbase.client.autoflush.enabled=true *in > the > > gora.properties file. > > > > > > > > > On related note also have a look on points where > > > you flush() the datastore with native HBase implementation. > > > > > > > The native implementation is through Yahoo! Cloud Service Benchmark. I > > haven't gone through their implementation. I think it may be due to the > > default configuration that I am using. I will try to dig further to see > if > > I can strike some improvement. > > > > > > > > > > [1] gora.hbasestore.hbase.client.autoflush.enabled=true > > > > > > Regards > > > Kevin > > > > > > On Tue, Jul 23, 2019 at 5:40 AM Furkan KAMACI <furkankam...@gmail.com> > > > wrote: > > > > > > > Hi Sheriffo, > > > > > > > > I've checked all the GSoC reports including your's. Thanks for > filling > > > > your reports with time slot information about tasks. > > > > > > > > You have 3 benchmark result charts at your Week 8 Report. > Hbase-native > > is > > > > dramatically slow compared to the others at 2 out of 3. Do you have > any > > > > comment about it? > > > > > > > > Kind Regards, > > > > Furkan KAMACI > > > > > > > > On Sun, Jul 21, 2019 at 7:33 PM Sheriffo Ceesay < > sneceesa...@gmail.com > > > > > > > wrote: > > > > > > > >> Week eight report is available at > > > >> > > > >> > > > > > > https://cwiki.apache.org/confluence/display/GORA/%5BGORA-532%5D+Apache+Gora+Benchmark+Module+Weekly+Report > > > >> > > > >> I ran some workloads to compare Gora implementation of Mongo and > HBase > > > to > > > >> the native implementations. Plots are provided in the reports and > the > > > >> generated data is also available at [1]. This is a work in > progress, I > > > >> have > > > >> done Workload A and Workload B [2]. > > > >> > > > >> Please let me know if you have any suggestions or questions. > > > >> > > > >> [1] https://github.com/sneceesay77/gora/tree/GORA-532 > > > >> [2] https://github.com/brianfrankcooper/YCSB/wiki/Core-Workloads > > > >> > > > >> > > > >> **Sheriffo Ceesay** > > > >> > > > > > > > > > >
