Finished unacked pubs: tput = 1275.9486132380466 ops/s Finished acked pubs: count = 179970, tput = 1275.5778267618311 ops/s, numFailed = 0, avg latency = 11, 99.9%ile latency = >= 100
Is the problem on the client side and not the server? It seems that the throughput for unacked publishes and acked ones is almost the same. On Thu, Apr 19, 2012 at 12:34 PM, Aniruddha Laud <[email protected]>wrote: > > > On Thu, Apr 19, 2012 at 2:51 AM, Ivan Kelly <[email protected]> wrote: > >> Hi Aniruddha, >> >> 1269 op/s does seem very low. How are your bookies configured? Does each >> bookie have a dedicated disk for the ledger dir and journal dir? With >> this machine machines I would expect much much higher performance. >> > Yes, there is one disk for the journal and 3 for ledgers. > >> >> I'm actually going to run the hedwig benchmarks here in the next >> couple of days. I'll let you know what result I get. >> > That would be really helpful. Thanks. > >> >> -Ivan >> >> On Wed, Apr 18, 2012 at 06:28:36PM -0700, Aniruddha Laud wrote: >> > I ran the benchmark in hedwig-client with the following command - >> > >> > java -cp hedwig-client-4.1.0-SNAPSHOT.jar -Dmode=pub -DnTopics=30 >> > -DnMsgs=180000 -DmsgSize=50 -DstartTopicLabel=1 >> > -Dlog4j.configuration=hedwig_client_log.properties >> > -Djava.net.preferIPv4Stack=true >> > org.apache.hedwig.client.benchmark.HedwigBenchmark >> > hedwig-loadtest-client.conf >> > >> > The hedwig-loadtest-client.conf contains one default_server_host. I get >> a >> > throughput of 1269 ops/s . The setup is 15 hubs with 15 bookies and an >> > ensemble size of 5 and quorum of 3. The number seems low to me. Am I >> > missing something? Also, I don't quite understand how to use the >> > nPartitions, nParallel options. Also, I have just 1 region. >> > >> > Regards, >> > Aniruddha. >> > >> > On Tue, Apr 17, 2012 at 7:45 PM, Sijie Guo <[email protected]> wrote: >> > >> > > Hello Aniruddha, >> > > >> > > there is a benchmark for hedwig provided in hedwig-client package. you >> > > could check org.apache.hedwig.client.benchmark package. >> > > >> > > Thanks, >> > > Sijie >> > > >> > > On Wed, Apr 18, 2012 at 5:29 AM, Aniruddha Laud < >> [email protected] >> > > >wrote: >> > > >> > > > Hi, >> > > > >> > > > Are there any benchmarks for hedwig that you could share? >> > > > >> > > > Regards, >> > > > Aniruddha. >> > > > >> > > >> > >
