which property in configuration affects the concerrency?

在 2011年7月30日 下午6:21,Ryan Rawson <[email protected]>写道:

> What is the level of concurrency?  I find that HDFS gets worse
> performing with more concurrent read threads.
>
> -ryan
>
> 2011/7/30 seven garfee <[email protected]>:
> > hi,all
> >  I set up a cluster on 4 machine.(1 HMaster,4RegionServer).
> >  Each Machine has a 16G mem, one 2T Sata disk,CentOS 5.3,XFS .
> >  I write 100M data in Hbase,only 1M key/value,so all keys are in only
> *one*
> > Store,and only 2 HFiles in that Store.(I used Large Data Set,but random
> read
> > performance is bad,so i try 100M)
> >  Then I test random read with existing keys with only 1 client. But I got
> a
> > Bad Performance,About >100ms latency per read.
> >
> > Why did I get so long latency?
> >
> >  I dig into the metric log,and found that,
> >  in metrics_rpc.log:
> >      get_avg_time=146, get_num_ops=22
> >      get_avg_time=94, get_num_ops=127
> >      get_avg_time=113, get_num_ops=182
> >      .......
> >
> > and in metrics_hbase.log:
> >      fsReadLatency_avg_time=140, fsReadLatency_num_ops=31
> >      fsReadLatency_avg_time=93, fsReadLatency_num_ops=137
> >      fsReadLatency_avg_time=109, fsReadLatency_num_ops=188
> >      .......
> >
> > Is that say the fsReadLatency causes the random get latency so long?
> >
> > But i didn't tuning hdfs almost,except some ips/ports and max.xcievers,
> > Should I tuning for hdfs?And How?
> >
>

Reply via email to