答复: Should we set the property hbase.local.dir to a list of directories on different disks to spread I/O?

2013-12-20 Thread 谢良
Please take a look at dfs.datanode.data.dir in hdfs-site.xml. P.S. hbase.local.dir supports one dir only, don't specify it with a list:) Thanks, 发件人: Tao Xiao [xiaotao.cs@gmail.com] 发送时间: 2013年12月20日 15:11 收件人: user 主题: Should we set the property

Re: 答复: Should we set the property hbase.local.dir to a list of directories on different disks to spread I/O?

2013-12-20 Thread Tao Xiao
Since hbase.local.dir specifes local directory, why doesn't it specify multiple directories on different disks to spread I/O, just as what dfs.datanode.data.dir does ? 2013/12/20 谢良 xieli...@xiaomi.com Please take a look at dfs.datanode.data.dir in hdfs-site.xml. P.S. hbase.local.dir supports

答复: 答复: Should we set the property hbase.local.dir to a list of directories on different disks to spread I/O?

2013-12-20 Thread 谢良
maybe you have a misunderstanding about hbase.local.dir, please refer to HBASE-6824 for why it was introduced. Thanks, 发件人: Tao Xiao [xiaotao.cs@gmail.com] 发送时间: 2013年12月20日 16:30 收件人: user 主题: Re: 答复: Should we set the property hbase.local.dir to a

Re: 答复: 答复: Should we set the property hbase.local.dir to a list of directories on different disks to spread I/O?

2013-12-20 Thread Bharath Vissapragada
Hbase uses HDFS for data storage and region servers just use HDFS API to write files. So you should be looking at balancing disk IO at datanode level (dfs.datanode.data.dir as mentioned in other response). The path you mentioned (hbase.local.dir) is just used for storing temporary files or

Re: 答复: 答复: Should we set the property hbase.local.dir to a list of directories on different disks to spread I/O?

2013-12-20 Thread Jean-Marc Spaggiari
Barath's respons is a good summary. There almost nothing going into hbase.local.dir. It's like in your local linux box. You don't specify more than one tmp directory. It's the same thing here. There will not be really any benefit of adding that. 2013/12/20 Bharath Vissapragada

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Jignesh Patel
Just curious !!! has anybody started using hbase-0.96.1.1 with hadoop 2.x? How stable it is? On Thu, Dec 19, 2013 at 6:39 PM, Elliott Clark ecl...@apache.org wrote: Thanks. Should we now go remove the 0.96.1 release from mirrors ? On Thu, Dec 19, 2013 at 1:29 PM, Jonathan Hsieh

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Jay Vyas
... I assume you mean the latest hdfs versions... Since hbase 96 doesn't run on YARN container nodes yet. (See Hoya project which aims to port it over). While were on the subject... @steve which version of hbase is expected to contain the Hoya stuff? Sent from my iPhone On Dec 20, 2013, at

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Jean-Marc Spaggiari
Hi Jignesh, I'm running 0.96.1.1 on Hadoop 2.2.0. So far I have not seen anything wrong. But it's not yet a production cluster. JM 2013/12/20 Jay Vyas jayunit...@gmail.com ... I assume you mean the latest hdfs versions... Since hbase 96 doesn't run on YARN container nodes yet. (See Hoya

Re: Why so many unexpected files like partitions_xxxx are created?

2013-12-20 Thread Ted Yu
} catch (IOException e) { LOG.error(Encountered unrecoverable error from region server, e); The IOException came from region server. During execution of LoadIncrementalHFiles, there would be some error on region server. Cheers On Thu, Dec 19, 2013 at 10:18 PM, Tao Xiao

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Ted Yu
You need the following: htrace-core-2.04.jar Cheers On Fri, Dec 20, 2013 at 9:04 AM, Biju G.S Nair bijun...@acm.org wrote: Tried to run a simple program using 0.96 Hadoop2 against Hadoop 2 cluster and getting errors about some cloudera class not found. Following are the details. Which

Re: ANNOUNCE: hbase-0.96.1.1 available for download.

2013-12-20 Thread Ted Yu
Steve is on vacation. bq. which version of hbase is expected to contain the Hoya stuff? HBase and Hoya are separate projects. You can use 0.96.1.1 tar ball in Hoya deployment. Cheers On Fri, Dec 20, 2013 at 6:01 AM, Jay Vyas jayunit...@gmail.com wrote: ... I assume you mean the latest hdfs

Re: 答复: 答复: Should we set the property hbase.local.dir to a list of directories on different disks to spread I/O?

2013-12-20 Thread Tao Xiao
To all: Thank you all. Now I understand how to set hbase.local.dir and the reason 2013/12/20 Jean-Marc Spaggiari jean-m...@spaggiari.org Barath's respons is a good summary. There almost nothing going into hbase.local.dir. It's like in your local linux box. You don't specify