Re: how to solve this problem?

Wed, 27 Jul 2011 05:41:59 -0700 

Hi Gan,            Thanks for tour reply....


            I set the nproc and ulimit in the /etc/security/limits.conf and 
session required pam_limits.so in the /etc/pam.d/common-session in all machines 
in my cluster .
      
My /etc/security/limits.conf
            hadoop(user)           -        nofile        32768
            hadoop      soft/hard         nproc       32000


After setting these configuration i got the same exception after 122 rows..


Regards


Shanmuganathan


---- On Wed, 27 Jul 2011 17:05:50 +0530  Gan<[email protected]> wrote 
---- 





http://wiki.apache.org/hadoop/Hbase/FAQ#A6 
 
On Wed, Jul 27, 2011 at 7:12 PM, shanmuganathan.r 
<[email protected]> wrote: 
> Hi All, 
> 
> 
>            I am running the hbase in fully distributed mode. I want to 
create a table with 500 rows . After creation of 122 rows the following 
exception is thrown 
> 
> org.apache.hadoop.hbase.ZooKeeperConnectionException: java.io.IOException: 
Too many open files 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:988)
 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
 
>    at 
org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:167) 
>    at 
org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:145) 
>    at 
com.zoho.ips.db.HBaseUtil.addNewSingleColumnFamilyValue(HBaseUtil.java:46) 
>    at com.zoho.ips.hbase.IPSKeyData.addData(IPSKeyData.java:26) 
>    at com.zoho.ips.IPSService.installService(IPSService.java:61) 
>    at com.zoho.ips.IPSService.install(IPSService.java:34) 
>    at testi.main(testi.java:6) 
> Caused by: java.io.IOException: Too many open files 
>    at sun.nio.ch.IOUtil.initPipe(Native Method) 
>    at 
sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:49) 
>    at 
sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:18) 
>    at java.nio.channels.Selector.open(Selector.java:209) 
>    at 
org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:160) 
>    at 
org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:331) 
>    at 
org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:377) 
>    at org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:97) 
>    at 
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:986)
 
>    ... 10 more 
> Exception in thread "main" com.zoho.ips.IPSException: 
IPSError:Z102:java.io.IOException: Too many open files 
>    at 
com.zoho.ips.db.HBaseUtil.addNewSingleColumnFamilyValue(HBaseUtil.java:63) 
>    at com.zoho.ips.hbase.IPSKeyData.addData(IPSKeyData.java:26) 
>    at com.zoho.ips.IPSService.installService(IPSService.java:61) 
>    at com.zoho.ips.IPSService.install(IPSService.java:34) 
>    at testi.main(testi.java:6) 
> Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: 
java.io.IOException: Too many open files 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:988)
 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
 
>    at 
org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:167) 
>    at 
org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:145) 
>    at 
com.zoho.ips.db.HBaseUtil.addNewSingleColumnFamilyValue(HBaseUtil.java:46) 
>    ... 4 more 
> Caused by: java.io.IOException: Too many open files 
>    at sun.nio.ch.IOUtil.initPipe(Native Method) 
>    at 
sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:49) 
>    at 
sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:18) 
>    at java.nio.channels.Selector.open(Selector.java:209) 
>    at 
org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:160) 
>    at 
org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:331) 
>    at 
org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:377) 
>    at org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:97) 
>    at 
org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
 
>    at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:986)
 
>    ... 10 more 
> 
> 
> Please give me your valuable suggestion regarding this problem. 
> 
> Thanks in advance ..... 
> 
> 
> Regards 
> 
> 
> Shanmuganathan 
> 
 
 
 
-- 
Best wishes 
Gan, Xiyun

Reply via email to