Re: how to solve this problem?

Wed, 27 Jul 2011 09:09:57 -0700 

Did you restart Hbase and HDFS daemons after applying the limit.conf changes? 
That will be necessary for the changes to take effect.

-chris

On Jul 27, 2011, at 5:37 AM, shanmuganathan.r wrote:

> Hi Gan,            Thanks for tour reply....
> 
> 
>            I set the nproc and ulimit in the /etc/security/limits.conf and 
> session required pam_limits.so in the /etc/pam.d/common-session in all 
> machines in my cluster .
> 
> My /etc/security/limits.conf
>            hadoop(user)           -        nofile        32768
>            hadoop      soft/hard         nproc       32000
> 
> 
> After setting these configuration i got the same exception after 122 rows..
> 
> 
> Regards
> 
> 
> Shanmuganathan
> 
> 
> ---- On Wed, 27 Jul 2011 17:05:50 +0530  Gan<[email protected]> wrote 
> ---- 
> 
> 
> 
> 
> 
> http://wiki.apache.org/hadoop/Hbase/FAQ#A6 
> 
> On Wed, Jul 27, 2011 at 7:12 PM, shanmuganathan.r 
> <[email protected]> wrote: 
> > Hi All, 
> > 
> > 
> >            I am running the hbase in fully distributed mode. I want to 
> create a table with 500 rows . After creation of 122 rows the following 
> exception is thrown 
> > 
> > org.apache.hadoop.hbase.ZooKeeperConnectionException: 
> java.io.IOException: Too many open files 
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:988)
>  
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>  
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
>  
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
>  
> >    at 
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:167) 
> >    at 
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:145) 
> >    at 
> com.zoho.ips.db.HBaseUtil.addNewSingleColumnFamilyValue(HBaseUtil.java:46) 
> >    at com.zoho.ips.hbase.IPSKeyData.addData(IPSKeyData.java:26) 
> >    at com.zoho.ips.IPSService.installService(IPSService.java:61) 
> >    at com.zoho.ips.IPSService.install(IPSService.java:34) 
> >    at testi.main(testi.java:6) 
> > Caused by: java.io.IOException: Too many open files 
> >    at sun.nio.ch.IOUtil.initPipe(Native Method) 
> >    at 
> sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:49) 
> >    at 
> sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:18) 
> >    at java.nio.channels.Selector.open(Selector.java:209) 
> >    at 
> org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:160) 
> >    at 
> org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:331) 
> >    at 
> org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:377) 
> >    at org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:97) 
> >    at 
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
>  
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:986)
>  
> >    ... 10 more 
> > Exception in thread "main" com.zoho.ips.IPSException: 
> IPSError:Z102:java.io.IOException: Too many open files 
> >    at 
> com.zoho.ips.db.HBaseUtil.addNewSingleColumnFamilyValue(HBaseUtil.java:63) 
> >    at com.zoho.ips.hbase.IPSKeyData.addData(IPSKeyData.java:26) 
> >    at com.zoho.ips.IPSService.installService(IPSService.java:61) 
> >    at com.zoho.ips.IPSService.install(IPSService.java:34) 
> >    at testi.main(testi.java:6) 
> > Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: 
> java.io.IOException: Too many open files 
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:988)
>  
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:301)
>  
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:292)
>  
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
>  
> >    at 
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:167) 
> >    at 
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:145) 
> >    at 
> com.zoho.ips.db.HBaseUtil.addNewSingleColumnFamilyValue(HBaseUtil.java:46) 
> >    ... 4 more 
> > Caused by: java.io.IOException: Too many open files 
> >    at sun.nio.ch.IOUtil.initPipe(Native Method) 
> >    at 
> sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:49) 
> >    at 
> sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:18) 
> >    at java.nio.channels.Selector.open(Selector.java:209) 
> >    at 
> org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:160) 
> >    at 
> org.apache.zookeeper.ClientCnxn.<init>(ClientCnxn.java:331) 
> >    at 
> org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:377) 
> >    at org.apache.hadoop.hbase.zookeeper.ZKUtil.connect(ZKUtil.java:97) 
> >    at 
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:119)
>  
> >    at 
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:986)
>  
> >    ... 10 more 
> > 
> > 
> > Please give me your valuable suggestion regarding this problem. 
> > 
> > Thanks in advance ..... 
> > 
> > 
> > Regards 
> > 
> > 
> > Shanmuganathan 
> > 
> 
> 
> 
> -- 
> Best wishes 
> Gan, Xiyun 
> 
> 
>

Reply via email to