Hi, I did ulimit -n , it shows 1024. Is it not sufficient?
Earlier when I did not have any broadcast variables, there was no error. Why broadcast variable caused this? Thanks, Sourav On Tue, Feb 4, 2014 at 5:40 PM, Marek Wiewiorka <[email protected]>wrote: > Hi - try increasing hard limits at os level. > > > 2014-02-04 Sourav Chandra <[email protected]>: > > Hi, >> >> I am trying to persist processed DStream in Cassandra 3 tables. >> >> For each of table I have corresponding class and created 3 broadcast >> variables. >> >> Now while trying to run the application it throws >> >> java.io.FileNotFoundException: >> /tmp/spark-local-20140204172552-9eed/0c/broadcast_2 (Too many open files) >> >> >> What could the possible reasons? >> >> Thanks, >> >> -- >> >> Sourav Chandra >> >> Senior Software Engineer >> >> · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · >> >> [email protected] >> >> o: +91 80 4121 8723 >> >> m: +91 988 699 3746 >> >> skype: sourav.chandra >> >> Livestream >> >> "Ajmera Summit", First Floor, #3/D, 68 Ward, 3rd Cross, 7th C Main, 3rd >> Block, Koramangala Industrial Area, >> >> Bangalore 560034 >> >> www.livestream.com >> > > -- Sourav Chandra Senior Software Engineer · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · · [email protected] o: +91 80 4121 8723 m: +91 988 699 3746 skype: sourav.chandra Livestream "Ajmera Summit", First Floor, #3/D, 68 Ward, 3rd Cross, 7th C Main, 3rd Block, Koramangala Industrial Area, Bangalore 560034 www.livestream.com
