Re: java.io.IOException: All datanodes DatanodeInfoWithStorage

2016-10-16 Thread Priyanka Gugale
Looks like you are reaching the limit set for max open file handles in your system. Is your application opening lot of files at same time? If you expect your application to open lot many files at same time, you can increase max open files limit in hadoop by changing some settings. (Check command "

Re: balanced of Stream Codec

2016-10-16 Thread Pramod Immaneni
Hi Sunil, Have you tried an alternate hashing function other than java hashcode that might provide a more uniform distribution of your data? The google guava library provides a set of hashing strategies, like murmur hash, that is reported to have lesser hash collisions in different cases. Below