I got mesos from  https://svn.apache.org/repos/asf/incubator/mesos/trunk/ .

When I try to run SparkKMeans on mesos to deal with data containing
1,000,000 points,  some slave nodes will disconnect after running some time
because Check sockets.count(s) >0 fails. If I just run it with data
containing 100,000 points, there won't be any problems.

The number of file discriptor is 65536, the os is CentOS 5.3. One machine
as master and 3 as slaves, program runs on their shared disk.

How does this happen?

-- 
Best Wishes
Jiang Cihang

Reply via email to