update:
this problem is fixed by restarting all impalad
if i was correct, the problem is cause by
https://issues.cloudera.org/browse/IMPALA-2799
and all other host is trying to reconnect to the "problem host" endlessly
On 12/8/16 2:09 PM, Chan Chor Pang wrote:
some more info apparently, some host try to connect to the problem
host use Ipv4 but the problem host response as IPv6 $ sudo lsof -p
14864 | grep 60827 impalad 14864 impala 1826u IPv6 787440313 0t0 TCP
had003:snapenetio->had058:60827 (ESTABLISHED) $ sudo lsof -p 111823 |
grep 60827 impalad 111823 impala 442u IPv4 472142649 0t0 TCP
had058:60827->had001:snapenetio (ESTABLISHED)
On 12/8/16 1:37 PM, Chan Chor Pang wrote:
hi everyone,
one of the impalad in our cluster create a huge amount of IPv6
connection
even i restart the impalad, the connections will just come back in 30
min
any one know the reason for it to create so much IPv6 connection?
$ ps -ef | grep impalad
1002 26751 104961 0 11:25 pts/0 00:00:00 grep impalad
impala 112687 4366 8 Dec07 ? 01:31:08
/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/impala/sbin-retail/impalad
--flagfile=/var/run/cloudera-scm-agent/process/22177-impala-IMPALAD/impala-conf/impalad_flags
$ sudo lsof -p 112687 | grep TCP | wc -l
24165
$ sudo lsof -p 112687 | grep IPv6 | wc -l
23987
