Hello, in the past two weeks, I see the following error on HBase Thrift servers, we have total of about 10 Thrift servers and randomly get the following errors:
2017-02-28 10:45:56,541 INFO org.apache.hadoop.hbase.client.AsyncProcess: #4087940, table=MBData, attempt=11/35 failed=2ops, last exception: ja va.io.IOException: Call to e26-node.fqdn.com/10.12.1.209:60020 failed on local exception: org.apache.hadoop.hbase.ipc.CallTimeoutExcepti on: Call id=36009061, waitTime=180001, operationTimeout=180000 expired. on e26-node.fqdn.com,60020,1487800633128, tracking started null, retrying after=10060ms, replay=2ops 2017-02-28 10:45:57,207 INFO org.apache.hadoop.hbase.client.AsyncProcess: #4084675, waiting for some tasks to finish. Expected max=0, tasksInPro gress=22 Restarting the Thrift server resolves the issue. Any ideas where should I be looking for? Thanks, Motty
