mayki created NIFI-3968:
---------------------------
Summary: Node disconnected from cluster : NIFI-API
Key: NIFI-3968
URL: https://issues.apache.org/jira/browse/NIFI-3968
Project: Apache NiFi
Issue Type: Bug
Components: Core UI
Affects Versions: 1.1.0
Environment: CentOS 6.8
Reporter: mayki
Priority: Critical
the node disconntected by cluster randomly when they post /nifi-api/provenance.
--- python request ------
headers = {"Content-Type": "application/json", "Accept": "application/json,
text/javascript"}
conn=httplib.HTTPSConnection('nifi002', 9443, key_file=None,
cert_file="cert_file")
conn.request("POST", "/nifi-api/provenance", json.dumps(params), headers)
response = conn.getresponse()
result = json.loads(response.read())
conn.close()
conn=httplib.HTTPSConnection('nifi002', 9443, key_file=None,
cert_file="cert_file")
conn.request("GET", "/nifi-api/provenance/" + result['provenance']['id'])
res = conn.getresponse()
result = json.loads(res.read())
conn.close()
conn=httplib.HTTPSConnection('nifi002', 9443, key_file=None,
cert_file="cert_file")
conn.request("DELETE", "/nifi-api/provenance/" + result['provenance']['id'])
res = conn.getresponse()
conn.close()
--- python request ------
--------- LOG ---------
2017-05-23 14:34:57,021 INFO [Clustering Tasks Thread-3]
o.a.n.c.c.ClusterProtocolHeartbeater After receiving heartbeat response,
updated status of nifi002.current.rec.mapreduce.m0.p.fti.net:9443 to
NodeConnectionStatus[nodeId=nifi002.current.rec.mapreduce.m0.p.fti.net:9443,
state=DISCONNECTED, Disconnect Code=Failed to Service Request, Disconnect
Reason=Failed to process request POST /nifi-api/provenance, updateId=355]
2017-05-23 14:34:57,022 INFO [Clustering Tasks Thread-3]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2017-05-23
14:34:56,801 and sent to nifi003:11443 at 2017-05-23 14:34:57,022; send took
220 millis
2017-05-23 14:34:59,383 INFO [Process Cluster Protocol Request-2]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
9bac3908-0eeb-4236-bf43-dbe18962ebb3 (type=DISCONNECTION_REQUEST, length=649
bytes) from nifi002.current.rec.mapreduce.m0.p.fti.net:9443 in 77 millis
2017-05-23 14:34:59,385 INFO [Disconnect from Cluster]
o.a.nifi.controller.StandardFlowService Received disconnection request message
from manager with explanation: Failed to process request POST
/nifi-api/provenance
2017-05-23 14:34:59,385 INFO [Disconnect from Cluster]
o.a.nifi.controller.StandardFlowService Disconnecting node.
2017-05-23 14:34:55,138 INFO [Process Cluster Protocol Request-4]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
847146bf-b6eb-47d5-942e-25e90723713d (type=DISCONNECTION_REQUEST, length=649
bytes) from nifi002:9443 in 1746 millis
2017-05-23 14:34:55,138 INFO [Disconnect from Cluster]
o.a.nifi.controller.StandardFlowService Received disconnection request message
from manager with explanation: Failed to process request POST
/nifi-api/provenance
2017-05-23 14:34:55,138 INFO [Disconnect from Cluster]
o.a.nifi.controller.StandardFlowService Disconnecting node.
2017-05-23 14:34:56,819 INFO [Disconnect from Cluster]
o.apache.nifi.controller.FlowController Cluster State changed from Clustered to
Not Clustered
2017-05-23 14:34:56,835 INFO [Process Cluster Protocol Request-6]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
ca1d66af-51d6-44c0-b840-9ee9396ff451 (type=DISCONNECTION_REQUEST, length=649
bytes) from nifi002:9443 in 1754 millis
2017-05-23 14:34:56,836 INFO [Disconnect from Cluster]
o.a.nifi.controller.StandardFlowService Received disconnection request message
from manager with explanation: Failed to process request POST
/nifi-api/provenance
2017-05-23 14:34:56,839 INFO [Disconnect from Cluster]
o.a.n.c.l.e.CuratorLeaderElectionManager This node is no longer registered to
be elected as the Leader for Role 'Primary Node'
2017-05-23 14:34:56,844 INFO [Disconnect from Cluster]
o.a.n.c.l.e.CuratorLeaderElectionManager This node is no longer registered to
be elected as the Leader for Role 'Cluster Coordinator'
2017-05-23 14:34:56,845 INFO [Disconnect from Cluster]
o.a.nifi.controller.StandardFlowService Node disconnected.
2017-05-23 14:34:56,845 INFO [Disconnect from Cluster]
o.a.nifi.controller.StandardFlowService Disconnecting node.
2017-05-23 14:34:56,872 INFO [Disconnect from Cluster]
o.a.n.c.l.e.CuratorLeaderElectionManager Cannot unregister Leader Election Role
'Primary Node' becuase that role is not registered
2017-05-23 14:34:56,872 INFO [Disconnect from Cluster]
o.a.n.c.l.e.CuratorLeaderElectionManager Cannot unregister Leader Election Role
'Cluster Coordinator' becuase that role is not registered
2017-05-23 14:34:56,872 INFO [Disconnect from Cluster]
o.a.nifi.controller.StandardFlowService Node disconnected.
2017-05-23 14:34:57,021 INFO [Clustering Tasks Thread-3]
o.a.n.c.c.ClusterProtocolHeartbeater After receiving heartbeat response,
updated status of nifi002:9443 to NodeConnectionStatus[nodeId=nifi002:9443,
state=DISCONNECTED, Disconnect Code=Failed to Service Request, Disconnect
Reason=Failed to process request POST /nifi-api/provenance, updateId=355]
2017-05-23 14:34:57,022 INFO [Clustering Tasks Thread-3]
o.a.n.c.c.ClusterProtocolHeartbeater Heartbeat created at 2017-05-23
14:34:56,801 and sent to nifi003:11443 at 2017-05-23 14:34:57,022; send took
220 millis
2017-05-23 14:34:59,383 INFO [Process Cluster Protocol Request-2]
o.a.n.c.p.impl.SocketProtocolListener Finished processing request
9bac3908-0eeb-4236-bf43-dbe18962ebb3 (type=DISCONNECTION_REQUEST, length=649
bytes) from nifi002:9443 in 77 millis
2017-05-23 14:34:59,385 INFO [Disconnect from Cluster]
o.a.nifi.controller.StandardFlowService Received disconnection request message
from manager with explanation: Failed to process request POST
/nifi-api/provenance
------ LOG ----------
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
