[
https://issues.apache.org/jira/browse/MINIFICPP-2502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gábor Gyimesi updated MINIFICPP-2502:
-------------------------------------
Description:
NiFi provides processor bulletin information that is published in the C2
protocol heartbeats in MiNiFi Java:
[https://github.com/apache/nifi/blob/main/c2/c2-protocol/c2-protocol-api/src/main/java/org/apache/nifi/c2/protocol/api/FlowInfo.java#L32]
We should provide the same metrics in C2 (and in other metric publishers) in
the FlowInformation metric node. To do this the FlowInformation metric node
should be extended and the serialization appended with the processorBulletins
JSON node in the following format:
{code:java}
"processorBulletins": [
{
"id": 1,
"timestamp": "Tue Dec 10 08:40:26 CET 2024",
"nodeAddress": "111973e6-03f7-49cd-a274-6c47a08a846b",
"level": "ERROR",
"category": "Log Message",
"message": "InvokeHTTP[id=c77d5d99-a9fc-4d6f-bb17-75ec93f62366] Request
Processing failed: java.net.UnknownHostException: asdsadsaasd.hu",
"groupId": "9d14a144-9344-40fd-8d1b-fce3feaa750e",
"groupName": "root",
"groupPath": "root",
"sourceId": "c77d5d99-a9fc-4d6f-bb17-75ec93f62366",
"sourceName": "InvokeHTTP",
"flowFileUuid": null
},
{
"id": 2,
"timestamp": "Tue Dec 10 08:40:26 CET 2024",
"nodeAddress": "111973e6-03f7-49cd-a274-6c47a08a846b",
"level": "ERROR",
"category": "Log Message",
"message": "InvokeHTTP[id=c77d5d99-a9fc-4d6f-bb17-75ec93f62366] Request
Processing failed: java.net.UnknownHostException: asdsadsaasd.hu",
"groupId": "9d14a144-9344-40fd-8d1b-fce3feaa750e",
"groupName": "root",
"groupPath": "root",
"sourceId": "c77d5d99-a9fc-4d6f-bb17-75ec93f62366",
"sourceName": "InvokeHTTP",
"flowFileUuid": null
}
] {code}
We should also decide what error, warnings should be stored, how many of them
should be published to C2 (as far as I know MiNiFi Java publishes the bulletins
of the last 5 minutes) and how should these be configured.
was:
NiFi provides processor status information that is published in the C2 protocol
heartbeats in MiNiFi Java:
[https://github.com/apache/nifi/blob/main/c2/c2-protocol/c2-protocol-api/src/main/java/org/apache/nifi/c2/protocol/api/FlowInfo.java#L32]
We should provide the same metrics in C2 (and in other metric publishers) in
the FlowInformation metric node. To do this the FlowInformation metric node
should be extended and the serialization appended with the processorBulletins
JSON node in the following format:
{code:java}
"processorBulletins": [
{
"id": 1,
"timestamp": "Tue Dec 10 08:40:26 CET 2024",
"nodeAddress": "111973e6-03f7-49cd-a274-6c47a08a846b",
"level": "ERROR",
"category": "Log Message",
"message": "InvokeHTTP[id=c77d5d99-a9fc-4d6f-bb17-75ec93f62366] Request
Processing failed: java.net.UnknownHostException: asdsadsaasd.hu",
"groupId": "9d14a144-9344-40fd-8d1b-fce3feaa750e",
"groupName": "root",
"groupPath": "root",
"sourceId": "c77d5d99-a9fc-4d6f-bb17-75ec93f62366",
"sourceName": "InvokeHTTP",
"flowFileUuid": null
},
{
"id": 2,
"timestamp": "Tue Dec 10 08:40:26 CET 2024",
"nodeAddress": "111973e6-03f7-49cd-a274-6c47a08a846b",
"level": "ERROR",
"category": "Log Message",
"message": "InvokeHTTP[id=c77d5d99-a9fc-4d6f-bb17-75ec93f62366] Request
Processing failed: java.net.UnknownHostException: asdsadsaasd.hu",
"groupId": "9d14a144-9344-40fd-8d1b-fce3feaa750e",
"groupName": "root",
"groupPath": "root",
"sourceId": "c77d5d99-a9fc-4d6f-bb17-75ec93f62366",
"sourceName": "InvokeHTTP",
"flowFileUuid": null
}
] {code}
We should also decide what error, warnings should be stored, how many of them
should be published to C2 (as far as I know MiNiFi Java publishes the bulletins
of the last 5 minutes) and how should these be configured.
> Add processorBulletins C2 metric node to FlowInformation
> --------------------------------------------------------
>
> Key: MINIFICPP-2502
> URL: https://issues.apache.org/jira/browse/MINIFICPP-2502
> Project: Apache NiFi MiNiFi C++
> Issue Type: New Feature
> Reporter: Gábor Gyimesi
> Assignee: Gábor Gyimesi
> Priority: Major
>
> NiFi provides processor bulletin information that is published in the C2
> protocol heartbeats in MiNiFi Java:
> [https://github.com/apache/nifi/blob/main/c2/c2-protocol/c2-protocol-api/src/main/java/org/apache/nifi/c2/protocol/api/FlowInfo.java#L32]
> We should provide the same metrics in C2 (and in other metric publishers) in
> the FlowInformation metric node. To do this the FlowInformation metric node
> should be extended and the serialization appended with the processorBulletins
> JSON node in the following format:
> {code:java}
> "processorBulletins": [
> {
> "id": 1,
> "timestamp": "Tue Dec 10 08:40:26 CET 2024",
> "nodeAddress": "111973e6-03f7-49cd-a274-6c47a08a846b",
> "level": "ERROR",
> "category": "Log Message",
> "message": "InvokeHTTP[id=c77d5d99-a9fc-4d6f-bb17-75ec93f62366]
> Request Processing failed: java.net.UnknownHostException: asdsadsaasd.hu",
> "groupId": "9d14a144-9344-40fd-8d1b-fce3feaa750e",
> "groupName": "root",
> "groupPath": "root",
> "sourceId": "c77d5d99-a9fc-4d6f-bb17-75ec93f62366",
> "sourceName": "InvokeHTTP",
> "flowFileUuid": null
> },
> {
> "id": 2,
> "timestamp": "Tue Dec 10 08:40:26 CET 2024",
> "nodeAddress": "111973e6-03f7-49cd-a274-6c47a08a846b",
> "level": "ERROR",
> "category": "Log Message",
> "message": "InvokeHTTP[id=c77d5d99-a9fc-4d6f-bb17-75ec93f62366]
> Request Processing failed: java.net.UnknownHostException: asdsadsaasd.hu",
> "groupId": "9d14a144-9344-40fd-8d1b-fce3feaa750e",
> "groupName": "root",
> "groupPath": "root",
> "sourceId": "c77d5d99-a9fc-4d6f-bb17-75ec93f62366",
> "sourceName": "InvokeHTTP",
> "flowFileUuid": null
> }
> ] {code}
> We should also decide what error, warnings should be stored, how many of them
> should be published to C2 (as far as I know MiNiFi Java publishes the
> bulletins of the last 5 minutes) and how should these be configured.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
