[
https://issues.apache.org/jira/browse/METRON-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16059415#comment-16059415
]
ASF GitHub Bot commented on METRON-1001:
----------------------------------------
Github user cestella commented on a diff in the pull request:
https://github.com/apache/metron/pull/621#discussion_r123513984
--- Diff:
metron-platform/metron-parsers/src/main/java/org/apache/metron/parsers/bolt/ParserBolt.java
---
@@ -129,18 +148,29 @@ public void execute(Tuple tuple) {
boolean ackTuple = !writer.handleAck();
int numWritten = 0;
if(sensorParserConfig != null) {
+ Map<String, Object> metadata = getMetadata(tuple,
sensorParserConfig.readMetadata());
List<FieldValidator> fieldValidations =
getConfigurations().getFieldValidations();
Optional<List<JSONObject>> messages =
parser.parseOptional(originalMessage);
for (JSONObject message :
messages.orElse(Collections.emptyList())) {
message.put(Constants.SENSOR_TYPE, getSensorType());
--- End diff --
If you merge it with the message or selectively expose them as stellar
transformations, then they will be. It does not have to be merged. By
default, merging is turned off and things work just as before.
> Allow metron to ingest parser metadata along with data
> ------------------------------------------------------
>
> Key: METRON-1001
> URL: https://issues.apache.org/jira/browse/METRON-1001
> Project: Metron
> Issue Type: Improvement
> Reporter: Casey Stella
> Assignee: Casey Stella
>
> Currently, we only ingest data in Metron. Often, there is valuable metadata
> constructed up-stream of Metron that is relevant to enrichment and cross-cuts
> many data formats. Take, for instance, a multi-tenancy case where multiple
> sources come in and you'd like to tag the data with the customer ID. In this
> case you're stuck finding ways to add the metadata to each data source's
> format. Rather than do that, we should allow metadata to be ingested along
> with the data associated with it.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
