ahuazhu opened a new issue #356: [RocketMQ-Flink] Job operator need more information not only key and body URL: https://github.com/apache/rocketmq-externals/issues/356 **FEATURE REQUEST** 1. Please describe the feature you are requesting. In a classical scene, a stream pipeline may look like ``` [Producer SendMessage] -> [Flink Job] -> [Downstream Operation] -> [Final Result Data/Event] ``` Every step consumes time then contribute to the latency. To statics/monitor the end to end time consumption, we want to keep the `BornTime` of messages as `BeginTime` of the whole pipeline. 2. Provide any additional detail on your proposed use case for this feature. In the `RocketMQSource.class`, information about messages are discarded, but only `keys` and `body` of messages saved. ``` for (MessageExt msg : messages) { byte[] key = msg.getKeys() != null ? msg.getKeys().getBytes(StandardCharsets.UTF_8) : null; byte[] value = msg.getBody(); OUT data = schema.deserializeKeyAndValue(key, value); // output and state update are atomic synchronized (lock) { context.collectWithTimestamp(data, msg.getBornTimestamp()); } } ``` I wonder if let users customize the serialization method will be better? 2. Indicate the importance of this issue to you (blocker, must-have, should-have, nice-to-have). Are you currently using any workarounds to address this issue? should-have 4. If there are some sub-tasks using -[] for each subtask and create a corresponding issue to map to the sub task: No
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
