muyangye commented on issue #2166:
URL: https://github.com/apache/streampipes/issues/2166#issuecomment-1806769554
Hi @bossenti, I have looked into the issue. The event is "correct"
("correct" meaning key value pairs are the same with the file) in frontend,
Kafka producer, and Kafka consumer. However, once the code hits [Influx
Store](https://github.com/apache/streampipes/blob/8bb9168c0e6e7e1770e1b9d1291978d75bd00890/streampipes-data-explorer-commons/src/main/java/org/apache/streampipes/dataexplorer/commons/influx/InfluxStore.java),
the runtime name of some keys are modified. The root cause is that "name" key
in the file stream is a keyword of [Influx reserved keywords
list](https://github.com/apache/streampipes/blob/8bb9168c0e6e7e1770e1b9d1291978d75bd00890/streampipes-data-explorer-commons/src/main/java/org/apache/streampipes/dataexplorer/commons/influx/InfluxDbReservedKeywords.java)
and Streampipes
[sanitizes](https://github.com/apache/streampipes/blob/8bb9168c0e6e7e1770e1b9d1291978d75bd00890/streampipes-data-explorer-commons/src/main/java/org/apache/streampipes/dataexplorer/commons/influx/I
nfluxNameSanitizer.java#L21) DataLake measure for those keys conflicting with
Influx reserved keywords. If you change "name" to something else not in the
list everything works.
To fix this, I propose to also sanitize event instead of only sanitizing
DataLake measure. Let me know what do you think🙂!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
