bossenti opened a new issue, #2106:
URL: https://github.com/apache/streampipes/issues/2106
### Apache StreamPipes version
dev (current development state)
### Affected StreamPipes components
Processing Elements
### What happened?
When trying to persist an event stream with an array as property, the influx
sink throws an exception:
> 2023-10-30T13:25:28.623+01:00 ERROR 25805 --- [ Thread-3]
>o.a.s.w.s.r.StandaloneEventSinkRuntime : RuntimeException while processing
event in >org.apache.streampipes.sinks.internal.jvm.datalake.DataLakeSink
>
>java.lang.IllegalArgumentException: Expecting a positive number for fields
size
> at
org.influxdb.impl.Preconditions.checkPositiveNumber(Preconditions.java:35)
> at org.influxdb.dto.Point$Builder.build(Point.java:352)
> at
org.apache.streampipes.dataexplorer.commons.influx.InfluxStore.onEvent(InfluxStore.java:176)
at
org.apache.streampipes.dataexplorer.commons.TimeSeriesStore.onEvent(TimeSeriesStore.java:64)
at
org.apache.streampipes.sinks.internal.jvm.datalake.DataLakeSink.onEvent(DataLakeSink.java:82)
at
org.apache.streampipes.wrapper.standalone.runtime.StandaloneEventSinkRuntime.process(StandaloneEventSinkRuntime.java:55)
at
org.apache.streampipes.wrapper.standalone.routing.StandaloneSpInputCollector.send(StandaloneSpInputCollector.java:56)
at
org.apache.streampipes.wrapper.standalone.routing.StandaloneSpInputCollector.lambda$onEvent$0(StandaloneSpInputCollector.java:51)
at
java.base/java.util.concurrent.ConcurrentHashMap.forEach(ConcurrentHashMap.java:1603)
at
org.apache.streampipes.wrapper.standalone.routing.StandaloneSpInputCollector.onEvent(StandaloneSpInputCollector.java:51)
at
org.apache.streampipes.wrapper.standalone.routing.StandaloneSpInputCollector.onEvent(StandaloneSpInputCollector.java:30)
at
org.apache.streampipes.messaging.kafka.SpKafkaConsumer.lambda$run$0(SpKafkaConsumer.java:105)
at java.base/java.lang.Iterable.forEach(Iterable.java:75)
at
org.apache.streampipes.messaging.kafka.SpKafkaConsumer.run(SpKafkaConsumer.java:105)
at java.base/java.lang.Thread.run(Thread.java:833)
This is du to the fact that only the handling of primitive types is
implemented:
https://github.com/apache/streampipes/blob/a34a4dda3000a20802f99c018cd28ecd6ab16ca1/streampipes-data-explorer-commons/src/main/java/org/apache/streampipes/dataexplorer/commons/influx/InfluxStore.java#L129
### How to reproduce?
Persist an event stream containing an array as property
### Expected behavior
Storage can handle non-primitve types as well
### Additional technical information
_No response_
### Are you willing to submit a PR?
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
