GitHub user tenthe added a comment to the discussion: Store and Handle Metadata in StreamPipes
Hi @flomickl, yes, you are right. There are two separate databases, one for the actual sensor data and one for the application data like the information of (adapters, processors, sinks, pipelines, users, ...). For the storage of the application data we use a NO-SQL database (Apache CouchDB). Sensor data is processed in two separate layers, one focused on streaming data that is not persistent and the other on long-term storage. There are several options for the message broker (e.g. Kafka, NATS), but we are currently discussing to focus on one of them. For the sensor data we use a time series storage, currently this is InfluxDB. Currently there are also discussions to change this in the future. If you or anyone else has experience with these technologies, please feel free to share your thoughts here. We are open to new ideas and suggestions. Cheers, Philipp GitHub link: https://github.com/apache/streampipes/discussions/1186#discussioncomment-4826264 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
