GitHub user flomickl added a comment to the discussion: Store and Handle Metadata in StreamPipes
How to achieve that the data lake will not run into a data swamp or is this information stored somewhere as well For example, the units of a specific field in the data lake. Also an important meta info is the username who executed the pipeline. The producer source and so on. There are a lot of different metadata types. I know it from the geo perspective: http://opengeospatial.github.io/e-learning/metadata/text/main.html Who What Why Where When? I think this is transferrable to "plain" sensor data as well. GitHub link: https://github.com/apache/streampipes/discussions/1186#discussioncomment-5001797 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
