[
https://issues.apache.org/jira/browse/IOTDB-519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17046065#comment-17046065
]
Venkat Datta commented on IOTDB-519:
------------------------------------
Tasks:
# add API into IoTDB to support Prometheus, (A middleware is also ok, like
IoTDB-Grafana-Connector)
-- Yes, we can write IoTDB-Prometheus-Adapter. This will mainly do the job of
receiving the requests from Prometheus, handling connection to IoTDB and the
schema conversion.
# We need to design the Schema mapping carefully between Prometheus and IoTDB,
as IoTDB has concepts like Storage Group, Device, Measurement, which is a
little different from InfulxDB, and the schema design will impact the
performance and the memory cost heavily in current IoTDB. Maybe in the process
of finishing this task, we may improve the data model of IoTDB, e.g.,
automatically choose how many storage groups for an application.
-- I did some reading on IoTDB Schema and got a high-level understanding of
devices, measurements, and storage groups.
Prometheus schema contains measurement and labels. We need to come up with
how this could be mapped with our devices, measurements,
and storage groups. I'm not very well versed with the internals of storage
groups and TsFile to be able to comment on perf cost.
I will go through the internals of IoTDB and try to understand them better.
# A complete test both on correctness and performance. That is, we do not only
integrate Prometheus but also we want to know can they work well in a heavy
workload (e.g., generating data in a very high frequency).
-- Functional testing can be done at the adapter level. For performance
benchmarking, I had previously used YCSB as the benchmark.
We can explore YCSB-Prometheus benchmark -
[https://github.com/TSDBBench/YCSB-TS/tree/master/prometheus|https://github.com/TSDBBench/YCSB-TS/tree/master/prometheus).]
> Apache IoTDB integration with Prometheus
> ----------------------------------------
>
> Key: IOTDB-519
> URL: https://issues.apache.org/jira/browse/IOTDB-519
> Project: Apache IoTDB
> Issue Type: Wish
> Components: Others
> Reporter: Xiangdong Huang
> Priority: Major
> Labels: gsoc2020, iotdb, mentor
>
> IoTDB is a highly efficient time series database.
> Prometheus is a monitoring and alerting toolkit, which supports collecting
> data from other systems, servers, and IoT devices, saving data into a DB,
> visualizing data and provides some query APIs.
>
> Prometheus allows users to use their database rather than just Prometheus DB
> for storing time series databases.
> This proposal is for integrating IoTDB with Prometheus.
>
> You should know:
> * How to use Prometheus
> * How to use IoTDB
> * Java and Go language
> difficulty: Major
> mentors:
> [email protected]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
