[
https://issues.apache.org/jira/browse/COMDEV-350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042777#comment-17042777
]
duheng commented on COMDEV-350:
-------------------------------
[~tsaitsunghan] Thanks for your attention about this project, and IoTDB example
can be found in
[https://github.com/apache/incubator-iotdb/tree/master/example/rocketmq].
and Apache RocketMQ connect is a High available framework for data
transmission, and you can find docs in
[https://github.com/apache/rocketmq-externals/blob/master/docs/cn/README.md]
and there are already have some connectors, e.g.
[https://github.com/apache/rocketmq-externals/tree/master/rocketmq-replicator],
All you need to do is implement these
[interfaces|http://example.com][https://github.com/openmessaging/openmessaging-connect]
to develop a sink connector, including parsing the data in RocketMQ and
writing it to IoTDB.
Please feel free to ask me if you have other questions:)
> RocketMQ Connect IoTDB
> ----------------------
>
> Key: COMDEV-350
> URL: https://issues.apache.org/jira/browse/COMDEV-350
> Project: Community Development
> Issue Type: Wish
> Components: GSoC/Mentoring ideas
> Reporter: duheng
> Priority: Major
> Labels: RocketMQ, gsoc2020
>
> h3. Content
> The IoTDB sink connector allows moving data from Apache RocketMQ to IoTDB. It
> writes data from a topic in Apache RocketMQ to IoTDB.
> [IoTDB|https://iotdb.apache.org/#/] (Internet of Things Database) is a data
> management system for time series data, which can provide users specific
> services, such as, data collection, storage and analysis. Due to its
> lightweight structure, high performance and usable features together with its
> seamless integration with the Hadoop and Spark ecology, IoTDB meets the
> requirements of massive dataset storage, high throughput data input and
> complex data analysis in the industrial IoTDB field.
> In this project, there are some update operations for historical data, so it
> is necessary to ensure the sequential transmission and consumption of data
> via RocketMQ. If there is no update operation in use, then there is no need
> to guarantee the order of data. IoTDB will process these data which may be
> disorderly.
> So, in this project, you need to implement an IoTDB sink connector based on
> OpenMessaging connect API, and run it on RocketMQ connect runtime.
> h3. You should learn before applying for this topic
> [IoTDB|https://iotdb.apache.org/#/]/[Apache
> RocketMQ|https://rocketmq.apache.org/]/[Apache RocketMQ
> Connect|https://github.com/apache/rocketmq-externals/tree/master/rocketmq-connect]/
> [OpenMessaging Connect
> API|https://github.com/openmessaging/openmessaging-connect]
> h3. Mentor
> [email protected], [[email protected]|mailto:[email protected]],
> [[email protected]|mailto:[email protected]],
> [[email protected]|mailto:[email protected]]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
