Repository: incubator-rocketmq-externals Updated Branches: refs/heads/master 6a45c7677 -> 8ca160f94
[ROCKETMQ-185] Add RocketMQ-MySQL's design closes apache/incubator-rocketmq-externals#16 Project: http://git-wip-us.apache.org/repos/asf/incubator-rocketmq-externals/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-rocketmq-externals/commit/8ca160f9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-rocketmq-externals/tree/8ca160f9 Diff: http://git-wip-us.apache.org/repos/asf/incubator-rocketmq-externals/diff/8ca160f9 Branch: refs/heads/master Commit: 8ca160f94d3f40a0006f8cd9dc48845d66bc4c42 Parents: 6a45c76 Author: zhaoqun911 <[email protected]> Authored: Tue Apr 25 22:24:26 2017 +0800 Committer: dongeforever <[email protected]> Committed: Tue Apr 25 22:24:26 2017 +0800 ---------------------------------------------------------------------- rocketmq-mysql/README.md | 15 +++++++++++++++ rocketmq-mysql/doc/dataflow.png | Bin 0 -> 28402 bytes rocketmq-mysql/doc/overview.png | Bin 0 -> 35155 bytes 3 files changed, 15 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-rocketmq-externals/blob/8ca160f9/rocketmq-mysql/README.md ---------------------------------------------------------------------- diff --git a/rocketmq-mysql/README.md b/rocketmq-mysql/README.md new file mode 100644 index 0000000..8b47a0e --- /dev/null +++ b/rocketmq-mysql/README.md @@ -0,0 +1,15 @@ +# RocketMQ-MySQL + + +## Overview + + +The RocketMQ-MySQL is a data replicator between MySQL and other system,the replicator parse the binglog event and send it in json format to the RocketMQ,and other system can pull data from RocketMQ. +## Dataflow + + +* 1.Firstly,get the last data from the queue,and get the binglog position from this data,and if the queue data is null,then use the latest binglog position of the MySQL,and surely user can also specify this position on his own; +* 2.Send a binlog dump request to the MySQL; +* 3.The MySQL push binglog event to the Replicator,the Replicator parse the data and accumulate as a transaction-object; +* 4.Add the next-position of the transaction to the transaction-object and send it in json format to the queue; +* 5.Record the binglog position and the offset in the queue of the latest transaction every second. \ No newline at end of file http://git-wip-us.apache.org/repos/asf/incubator-rocketmq-externals/blob/8ca160f9/rocketmq-mysql/doc/dataflow.png ---------------------------------------------------------------------- diff --git a/rocketmq-mysql/doc/dataflow.png b/rocketmq-mysql/doc/dataflow.png new file mode 100644 index 0000000..179f24d Binary files /dev/null and b/rocketmq-mysql/doc/dataflow.png differ http://git-wip-us.apache.org/repos/asf/incubator-rocketmq-externals/blob/8ca160f9/rocketmq-mysql/doc/overview.png ---------------------------------------------------------------------- diff --git a/rocketmq-mysql/doc/overview.png b/rocketmq-mysql/doc/overview.png new file mode 100644 index 0000000..0a3ec82 Binary files /dev/null and b/rocketmq-mysql/doc/overview.png differ
