This is an automated email from the ASF dual-hosted git repository.
tyrantlucifer pushed a commit to branch dev
in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git
The following commit(s) were added to refs/heads/dev by this push:
new cd1a458cb [Improve][Zeta][Doc] Add imap store doc (#4008)
cd1a458cb is described below
commit cd1a458cb679ca693b62e7f3649bded4684a8b13
Author: Guangdong Liu <[email protected]>
AuthorDate: Wed Feb 1 10:21:03 2023 +0800
[Improve][Zeta][Doc] Add imap store doc (#4008)
* add imap store doc
* fix some error
* Update docs/en/seatunnel-engine/deployment.md
Co-authored-by: Eric <[email protected]>
---------
Co-authored-by: Eric <[email protected]>
---
docs/en/seatunnel-engine/deployment.md | 53 ++++++++++++++++++++++++++++++++++
1 file changed, 53 insertions(+)
diff --git a/docs/en/seatunnel-engine/deployment.md
b/docs/en/seatunnel-engine/deployment.md
index 9b0484ebd..cb49af7da 100644
--- a/docs/en/seatunnel-engine/deployment.md
+++ b/docs/en/seatunnel-engine/deployment.md
@@ -156,6 +156,59 @@ TCP is our suggest way in a standalone SeaTunnel Engine
cluster.
On the other hand, Hazelcast provides some other service discovery methods.
For details, please refer to [hazelcast
network](https://docs.hazelcast.com/imdg/4.1/clusters/setting-up-clusters)
+### 5.3 Map
+
+MapStores connect to an external data store only when they are configured on a
map. This topic explains how to configure a map with a MapStore. For details,
please refer to [hazelcast
map](https://docs.hazelcast.com/imdg/4.2/data-structures/map)
+
+**type**
+
+The type of imap persistence, currently only supports `hdfs`.
+
+**namespace**
+
+It is used to distinguish data storage locations of different business, like
OSS bucket name.
+
+**clusterName**
+
+This parameter is primarily used for cluster isolation, we can use this to
distinguish different cluster, like cluster1,
+cluster2 and this is also used to distinguish different business
+
+**fs.defaultFS**
+
+We used hdfs api read/write file, so used this storage need provide hdfs
configuration
+
+if you used HDFS, you can config like this:
+
+```yaml
+map:
+ engine*:
+ map-store:
+ enabled: true
+ initial-mode: EAGER
+ factory-class-name:
org.apache.seatunnel.engine.server.persistence.FileMapStoreFactory
+ properties:
+ type: hdfs
+ namespace: /tmp/seatunnel/imap
+ clusterName: seatunnel-cluster
+ fs.defaultFS: hdfs://localhost:9000
+```
+If there is no HDFS and your cluster only have one node, you can config to use
local file like this:
+
+```yaml
+map:
+ engine*:
+ map-store:
+ enabled: true
+ initial-mode: EAGER
+ factory-class-name:
org.apache.seatunnel.engine.server.persistence.FileMapStoreFactory
+ properties:
+ type: hdfs
+ namespace: /tmp/seatunnel/imap
+ clusterName: seatunnel-cluster
+ fs.defaultFS: file:///
+```
+
+
## 6. Config SeaTunnel Engine Client
All SeaTunnel Engine Client config in `hazelcast-client.yaml`.
