EricJoy2048 commented on code in PR #4008: URL: https://github.com/apache/incubator-seatunnel/pull/4008#discussion_r1091482529
########## docs/en/seatunnel-engine/deployment.md: ########## @@ -144,6 +144,59 @@ TCP is our suggest way in a standalone SeaTunnel Engine cluster. On the other hand, Hazelcast provides some other service discovery methods. For details, please refer to [hazelcast network](https://docs.hazelcast.com/imdg/4.1/clusters/setting-up-clusters) +### 5.3 Map + +MapStores connect to an external data store only when they are configured on a map. This topic explains how to configure a map with a MapStore. For details, please refer to [hazelcast map](https://docs.hazelcast.com/imdg/4.2/data-structures/map) + +**type** + +The type of imap persistence, currently only supports `hdfs`. + +**namespace** + +It is used to distinguish data storage locations of different business, like OSS bucket name. + +**clusterName** + +This parameter is primarily used for cluster isolation, we can use this to distinguish different cluster, like cluster1, +cluster2 and this is also used to distinguish different business + +**fs.defaultFS** + +We used hdfs api read/write file, so used this storage need provide hdfs configuration + +if you used HDFS, you can config like this: + +```yaml +map: + engine*: + map-store: + enabled: true + initial-mode: EAGER + factory-class-name: org.apache.seatunnel.engine.server.persistence.FileMapStoreFactory + properties: + type: hdfs + namespace: /tmp/seatunnel/imap + clusterName: seatunnel-cluster + fs.defaultFS: hdfs://localhost:9000 +``` +If there is no HDFS, you can config like this: Review Comment: ```suggestion If there is no HDFS and your cluster only have one node, you can config to use local file like this: ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
