[
https://issues.apache.org/jira/browse/IOTDB-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tian Jiang reassigned IOTDB-352:
--------------------------------
Assignee: Tian Jiang
> [Distributed] Recognize and skip duplicated files in a snapshot
> ---------------------------------------------------------------
>
> Key: IOTDB-352
> URL: https://issues.apache.org/jira/browse/IOTDB-352
> Project: Apache IoTDB
> Issue Type: Improvement
> Reporter: Tian Jiang
> Assignee: Tian Jiang
> Priority: Major
> Labels: distributed
> Attachments: The solution to data deduplication across replicasV1.docx
>
>
> By the naming of TsFiles in IoTDB, the files with the same data may have
> different names on different nodes. When such files are sent through
> snapshots, the receiver is unable to tell whether the file already exists
> locally or not, so it will blindly load the file as an unsequential one (if
> it does overlap any existing files), which will waste a lot of system
> resources.
> How can we figure out if we already have one file or not?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
