Re: [Csync2] Adding a huge amount of data to an existing csync2/lsyncd setup

2017-05-03 Thread Kevin Cackler
Thanks, Jerry. I do have the paper and actually did use that section of it to initialize these new files, but csync2 still wanted to sync everything up on the next sync. I figured out late last night that the file creation times were different on each of the hosts, and because of that, csync2 h

Re: [Csync2] Adding a huge amount of data to an existing csync2/lsyncd setup

2017-05-02 Thread Jerry Chin
Hey! Do you have the csync2 paper at hand which came along with the package (or check out this link http://oss.linbit.com/csync2/paper.pdf) ? thoroughly read chapter *5.5 Bootstrapping large setups* will extremely helpful. The chapter will show you how to add new files to status db without marking

[Csync2] Adding a huge amount of data to an existing csync2/lsyncd setup

2017-05-02 Thread Kevin Cackler
What is the best method for adding a lot of data to an already existing setup? I'm talking about 50GB here and probably around 60,000 files. If I just add the files to a node in the cluster, it takes many hours for the data to sync to the rest of the nodes. I would be fine with stopping lsyncd