Flume doesn't "migrate" sources, you would need to have both ftp sources (to servers A and B) configured on multiple agents and have some coordination mechanism between them.
For instance, if you have a zookeeper cluster is very easy for the ftp sources that want to access each ftp server to do leader election (using Curator). So if the leader dies another takes the responsability. You could also do some "fencing" mechanism so you create a tmp file to indicate other servers you are already working on a specific file (this has many complications and will take you time to make it robust) Regars, Gonzalo On Sep 6, 2015 9:58 AM, "[email protected]" < [email protected]> wrote: > Dear everyone > > I have a custom source named FTP-Source which can get data from ftp > server and delever data to channels. And I have a question about the high > availibity of flume-ng that I hope you can spare some time and give me some > advices. Thank you very much again! > 1, Two servers say serverA and serverB. each server is running a flume > process with FTP-Source to collecte data from different remote FTP server. > For example, serverA collectes data from FTPserverA, serverB cllectes data > from FTPserverB, serverA and serverB save all the data to serverC. If > severA is poweroff or offline, how the task processed in serverA can be > migrated to serverB to avoid data loss. > Looking forward to your reply. > > Best wishes. > > > > 陈雷雷 IT支撑系统开发部 > 中移（苏州）软件技术有限公司 > 中国移动苏州研发中心 > Tel：18896724634 > E-Mail：[email protected] >
