Hi Steve, Sorry for the late reply.
The community@f.a.o mailing list is used for community-related announcements or discussions. Would you mind reposting your mail to the u...@flink.apache.org? Many contributors and users are subscribed to that list and answer many questions every day. Best, Fabian <stephen.hesk...@natwestmarkets.com.invalid> schrieb am Mo., 9. Apr. 2018, 06:51: > Hi all, > > We have a Flink environment using zookeeper to manage the cluster. The > high availability option is set up with the high-availability.storageDir > parameter set to a shared directory on NAS; this is available to all nodes. > > When zookeeper fails over to the standby JobManager during a cluster > change, we see old jobs that have long been cancelled being restarted > automatically by Flink. It seems like the standby JobManager is > reconnecting with old configuration and old job details. > > I can't see anything in the log that gives any indication why this old job > is restarting. I have noticed that the blob.storage.directory is set to a > local directory. > > Are there any other settings in Flink that might cause a Job Manager to > restart against an old local state rather than the latest shared state? > > Thanks, > > Steve > > > > Stephen Hesketh > Reporting Shared Services, NatWest Markets > 250 Bishopsgate, London EC2M 4AA > Office: +44 (0)20 7678 1482 (internal 381482) | Mobile: +44 (0)7968 039848 > > ****************************************************************** > > NatWest Markets is a marketing name of The Royal Bank of Scotland plc. > > This communication and any attachments are confidential and intended > solely for the addressee. If you are not the intended recipient please > advise us immediately and delete it. Unless specifically stated in the > message or otherwise indicated, you may not duplicate, redistribute or > forward this message and any attachments are not intended for distribution > to, or use by any person or entity in any jurisdiction or country where > such distribution or use would be contrary to local law or regulation. The > Royal Bank Of Scotland plc or any affiliated entity ("RBS") accepts no > responsibility for any changes made to this message after it was sent. > > Unless otherwise specifically indicated, the contents of this > communication and its attachments are for information purposes only and > should not be regarded as an offer or solicitation to buy or sell a product > or service, confirmation of any transaction, a valuation, indicative price > or an official statement. This communication has been prepared by the RBS > trading desk, which may have a position or interest in the products or > services mentioned that is inconsistent with any views expressed in this > message. In evaluating the information contained in this message, you > should know that it could have been previously provided to other clients > and/or internal RBS personnel, who could have already acted on it. > > RBS cannot provide absolute assurances that all electronic communications > (sent or received) are secure, error free, not corrupted, incomplete or > virus free and/or that they will not be lost, mis-delivered, destroyed, > delayed or intercepted/decrypted by others. Therefore RBS disclaims all > liability with regards to electronic communications (and the contents > therein) if they are corrupted, lost destroyed, delayed, incomplete, > mis-delivered, intercepted, decrypted or otherwise misappropriated by > others. > > Any electronic communication that is conducted within or through RBS > systems will be subject to being archived, monitored and produced to > regulators and in litigation in accordance with RBS's policy and local > laws, rules and regulations. Unless expressly prohibited by local law, > electronic communications may be archived in countries other than the > country in which you are located, and may be treated in accordance with the > laws and regulations of the country of each individual included in the > entire chain. > > Copyright 2014 The Royal Bank of Scotland plc. All rights reserved. See > http://www.natwestmarkets.com/legal/s-t-discl.html for further risk > disclosure. > > ****************************************************************** >