Github user harishreedharan commented on the pull request:
https://github.com/apache/spark/pull/1310#issuecomment-50996774
@joyyoj I will take a look at it in the next couple days. As far as #807 is
concerned - yes, if the flume agent's location changes, the config needs to
change. In my experience (I work for a company that has a large number of Flume
customers), Flume agents are usually deployed on specific nodes and if they
crash - they are restarted on the same node - since Flume has no concept of
workers (every agent is a worker), so that was not a concern in my design.
The ZK-based config seems interesting. I will take a look at it soon.
Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
