Github user shivaram commented on the pull request:
https://github.com/apache/spark/pull/4038#issuecomment-71286989
@voukka @nchammas - This high level goal looks fine to me. However I the
function get_hostname is being called on all instances (its inside a loop) in
many cases. I wonder if we can do something more lightweight by exploiting the
fact that you typically want to use the same kind of resolution for all
machines. What this will mean is that for the very first machine we will try
all four options and then just save which field was used -- Then the function
just picks the appropriate field going forward.
Will this solve your use case ? Or are there use cases where we need to do
this for every instance ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
