Maysam Yabandeh created HADOOP-11276:
----------------------------------------

             Summary: Allow setting url connection timeout in Configuration
                 Key: HADOOP-11276
                 URL: https://issues.apache.org/jira/browse/HADOOP-11276
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Maysam Yabandeh
            Priority: Minor


Currently for url resources there is no way to control the http connection 
opened by Configuration:
{code}
  private Document parse(DocumentBuilder builder, URL url)
      throws IOException, SAXException {
    if (!quietmode) {
      LOG.debug("parsing URL " + url);
    }
    if (url == null) {
      return null;
    }
    return parse(builder, url.openStream(), url.toString());
  }
{code}

If we let this method call a protected method that return a stream object from 
a URL, then the application can override such method and set the application 
specific connection settings on the URL, like
{code}
URLConnection con = url.openConnection();
con.setConnectTimeout(connectTimeout);
InputStream in = con.getInputStream();
return in;
{code}

Our monitoring tool currently needs to retrieve the conf from many app masters 
and the default timeout of 60s is too much, and no way to configure it in the 
current implementation of the Configuration.

If there is any +1 for this change I can submit an initial patch.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to