[jira] [Resolved] (HADOOP-7469) add a standard handler for socket connection problems which improves diagnostics
[
https://issues.apache.org/jira/browse/HADOOP-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-7469.
Resolution: Fixed
Fix Version/s: 0.23.0
Target Version/s: 0.23.0, 0.24.0 (was: 0.24.0, 0.23.0)
backported to 0.23
add a standard handler for socket connection problems which improves
diagnostics
Key: HADOOP-7469
URL: https://issues.apache.org/jira/browse/HADOOP-7469
Project: Hadoop Common
Issue Type: Sub-task
Components: util
Affects Versions: 0.20.203.0, 0.23.0
Reporter: Steve Loughran
Assignee: Steve Loughran
Priority: Minor
Labels: debugging
Fix For: 0.23.0, 0.24.0
Attachments: HADOOP-7466-connection-handler.patch,
HADOOP-7469-3.patch, HADOOP-7469-b023.patch, HADOOP-7469.patch,
HADOOP-7469.patch, HADOOP-7469.patch
Original Estimate: 2h
Remaining Estimate: 2h
connection refused, connection timed out, no route to host, etc, are classic
IOExceptions that can be raised in a lot of parts of the code. The standard
JDK exceptions are useless for debugging as they
# don't include the destination (host, port) that can be used in diagnosing
service dead/blocked problems
# don't include any source hostname that can be used to handle routing issues
# assume the reader understands the TCP stack.
It's obvious from the -user lists that a lot of people hit these problems and
don't know how to fix them. Sometimes the source has been patched to insert
the diagnostics, but it may be convenient to have a single method to
translate some
{code}
SocketException processIOException(SocketException e, String destHost, int
destPort) {
String localhost = getLocalHostname();
String details = From + localhost + to + desthost + :+destPort;
if (e instanceof ConnectException) {
return new ConnectException(details
+ -- see http://wiki.apache.org/hadoop/ConnectionRefused -- +
e, e);
}
if (e instanceof UnknownHostException) {
return new UnknownHostException(details
+ -- see http://wiki.apache.org/hadoop/UnknownHost -- + e, e);
}
// + handlers for other common socket exceptions
//and a default that returns an unknown class unchanged
return e;
}
{code}
Testing: try to connect to an unknown host, a local port that isn't live,
etc. It's hard to replicate all failures consistently. It may be simpler just
to verify that if you pass in a specific exception, the string is expanded
and the class is unchanged.
This code could then be patched in to places where IO takes place. Note that
Http Components and HttpClient libs already add some destination details on
some operation failures, with their own HttpException tree: it's simplest to
leave these alone.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7705) Add a lo4j back end that can push out JSON data, one per line
Add a lo4j back end that can push out JSON data, one per line - Key: HADOOP-7705 URL: https://issues.apache.org/jira/browse/HADOOP-7705 Project: Hadoop Common Issue Type: New Feature Components: util Reporter: Steve Loughran Assignee: Steve Loughran Priority: Minor If we had a back end for Log4j that pushed out log events in single line JSON content, we'd have something that is fairly straightforward to machine parse. If: it may be harder to do than expected. Once working HADOOP-6244 could use it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7707) improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off
improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off Key: HADOOP-7707 URL: https://issues.apache.org/jira/browse/HADOOP-7707 Project: Hadoop Common Issue Type: Improvement Components: conf Affects Versions: 0.20.205.1 Reporter: Arpit Gupta -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7708) config generator does not update the properties file if on exists already
config generator does not update the properties file if on exists already - Key: HADOOP-7708 URL: https://issues.apache.org/jira/browse/HADOOP-7708 Project: Hadoop Common Issue Type: Bug Components: conf Affects Versions: 0.20.205.1 Reporter: Arpit Gupta We are copying configs to the hadoop conf dir but are not using the -f option. This leads to conf file not getting replaced in case the file exists and thus the user never gets the new conf. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7709) Running a set of methods in a Single Test Class
Running a set of methods in a Single Test Class --- Key: HADOOP-7709 URL: https://issues.apache.org/jira/browse/HADOOP-7709 Project: Hadoop Common Issue Type: Improvement Affects Versions: 0.23.0 Reporter: Jonathan Eagles Assignee: Jonathan Eagles Instead of running every test method in a class, limit to specific testing methods as describe in the link below. http://maven.apache.org/plugins/maven-surefire-plugin/examples/single-test.html Upgrade to the latest version of maven-surefire-plugin that has this feature. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HADOOP-7710) create a script to setup application in order to create root directories for application such hbase, hcat, hive etc
create a script to setup application in order to create root directories for application such hbase, hcat, hive etc --- Key: HADOOP-7710 URL: https://issues.apache.org/jira/browse/HADOOP-7710 Project: Hadoop Common Issue Type: Improvement Affects Versions: 0.20.205.1 Reporter: Arpit Gupta -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
