Benjamin Teke created YARN-10422:
------------------------------------
Summary: Create the script responsible for collecting the bundle
data
Key: YARN-10422
URL: https://issues.apache.org/jira/browse/YARN-10422
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Benjamin Teke
Assignee: Benjamin Teke
The script should provide the list of diagnostic use-cases described in
YARN-10421. If a request comes in to the YarnDiagnosticCollector servlet, the
script will be invoked. It collects all the information required for that
diagnostic category and saves it into a configurable directory as a compressed
tar file.
An example of how the script could look like:
{code:java}
if [$1 = "listcommonissues"]
echo "1, Application Failed"
echo "2, Application Hanging"
echo "3, Scheduler Related Issue"
echo "4, RM failure to start"
echo "5, NM failure to start"
elif [$1 = "collect"]
if [$2 == 1]
appId = $3
mkdir /tmp/$appId
yarn logs -applicationId $appId > /tmp/$appId/joblogs
curl <JHS>/{appId}/conf > /tmp/$appId/conf
curl <RM>/logs | grep container > /tmp/$appId/rmlogs
curl <NM>/logs | grep container > /tmp/$appId/nmlogs
outputpath = /tmp/$appId
elif ...
elif ...
fi tar and compress outputpath.{code}
During class load YarnDiagnosticsCollector reads the list of common issues from
the script and keeps it in memory. On every startup of YARN UI2 diagnostics
page, it fetches the list from the servlet and displays them. The servlet
should handle the script changes, so if a new diagnostic case is added, a YARN
UI2 reload should show it. This way the users can easily plug new categories
without any UI2 or Servlet code change.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
