[
https://issues.apache.org/jira/browse/YARN-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinod Kumar Vavilapalli updated YARN-4372:
--
Attachment: YARN-4372-20151119.1.txt
Attaching a patch that should fix this.
The patch does the following:
- Reordered the service creation in MiniYARNCluster to be AHS -> RM -> NMs.
- Moved URI creation in TimelineClient to service-start so that RM can safely
start sending events. This should be fine for existing users of TimelineClient
also as they cannot do anything for real before client.start().
- Added a simple test in TestMiniYARNCluster to validate the service order.
[~Naganarasimha]
Responding to your comments on this JIRA as well as YARN-2859.
bq. the timeline service was having some issue starting the web service though
the port was correctly set (was not an expert with jersey and guice, hence had
stopped further analysis there)
Can you try my uploaded patch here together with YARN-4350 and see if you still
find issues?
bq. In MiniYARNCluster RM servicewrapper is first added and then AHSwrapper,
and also actual AHS service is started in a thread, so RM's will be using the
wrong timelineclient address(port is zero) as AHS service is not yet
initialized.
This should be fixed in the patch - I changed the order to be AHS -> RM -> NM.
The separate thread is not an issue as RM will only start after AHS
successfully starts.
bq. In Timeline client Impl's serviceInit URI for timeline REST service is set.
So even though we create the correct service order (as per previous step), RM's
SMP will fail to publish, as timelineweb address is got only after the AHS
service is started.
Fixed TimelineClient to delay the URI creation.
bq. Also one more point(not related to this jira) to note in MiniYARNCluster,
we no more support old AHS interfce so basically
yarn.timeline-service.generic-application-history.store-class should not be
configured in ApplicationHistoryServerWrapper so that levelDBtimelinestore is
created. which i feel is correct atleast for existing 2.7.x versions. And if
you agree with it, can we fix it along with this jira as its a small thing ?,
Even if that store is specified, TimelineDataManager will continue to be
instantiated in the server, so your assumption is wrong that levelDB is not
created. Agree?
> Cannot enable system-metrics-publisher inside MiniYARNCluster
> -
>
> Key: YARN-4372
> URL: https://issues.apache.org/jira/browse/YARN-4372
> Project: Hadoop YARN
> Issue Type: Bug
>Reporter: Vinod Kumar Vavilapalli
>Assignee: Vinod Kumar Vavilapalli
> Attachments: YARN-4372-20151119.1.txt
>
>
> [~Naganarasimha] found this at YARN-2859, see [this
> comment|https://issues.apache.org/jira/browse/YARN-2859?focusedCommentId=15005746=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15005746].
> The way daemons are started inside MiniYARNCluster, RM is not setup correctly
> to send information to TimelineService.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
