[
https://issues.apache.org/jira/browse/MAPREDUCE-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shilun Fan updated MAPREDUCE-7298:
----------------------------------
Affects Version/s: 3.4.0
> Distcp doesn't close the job after the job is completed
> -------------------------------------------------------
>
> Key: MAPREDUCE-7298
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7298
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: distcp
> Affects Versions: 3.4.0
> Reporter: Aasha Medhi
> Assignee: Aasha Medhi
> Priority: Major
> Fix For: 3.4.0
>
> Attachments: MAPREDUCE-7298.01.patch, MAPREDUCE-7298.02.patch
>
>
> Distcp doesn't close the job after the job is completed. This leads to leaked
> Truststore Reloader Threads.
> The fix is to close the job once it is complete. job.close internally calls
> yarnClient.close(), which then calls timelineConnector.serviceStop() . This
> destroys the sslFactory cleaning up the ReloadingX509TrustManager.
> Without the patch for each distcp job, a new ReloadingX509TrustManager is
> created which creates a new thread. These threads are never killed and they
> remain like that till HS2 is restarted. With the close, the thread will be
> cleaned up once the job is completed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
