[
https://issues.apache.org/jira/browse/MAPREDUCE-7320?focusedWorklogId=557213&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-557213
]
ASF GitHub Bot logged work on MAPREDUCE-7320:
---------------------------------------------
Author: ASF GitHub Bot
Created on: 24/Feb/21 18:17
Start Date: 24/Feb/21 18:17
Worklog Time Spent: 10m
Work Description: amahussein opened a new pull request #2722:
URL: https://github.com/apache/hadoop/pull/2722
[MAPREDUCE-7320: ClusterMapReduceTestCase does not clean
directories](https://issues.apache.org/jira/browse/MAPREDUCE-7320)
Running Junits that extend ClusterMapReduceTestCase generate lots of
directories and folders all over the place.
This PR addresses organizing the directories generated by the unit test,
cleaning them up at the beginning of the execution if necessary.
- It touches `MiniYARNCluster.java` in order to change the base dir to
`target/test-dir/$TEST_CLASS_NAME`
- test classes affected
- TestMRJobClient,
- TestStreamingBadRecords,
- TestClusterMapReduceTestCase,
- TestBadRecords.
- TestMRCJCJobClient,
- TestJobName
I tested the TestUnits that use `MiniYARNCluster.java` such as:
```bash
Class
MiniYARNCluster
TestOSSMiniYarnCluster (3 usages found)
TestMRTimelineEventHandling (4 usages found)
TestJobHistoryEventHandler (3 usages found)
TestHadoopArchiveLogs (3 usages found)
TestHadoopArchiveLogsRunner (3 usages found)
TestDynamometerInfra (3 usages found)
TestDSTimelineV10
TestDSTimelineV20
TestDSTimelineV15
TestUnmanagedAMLauncher (3 usages found)
TestApplicationMasterServiceProtocolForTimelineV2
TestFederationRMFailoverProxyProvider (3 usages found)
TestHedgingRequestRMFailoverProxyProvider (4 usages found)
TestNoHaRMFailoverProxyProvider (5 usages found)
TestRMFailover (4 usages found)
TestAMRMClient
TestAMRMClientPlacementConstraints
TestAMRMProxy (5 usages found)
TestNMClient (3 usages found)
TestOpportunisticContainerAllocationE2E (3 usages found)
TestYarnClient (3 usages found)
TestYarnClientWithReservation (12 usages found)
TestYarnCLI (7 usages found)
TestContainerManagerSecurity (2 usages found)
TestDiskFailures (2 usages found)
TestMiniYarnCluster (9 usages found)
TestMiniYARNClusterForHA (2 usages found)
TestMiniYarnClusterNodeUtilization (3 usages found)
TestEncryptedShuffle
```
MAPREDUCE-7320. fix TestEncryptedShuffle paths
MAPREDUCE-7320. move cleaning up root directory to setup
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 557213)
Time Spent: 1h (was: 50m)
> ClusterMapReduceTestCase does not clean directories
> ---------------------------------------------------
>
> Key: MAPREDUCE-7320
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7320
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Ahmed Hussein
> Assignee: Ahmed Hussein
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Running Junits that extend {{ClusterMapReduceTestCase}} generate lots of
> directories and folders without cleaning them up.
> For example:
> {code:bash}
> men test -Dtest=TestMRJobClient{code}
> generates the following directories:
> {code:bash}
> - target
> -+ ConfigurableMiniMRCluster_315090884
> -+ ConfigurableMiniMRCluster_1335188990
> -+ ConfigurableMiniMRCluster_1973037511
> -+ test-dir
> -+ dfs
> -+ hadopp-XYZ-01
> -+ hadopp-XYZ-02
> -+ hadopp-XYZ-03
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
