[
https://issues.apache.org/jira/browse/YARN-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yesha Vora updated YARN-8913:
-----------------------------
Attachment: YARN-8913.003.patch
> Add helper scripts to launch MaWo App to run Hadoop unit tests on Hadoop
> Cluster
> --------------------------------------------------------------------------------
>
> Key: YARN-8913
> URL: https://issues.apache.org/jira/browse/YARN-8913
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Yesha Vora
> Assignee: Yesha Vora
> Priority: Blocker
> Attachments: YARN-8913.001.patch, YARN-8913.002.patch,
> YARN-8913.003.patch
>
>
> MaWo application can be used to run Hadoop UT faster in a Hadoop cluster.
> Develop helper scripts to orchestrate end-to-end workflow for running Hadoop
> UT using MaWo app.
> Pre-requisite:
> * A Hadoop Cluster with HDFS and YARN installed
> * Enable Docker on YARN feature
>
> Helper-scripts
> * MaWo_Driver
> ** create a docker image with latest hadoop source code
> ** create payload to MaWo app (This is input to mawo app where Each MaWo
> Task = UT execution of each Hadoop Module)
> ** Upload payload file to HDFS
> ** Update MaWo-Launch.json to resolve RM_HOST / Docker Image etc dynamically
> ** Launch MaWo app in Hadoop cluster
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
