App Id null and Name not coming proper with Amazon EMR

[raman gugnani]

HI ,

I have recently started using apache livy for submitting spark applications
on spark cluster hosted over amazon EMR. While submitting the application I
am getting application id as null and name not coming proper which I am
submitting.

PCB the curl request.

curl -X POST \
  http://XX.XX.XX.XX:8998/batches \
  -H 'Content-Type: application/json' \
  -d '{
    "file": "s3://XXXXX/XYZ.jar",
    "className": "com.abc.xyz",
    "driverMemory": "1g",
    "driverCores": 1,
    "executorMemory": "512m",
    "executorCores": 1,
    "numExecutors": 1,
    "name": "BATCH_promo_game_aggregation",
    "conf": {
    "spark.app.name":"BATCH_promo_game_aggregations",
    "spark.sql.session.timeZone":"UTC"
    }
}'

*Response Body*
{
    "id": 6,
    "state": "starting",
    "appId": null,
    "appInfo": {
        "driverLogUrl": null,
        "sparkUiUrl": null
    },
    "log": [
        "stdout: ",
        "\nstderr: ",
        "\nYARN Diagnostics: "
    ]
}


While the UI of yarn cluster shows :

                  ID                                  user            Name
application_1582700890661_0009  livy  SparkCassandraApp

-- 
Raman Gugnani