How do I set spark conf parameters?

[kant kodali]

Hi All,


How do I set Spark Conf Parameters ? The below doesnt seem to get picked
up? If so, how can I change my program such that it can pick it up. I am
not seeing a way if sparkcontext is already created?

public String call(JobContext ctx) throws Exception {
    ctx.sc().setLogLevel("INFO");
    ctx.sc().getConf()
        .set("spark.cassandra.connection.host",
config.getString("cassandra.host"))
        .set("spark.cassandra.auth.username",
config.getString("cassandra.user"))
        .set("spark.cassandra.auth.password",
config.getString("cassandra.pass"))
        .set("es.index.auto.create", "true");

}


Thanks!