Hey , I need to set the number of cores from inside the topology . Its working fine by setting in spark-env.sh but unable to do via setting key/value for conf .
SparkConf sparkConf = new SparkConf().setAppName("JavaCustomReceiver").setMaster("local[4]"); if(toponame.equals("IdentityTopology")) { sparkConf.setExecutorEnv("SPARK_WORKER_CORES","1"); } -- Thanks & Regards, Anshu Shukla