I am trying to add my custom jar in spark job using "spark.jars" property. Although I can read the info in logs of jar getting added but when I check the jars that are added to class path, I doesn't find it.Below are the functions that I also have tried it out. 1)spark.jars 2)spark.driver.extraLibraryPath 3)spark.executor.extraLibraryPath 4)setJars(Seq[<path>])
But none added jar.I am using spark 2.2.0 in HDP and files were kept locally. Please let me know what possibly I am doing wrong.