Re: jar conflict with Spark default packaging

2015-03-16 Thread Shawn Zheng
Thanks a lot. I will give a try! On Monday, March 16, 2015, Adam Lewandowski wrote: > Prior to 1.3.0, Spark has 'spark.files.userClassPathFirst' for non-yarn > apps. For 1.3.0, use 'spark.executor.userClassPathFirst'. > > See > https://mail-archives.apache.org/mod_mbox/spark-user/201503.mbox/%3C

jar conflict with Spark default packaging

2015-03-13 Thread Shuai Zheng
Hi All, I am running spark to deal with AWS. And aws sdk latest version is working with httpclient 3.4+. Then but spark-assembly-*-.jar file has packaged an old httpclient version which cause me: ClassNotFoundException for org/apache/http/client/methods/HttpPatch Even when I put the rig