Re: Potential conflict with org.iq80.snappy in Spark 1.6.0 environment?

2016-03-27 Thread Vasu Parameswaran
It turned out that there is a conflict for this within the Spark environment. This error got resolved after I shaded out org.iq80.snappy via the maven shade plugin. Just posting so others may benefit. On Sun, Mar 20, 2016 at 11:40 PM, Akhil Das wrote: > Looks

Re: Potential conflict with org.iq80.snappy in Spark 1.6.0 environment?

2016-03-21 Thread Akhil Das
Looks like a jar conflict, could you paste the piece of code? and how your dependency file looks like? Thanks Best Regards On Sat, Mar 19, 2016 at 7:49 AM, vasu20 wrote: > Hi, > > I have some code that parses a snappy thrift file for objects. This code > works fine when run

Potential conflict with org.iq80.snappy in Spark 1.6.0 environment?

2016-03-18 Thread vasu20
Hi, I have some code that parses a snappy thrift file for objects. This code works fine when run standalone (outside of the Spark environment). However, when running from within Spark, I get an IllegalAccessError exception from the org.iq80.snappy package. Has anyone else seen this error