Re: cutting 2.0.2?

2016-10-17 Thread Erik O'Shaughnessy
I would very much like to see SPARK-16962 included in 2.0.2 as it addresses unaligned memory access patterns that crash non-x86 platforms. I believe this falls in the category of "correctness fix". We (Oracle SAE) have applied the fixes for SPARK-16962 to branch-2.0 and have not encountered any p

Integrating a Native ARchive (NAR) into Apache Spark

2016-06-20 Thread Erik O'Shaughnessy
mes to the Maven ecosystem, however I’ve come a long way in the last two weeks. I know it’s a weird request, but I would be most appreciative if someone could provide some gentle hints about how to make my Foo object available within spark-shell. Best regards, Erik Erik O'Shaughnessy - P