FWIW, I fixed this. It was related to how I was serializing my clojure
functions, although I'm still not sure exactly what the cause of the
exception was.
On Wed, Jan 15, 2014 at 3:05 PM, Soren Macbeth so...@yieldbot.com wrote:
I'm working on a Clojure DSL, so my map and reduce function are in
I'm glad you found a fix. I was strongly suspecting that the problem had
to reside in your Clojure function and how it was passed to Spark, but I
didn't have time to nail that down definitively.
When you say that you don't understand the exception, do you mean that you
don't understand match
Yeah, sorry, I understand match errors, just not what was causing it in this
case.
On January 16, 2014 at 11:12:39 AM, Mark Hamstra (m...@clearstorydata.com)
wrote:
I'm glad you found a fix. I was strongly suspecting that the problem had to
reside in your Clojure function and how it was
Howdy,
I'm having some trouble understanding what this exception means, i.e., what
the problem it's complaining about is. The full stack trace is here:
https://gist.github.com/sorenmacbeth/6f49aa1852d9097deee4
I've doing a simple map and then reduce.
TIA
0.8.1-incubating running locally.
On January 15, 2014 at 2:28:00 PM, Mark Hamstra (m...@clearstorydata.com) wrote:
Spark version?
On Wed, Jan 15, 2014 at 2:19 PM, Soren Macbeth so...@yieldbot.com wrote:
Howdy,
I'm having some trouble understanding what this exception means, i.e., what the
Okay, that fits with what I was expecting.
What does your reduce function look like?
On Wed, Jan 15, 2014 at 2:33 PM, Soren Macbeth so...@yieldbot.com wrote:
0.8.1-incubating running locally.
On January 15, 2014 at 2:28:00 PM, Mark Hamstra
I'm working on a Clojure DSL, so my map and reduce function are in Clojure,
but I updated to the gist to include the code.
https://gist.github.com/sorenmacbeth/6f49aa1852d9097deee4
(map-reduce-1) works as expected, however, (map-reduce) throws that
exception. I've traced the types and outputs
