FWIW, I fixed this. It was related to how I was serializing my clojure functions, although I'm still not sure exactly what the cause of the exception was.
On Wed, Jan 15, 2014 at 3:05 PM, Soren Macbeth <[email protected]> wrote: > I'm working on a Clojure DSL, so my map and reduce function are in > Clojure, but I updated to the gist to include the code. > > https://gist.github.com/sorenmacbeth/6f49aa1852d9097deee4 > > (map-reduce-1) works as expected, however, (map-reduce) throws that > exception. I've traced the types and outputs along the way and every is > identical form what I can tell. (defsparkfn) uses (sparkop) under the hood > as well, so that code is essentially identical, which has my scratching my > head. > > > On Wed, Jan 15, 2014 at 2:56 PM, Mark Hamstra <[email protected]>wrote: > >> Okay, that fits with what I was expecting. >> >> What does your reduce function look like? >> >> >> On Wed, Jan 15, 2014 at 2:33 PM, Soren Macbeth <[email protected]>wrote: >> >>> 0.8.1-incubating running locally. >>> >>> On January 15, 2014 at 2:28:00 PM, Mark Hamstra >>> ([email protected]<//[email protected]>) >>> wrote: >>> >>> Spark version? >>> >>> >>> >>> On Wed, Jan 15, 2014 at 2:19 PM, Soren Macbeth <[email protected]>wrote: >>> >>>> Howdy, >>>> >>>> I'm having some trouble understanding what this exception means, i.e., >>>> what the problem it's complaining about is. The full stack trace is here: >>>> >>>> https://gist.github.com/sorenmacbeth/6f49aa1852d9097deee4 >>>> >>>> I've doing a simple map and then reduce. >>>> >>>> TIA >>>> >>> >>> >> >
