I'm working on a Clojure DSL, so my map and reduce function are in Clojure, but I updated to the gist to include the code.
https://gist.github.com/sorenmacbeth/6f49aa1852d9097deee4 (map-reduce-1) works as expected, however, (map-reduce) throws that exception. I've traced the types and outputs along the way and every is identical form what I can tell. (defsparkfn) uses (sparkop) under the hood as well, so that code is essentially identical, which has my scratching my head. On Wed, Jan 15, 2014 at 2:56 PM, Mark Hamstra <[email protected]>wrote: > Okay, that fits with what I was expecting. > > What does your reduce function look like? > > > On Wed, Jan 15, 2014 at 2:33 PM, Soren Macbeth <[email protected]> wrote: > >> 0.8.1-incubating running locally. >> >> On January 15, 2014 at 2:28:00 PM, Mark Hamstra >> ([email protected]<//[email protected]>) >> wrote: >> >> Spark version? >> >> >> >> On Wed, Jan 15, 2014 at 2:19 PM, Soren Macbeth <[email protected]>wrote: >> >>> Howdy, >>> >>> I'm having some trouble understanding what this exception means, i.e., >>> what the problem it's complaining about is. The full stack trace is here: >>> >>> https://gist.github.com/sorenmacbeth/6f49aa1852d9097deee4 >>> >>> I've doing a simple map and then reduce. >>> >>> TIA >>> >> >> >
