Re: User Defined Type (UDT)

2015-05-20 Thread Justin Uang
Xiangrui, is there a timeline for when UDTs will become a public API? I'm currently using them to support java 8's ZonedDateTime. On Tue, May 19, 2015 at 3:14 PM Xiangrui Meng wrote: > (Note that UDT is not a public API yet.) > > On Thu, May 7, 2015 at 7:11 AM, wjur wrote: > > Hi all! > > > > I

Re: Aggregate order semantics when spilling

2015-01-20 Thread Justin Uang
#x27;re spilling anyway the overhead will > likely be shadowed by disk I/O. > > Let me know if that works. > -Andrew > > > 2015-01-20 9:18 GMT-08:00 Justin Uang : > > Hi, >> >> I am trying to aggregate a key based on some timestamp, and I believe >> that sp

Aggregate order semantics when spilling

2015-01-20 Thread Justin Uang
Hi, I am trying to aggregate a key based on some timestamp, and I believe that spilling to disk is changing the order of the data fed into the combiner. I have some timeseries data that is of the form: ("key", "date", "other data") Partition 1 ("A", 2, ...) ("B", 4, ...) ("A", 1,