I posted a note on the Spark list pointing to this thread. I also know most of the issues that they're interested in fixing, so I've marked those on the backports doc. We should also do a benchmark to compare 1.8.1 with 1.8.2 to ensure we don't have a performance regression.
rb On Fri, Jan 6, 2017 at 3:37 PM, Julien Le Dem <[email protected]> wrote: > Thanks Ryan! > Do we know who are the folks from the Spark project that need to review > this? > It would be great to get their explicit review/approval here. > can you cc them on the thread? > Julien > > > > On Jan 6, 2017, at 3:16 PM, Ryan Blue <[email protected]> wrote: > > > > Hi everyone, > > > > There was some discussion last month about getting a 1.8.2 patch release > > out so that some projects like Spark can take advantage of recent bug > > fixes, but not pull in more risky changes like the byte buffer read path. > > I've gone ahead an filtered the commits since 1.8.1 and created a list of > > what I think should go into the 1.8.2 release here: > > > > > > https://docs.google.com/spreadsheets/d/1NAuY3c77Egs6REu- > UVkQqPswpVYVgZTTnY3bM0SPVRs/edit?usp=sharing > > > > I also built a branch with these commits backported: > > > > https://github.com/rdblue/parquet-mr/tree/parquet-1.8.x > > > > I'd like to get a 1.8.2 release candidate out sometime soon, so please > look > > at what I've included and comment on the doc if there's anything else > you'd > > like to get in, or if you think some commits shouldn't be there. > > > > Thanks! > > > > rb > > > > -- > > Ryan Blue > > Software Engineer > > Netflix > > -- Ryan Blue Software Engineer Netflix
