Re: modifying spark's optimizer for research

2021-04-22 Thread Walter Cai
hD work > > > > Maybe you could share some links or pointers for the work you have done? > So this can help give people some basic ideas and provide help more > specifically. > > > > Thanks, > > Cheng Su > > > > *From: *Walter Cai > *Date: *

Re: modifying spark's optimizer for research

2021-04-22 Thread Cheng Su
u have done? So this can help give people some basic ideas and provide help more specifically. Thanks, Cheng Su From: Walter Cai Date: Wednesday, April 21, 2021 at 6:09 PM To: "dev@spark.apache.org" Subject: modifying spark's optimizer for research Hi, I'm Walter, a PhD student a

modifying spark's optimizer for research

2021-04-21 Thread Walter Cai
Hi, I'm Walter, a PhD student at the University of Washington. My goal is to implement a prototype modification to spark's optimizer to exhibit/experiment some of my PhD work. I was hoping to set up a chat with somebody who is familiar with catalyst and the best place to start modifying. Thanks,