Re: [Discussion] Speed up CI/CD build

2020-12-11 Thread Vinoth Chandar
No worries. If you could share how far you got and what the next steps are and if you still think its the right direction, it ll help the person picking this up :) On Fri, Dec 11, 2020 at 3:52 AM vino yang wrote: > Hi, > > Sorry. > Due to busy work, I interrupted this verification work. I will

Re: [Discussion] Speed up CI/CD build

2020-12-11 Thread vino yang
Hi, Sorry. Due to busy work, I interrupted this verification work. I will let @wangxianghu continue to follow up this work. Best, Vino Vinoth Chandar 于2020年12月11日周五 下午3:25写道: > Thanks for kicking this off, Gary! > > Thanks to Raymond, the CI tests are leaner and more parellelized now. But I >

Re: Schema evolution in hudi

2020-12-11 Thread Vinoth Chandar
Hi Rahul, On the specific scenario, if you could raise a GH Support issue with steps/stacktrace we can certainly help out. On the first part, we have relied on Avro schema evolution/compatibility thus far, where you null out the old columns (which is very cheap for parquet storage anyway). For