One related question. The GC tuning part says [must] use G1/CMS collector, but the recommended production config doesn’t specify any GC. Is there a reason behind this?
On Thu, Jul 18, 2019 at 9:37 AM Vinoth Chandar <[email protected]> wrote: > https://cwiki.apache.org/confluence/display/HUDI/Tuning+Guide > https://hudi.apache.org/performance.html > are good resources for what you need. > > On Thu, Jul 18, 2019 at 7:37 AM Amarnath Venkataswamy < > [email protected]> wrote: > > > Hi > > > > Can you anyone of you share the Spark configuration used at UBER I didn't > > save that link to my favorites. > > > > I am currently doing some performance test against 240million records and > > job is failing for one or other reasons with memory. > > > > Regards > > Amarnath > > >
