No real reason. If you notice a sample configuration is presented under “gc tuning” section and asks the user to add it to extraJavaOptions. Its separate coz its for cms and someone else may want to do g1
On Thu, Jul 18, 2019 at 5:26 PM Gary Li <[email protected]> wrote: > One related question. The GC tuning part says [must] use G1/CMS collector, > but the recommended production config doesn’t specify any GC. Is there a > reason behind this? > > On Thu, Jul 18, 2019 at 9:37 AM Vinoth Chandar <[email protected]> wrote: > > > https://cwiki.apache.org/confluence/display/HUDI/Tuning+Guide > > https://hudi.apache.org/performance.html > > are good resources for what you need. > > > > On Thu, Jul 18, 2019 at 7:37 AM Amarnath Venkataswamy < > > [email protected]> wrote: > > > > > Hi > > > > > > Can you anyone of you share the Spark configuration used at UBER I > didn't > > > save that link to my favorites. > > > > > > I am currently doing some performance test against 240million records > and > > > job is failing for one or other reasons with memory. > > > > > > Regards > > > Amarnath > > > > > >
