yes.I am looking for the same thing only. On Thu, Jul 18, 2019 at 9:20 PM Vinoth Chandar <[email protected]> wrote:
> No real reason. If you notice a sample configuration is presented under > “gc tuning” section and asks the user to add it to extraJavaOptions. Its > separate coz its for cms and someone else may want to do g1 > > On Thu, Jul 18, 2019 at 5:26 PM Gary Li <[email protected]> wrote: > > > One related question. The GC tuning part says [must] use G1/CMS > collector, > > but the recommended production config doesn’t specify any GC. Is there a > > reason behind this? > > > > On Thu, Jul 18, 2019 at 9:37 AM Vinoth Chandar <[email protected]> > wrote: > > > > > https://cwiki.apache.org/confluence/display/HUDI/Tuning+Guide > > > https://hudi.apache.org/performance.html > > > are good resources for what you need. > > > > > > On Thu, Jul 18, 2019 at 7:37 AM Amarnath Venkataswamy < > > > [email protected]> wrote: > > > > > > > Hi > > > > > > > > Can you anyone of you share the Spark configuration used at UBER I > > didn't > > > > save that link to my favorites. > > > > > > > > I am currently doing some performance test against 240million records > > and > > > > job is failing for one or other reasons with memory. > > > > > > > > Regards > > > > Amarnath > > > > > > > > > >
