Hi All,
There are default values of configs in hdfs-default.xml and
core-default.xml, and I am wondering which situation are they for? Are they
closer to lab use, or closer to real production environment?
Maybe it depends on different configs, then I have questions to these
Hello,
I wanted to know if there is any recommendation for ResourceManager GC settings.
Full GC (with Parallel GC, 8 threads) is sometimes taking more than 30 sec due
to which state store sessions to Zookeeper time out resulting in FATAL errors.
The YARN cluster is heavily used with 1000’s of
Hi Puneet
Can you take a heap dump and see where most of the churn is? Is it lots of
small applications / few really large applications with small containers
etc. ?
Cheers
Ravi
On Wed, Aug 23, 2017 at 9:23 AM, Ravuri, Venkata Puneet
wrote:
> Hello,
>
>
>
> I wanted to know if
Hi Doris!
I'm not sure what the difference between lab / production use is. All
configuration affects some behavior of the Hadoop system. Usually the
defaults are good for small clusters. For larger clusters, it becomes
worthwhile to tune the configuration.
1.
Hi Puneet,
Along with the heap dump details, I would also like to know the version of
the Hadoop-Yarn being used, size of the cluster, all Memory configurations,
and JRE version.
Also if possible can you share the rational behind the choice for Parallel
GC collector over others (CMS or G1) ?
What is the ResourceManager JVM’s heap size? What is the value for the
configuration yarn.resourcemanager.max-completed-applications?
+Vinod
> On Aug 23, 2017, at 9:23 AM, Ravuri, Venkata Puneet wrote:
>
> Hello,
>
> I wanted to know if there is any recommendation for