[
https://issues.apache.org/jira/browse/HADOOP-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617798#action_12617798
]
Tom White commented on HADOOP-2411:
-----------------------------------
These are good changes (with the groovy stuff removed, and the INSTANCE_TYPE
changed back to small), but the intent of this Jira was to configure Hadoop
appropriately according to the instance type. Larger instances have more RAM
and more CPUs so we could change properties like fs.inmemory.size.mb,
io.sort.mb and mapred.tasktracker.(map|reduce).tasks.maximum according to the
instance size. Unfortunately, the configuration story for Hadoop on EC2 needs
some work (for example, you can't rsync changes around a cluster), and we
should concentrate on fixing this. Another approach is HADOOP-2409.
> Add support for larger EC2 instance types
> -----------------------------------------
>
> Key: HADOOP-2411
> URL: https://issues.apache.org/jira/browse/HADOOP-2411
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/ec2
> Affects Versions: 0.17.0
> Reporter: Tom White
> Attachments: hadoop-ec2.patch
>
>
> Need to configure Hadoop to exploit the resources available on larger
> instance types: 64bit, extra CPUs, larger memory. See
> http://docs.amazonwebservices.com/AWSEC2/2007-08-29/DeveloperGuide/instance-types.html
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
