[
https://issues.apache.org/jira/browse/HAMA-244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12867134#action_12867134
]
Hyunsik Choi commented on HAMA-244:
-----------------------------------
https://issues.apache.org/jira/browse/HAMA-251?focusedCommentId=12865430&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#action_12865430
As I mentioned in the above comment, BSPMaster is responsible to do the
following:
1. Maintaining groom server status.
2. Controlling super steps in a cluster.
3. Maintaining job progress information.
4. Assigning tasks to groom servers.
5. Scheduling Job
6. Controlling fault.
7. Providing users with the cluster control interface.
8. Disseminating execution class across groom servers. (newly added)
Among them, now I plan to implement 1,3,4, 5 and 8. For these works, I made
only the Work class (i.e., a dummy class for BSP computing) that has no method.
A user needs to set only the class to a simple job instance in order to submit
a job. It is enough for me to implement above features. Among above 5 features
that I plan in HAMA-251, I already implemented most features although they are
simple and some of the classes are borrowed from MapReduce.
For instance, the 8th feature plays a role to copy both job's meta data
submitted and a jar file (containing an executable BSP class and its related
classes) to a bsp master's disk from clients's disk and then to copy the
bsp.jar to all groom servers' disk. This way has used in many cluster
architectures, such as Condor, Clustera, and MapReduce.
I still don't know why HAMA-244 must be first. Do you mean that we have to
solve issues in the order that you determine?
> Consider more simplified BSP programming interface
> --------------------------------------------------
>
> Key: HAMA-244
> URL: https://issues.apache.org/jira/browse/HAMA-244
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Affects Versions: 0.2.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.2.0
>
> Attachments: HAMA-244_v01.patch, HAMA-244_v02.patch
>
>
> Perhaps, every BSP program will be consists of three steps such as,
> initialization, SPMD code implementation, and finalization from developer
> angle.
> However, currently there is no interface layer so users have to do all the
> works w/o any guide.
> Would be nice if it allow to use a more simplified interface.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
