Wiki migration

2019-04-26 Thread Chia-Hung Lin
Old wiki is migrated to Confluence[1]. Given a quick check, that looks ok. But please let me know if anything in terms of this. [1]. https://cwiki.apache.org/HAMA

Kanban

2019-03-24 Thread Chia-Hung Lin
Can't get jira's kanban working, so use [1] temporary. [1]. https://trello.com/b/KRPf8xqS

Re: [DISCUSS] Roadmap

2019-03-17 Thread Chia-Hung Lin
out the item below > 1. Distribued Processing using blockchain > 2. Add Tensorflow. > > Have a nice day^^ > > 2019년 3월 3일 일요일, Chia-Hung Lin 님이 작성: > > > In addition to what's been working on right now. What other tasks you would > > like it to be added? Please share your thought. > >

[DISCUSS] Roadmap

2019-03-03 Thread Chia-Hung Lin
In addition to what's been working on right now. What other tasks you would like it to be added? Please share your thought.

Re: Project healthy question

2019-02-28 Thread Chia-Hung Lin
to start the 2019 roadmap first > > 2019년 2월 26일 (화) 오후 10:25, Edward J. Yoon 님이 작성: > > > Obviously inactive :/ By the way, I personally seeing that many of apache > > projects are going into inactive state. especially big data related > > projects. > > > > > &g

Re: Project healthy question

2019-02-26 Thread Chia-Hung Lin
ecially big data related > projects. > > > 2019년 2월 25일 (월) 오전 12:19, Chia-Hung Lin 님이 > 작성: > > > As you may notice that the activity is low for a period of time. This > > raises an issue when doing board project with respect to the project > > healthy. So it&#x

Project healthy question

2019-02-24 Thread Chia-Hung Lin
As you may notice that the activity is low for a period of time. This raises an issue when doing board project with respect to the project healthy. So it's greatly appreciated if anyone has inputs or comments regarding to this.

Apache Hama git repos migration

2019-02-16 Thread Chia-Hung Lin
According to [1], Apache Hama git repos was migrated to gitbox [2]. [1]. https://issues.apache.org/jira/browse/INFRA-17788 [2]. https://gitbox.apache.org/repos/asf/hama.git

Re: [NOTICE] Mandatory migration of git repos to gitbox.apache.org - three weeks left!

2019-01-30 Thread Chia-Hung Lin
update the web site / documentation to reflect that. > > > > > > Does anyone see any problems with this approach? > > > If there's no objections, I'll create a jira ticket. > > > > > > Thanks. > > > > > > On Thu, Jan 17, 2019 a

Re: [NOTICE] Mandatory migration of git repos to gitbox.apache.org - three weeks left!

2019-01-16 Thread Chia-Hung Lin
Hi Edward, thanks for help! On Tue, 15 Jan 2019 at 13:10, Edward J. Yoon wrote: > I can check tomorrow! > > 2019년 1월 15일 (화) 오후 4:50에 Apache Infrastructure Team < > infrastruct...@apache.org>님이 작성: > > > Hello, hama folks. > > As stated earlier in 2018, and reiterated two weeks ago, all git > >

[ANN] Youngwoo Kim is now the committer and member of Apache Hama

2018-05-19 Thread Chia-Hung Lin
Hi all, I'm happy to announce that Youngwoo Kim was accepted as the committer by Hama project. Welcome, please keep up the great work! Thanks.

Re: [jira] [Commented] (HAMA-1002) Add junit dependency to commons to compile with Hadoop 2.8+

2017-12-29 Thread Chia-Hung Lin
When applying patch Jenkins complains fail integrating patch. Checking TestResult[1], it looks like other tests are waiting master to be up running for use. Anyone knows if there's any way we can re-run the build? [1]. https://builds.apache.org/job/Hama-Nightly-for-Hadoop-2.x/731/testReport/ On 3

Re: [jira] [Created] (HAMA-1002) Add junit dependency to commons to compile with Hadoop 2.8+

2017-12-28 Thread Chia-Hung Lin
I'll look into this, but it may be slow. So feel free to pick this up if the progress appears to be stalled. On Thursday, 28 December 2017, Edward J. Yoon wrote: > Can someone review and commit this patch? :) > > 2017. 12. 26. 오후 5:04에 "ASF GitHub Bot (JIRA)" 님이 작성: > >> >> [ https://issues.a

[DISCUSS] Roadmap

2017-12-27 Thread Chia-Hung Lin
As there are still many areas Hama could be of its use and improved, it might be a good time to open discuss these issues at this moment. Some thoughts I have in mind: - Refactor core package for finer granularity. * Separate io into its own package. * Decouple BSP interface. - Monitor subsys

Re: Missing Hama Board Report - time for the Attic?

2017-09-28 Thread Chia-Hung Lin
Happy to see this. Although this looks contradictory to my previous mail, I am happy to continuously participate to this project, except I am only available during my spare time. On 28 September 2017 at 11:50, Tommaso Teofili wrote: > Hi ByungSeok Min, > > if we have people like you willing to c

[ANNOUNCE] Hama New PMC Chair - Edward J. Yoon

2015-11-19 Thread Chia-Hung Lin
On behalf of the Apache Hama PMC, I'm pleased to announce that Apache Board has approved the nomination of Edward J. Yoon as Hama's new PMC Chair! Congratulation!

Re: [DISCUSS] Hama releases for each hadoop version

2015-08-11 Thread Chia-Hung Lin
I am +1 with this if no additional issue. On 12 August 2015 at 09:23, Edward J. Yoon wrote: > Any objections/thoughts? > > On Wed, Jul 22, 2015 at 7:48 PM, Edward J. Yoon wrote: >> Hi, >> >> Like http://www.apache.org/dist/spark/spark-1.3.1/, should we create >> release tarball for each hadoop v

Re: 0.7.1 release plan

2015-08-09 Thread Chia-Hung Lin
+1 Sorry miss this in the mailbox. On 6 August 2015 at 08:57, Edward J. Yoon wrote: > Hey all, > > As you already might know, file IO bugs of YARN module has reported. I > would like to fix this issue and cut a release 0.7.1 ASAP. Rests looks > good to me. WDYT? > > -- > Best Regards, Edward J. Y

Re: [DISCUSSION] Spinoff ANN package

2015-08-04 Thread Chia-Hung Lin
+1 That looks interesting. I would like to participate in this project. On 5 August 2015 at 11:52, Edward J. Yoon wrote: > Guys, > > I plan to submit a 'DNN platform on top of Apache Hama' proposal as > below. I know Hama community is somewhat small, but the main reason is > that this domain-spec

Re: [VOTE] Apache Hama 0.7 release (RC3)

2015-06-12 Thread Chia-Hung Lin
1. http://svn.apache.org/repos/asf/hama/tags/0.7.0-RC3/trunk/ >> >> On Fri, Jun 12, 2015 at 8:16 PM, Chia-Hung Lin wrote: >>> When compiling with source checked out from >>> http://svn.apache.org/repos/asf/hama/tags/0.7.0-RC3/, followin

Re: [VOTE] Apache Hama 0.7 release (RC3)

2015-06-12 Thread Chia-Hung Lin
When compiling with source checked out from http://svn.apache.org/repos/asf/hama/tags/0.7.0-RC3/, following warnings are thrown, and the build (mvn clean install) fails. That looks like the internal dtd problem. Warning: org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser: Property 'http://www.ora

Re: [DISCUSS] Things I'd like to focus on next

2015-06-04 Thread Chia-Hung Lin
I suppose that decoupling key/ value from BSP interface may be needed because not all inputs are in key/ value format. On 4 June 2015 at 21:24, Behroz Sikander wrote: > Hi, > +1. > Yes documentation needs improvement. I also saw that a book on Hama is also > under progress. I can help with the do

Re: [VOTE] Move Hama 0.7 to Java 7+ only

2015-06-04 Thread Chia-Hung Lin
+1 On 4 June 2015 at 21:24, Behroz Sikander wrote: > +1 > > On Thu, Jun 4, 2015 at 3:23 PM, 김민호 wrote: > >> +1 >> >> Best Regards, >> Minho Kim >> >> 2015-06-04 20:26 GMT+09:00 Andronidis Anastasios > >: >> >> > +1 >> > >> > > On 4 Jun, 2015, at 12:38, Martin Illecker >> wrote: >> > > >> > > +1

Re: DNN at Tencent

2015-05-26 Thread Chia-Hung Lin
That's why I am working on refactoring core module stuff : ) BSP is suitable for iterative applications and is for general purpose parallelism. So as long as the application can be expressed as iterative algorithm, ideally our framework (in terms of higher abstraction level) should have no problem

Re: Bug in Netty-based RPC

2015-04-27 Thread Chia-Hung Lin
Have you checked limit.conf? >From the message it looks like the files opened at underlying system exceed its default limit. On 28 April 2015 at 08:08, Edward J. Yoon wrote: > I tried to run BSP job using netty-based RPC instead of message > bundle, but I received "too many open files". > > -- >

Re: [DISCUSS] Make Hadoop2 profile default

2015-03-15 Thread Chia-Hung Lin
since HAMA-848 is fixed +1 if no additional issue. On 16 March 2015 at 09:49, Edward J. Yoon wrote: > Hi all, > > It seems time to switch our project to Hadoop2 base. My suggestion is that > we keep two hadoop1 and hadoop2 profiles but make hadoop2 profile default. > WDYT? > > -- > Best Regards,

Offline for holidays

2015-02-13 Thread Chia-Hung Lin
I am going to be offline for 1 ~ 2 weeks for traditional holidays. Thanks

Re: Legal question to include code like com.sun.tools.javac.Main

2015-01-27 Thread Chia-Hung Lin
gain for kindly help! [1]. http://www.scala-lang.org/license.html [2]. http://www.apache.org/legal/resolved.html#category-x On 27 January 2015 at 18:43, Mark Thomas wrote: > On 26/01/2015 09:45, Chia-Hung Lin wrote: >> Hi, >> >> I have a naive question regarding to inclu

Legal question to include code like com.sun.tools.javac.Main

2015-01-26 Thread Chia-Hung Lin
Hi, I have a naive question regarding to include the methods like Main.compile in com.sun package in the project source code. For instance, in our project like hama if there is a source file that makes use of com.sun.tools.javac.Main to runtime compile java sources into classes. Is it legal to re

License issue

2015-01-26 Thread Chia-Hung Lin
Is it legal if the source code include functions that call to com.sun.tools.javac.Main.compile related methods? Should I simply ask in the following mailing list? www.apache.org/foundation/mailinglists.html#foundation-legal Otherwise where might be the right place to check? Thanks

Git security issue

2014-12-20 Thread Chia-Hung Lin
If you are using git repository, you may need to update git client for security concern. https://github.com/blog/1938-vulnerability-announced-update-your-git-clients http://article.gmane.org/gmane.linux.kernel/1853266

Re: MapWritable is really bad

2014-09-25 Thread Chia-Hung Lin
> Anastasis > > On 25 Σεπ 2014, at 12:58 μ.μ., Chia-Hung Lin wrote: > >> Should we roll out with our own implementation? Switching to kyro look >> like will get of this issue, but if we are going to have plugable >> serialization framework (are we?) that might help

Re: MapWritable is really bad

2014-09-25 Thread Chia-Hung Lin
Should we roll out with our own implementation? Switching to kyro look like will get of this issue, but if we are going to have plugable serialization framework (are we?) that might help those who need it. On 24 September 2014 17:19, Edward J. Yoon wrote: > Interesting .. > > On Fri, Sep 19, 2014

Re: [DISCUSS/VOTE] Refactor of message queue .

2014-08-29 Thread Chia-Hung Lin
Is incoming bundles manager equals to localQueueForNextIteration/ localQueue in 0.6.4 version? My understanding for localQueueForNextIteration/ localQueue is that their role serves as input for the coming superstep; for instance, in the N-th superstep its incoming messages are obtained from localQ

Re: Remove Spilling Queue and rewrite checkpoint/recovery

2014-08-18 Thread Chia-Hung Lin
I will make the code stable first before merging it back. On 18 August 2014 17:40, Edward J. Yoon wrote: > Do you have any plan for merging them? > > This is side opinion. If we want to use Git, now I'm +1. > > On Sat, Aug 16, 2014 at 12:00 AM, Chia-Hung Lin wrote: >>

Re: Remove Spilling Queue and rewrite checkpoint/recovery

2014-08-15 Thread Chia-Hung Lin
> > On Tue, Aug 12, 2014 at 7:15 AM, Edward J. Yoon > wrote: > >> ChiaHung, >> >> Yes, I'm thinking similar things. >> >> On Tue, Aug 12, 2014 at 4:11 PM, Chia-Hung Lin >> wrote: >> > I am currently working on this part based on the supers

Re: Remove Spilling Queue and rewrite checkpoint/recovery

2014-08-12 Thread Chia-Hung Lin
I am currently working on this part based on the superstep api, similar to the Superstep.java in the trunk. The checkpointer[1] saves bundle message instead of single message. Not very sure if this is what you are looking for? [1]. https://github.com/chlin501/hama/blob/peer-comm-mech-changed/cor

Re: [ANN] Welcome to new Hama committers

2014-08-10 Thread Chia-Hung Lin
Congrats to join the community! On 11 August 2014 06:46, Edward J. Yoon wrote: > The Apache Hama PMC is pleased to announce the following additions: > > * Victor Lee is now a Hama Committer > * ByungSeok Min is now a Hama committer. > > Thanks again to both for their efforts, we hope to see them

Re: Questions on Hama

2014-08-10 Thread Chia-Hung Lin
Perhaps you can check ${module-name}/target/surefire-report/ for more detail about which test cases fail. Apache Hama is a BSP engine, meaning it's not only capable of performing graph computation. Instead, it's suitable for general purpose parallel computing as long as the algorithm can be expres

Re: [ANN] Jeff Fenchel as a new Hama committer

2014-06-09 Thread Chia-Hung Lin
Congratulation, and thanks for the contribution! On 9 June 2014 18:41, Andronidis Anastasios wrote: > congrats Jeff! > > Anastasis > > On 9 Ιουν 2014, at 11:59 π.μ., Edward J. Yoon wrote: > >> The Hama PMC is pleased to announce Jeff Fenchel (Mesos module >> contributor) as a new committer of Ap

Re: Renil Joseph as a new Hama committer

2014-05-23 Thread Chia-Hung Lin
Congratulation! Welcome joining Hama community. On 23 May 2014 14:59, Edward J. Yoon wrote: > The Hama PMC is pleased to announce Renil Joseph as a new committer of > Hama. We look forward to his continuing involvement with Hama. > > Congrats, Renil Joseph! > > -- > Best Regards, Edward J. Yoon >

Re: [DISCUSS] Disk Queue and Spilling Queue

2014-05-12 Thread Chia-Hung Lin
Is it going to use rpc? Will it still use the interface, for instance, MessageManager.java? Just to check if any point for integrating with the current ongoing refactoring process. If possible, perhaps decoupling io part and rpc from interface would somehow simplify the integration progress. O

Re: Refactoring code

2014-04-30 Thread Chia-Hung Lin
Get it. Thanks! On 30 April 2014 15:23, Tommaso Teofili wrote: > sure, I think work in progress as an effort to innovate and improve our > current architecture and performance would be a great one, and I've seen > wip talks in the past. > > Tommaso > > > 2014-04-30

Re: Refactoring code

2014-04-30 Thread Chia-Hung Lin
; 2014-04-30 9:02 GMT+02:00 Chia-Hung Lin : > >> The refactoring process is still underway. Is it appropriate to submit >> something that is wip or may be changed drastically later on? >> >> On 30 April 2014 03:12, Tommaso Teofili wrote: >> > I do like t

Re: Refactoring code

2014-04-30 Thread Chia-Hung Lin
Maybe a chance for a submission to ApacheCon EU? > > Regards, > Tommaso > > > 2014-04-29 17:01 GMT+02:00 Chia-Hung Lin : > >> The core module are heavily refactored. And will try our best to >> retain the original interface so that users and other modules won'

Re: Refactoring code

2014-04-29 Thread Chia-Hung Lin
me know if anything in terms of this. On 29 April 2014 22:24, Suraj Menon wrote: > Looks like a complete refactor and with a different language ;). I am +1 on > moving to Scala. > > -Suraj > > > On Tue, Apr 29, 2014 at 6:19 AM, Chia-Hung Lin wrote: > >> Hi >> &

Refactoring code

2014-04-29 Thread Chia-Hung Lin
Hi Recently I am working on the refactoring bsp core module. It's basically related to HAMA-881. There's already some changes. If you have interested, the code is at https://github.com/chlin501

Open ssl security issue

2014-04-15 Thread Chia-Hung Lin
Due to open ssl vulnerabilities[1], it might be good for committer, etc. to reset their Apache password as mentioned in [2]. [1]. http://www.openssl.org/news/vulnerabilities.html [2]. https://blogs.apache.org/infra/entry/heartbleed_fallout_for_apache

Re: [DISCUSS] Rename of ML and Graph modules

2014-04-14 Thread Chia-Hung Lin
Graph package is clearer for me. Mach may be confusing with CMU's os microkernel. Or we want a code name for each release like some GNU/ Linux dist release? On 14 April 2014 14:57, Tommaso Teofili wrote: > I think graph is a pretty fine name, it'easy to understand it's Hama > applied to grap

Re: [jira] [Commented] (HAMA-883) [Research Task] Massive log event aggregation in real time using Apache Hama

2014-04-11 Thread Chia-Hung Lin
and executes it. Then, > it'll work like Storm flow. I didn't think about FT issue yet. :-) > > > > On Fri, Apr 11, 2014 at 5:12 PM, Chia-Hung Lin wrote: > >> Or we can have POC first and then see how it relates to the issue we >> might need to fix. >>

Re: [jira] [Commented] (HAMA-883) [Research Task] Massive log event aggregation in real time using Apache Hama

2014-04-11 Thread Chia-Hung Lin
Or we can have POC first and then see how it relates to the issue we might need to fix. On 11 April 2014 16:10, Chia-Hung Lin wrote: > In that case are we going to organize multiple tasks into a group? A > job has N bsp groups (bsp task in current code), in turn each group > contain

Re: [jira] [Commented] (HAMA-883) [Research Task] Massive log event aggregation in real time using Apache Hama

2014-04-11 Thread Chia-Hung Lin
In that case are we going to organize multiple tasks into a group? A job has N bsp groups (bsp task in current code), in turn each group contain multiple tasks (and all tasks are on the same server)? If this is the case, how do they send messages or communicate between groups? group to group? A ta

Re: [DISCUSS] Fault tolerant BSP job

2014-04-10 Thread Chia-Hung Lin
old issue tickets? Let's just code it. > > > > On Thu, Apr 10, 2014 at 2:31 AM, Chia-Hung Lin wrote: >> That's why I proposed to use Superstep api instead, though I prefer >> plain bsp function. Unless we want to instrument the source code, >> which I believe is n

Re: [DISCUSS] Fault tolerant BSP job

2014-04-09 Thread Chia-Hung Lin
> > -Suraj > > > On Wed, Apr 9, 2014 at 7:29 AM, Edward J. Yoon wrote: > >> I just found this: https://issues.apache.org/jira/browse/HAMA-503 and >> HAMA-639. >> >> Do you still think superstep API is essential for checkpoint/recovery? >> If not, w

Re: [DISCUSS] Fault tolerant BSP job

2014-04-09 Thread Chia-Hung Lin
model. > > 1. > http://svn.apache.org/repos/asf/hama/trunk/examples/src/main/java/org/apache/hama/examples/SuperstepPiEstimator.java > > On Wed, Apr 9, 2014 at 4:25 PM, Chia-Hung Lin wrote: >> Sorry don't catch the point. >> >> What's differ

Re: [DISCUSS] Fault tolerant BSP job

2014-04-09 Thread Chia-Hung Lin
Sorry don't catch the point. What's difference between pure BSP and FT BSP? Any concrete example? On 9 April 2014 08:29, Edward J. Yoon wrote: > In my eyes, SuperstepPiEstimator[1] look like totally new programming > model, very similar with Pregel. > > I personally would like to suggest that w

Re: I'd like to contribute to Hama

2014-04-09 Thread Chia-Hung Lin
Hi You can have a look at jira [1]. Checking out the source [2]. And submit patch as attachment to a jira ticket. Welcome for contribution. : ) [1]. https://issues.apache.org/jira/browse/HAMA/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel [2]. http://wiki.apache.org/hama/How

Re: Project and Website Layout Refactoring Idea.

2014-04-04 Thread Chia-Hung Lin
+1 On 4 April 2014 16:41, Andronidis Anastasios wrote: > +1 > > Anastasis > > On 4 Απρ 2014, at 8:22 π.μ., Tommaso Teofili > wrote: > >> it sounds reasonable to me, good point. >> >> Tommaso >> >> >> 2014-04-04 3:31 GMT+02:00 Edward J. Yoon : >> >>> All, >>> >>> From an user's perspective, we o

Jira tasks status for v0.7.0

2014-04-02 Thread Chia-Hung Lin
A list of tasks are at [1]. Just to check: - Are we going to fix all of them before release? - Do we have priority? What tickets do we think that should be included in v0.7? [1]. https://issues.apache.org/jira/browse/HAMA/fixforversion/12320349/?selectedTab=com.atlassian.jira.jira-projects-plugi

Re: Procedure

2014-03-27 Thread Chia-Hung Lin
Thank for volunteer. On 27 March 2014 14:50, Edward J. Yoon wrote: > I can volunteer to release manager. > > On Thu, Mar 27, 2014 at 3:24 PM, Chia-Hung Lin wrote: >> As we will have new version for each release, we need someone help >> deal with release process. Anyone wo

Procedure

2014-03-26 Thread Chia-Hung Lin
As we will have new version for each release, we need someone help deal with release process. Anyone would like to volunteer on this?

NPE is thrown when generating javadoc

2014-03-14 Thread Chia-Hung Lin
I am not sure if this is jdk bug (maybe not). Just write down as side note. When compiling with jdk 6 (java version "1.6.0_25") following exception is thrown. Switching to jdk 7, this api doc exception goes away. Came across to find on the interest there is a same problem report, but no bug databa

Re: [DISCUSS] Close all old JIRA tickets and Redesign for future fault tolerant system

2014-03-06 Thread Chia-Hung Lin
I am refactoring the code. If you are interested, it's at https://github.com/chlin501/hama On 7 March 2014 10:12, Edward J. Yoon wrote: > I'd like to close all old (very inactive) JIRA tickets, and re-design > for future system. > > If no objections are raised, I'll do next week. > > Thanks! >

Re: [jira] [Updated] (HAMA-883) [Research Task] Massive log event aggregation in real time using Apache Hama

2014-03-04 Thread Chia-Hung Lin
> >> Do we really need to make Hama to support the real time computing? In that >> case, we need to compete with Storm... >> >> >> 2014-03-04 22:58 GMT-05:00 Chia-Hung Lin : >> >>> I used Twitter Storm previously. Storm is an excellent framework in >&

Re: [jira] [Updated] (HAMA-883) [Research Task] Massive log event aggregation in real time using Apache Hama

2014-03-04 Thread Chia-Hung Lin
I used Twitter Storm previously. Storm is an excellent framework in real time processing. Considering Hama in real time tasks, the framework in my opinion need to decouple io from hdfs so that the source/ input is not restricted to just hdfs. On 5 March 2014 09:30, Yexi Jiang wrote: > Please cor

Re: [jira] [Updated] (HAMA-883) [Research Task] Massive log event aggregation in real time using Apache Hama

2014-03-04 Thread Chia-Hung Lin
BSP is a bridge model that doesn't restrict itself to some particular usage. My understanding (I could be wrong) is that our framework needs to address such issue. [1], for example, proposes a solution based on bsp in the field of real-time application. [1]. Hartley J.K., Bargiela A., TPML: Parall

Re: [VOTE] Release Hama 0.6.4 (RC1)

2014-03-04 Thread Chia-Hung Lin
+1 My local compilation, test, etc. passe with version 0.6.4. On 4 March 2014 16:12, Martin Illecker wrote: > +1 all test cases pass on my machine. > > > 2014-03-04 1:29 GMT+01:00 Anastasis Andronidis : > >> +1 my small graph programs seams to work rather fine >> >> Anastasis >> >> On 4 Μαρ 2014

Re: Cutting a 0.7 release

2014-02-24 Thread Chia-Hung Lin
Programmer can't control java memory like malloc/ free in c, type boxing/ unboxing, etc., it seems not be easy to evaluate the memory. So it would be good sticking to erlang fail fast style. Or we can have a programme that load data and measure the actual memory usage. On 24 February 2014 22:32,

Re: Cutting a 0.7 release

2014-02-24 Thread Chia-Hung Lin
Just let you know I may refactor based on the following diagram. http://people.apache.org/~chl501/diagram1.png That sketches the basic flow required for ft. I am currently evaluate related parts, so it's subjected to change. On 24 February 2014 20:52, Edward J. Yoon wrote: > 0.6.4 or 0.7.0

Re: Superstep API / FT

2014-01-30 Thread Chia-Hung Lin
So far as I know (there may be something I miss), message can be checkpointed and a simple failure detector can be embedded to groom server. On 30 January 2014 00:45, Tommaso Teofili wrote: > Hi all, > > just a quick question: where are we wrt FT support (via Superstep API)? > > Thanks, > Tommaso

Re: New logo on website

2014-01-20 Thread Chia-Hung Lin
+ one hama On 20 January 2014 20:18, Martin Illecker wrote: > Nice ;-) > > > 2014/1/20 Edward J. Yoon > >> Hi, >> >> http://people.apache.org/~edwardyoon/site/index.html >> >> Do you like this new logo? >> >> If no objections arise, I'd like to commit this! >> >> -- >> Best Regards, Edward J. Yo

Re: FYI, Comparison and Evaluation of Open Source Implementations of Pregel and Related Systems

2014-01-13 Thread Chia-Hung Lin
Not very sure, but it seems JUnitBenchmarks can be integrated to Jekins. On 13 January 2014 17:05, Tommaso Teofili wrote: > Thanks Song Bai and Ed for your replies, looking forward to Song's > contributions and HAMA-843/816 to be done. > > Tommaso > > p.s.: > I think we need a way of continuously

Re: Hama Scheduler

2013-12-24 Thread Chia-Hung Lin
BSPMaster makes use of TaskScheduler for scheduling tasks BSPMaster.java Class schedulerClass = conf.getClass( "bsp.master.taskscheduler", SimpleTaskScheduler.class, TaskScheduler.class); this.taskScheduler = ReflectionUtils.newInstance(schedulerClass, conf); Then in SimpleTaskSch

Re: Hama book

2013-11-26 Thread Chia-Hung Lin
I am happy to help. On 26 November 2013 22:09, Tommaso Teofili wrote: > looks like a community written book, nice :) > > p.s.: > I can help as well > > > 2013/11/26 Yexi Jiang > >> Me too, that's pretty interesting. >> >> >> 2013/11/26 Suraj Menon >> >> > I can help too. What is the timeline? >

Re: [DISCUSS] Hama 0.7.0

2013-11-18 Thread Chia-Hung Lin
ting in Spilling queue. >>> HAMA-816 Add the getMsgIterators method for efficient message looping. >>> HAMA-783 Efficient InMemory Storage for Vertices. >>> >>> If no objection, i would like to arrange the JIRA tasks for 0.7.0, >>> based on this. WDYT? >>

Re: Combine all Writables into a new package

2013-10-21 Thread Chia-Hung Lin
+1 for hama-io or hama-commons On 21 October 2013 21:35, Tommaso Teofili wrote: > what about creating a module for that (Writables and InputFormats for now) > hama-io / hama-commons that can be used by both (containing math stuff as > well) ? > > Tommaso > > > 2013/10/21 Martin Illecker > >> Ve

Re: TaskStatus question

2013-09-29 Thread Chia-Hung Lin
> -Suraj > > > On Sat, Sep 28, 2013 at 7:49 AM, Chia-Hung Lin wrote: > >> TaskStatus has following phase >> >> STARTING, COMPUTE, BARRIER_SYNC, CLEANUP, RECOVERING >> >> and state >> >> RUNNING, SUCCEEDED, FAILED, UNASSIGNED, KILLED,

TaskStatus question

2013-09-28 Thread Chia-Hung Lin
TaskStatus has following phase STARTING, COMPUTE, BARRIER_SYNC, CLEANUP, RECOVERING and state RUNNING, SUCCEEDED, FAILED, UNASSIGNED, KILLED, COMMIT_PENDING, FAILED_UNCLEAN, KILLED_UNCLEAN, FAULT_NOTIFIED, RECOVERY_SCHEDULING, RECOVERY_SCHEDULED, RECOVERING What is the valid mapping or the stat

Re: svn commit: r1523425 - in /hama/trunk/c++: pom.xml src/main/native/pipes/impl/HamaPipes.cc

2013-09-18 Thread Chia-Hung Lin
7;m of course not against your commit, just it's possible that > Edward's rollback command will overwrite it, so let's keep in mind we have > to check that. > > Regards, > Tommaso > > > > 2013/9/17 Chia-Hung Lin > >> Any reason why this has

Re: svn commit: r1523425 - in /hama/trunk/c++: pom.xml src/main/native/pipes/impl/HamaPipes.cc

2013-09-17 Thread Chia-Hung Lin
Any reason why this has to be rollback e.g. procedure, format, etc. because I would need this patch to be in? If it's procedure, format, etc., do we have guideline on wiki? Checking wiki such as jekins, HowTOCommit doesn't contain related information. Thanks On 17 September 2013 16:52, Tommaso T

Re: [CANCELED][VOTE] Hama 0.6.3 RC2

2013-09-15 Thread Chia-Hung Lin
ecker wrote: > Hi, > thanks for your review! > Did you also test a build without cmake installed? > (Then it should skip Hama Pipes) > > > 2013/9/15 Chia-Hung Lin > >> Hi Martin, >> >> Your patch fix the problem. I've applied it on trunk , it passes >&g

Re: [CANCELED][VOTE] Hama 0.6.3 RC2

2013-09-15 Thread Chia-Hung Lin
also includes your solution to > include > +#include > in HamaPipes.cc. > > Please upload your patch, I will have a look. > Thanks! > > [1] https://issues.apache.org/jira/browse/HAMA-802 > > Am 15.09.2013 um 10:04 schrieb Chia-Hung Lin : > >> In addition to th

Re: [CANCELED][VOTE] Hama 0.6.3 RC2

2013-09-15 Thread Chia-Hung Lin
Just notice that HAMA-802 should fix c++ compilation error. I've applied the patch to the trunk, it passes compilation and testing. On 15 September 2013 16:04, Chia-Hung Lin wrote: > In addition to that, I also encounter a compilation error. I can help > fix this, but just not v

Re: [CANCELED][VOTE] Hama 0.6.3 RC2

2013-09-15 Thread Chia-Hung Lin
In addition to that, I also encounter a compilation error. I can help fix this, but just not very sure if that's the right way to do it. If there is a jira created for these two fixes, I can provide a patch for compilation issue; and it would be good if anyone can help review it. [exec] /usr/bin/c

Re: [VOTE] Hama 0.6.3 RC2

2013-09-15 Thread Chia-Hung Lin
-1 Compilation fails with message thrown as below [exec] /usr/bin/c++-g -Wall -O2 -D_REENTRANT -D_GNU_SOURCE -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -I/tmp/0.6.3-RC2/c++/src/main/native/utils/api -I/tmp/0.6.3-RC2/c++/src/main/native/pipes/api -I/tmp/0.6.3-RC2/c++/src-o CMakeFiles/hamap

Re: [DISCUSS] Hama 0.7.0

2013-09-09 Thread Chia-Hung Lin
(spilling) > message queue also should be considered together?). > * Implementation of asynchronous messaging functions, such as send or flush. > * Evaluation and adopt asynchronous messaging as a default messenger system. > > WDYT? > > > On Mon, Sep 2, 2013 at 11:31 PM, Chi

Re: hama pipes build

2013-09-09 Thread Chia-Hung Lin
If that's related to the error with mail titled - hama-pipes: An Ant BuildException during `make' Then 1. install cmake 2. an inclusion of `#include ` to the HamaPipes.cc is needed. On 9 September 2013 15:39, Anastasis Andronidis wrote: > Hello, > > as Martin Illecker explains at his tic

Re: hama-pipes: An Ant BuildException during `make'

2013-09-08 Thread Chia-Hung Lin
Illecker wrote: > Do you have *cmake* installed? > > > 2013/9/8 Chia-Hung Lin > >> When compiling trunk, following errors are thrown. How can I fix this >> problem? >> >> Environment: debian, 3.10-2-rt-686-pae, g++ 4.7.3, make 3.8.1 >> >> Thanks >>

hama-pipes: An Ant BuildException during `make'

2013-09-08 Thread Chia-Hung Lin
When compiling trunk, following errors are thrown. How can I fix this problem? Environment: debian, 3.10-2-rt-686-pae, g++ 4.7.3, make 3.8.1 Thanks ... [exec] /path/to/trunk/c++/src/main/native/pipes/impl/HamaPipes.cc: In function ‘void* HamaPipes::ping(void*)’: [exec] /path/to/trunk/c+

Re: HybridBSP (CPU and GPU) Task Integration

2013-09-02 Thread Chia-Hung Lin
ks. > > By the way do you think a HybridBSP based task which extends BSP will work > on Hama without any changes. > Normally it should work because of inheritance of BSP. > > Thanks! > > Martin > > [1] http://i.imgur.com/RP3ETBW.png > > 2013/8/24 Chia-Hung Lin > &g

Re: [DISCUSS] Hama 0.7.0

2013-09-02 Thread Chia-Hung Lin
+1 BTW, are we going to prioritize tasks in roadmap? On 28 August 2013 14:17, Tommaso Teofili wrote: > sure, it looks reasonable to me. > Tommaso > > > > 2013/8/28 Edward J. Yoon > >> Hi all, >> >> After we release the 0.6.3 (HDFS 2.0 version), we have to work for 0.7.0 >> version now. >> >>

ML test case fails

2013-08-24 Thread Chia-Hung Lin
When testing with the latest source obtained from svn (r1514736), ml test seems to fail. Is any setting is required? Just to check in case it's environment specific issue. --- T E S T S --- Run

Re: HybridBSP (CPU and GPU) Task Integration

2013-08-24 Thread Chia-Hung Lin
nel() { } > > public void gpuMethod() { >// process algorithm on GPU > >// the following commands will need Hama Pipes >HamaPeer.getConfiguration(); >HamaPeer.readNext(...,...); >// and others > } > } > > Than

ML test fails

2013-08-24 Thread Chia-Hung Lin
When testing with the latest source obtained from svn (r1514736), ml test seems to fail. Is any setting is required? Just to check in case it's environment specific issue. --- T E S T S --- Run

Re: HybridBSP (CPU and GPU) Task Integration

2013-08-23 Thread Chia-Hung Lin
What's the difference between launching `bsp task' and `gpu bsp task'? Will gpu bsp task fork and execute c/ c++ process? It might be good to distinguish how gpu bsp task will be executed, then deciding how to launch such task. Basically for launching a bsp task, an external process is created. T

Re: [VOTE] Skip minor release, and prepare 1.0

2013-08-19 Thread Chia-Hung Lin
do? > > See http://wiki.apache.org/hama/RoadMap - Do you think we can finish > 0.7 within a year? If not, should we separate them into 0.8, 0.9 ..., > etc? Is there a way to work in parallel? > > On Sun, Aug 18, 2013 at 9:02 PM, Chia-Hung Lin wrote: >> Sorry just want to

Re: [VOTE] Skip minor release, and prepare 1.0

2013-08-18 Thread Chia-Hung Lin
arison has been > already started.. Spark shows good performance, giraph shows good > scalability. Hama has good performance and very flexible interface, > but we are in gray zone. > >> +0 > > I'm -0. I think we have to cut periodically. > > On Sun, Aug 18, 2013 a

Re: [VOTE] Skip minor release, and prepare 1.0

2013-08-18 Thread Chia-Hung Lin
+0 Personally I would not go for 1.0 now though the release for 1.0 is ok for me. My reason is people may expect functions such as FT to be ready when it's in the version 1.0. Also it might be inevitably that people would compare MRv2, Giraph to Hama; and would think that MRv2, and Giraph would b

Re: Discussion about guideline

2013-08-08 Thread Chia-Hung Lin
t cases >>>> > Each patch should have test cases that at least capture the main >>>> > logical flow. And the tests is recommended not to bound to external >>>> > dependencies so that time spent on testing can be reduced. >>>> > >>

Discussion about guideline

2013-08-05 Thread Chia-Hung Lin
As hama community grows, it seems that it is good to have a guideline so that participants can follow and cooperate more smoothly. Therefore I would like to discuss about this, and please share your opinions so that we can improve the process. Below are some issues popping up on my head. - roadmap

  1   2   >