Re: [VOTE] Accept Hama into the Incubator
Otis Gospodnetic wrote: +1 for the idea, but you don't have Apache Members there (neither Ian nor Jeff are ASF members, as far as I know). Hey Otis. I'm a member. I just don't act like one ;-) Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
On Fri, May 16, 2008 at 2:58 PM, Robert Burrell Donkin [EMAIL PROTECTED] wrote: ...i really like the idea but i'm pretty uncomfortable about having only one member as mentor. maybe we can find another mentor or two I think another ASF member as a mentor would be enough, that would make a total of three mentors, two of which are members. Seems like Brett Porter is volunteering, see the other Mentor recruit for Hama project thread, with this the issue would be solved IMHO. -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
On Mon, 19 May 2008 17:52:47 +0900, Bertrand Delacretaz [EMAIL PROTECTED] wrote: Seems like Brett Porter is volunteering, see the other Mentor recruit for Hama project thread, with this the issue would be solved IMHO. And he forgot to vote here. Oh well, is it possible to be a mentor not casting a vote? Brett, hurry up! ;) -- Trustin Lee - Principal Software Engineer, JBoss, Red Hat -- what we call human nature is actually human habit -- http://gleamynode.net/ - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
2008/5/19 이희승 (Trustin Lee) [EMAIL PROTECTED]: On Mon, 19 May 2008 17:52:47 +0900, Bertrand Delacretaz [EMAIL PROTECTED] wrote: Seems like Brett Porter is volunteering, see the other Mentor recruit for Hama project thread, with this the issue would be solved IMHO. And he forgot to vote here. Oh well, is it possible to be a mentor not casting a vote? Brett, hurry up! ;) I thought there was only 1 mentor (Ian) previously? Regardless, +1 :) -- Trustin Lee - Principal Software Engineer, JBoss, Red Hat -- what we call human nature is actually human habit -- http://gleamynode.net/ - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] -- Brett Porter Blog: http://blogs.exist.com/bporter/
Re: [VOTE] Accept Hama into the Incubator
2008/5/19 Brett Porter [EMAIL PROTECTED]: ...I thought there was only 1 mentor (Ian) previously?... http://wiki.apache.org/incubator/HamaProposal says: Mentors Ian Holsman, (ianh AT apache DOT org) Jeff Eastman, (jeastman AT apache DOT org) Brett Porter, (brett AT apache DOT org) so there are now two mentors who are ASF members, and one who isn't (Jeff). -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
On Wed, May 14, 2008 at 1:27 AM, Edward J. Yoon [EMAIL PROTECTED] wrote: Please vote on accepting the Hama project for incubation... +1 Personally, I'd appreciate having more information on the affiliations of the initial committers. I know it is not currently a requirement, but it's IMHO a good thing for the Incubator PMC to have an idea of the weight of affiliations in podlings. -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
On Mon, May 19, 2008 at 2:42 PM, Edward J. Yoon [EMAIL PROTECTED] wrote: ...Personally, I'd appreciate having more information on the affiliations of the initial committers ...Edward J. Yoon, (NHN, Master of Mathematics) Chanwit Kaewkasi, (Univ. of Manchester, Ph.D student in CS) Cha MinChang, (NHN, Bachelor of Computer Science)... Thanks very much - do you mind adding this info to http://wiki.apache.org/incubator/HamaProposal as well? Sorry, I should have asked this upfront - the idea is to have as much info in the proposal as possible (as long as people agree on disclosing their affiliations). -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
Thank you for your advices and for your vote. Personally, I'd appreciate having more information on the affiliations of the initial committers. I know it is not currently a requirement, but it's IMHO a good thing for the Incubator PMC to have an idea of the weight of affiliations in podlings. Edward J. Yoon, (NHN, Master of Mathematics) Chanwit Kaewkasi, (Univ. of Manchester, Ph.D student in CS) Cha MinChang, (NHN, Bachelor of Computer Science) Suh ChangHee, (NHN, Bachelor of Science major in Biology) Ha Yongho, (TmaxSoft, Master of Mathematical Informatics) Hong Taehui, (KRIBB, Bachelor of Biomedical Informatics) Yoon JooSun, (NHN, Bachelor of Computer Science) Takkiel Shim, (NHN, Master of Computer Science) Donguk Choi, (NHN, Bachelor of Computer Science) NHN members are coming from the Service Development Center, Distributed Computing TF Team at RD center. Thanks, Edward On Mon, May 19, 2008 at 8:36 PM, Bertrand Delacretaz [EMAIL PROTECTED] wrote: On Wed, May 14, 2008 at 1:27 AM, Edward J. Yoon [EMAIL PROTECTED] wrote: Please vote on accepting the Hama project for incubation... +1 Personally, I'd appreciate having more information on the affiliations of the initial committers. I know it is not currently a requirement, but it's IMHO a good thing for the Incubator PMC to have an idea of the weight of affiliations in podlings. -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] -- Best regards, Edward J. Yoon, http://blog.udanax.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
On Mon, May 19, 2008 at 1:50 PM, Bertrand Delacretaz [EMAIL PROTECTED] wrote: On Mon, May 19, 2008 at 2:42 PM, Edward J. Yoon [EMAIL PROTECTED] wrote: ...Personally, I'd appreciate having more information on the affiliations of the initial committers ...Edward J. Yoon, (NHN, Master of Mathematics) Chanwit Kaewkasi, (Univ. of Manchester, Ph.D student in CS) Cha MinChang, (NHN, Bachelor of Computer Science)... Thanks very much - do you mind adding this info to http://wiki.apache.org/incubator/HamaProposal as well? Sorry, I should have asked this upfront - the idea is to have as much info in the proposal as possible (as long as people agree on disclosing their affiliations). i'm now +1 on hama - robert - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
+1 Niall On Wed, May 14, 2008 at 12:27 AM, Edward J. Yoon [EMAIL PROTECTED] wrote: Dear Incubator PMC, There has been some discussion around the Hama proposal, and we would now like to officially propose Hama to the Incubator for consideration, with Grant Ingersoll's +1. Please vote on accepting the Hama project for incubation. The full Hama proposal is available at the end of this message and as a wiki page at http://wiki.apache.org/incubator/HamaProposal. We ask the Incubator PMC to sponsor the Hama podling, with myself, Ian Holsman, and Jeff Eastman as the mentors. The vote is open for the next 72 hours and only votes from the Incubator PMC are binding. [ ] +1 Accept Hama as a new podling [ ] -1 Do not accept the new podling (provide reason, please) == Abstract == Hama will develop a parallel matrix computational package based on [http://hadoop.apache.org Hadoop] Map/Reduce. == Proposal == Hama will develop a parallel matrix computational package, which provides an library of matrix operations for the large-scale processing development environment and Map/Reduce framework for the large-scale Numerical Analysis and Data Mining, which need the intensive computation power of matrix inversion, e.g. linear regression, PCA, SVM and etc. It will be also useful for many scientific applications, e.g. physics computations, linear algebra, computational fluid dynamics, statistics, graphic rendering and many more. == Background == Currently, several shared-memory based parallel matrix solutions can provide a scalable and high performance matrix operations, but matrix resources can not be scalable in the term of complexity. And, Hadoop HDFS Files and Map/Reduce can only used by 1D blocked algorithm. == Rationale == Hama approach proposes the use of 3-dimensional Row and Column (Qualifier), Time space and multi-dimensional Columnfamilies of [http://hadoop.apache.org/hbase Hbase], which is able to store large sparse and various type of matrices (e.g. Triangular Matrix, 3D Matrix, and etc.) and utilize the 2D blocked algorithm. its auto-partitioned sparsity sub-structure will be efficiently managed and serviced by Hbase. Row and Column operations can be done in linear-time, where several algorithms, such as ''structured Gaussian elimination'' or ''iterative methods'', run in O(the number of non-zero elements in the matrix / number of mappers) time on Hadoop Map/Reduce. == Current Status == In its current state, the 'hama' is buggy and needs filling out, but generalized matrix interface and basic linear algebra operations was implemented within a large prototype system. In the future, We need new parallel algorithms based on Map/Reduce for performance of heavy decompositions and factorizations. It also needs tools to compose an arbitrary matrix only with certain data filtered from hbase array structure. == Meritocracy == The initial developers are very familiar with meritocratic open source development, both at Apache and elsewhere. Apache was chosen specifically because the initial developers want to encourage this style of development for the project. === Community === Hama seeks to develop developer and user communities during incubation. == Core Developers == The initial set of committers includes folks from the [http://hadoop.apache.org Hadoop] [http://hadoop.apache.org/hbase Hbase] communities. We have varying degrees of experience with Apache-style open source development, ranging from none to ASF Members. == Alignment == The developers of Hama want to work with the Apache Software Foundation specifically because Apache has proven to provide a strong foundation and set of practices for developing standards-based infrastructure and server components. == Known Risks == === Orphaned products === Most of the active developers would like to become Hama Committers or PMC Members and have long term interest to develop/maintain and '''use''' the code. === Inexperience with Open Source === We has already a good experience with Apache open source development process. === Homogenous Developers === The current list of committers includes developers from several different companies ([http://en.wikipedia.org/wiki/NHN NHN, corp], TMAX software, Korea Research Institute of Bioscience and Biotechnology, Students) plus many independent volunteers. The committers are geographically distributed across the Europe, and Asia. They are experienced with working in a distributed environment. === Reliance on Salaried Developers === It is expected that Hama development will occur on both salaried time and on volunteer time, after hours. While there is reliance on salaried developers (currently from [http://en.wikipedia.org/wiki/NHN NHN, corp], but it's expected that other company's salaried developers will also be involved), the Hama Community is very active and things should balance out fairly quickly. In the
Re: [VOTE] Accept Hama into the Incubator
Hi, +1 Accept Hama as a new podling Sorry for the late vote. I was initially a bit confused about whether Hama should be just a Hadoop component from the beginning or if full incubation is needed, but the answer to Brett's question covered my concerns well. In general I'm quite excited to see scientific computing projects finding their way to Apache. While academia and the open source world are well aligned in theory, the practice isn't always very smooth. I'm sorry I currently don't have the spare cycles to join you as a mentor, but I'll certainly keep an interested eye on the project. BR, Jukka Zitting - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
On Thu, May 15, 2008 at 2:40 AM, Yonik Seeley [EMAIL PROTECTED] wrote: On Wed, May 14, 2008 at 9:28 PM, Otis Gospodnetic [EMAIL PROTECTED] wrote: +1 for the idea, but you don't have Apache Members there (neither Ian nor Jeff are ASF members, as far as I know). Ian is a member. i really like the idea but i'm pretty uncomfortable about having only one member as mentor. maybe we can find another mentor or two... -robert - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
i really like the idea but i'm pretty uncomfortable about having only one member as mentor. maybe we can find another mentor or two... Right you're, We would leave the vote open a bit longer and continue the discussion until we have enough votes and mentors. -Edward On Fri, May 16, 2008 at 9:58 PM, Robert Burrell Donkin [EMAIL PROTECTED] wrote: On Thu, May 15, 2008 at 2:40 AM, Yonik Seeley [EMAIL PROTECTED] wrote: On Wed, May 14, 2008 at 9:28 PM, Otis Gospodnetic [EMAIL PROTECTED] wrote: +1 for the idea, but you don't have Apache Members there (neither Ian nor Jeff are ASF members, as far as I know). Ian is a member. i really like the idea but i'm pretty uncomfortable about having only one member as mentor. maybe we can find another mentor or two... -robert - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] -- B. Regards, Edward J. Yoon, http://blog.udanax.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [VOTE] Accept Hama into the Incubator
On Wed, May 14, 2008 at 6:23 AM, Ian Holsman (Lists) [EMAIL PROTECTED] wrote: +1 from me as well. I think it would be a great addition for the hadoop Ditto +1 Alex
Re: [VOTE] Accept Hama into the Incubator
+1 On May 13, 2008, at 7:27 PM, Edward J. Yoon wrote: Dear Incubator PMC, There has been some discussion around the Hama proposal, and we would now like to officially propose Hama to the Incubator for consideration, with Grant Ingersoll's +1. Please vote on accepting the Hama project for incubation. The full Hama proposal is available at the end of this message and as a wiki page at http://wiki.apache.org/incubator/HamaProposal. We ask the Incubator PMC to sponsor the Hama podling, with myself, Ian Holsman, and Jeff Eastman as the mentors. The vote is open for the next 72 hours and only votes from the Incubator PMC are binding. [ ] +1 Accept Hama as a new podling [ ] -1 Do not accept the new podling (provide reason, please) == Abstract == Hama will develop a parallel matrix computational package based on [http://hadoop.apache.org Hadoop] Map/Reduce. == Proposal == Hama will develop a parallel matrix computational package, which provides an library of matrix operations for the large-scale processing development environment and Map/Reduce framework for the large-scale Numerical Analysis and Data Mining, which need the intensive computation power of matrix inversion, e.g. linear regression, PCA, SVM and etc. It will be also useful for many scientific applications, e.g. physics computations, linear algebra, computational fluid dynamics, statistics, graphic rendering and many more. == Background == Currently, several shared-memory based parallel matrix solutions can provide a scalable and high performance matrix operations, but matrix resources can not be scalable in the term of complexity. And, Hadoop HDFS Files and Map/Reduce can only used by 1D blocked algorithm. == Rationale == Hama approach proposes the use of 3-dimensional Row and Column (Qualifier), Time space and multi-dimensional Columnfamilies of [http://hadoop.apache.org/hbase Hbase], which is able to store large sparse and various type of matrices (e.g. Triangular Matrix, 3D Matrix, and etc.) and utilize the 2D blocked algorithm. its auto-partitioned sparsity sub-structure will be efficiently managed and serviced by Hbase. Row and Column operations can be done in linear-time, where several algorithms, such as ''structured Gaussian elimination'' or ''iterative methods'', run in O(the number of non-zero elements in the matrix / number of mappers) time on Hadoop Map/Reduce. == Current Status == In its current state, the 'hama' is buggy and needs filling out, but generalized matrix interface and basic linear algebra operations was implemented within a large prototype system. In the future, We need new parallel algorithms based on Map/Reduce for performance of heavy decompositions and factorizations. It also needs tools to compose an arbitrary matrix only with certain data filtered from hbase array structure. == Meritocracy == The initial developers are very familiar with meritocratic open source development, both at Apache and elsewhere. Apache was chosen specifically because the initial developers want to encourage this style of development for the project. === Community === Hama seeks to develop developer and user communities during incubation. == Core Developers == The initial set of committers includes folks from the [http://hadoop.apache.org Hadoop] [http://hadoop.apache.org/hbase Hbase] communities. We have varying degrees of experience with Apache-style open source development, ranging from none to ASF Members. == Alignment == The developers of Hama want to work with the Apache Software Foundation specifically because Apache has proven to provide a strong foundation and set of practices for developing standards-based infrastructure and server components. == Known Risks == === Orphaned products === Most of the active developers would like to become Hama Committers or PMC Members and have long term interest to develop/maintain and '''use''' the code. === Inexperience with Open Source === We has already a good experience with Apache open source development process. === Homogenous Developers === The current list of committers includes developers from several different companies ([http://en.wikipedia.org/wiki/NHN NHN, corp], TMAX software, Korea Research Institute of Bioscience and Biotechnology, Students) plus many independent volunteers. The committers are geographically distributed across the Europe, and Asia. They are experienced with working in a distributed environment. === Reliance on Salaried Developers === It is expected that Hama development will occur on both salaried time and on volunteer time, after hours. While there is reliance on salaried developers (currently from [http://en.wikipedia.org/wiki/NHN NHN, corp], but it's expected that other company's salaried developers will also be involved), the Hama Community is very active and things should balance out fairly quickly. In the meantime, [http://en.wikipedia.org/wiki/NHN NHN, corp] might support the project in the future by dedicating
Re: [VOTE] Accept Hama into the Incubator
On Wed, May 14, 2008 at 9:28 PM, Otis Gospodnetic [EMAIL PROTECTED] wrote: +1 for the idea, but you don't have Apache Members there (neither Ian nor Jeff are ASF members, as far as I know). Ian is a member. -Yonik - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
