RE: [VOTE] Move Hama 0.7 to Java 7+ only
Thanks all, Let's migrate to Java 7. -- Best Regards, Edward J. Yoon -Original Message- From: Chia-Hung Lin [mailto:cli...@googlemail.com] Sent: Friday, June 05, 2015 12:06 AM To: dev@hama.apache.org Subject: Re: [VOTE] Move Hama 0.7 to Java 7+ only +1 On 4 June 2015 at 21:24, Behroz Sikander wrote: > +1 > > On Thu, Jun 4, 2015 at 3:23 PM, 김민호 wrote: > >> +1 >> >> Best Regards, >> Minho Kim >> >> 2015-06-04 20:26 GMT+09:00 Andronidis Anastasios > >: >> >> > +1 >> > >> > > On 4 Jun, 2015, at 12:38, Martin Illecker >> wrote: >> > > >> > > +1 >> > > >> > > 2015-06-04 12:11 GMT+02:00 Tommaso Teofili > >: >> > > >> > >> +1 >> > >> >> > >> Tommaso >> > >> >> > >> 2015-06-04 11:55 GMT+02:00 Edward J. Yoon : >> > >> >> > >>> Hello all, >> > >>> >> > >>> I knew that Java 7 isn't fully backwards compatible with Java 6, but >> I >> > >>> haven't experienced any issues at all so far. Because our code >> doesn't >> > >>> use any features from Java 7. >> > >>> >> > >>> However, I just noticed that latest Hadoop supports Java 7+ only and >> > >>> we also need to move to Java 7 for supporting YARN. The classic Hama >> > >>> cluster mode is outside the area of influence. Should we move to Java >> > >>> 7? >> > >>> >> > >>> Thanks! >> > >>> >> > >>> [ ] +1, We are ending support for Java 6 and move to Java 7. >> > >>> [ ] -1, Keep support Java 6, because ... >> > >>> >> > >>> -- >> > >>> Best Regards, Edward J. Yoon >> > >>> >> > >> >> > >> > >>
RE: [DISCUSS] Things I'd like to focus on next
Please feel free to contribute documentation to the Apache Hama wiki[1]! Ultimately, I'm considering improving our official website[2] on HAMA-960. We also maybe work together on it but I have no idea yet. Custom “Modern” or “Classic” Style? Maven website again? ADDM is quite interesting, and it looks like more fit into BSP than MapReduce (even if HBase(?) or memory-based shared storage is used). But I don't fully understand and so don't know whether it can be used as abstraction layer of many ML algorithms. We'll need more investigation. 1. https://wiki.apache.org/hama 2. https://hama.apache.org/ -- Best Regards, Edward J. Yoon -Original Message- From: Behroz Sikander [mailto:behro...@gmail.com] Sent: Thursday, June 04, 2015 10:24 PM To: dev@hama.apache.org Subject: Re: [DISCUSS] Things I'd like to focus on next Hi, +1. Yes documentation needs improvement. I also saw that a book on Hama is also under progress. I can help with the documentation. I only found the following open issuehttps://issues.apache.org/jira/browse/HAMA-960. Something like MLBase or Mahout on top of Hama would be really nice and will boost the project. Regarding machine learning algorithms can we use ADMM(a) to implement the algorithms ? Like https://issues.apache.org/jira/browse/SPARK-1543 a) https://web.stanford.edu/~boyd/papers/pdf/admm_distr_stats.pdf Regards, Behroz Sikander On Wed, Jun 3, 2015 at 9:48 AM, Edward J. Yoon wrote: > Hey, > > Here's few things I'd like to focus on next. > > 1. Add stream input format for listening messages coming from 3rd > party applications, and incremental learning algorithms. > 2. Improve reliability of system e.g., fault tolerance, HA, ..., etc. > 3. More machine learning algorithms, such as ensemble classifier, SVM, > DNN, ..., etc > > Do you have any other suggestions? > > Thanks! > > -- > Best Regards, Edward J. Yoon >
Re: [DISCUSS] Things I'd like to focus on next
I suppose that decoupling key/ value from BSP interface may be needed because not all inputs are in key/ value format. On 4 June 2015 at 21:24, Behroz Sikander wrote: > Hi, > +1. > Yes documentation needs improvement. I also saw that a book on Hama is also > under progress. I can help with the documentation. I only found the > following open issue > https://issues.apache.org/jira/browse/HAMA-960. > > Something like MLBase or Mahout on top of Hama would be really nice and > will boost the project. Regarding machine learning algorithms can we use > ADMM(a) to implement the algorithms ? > Like https://issues.apache.org/jira/browse/SPARK-1543 > > a) https://web.stanford.edu/~boyd/papers/pdf/admm_distr_stats.pdf > > Regards, > Behroz Sikander > > On Wed, Jun 3, 2015 at 9:48 AM, Edward J. Yoon > wrote: > >> Hey, >> >> Here's few things I'd like to focus on next. >> >> 1. Add stream input format for listening messages coming from 3rd >> party applications, and incremental learning algorithms. >> 2. Improve reliability of system e.g., fault tolerance, HA, ..., etc. >> 3. More machine learning algorithms, such as ensemble classifier, SVM, >> DNN, ..., etc >> >> Do you have any other suggestions? >> >> Thanks! >> >> -- >> Best Regards, Edward J. Yoon >>
Re: [VOTE] Move Hama 0.7 to Java 7+ only
+1 On 4 June 2015 at 21:24, Behroz Sikander wrote: > +1 > > On Thu, Jun 4, 2015 at 3:23 PM, 김민호 wrote: > >> +1 >> >> Best Regards, >> Minho Kim >> >> 2015-06-04 20:26 GMT+09:00 Andronidis Anastasios > >: >> >> > +1 >> > >> > > On 4 Jun, 2015, at 12:38, Martin Illecker >> wrote: >> > > >> > > +1 >> > > >> > > 2015-06-04 12:11 GMT+02:00 Tommaso Teofili > >: >> > > >> > >> +1 >> > >> >> > >> Tommaso >> > >> >> > >> 2015-06-04 11:55 GMT+02:00 Edward J. Yoon : >> > >> >> > >>> Hello all, >> > >>> >> > >>> I knew that Java 7 isn't fully backwards compatible with Java 6, but >> I >> > >>> haven't experienced any issues at all so far. Because our code >> doesn't >> > >>> use any features from Java 7. >> > >>> >> > >>> However, I just noticed that latest Hadoop supports Java 7+ only and >> > >>> we also need to move to Java 7 for supporting YARN. The classic Hama >> > >>> cluster mode is outside the area of influence. Should we move to Java >> > >>> 7? >> > >>> >> > >>> Thanks! >> > >>> >> > >>> [ ] +1, We are ending support for Java 6 and move to Java 7. >> > >>> [ ] -1, Keep support Java 6, because ... >> > >>> >> > >>> -- >> > >>> Best Regards, Edward J. Yoon >> > >>> >> > >> >> > >> > >>
Re: [VOTE] Move Hama 0.7 to Java 7+ only
+1 On Thu, Jun 4, 2015 at 3:23 PM, 김민호 wrote: > +1 > > Best Regards, > Minho Kim > > 2015-06-04 20:26 GMT+09:00 Andronidis Anastasios >: > > > +1 > > > > > On 4 Jun, 2015, at 12:38, Martin Illecker > wrote: > > > > > > +1 > > > > > > 2015-06-04 12:11 GMT+02:00 Tommaso Teofili >: > > > > > >> +1 > > >> > > >> Tommaso > > >> > > >> 2015-06-04 11:55 GMT+02:00 Edward J. Yoon : > > >> > > >>> Hello all, > > >>> > > >>> I knew that Java 7 isn't fully backwards compatible with Java 6, but > I > > >>> haven't experienced any issues at all so far. Because our code > doesn't > > >>> use any features from Java 7. > > >>> > > >>> However, I just noticed that latest Hadoop supports Java 7+ only and > > >>> we also need to move to Java 7 for supporting YARN. The classic Hama > > >>> cluster mode is outside the area of influence. Should we move to Java > > >>> 7? > > >>> > > >>> Thanks! > > >>> > > >>> [ ] +1, We are ending support for Java 6 and move to Java 7. > > >>> [ ] -1, Keep support Java 6, because ... > > >>> > > >>> -- > > >>> Best Regards, Edward J. Yoon > > >>> > > >> > > > > >
Re: [DISCUSS] Things I'd like to focus on next
Hi, +1. Yes documentation needs improvement. I also saw that a book on Hama is also under progress. I can help with the documentation. I only found the following open issue https://issues.apache.org/jira/browse/HAMA-960. Something like MLBase or Mahout on top of Hama would be really nice and will boost the project. Regarding machine learning algorithms can we use ADMM(a) to implement the algorithms ? Like https://issues.apache.org/jira/browse/SPARK-1543 a) https://web.stanford.edu/~boyd/papers/pdf/admm_distr_stats.pdf Regards, Behroz Sikander On Wed, Jun 3, 2015 at 9:48 AM, Edward J. Yoon wrote: > Hey, > > Here's few things I'd like to focus on next. > > 1. Add stream input format for listening messages coming from 3rd > party applications, and incremental learning algorithms. > 2. Improve reliability of system e.g., fault tolerance, HA, ..., etc. > 3. More machine learning algorithms, such as ensemble classifier, SVM, > DNN, ..., etc > > Do you have any other suggestions? > > Thanks! > > -- > Best Regards, Edward J. Yoon >
Re: [VOTE] Move Hama 0.7 to Java 7+ only
+1 Best Regards, Minho Kim 2015-06-04 20:26 GMT+09:00 Andronidis Anastasios : > +1 > > > On 4 Jun, 2015, at 12:38, Martin Illecker wrote: > > > > +1 > > > > 2015-06-04 12:11 GMT+02:00 Tommaso Teofili : > > > >> +1 > >> > >> Tommaso > >> > >> 2015-06-04 11:55 GMT+02:00 Edward J. Yoon : > >> > >>> Hello all, > >>> > >>> I knew that Java 7 isn't fully backwards compatible with Java 6, but I > >>> haven't experienced any issues at all so far. Because our code doesn't > >>> use any features from Java 7. > >>> > >>> However, I just noticed that latest Hadoop supports Java 7+ only and > >>> we also need to move to Java 7 for supporting YARN. The classic Hama > >>> cluster mode is outside the area of influence. Should we move to Java > >>> 7? > >>> > >>> Thanks! > >>> > >>> [ ] +1, We are ending support for Java 6 and move to Java 7. > >>> [ ] -1, Keep support Java 6, because ... > >>> > >>> -- > >>> Best Regards, Edward J. Yoon > >>> > >> > >
Re: [VOTE] Move Hama 0.7 to Java 7+ only
+1 > On 4 Jun, 2015, at 12:38, Martin Illecker wrote: > > +1 > > 2015-06-04 12:11 GMT+02:00 Tommaso Teofili : > >> +1 >> >> Tommaso >> >> 2015-06-04 11:55 GMT+02:00 Edward J. Yoon : >> >>> Hello all, >>> >>> I knew that Java 7 isn't fully backwards compatible with Java 6, but I >>> haven't experienced any issues at all so far. Because our code doesn't >>> use any features from Java 7. >>> >>> However, I just noticed that latest Hadoop supports Java 7+ only and >>> we also need to move to Java 7 for supporting YARN. The classic Hama >>> cluster mode is outside the area of influence. Should we move to Java >>> 7? >>> >>> Thanks! >>> >>> [ ] +1, We are ending support for Java 6 and move to Java 7. >>> [ ] -1, Keep support Java 6, because ... >>> >>> -- >>> Best Regards, Edward J. Yoon >>> >>
Re: [VOTE] Move Hama 0.7 to Java 7+ only
+1 2015-06-04 12:11 GMT+02:00 Tommaso Teofili : > +1 > > Tommaso > > 2015-06-04 11:55 GMT+02:00 Edward J. Yoon : > > > Hello all, > > > > I knew that Java 7 isn't fully backwards compatible with Java 6, but I > > haven't experienced any issues at all so far. Because our code doesn't > > use any features from Java 7. > > > > However, I just noticed that latest Hadoop supports Java 7+ only and > > we also need to move to Java 7 for supporting YARN. The classic Hama > > cluster mode is outside the area of influence. Should we move to Java > > 7? > > > > Thanks! > > > > [ ] +1, We are ending support for Java 6 and move to Java 7. > > [ ] -1, Keep support Java 6, because ... > > > > -- > > Best Regards, Edward J. Yoon > > >
Re: [VOTE] Move Hama 0.7 to Java 7+ only
+1 Tommaso 2015-06-04 11:55 GMT+02:00 Edward J. Yoon : > Hello all, > > I knew that Java 7 isn't fully backwards compatible with Java 6, but I > haven't experienced any issues at all so far. Because our code doesn't > use any features from Java 7. > > However, I just noticed that latest Hadoop supports Java 7+ only and > we also need to move to Java 7 for supporting YARN. The classic Hama > cluster mode is outside the area of influence. Should we move to Java > 7? > > Thanks! > > [ ] +1, We are ending support for Java 6 and move to Java 7. > [ ] -1, Keep support Java 6, because ... > > -- > Best Regards, Edward J. Yoon >
[VOTE] Move Hama 0.7 to Java 7+ only
Hello all, I knew that Java 7 isn't fully backwards compatible with Java 6, but I haven't experienced any issues at all so far. Because our code doesn't use any features from Java 7. However, I just noticed that latest Hadoop supports Java 7+ only and we also need to move to Java 7 for supporting YARN. The classic Hama cluster mode is outside the area of influence. Should we move to Java 7? Thanks! [ ] +1, We are ending support for Java 6 and move to Java 7. [ ] -1, Keep support Java 6, because ... -- Best Regards, Edward J. Yoon
Re: [VOTE] Apache Hama 0.7 release (RC1)
> run Hama with Hadoop 2.7.x, is that correct ? Yes, right. As Júlio Pires mentioned before, hadoop 2.7.0 works with JDK 7+ only. Since important new feature of this release is supporting YARN and Mesos, I think we have to support latest hadoop. > I am fine with that as Java 6 has long gone EOL, but let's make a conscious > decision on that (maybe worth a vote). Agree with you. I'll open the vote first. Thanks Tommaso! On Thu, Jun 4, 2015 at 3:39 PM, Tommaso Teofili wrote: > one important thing is deciding which Java version we support, as far as I > understand Edward wants to drop support for Java 6 to make it possible to > run Hama with Hadoop 2.7.x, is that correct ? > > I am fine with that as Java 6 has long gone EOL, but let's make a conscious > decision on that (maybe worth a vote). > > Regards, > Tommaso > > > 2015-06-04 3:01 GMT+02:00 Edward J. Yoon : > >> While testing I received a NoSuchMethodError on >> ConcurrentHashMap$KeySetView: >> >> java.lang.NoSuchMethodError: >> >> java.util.concurrent.ConcurrentHashMap.keySet()Ljava/util/concurrent/ConcurrentHashMap$KeySetView >> >> The reason is that Java 1.7 ConcurrentHashMap#keySet() returns a Set >> while >> the 1.8 ConcurrentHashMap#keySet() returns a >> ConcurrentHashMap.KeySetView. >> >> I'll create new one using Java 1.7. Also, if you have any good idea for >> this, >> Pls let me know. >> >> -- >> Best Regards, Edward J. Yoon >> >> -Original Message- >> From: Edward J. Yoon [mailto:edwardy...@apache.org] >> Sent: Thursday, June 04, 2015 8:09 AM >> To: dev@hama.apache.org >> Subject: [VOTE] Apache Hama 0.7 release (RC1) >> >> Hey all, >> >> I just created a first release candidate for the Apache Hama 0.7 >> release. This release includes new features such as Mesos, Yarn >> modules and many improvements/bug fixes. >> >> The RC1 is available at: >> >> http://people.apache.org/~edwardyoon/dist/0.7.0-RC1/ >> >> Tags: >> >> http://svn.apache.org/repos/asf/hama/tags/0.7.0-RC1/ >> >> Please try it, run the tests, verify checksum files, etc. and vote. >> >> Thanks! >> >> -- >> Best Regards, Edward J. Yoon >> >> >> -- Best Regards, Edward J. Yoon
