Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)
I think it's okay to merge. We've already bumped other deps in trunk. On Wed, Jun 29, 2016 at 12:27 PM, Tsuyoshi Ozawawrote: > I forgot to mention about importance point: it's a blocker issue to > compile Hadoop with JDK8. Hence, we need to merge it on both client > side and server slide anyway. > > Thanks, > - Tsuyoshi > > On Wed, Jun 29, 2016 at 12:24 PM, Tsuyoshi Ozawa wrote: > > Thanks Vinod, Sangjin, Sean for your comment. > > > > Okay, I will take a look at the class path isolation. > > Should I postpone to merge Guice upgrade to trunk? IMHO, it works with > > tests, so it's okay to merge to runk. Thoughts? > > > > - Tsuyoshi > > > > On Wed, Jun 29, 2016 at 12:10 PM, Sangjin Lee wrote: > >> Yeah it would be awesome if we can get feedback and/or suggestions on > these > >> JIRAs (HADOOP-11804 and HADOOP-13070). > >> > >> Thanks, > >> Sangjin > >> > >> On Wed, Jun 29, 2016 at 10:55 AM, Sean Busbey > wrote: > >>> > >>> At the very least, I'm running through an updated shaded hadoop client > >>> this week[1] (HBase is my test application and it wandered onto some > >>> private things that broke in branch-2). And Sangjin has a good lead on > >>> an lower-short-term-cost incremental improvement for runtime isolation > >>> of apps built on yarn/mapreduce[2]. He's been patiently waiting for > >>> more review feedback. > >>> > >>> > >>> [1]: https://issues.apache.org/jira/browse/HADOOP-11804 > >>> [2]: https://issues.apache.org/jira/browse/HADOOP-13070 > >>> > >>> On Wed, Jun 29, 2016 at 12:33 PM, Vinod Kumar Vavilapalli > >>> wrote: > >>> > My strong expectation is that we’ll have a version of classpath > >>> > isolation in our first release of 3.x. I’m planning to spending some > cycles > >>> > right away on this. > >>> > > >>> > Assuming classpath isolation gets in, it is reasonable to bump up our > >>> > dependencies like Jetty / Guice to the latest stable versions. > >>> > > >>> > Thanks > >>> > +Vinod > >>> > > >>> >> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa > wrote: > >>> >> > >>> >> Hi developers, > >>> >> > >>> >> I will plan to upgrade Google Guice dependency on trunk. The change > >>> >> also includes asm and cglib upgrade. > >>> >> I checked following points: > >>> >> > >>> >> * Both HDFS and YARN UIs work well. > >>> >> * All webIU-related tests pass as described on HADOOP-12064. > >>> >> * Ran mapreduce job, and it works well. > >>> >> > >>> >> https://issues.apache.org/jira/browse/HADOOP-12064 > >>> >> > >>> >> Do you have any concern or opinion? I would like to merge it to > trunk > >>> >> on this Friday if you have no objections. > >>> >> > >>> >> Best, > >>> >> - Tsuyoshi > >>> >> > >>> >> > - > >>> >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > >>> >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >>> >> > >>> >> > >>> > > >>> > > >>> > - > >>> > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > >>> > For additional commands, e-mail: > mapreduce-dev-h...@hadoop.apache.org > >>> > > >>> > >>> > >>> > >>> -- > >>> busbey > >>> > >>> - > >>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > >>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >>> > >> > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > >
Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)
I forgot to mention about importance point: it's a blocker issue to compile Hadoop with JDK8. Hence, we need to merge it on both client side and server slide anyway. Thanks, - Tsuyoshi On Wed, Jun 29, 2016 at 12:24 PM, Tsuyoshi Ozawawrote: > Thanks Vinod, Sangjin, Sean for your comment. > > Okay, I will take a look at the class path isolation. > Should I postpone to merge Guice upgrade to trunk? IMHO, it works with > tests, so it's okay to merge to runk. Thoughts? > > - Tsuyoshi > > On Wed, Jun 29, 2016 at 12:10 PM, Sangjin Lee wrote: >> Yeah it would be awesome if we can get feedback and/or suggestions on these >> JIRAs (HADOOP-11804 and HADOOP-13070). >> >> Thanks, >> Sangjin >> >> On Wed, Jun 29, 2016 at 10:55 AM, Sean Busbey wrote: >>> >>> At the very least, I'm running through an updated shaded hadoop client >>> this week[1] (HBase is my test application and it wandered onto some >>> private things that broke in branch-2). And Sangjin has a good lead on >>> an lower-short-term-cost incremental improvement for runtime isolation >>> of apps built on yarn/mapreduce[2]. He's been patiently waiting for >>> more review feedback. >>> >>> >>> [1]: https://issues.apache.org/jira/browse/HADOOP-11804 >>> [2]: https://issues.apache.org/jira/browse/HADOOP-13070 >>> >>> On Wed, Jun 29, 2016 at 12:33 PM, Vinod Kumar Vavilapalli >>> wrote: >>> > My strong expectation is that we’ll have a version of classpath >>> > isolation in our first release of 3.x. I’m planning to spending some >>> > cycles >>> > right away on this. >>> > >>> > Assuming classpath isolation gets in, it is reasonable to bump up our >>> > dependencies like Jetty / Guice to the latest stable versions. >>> > >>> > Thanks >>> > +Vinod >>> > >>> >> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa wrote: >>> >> >>> >> Hi developers, >>> >> >>> >> I will plan to upgrade Google Guice dependency on trunk. The change >>> >> also includes asm and cglib upgrade. >>> >> I checked following points: >>> >> >>> >> * Both HDFS and YARN UIs work well. >>> >> * All webIU-related tests pass as described on HADOOP-12064. >>> >> * Ran mapreduce job, and it works well. >>> >> >>> >> https://issues.apache.org/jira/browse/HADOOP-12064 >>> >> >>> >> Do you have any concern or opinion? I would like to merge it to trunk >>> >> on this Friday if you have no objections. >>> >> >>> >> Best, >>> >> - Tsuyoshi >>> >> >>> >> - >>> >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org >>> >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org >>> >> >>> >> >>> > >>> > >>> > - >>> > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org >>> > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org >>> > >>> >>> >>> >>> -- >>> busbey >>> >>> - >>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org >>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org >>> >> - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)
Thanks Vinod, Sangjin, Sean for your comment. Okay, I will take a look at the class path isolation. Should I postpone to merge Guice upgrade to trunk? IMHO, it works with tests, so it's okay to merge to runk. Thoughts? - Tsuyoshi On Wed, Jun 29, 2016 at 12:10 PM, Sangjin Leewrote: > Yeah it would be awesome if we can get feedback and/or suggestions on these > JIRAs (HADOOP-11804 and HADOOP-13070). > > Thanks, > Sangjin > > On Wed, Jun 29, 2016 at 10:55 AM, Sean Busbey wrote: >> >> At the very least, I'm running through an updated shaded hadoop client >> this week[1] (HBase is my test application and it wandered onto some >> private things that broke in branch-2). And Sangjin has a good lead on >> an lower-short-term-cost incremental improvement for runtime isolation >> of apps built on yarn/mapreduce[2]. He's been patiently waiting for >> more review feedback. >> >> >> [1]: https://issues.apache.org/jira/browse/HADOOP-11804 >> [2]: https://issues.apache.org/jira/browse/HADOOP-13070 >> >> On Wed, Jun 29, 2016 at 12:33 PM, Vinod Kumar Vavilapalli >> wrote: >> > My strong expectation is that we’ll have a version of classpath >> > isolation in our first release of 3.x. I’m planning to spending some cycles >> > right away on this. >> > >> > Assuming classpath isolation gets in, it is reasonable to bump up our >> > dependencies like Jetty / Guice to the latest stable versions. >> > >> > Thanks >> > +Vinod >> > >> >> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa wrote: >> >> >> >> Hi developers, >> >> >> >> I will plan to upgrade Google Guice dependency on trunk. The change >> >> also includes asm and cglib upgrade. >> >> I checked following points: >> >> >> >> * Both HDFS and YARN UIs work well. >> >> * All webIU-related tests pass as described on HADOOP-12064. >> >> * Ran mapreduce job, and it works well. >> >> >> >> https://issues.apache.org/jira/browse/HADOOP-12064 >> >> >> >> Do you have any concern or opinion? I would like to merge it to trunk >> >> on this Friday if you have no objections. >> >> >> >> Best, >> >> - Tsuyoshi >> >> >> >> - >> >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org >> >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org >> >> >> >> >> > >> > >> > - >> > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org >> > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org >> > >> >> >> >> -- >> busbey >> >> - >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org >> > - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)
At the very least, I'm running through an updated shaded hadoop client this week[1] (HBase is my test application and it wandered onto some private things that broke in branch-2). And Sangjin has a good lead on an lower-short-term-cost incremental improvement for runtime isolation of apps built on yarn/mapreduce[2]. He's been patiently waiting for more review feedback. [1]: https://issues.apache.org/jira/browse/HADOOP-11804 [2]: https://issues.apache.org/jira/browse/HADOOP-13070 On Wed, Jun 29, 2016 at 12:33 PM, Vinod Kumar Vavilapalliwrote: > My strong expectation is that we’ll have a version of classpath isolation in > our first release of 3.x. I’m planning to spending some cycles right away on > this. > > Assuming classpath isolation gets in, it is reasonable to bump up our > dependencies like Jetty / Guice to the latest stable versions. > > Thanks > +Vinod > >> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa wrote: >> >> Hi developers, >> >> I will plan to upgrade Google Guice dependency on trunk. The change >> also includes asm and cglib upgrade. >> I checked following points: >> >> * Both HDFS and YARN UIs work well. >> * All webIU-related tests pass as described on HADOOP-12064. >> * Ran mapreduce job, and it works well. >> >> https://issues.apache.org/jira/browse/HADOOP-12064 >> >> Do you have any concern or opinion? I would like to merge it to trunk >> on this Friday if you have no objections. >> >> Best, >> - Tsuyoshi >> >> - >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org >> >> > > > - > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org > -- busbey - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)
My strong expectation is that we’ll have a version of classpath isolation in our first release of 3.x. I’m planning to spending some cycles right away on this. Assuming classpath isolation gets in, it is reasonable to bump up our dependencies like Jetty / Guice to the latest stable versions. Thanks +Vinod > On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawawrote: > > Hi developers, > > I will plan to upgrade Google Guice dependency on trunk. The change > also includes asm and cglib upgrade. > I checked following points: > > * Both HDFS and YARN UIs work well. > * All webIU-related tests pass as described on HADOOP-12064. > * Ran mapreduce job, and it works well. > > https://issues.apache.org/jira/browse/HADOOP-12064 > > Do you have any concern or opinion? I would like to merge it to trunk > on this Friday if you have no objections. > > Best, > - Tsuyoshi > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)
As I commented in the jira, I'm +1 for upgrading. -Akira On 6/29/16 10:16, Tsuyoshi Ozawa wrote: No objections here? - Tsuyoshi On Mon, Jun 27, 2016 at 6:01 AM, Tsuyoshi Ozawawrote: Hi developers, I will plan to upgrade Google Guice dependency on trunk. The change also includes asm and cglib upgrade. I checked following points: * Both HDFS and YARN UIs work well. * All webIU-related tests pass as described on HADOOP-12064. * Ran mapreduce job, and it works well. https://issues.apache.org/jira/browse/HADOOP-12064 Do you have any concern or opinion? I would like to merge it to trunk on this Friday if you have no objections. Best, - Tsuyoshi - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)
> On Jun 29, 2016, at 10:16 AM, Tsuyoshi Ozawawrote: > > No objections here? I talked to a handful of non-committer ISV-type folks yesterday and the general consensus was that there is an expectation that 3.x will have all the dependencies updated to something relatively modern if we can't either remove from the client path[*] or shade them. So I think it's a safe bet that there basically won't be any major complaints for upgrades. * - We should be able to use the same trick that is happening in hadoop-tools to do this (effectively lazy loading). I'm not sure it's worth the time/effort/politics to make that sort of a change. - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)
No objections here? - Tsuyoshi On Mon, Jun 27, 2016 at 6:01 AM, Tsuyoshi Ozawawrote: > Hi developers, > > I will plan to upgrade Google Guice dependency on trunk. The change > also includes asm and cglib upgrade. > I checked following points: > > * Both HDFS and YARN UIs work well. > * All webIU-related tests pass as described on HADOOP-12064. > * Ran mapreduce job, and it works well. > > https://issues.apache.org/jira/browse/HADOOP-12064 > > Do you have any concern or opinion? I would like to merge it to trunk > on this Friday if you have no objections. > > Best, > - Tsuyoshi - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/ [Jun 28, 2016 11:19:39 AM] (vinayakumarb) HDFS-10440. Improve DataNode web UI (Contributed by Weiwei Yang) [Jun 28, 2016 12:53:03 PM] (aw) HADOOP-13209. replace slaves with workers (John Smith via aw) [Jun 28, 2016 2:21:04 PM] (aw) HADOOP-13034. Log message about input options in distcp lacks some items [Jun 28, 2016 2:22:51 PM] (aw) HADOOP-9888. KerberosName static initialization gets default realm, [Jun 28, 2016 8:55:26 PM] (wang) HDFS-6434. Default permission for creating file should be 644 for [Jun 28, 2016 9:25:02 PM] (wang) HADOOP-12864. Remove bin/rcc script. Contributed by Allen Wittenauer. [Jun 29, 2016 3:37:42 AM] (aw) HADOOP-9321. fix coverage org.apache.hadoop.net (Ivan A. Veselovsky via [Jun 29, 2016 3:40:41 AM] (aw) HADOOP-9330. Add custom JUnit4 test runner with configurable timeout [Jun 29, 2016 3:47:05 AM] (aw) HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu [Jun 29, 2016 4:38:30 AM] (rohithsharmaks) YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for [Jun 29, 2016 6:15:13 AM] (yzhang) HDFS-10396. Using -diff option with DistCp may get "Comparison method -1 overall The following subsystems voted -1: unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.client.cli.TestLogsCLI hadoop.yarn.client.api.impl.TestYarnClient hadoop.mapreduce.tools.TestCLI Timed out junit tests : org.apache.hadoop.http.TestHttpServerLifecycle cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-compile-javac-root.txt [172K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-patch-pylint.txt [16K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/whitespace-eol.txt [12M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-javadoc-javadoc-root.txt [2.3M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [116K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [144K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [28K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [60K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [124K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands,