Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Andrew Wang
I think it's okay to merge. We've already bumped other deps in trunk.

On Wed, Jun 29, 2016 at 12:27 PM, Tsuyoshi Ozawa  wrote:

> I forgot to mention about importance point: it's a blocker issue to
> compile Hadoop with JDK8. Hence, we need to merge it on both client
> side and server slide anyway.
>
> Thanks,
> - Tsuyoshi
>
> On Wed, Jun 29, 2016 at 12:24 PM, Tsuyoshi Ozawa  wrote:
> > Thanks Vinod, Sangjin, Sean for your comment.
> >
> > Okay, I will take a look at the class path isolation.
> > Should I postpone to merge Guice upgrade to trunk? IMHO, it works with
> > tests, so it's okay to merge to runk. Thoughts?
> >
> > - Tsuyoshi
> >
> > On Wed, Jun 29, 2016 at 12:10 PM, Sangjin Lee  wrote:
> >> Yeah it would be awesome if we can get feedback and/or suggestions on
> these
> >> JIRAs (HADOOP-11804 and HADOOP-13070).
> >>
> >> Thanks,
> >> Sangjin
> >>
> >> On Wed, Jun 29, 2016 at 10:55 AM, Sean Busbey 
> wrote:
> >>>
> >>> At the very least, I'm running through an updated shaded hadoop client
> >>> this week[1] (HBase is my test application and it wandered onto some
> >>> private things that broke in branch-2). And Sangjin has a good lead on
> >>> an lower-short-term-cost incremental improvement for runtime isolation
> >>> of apps built on yarn/mapreduce[2]. He's been patiently waiting for
> >>> more review feedback.
> >>>
> >>>
> >>> [1]: https://issues.apache.org/jira/browse/HADOOP-11804
> >>> [2]: https://issues.apache.org/jira/browse/HADOOP-13070
> >>>
> >>> On Wed, Jun 29, 2016 at 12:33 PM, Vinod Kumar Vavilapalli
> >>>  wrote:
> >>> > My strong expectation is that we’ll have a version of classpath
> >>> > isolation in our first release of 3.x. I’m planning to spending some
> cycles
> >>> > right away on this.
> >>> >
> >>> > Assuming classpath isolation gets in, it is reasonable to bump up our
> >>> > dependencies like Jetty / Guice to the latest stable versions.
> >>> >
> >>> > Thanks
> >>> > +Vinod
> >>> >
> >>> >> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa 
> wrote:
> >>> >>
> >>> >> Hi developers,
> >>> >>
> >>> >> I will plan to upgrade Google Guice dependency on trunk. The change
> >>> >> also includes asm and cglib upgrade.
> >>> >> I checked following points:
> >>> >>
> >>> >> * Both HDFS and YARN UIs work well.
> >>> >> * All webIU-related tests pass as described on HADOOP-12064.
> >>> >> * Ran mapreduce job, and it works well.
> >>> >>
> >>> >> https://issues.apache.org/jira/browse/HADOOP-12064
> >>> >>
> >>> >> Do you have any concern or opinion?  I would like to merge it to
> trunk
> >>> >> on this Friday if you have no objections.
> >>> >>
> >>> >> Best,
> >>> >> - Tsuyoshi
> >>> >>
> >>> >>
> -
> >>> >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> >>> >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> >>> >>
> >>> >>
> >>> >
> >>> >
> >>> > -
> >>> > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
> >>> > For additional commands, e-mail:
> mapreduce-dev-h...@hadoop.apache.org
> >>> >
> >>>
> >>>
> >>>
> >>> --
> >>> busbey
> >>>
> >>> -
> >>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> >>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> >>>
> >>
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>


Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Tsuyoshi Ozawa
I forgot to mention about importance point: it's a blocker issue to
compile Hadoop with JDK8. Hence, we need to merge it on both client
side and server slide anyway.

Thanks,
- Tsuyoshi

On Wed, Jun 29, 2016 at 12:24 PM, Tsuyoshi Ozawa  wrote:
> Thanks Vinod, Sangjin, Sean for your comment.
>
> Okay, I will take a look at the class path isolation.
> Should I postpone to merge Guice upgrade to trunk? IMHO, it works with
> tests, so it's okay to merge to runk. Thoughts?
>
> - Tsuyoshi
>
> On Wed, Jun 29, 2016 at 12:10 PM, Sangjin Lee  wrote:
>> Yeah it would be awesome if we can get feedback and/or suggestions on these
>> JIRAs (HADOOP-11804 and HADOOP-13070).
>>
>> Thanks,
>> Sangjin
>>
>> On Wed, Jun 29, 2016 at 10:55 AM, Sean Busbey  wrote:
>>>
>>> At the very least, I'm running through an updated shaded hadoop client
>>> this week[1] (HBase is my test application and it wandered onto some
>>> private things that broke in branch-2). And Sangjin has a good lead on
>>> an lower-short-term-cost incremental improvement for runtime isolation
>>> of apps built on yarn/mapreduce[2]. He's been patiently waiting for
>>> more review feedback.
>>>
>>>
>>> [1]: https://issues.apache.org/jira/browse/HADOOP-11804
>>> [2]: https://issues.apache.org/jira/browse/HADOOP-13070
>>>
>>> On Wed, Jun 29, 2016 at 12:33 PM, Vinod Kumar Vavilapalli
>>>  wrote:
>>> > My strong expectation is that we’ll have a version of classpath
>>> > isolation in our first release of 3.x. I’m planning to spending some 
>>> > cycles
>>> > right away on this.
>>> >
>>> > Assuming classpath isolation gets in, it is reasonable to bump up our
>>> > dependencies like Jetty / Guice to the latest stable versions.
>>> >
>>> > Thanks
>>> > +Vinod
>>> >
>>> >> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa  wrote:
>>> >>
>>> >> Hi developers,
>>> >>
>>> >> I will plan to upgrade Google Guice dependency on trunk. The change
>>> >> also includes asm and cglib upgrade.
>>> >> I checked following points:
>>> >>
>>> >> * Both HDFS and YARN UIs work well.
>>> >> * All webIU-related tests pass as described on HADOOP-12064.
>>> >> * Ran mapreduce job, and it works well.
>>> >>
>>> >> https://issues.apache.org/jira/browse/HADOOP-12064
>>> >>
>>> >> Do you have any concern or opinion?  I would like to merge it to trunk
>>> >> on this Friday if you have no objections.
>>> >>
>>> >> Best,
>>> >> - Tsuyoshi
>>> >>
>>> >> -
>>> >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
>>> >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>>> >>
>>> >>
>>> >
>>> >
>>> > -
>>> > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
>>> > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
>>> >
>>>
>>>
>>>
>>> --
>>> busbey
>>>
>>> -
>>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
>>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>>>
>>

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Tsuyoshi Ozawa
Thanks Vinod, Sangjin, Sean for your comment.

Okay, I will take a look at the class path isolation.
Should I postpone to merge Guice upgrade to trunk? IMHO, it works with
tests, so it's okay to merge to runk. Thoughts?

- Tsuyoshi

On Wed, Jun 29, 2016 at 12:10 PM, Sangjin Lee  wrote:
> Yeah it would be awesome if we can get feedback and/or suggestions on these
> JIRAs (HADOOP-11804 and HADOOP-13070).
>
> Thanks,
> Sangjin
>
> On Wed, Jun 29, 2016 at 10:55 AM, Sean Busbey  wrote:
>>
>> At the very least, I'm running through an updated shaded hadoop client
>> this week[1] (HBase is my test application and it wandered onto some
>> private things that broke in branch-2). And Sangjin has a good lead on
>> an lower-short-term-cost incremental improvement for runtime isolation
>> of apps built on yarn/mapreduce[2]. He's been patiently waiting for
>> more review feedback.
>>
>>
>> [1]: https://issues.apache.org/jira/browse/HADOOP-11804
>> [2]: https://issues.apache.org/jira/browse/HADOOP-13070
>>
>> On Wed, Jun 29, 2016 at 12:33 PM, Vinod Kumar Vavilapalli
>>  wrote:
>> > My strong expectation is that we’ll have a version of classpath
>> > isolation in our first release of 3.x. I’m planning to spending some cycles
>> > right away on this.
>> >
>> > Assuming classpath isolation gets in, it is reasonable to bump up our
>> > dependencies like Jetty / Guice to the latest stable versions.
>> >
>> > Thanks
>> > +Vinod
>> >
>> >> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa  wrote:
>> >>
>> >> Hi developers,
>> >>
>> >> I will plan to upgrade Google Guice dependency on trunk. The change
>> >> also includes asm and cglib upgrade.
>> >> I checked following points:
>> >>
>> >> * Both HDFS and YARN UIs work well.
>> >> * All webIU-related tests pass as described on HADOOP-12064.
>> >> * Ran mapreduce job, and it works well.
>> >>
>> >> https://issues.apache.org/jira/browse/HADOOP-12064
>> >>
>> >> Do you have any concern or opinion?  I would like to merge it to trunk
>> >> on this Friday if you have no objections.
>> >>
>> >> Best,
>> >> - Tsuyoshi
>> >>
>> >> -
>> >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
>> >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>> >>
>> >>
>> >
>> >
>> > -
>> > To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
>> > For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
>> >
>>
>>
>>
>> --
>> busbey
>>
>> -
>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>>
>

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Sean Busbey
At the very least, I'm running through an updated shaded hadoop client
this week[1] (HBase is my test application and it wandered onto some
private things that broke in branch-2). And Sangjin has a good lead on
an lower-short-term-cost incremental improvement for runtime isolation
of apps built on yarn/mapreduce[2]. He's been patiently waiting for
more review feedback.


[1]: https://issues.apache.org/jira/browse/HADOOP-11804
[2]: https://issues.apache.org/jira/browse/HADOOP-13070

On Wed, Jun 29, 2016 at 12:33 PM, Vinod Kumar Vavilapalli
 wrote:
> My strong expectation is that we’ll have a version of classpath isolation in 
> our first release of 3.x. I’m planning to spending some cycles right away on 
> this.
>
> Assuming classpath isolation gets in, it is reasonable to bump up our 
> dependencies like Jetty / Guice to the latest stable versions.
>
> Thanks
> +Vinod
>
>> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa  wrote:
>>
>> Hi developers,
>>
>> I will plan to upgrade Google Guice dependency on trunk. The change
>> also includes asm and cglib upgrade.
>> I checked following points:
>>
>> * Both HDFS and YARN UIs work well.
>> * All webIU-related tests pass as described on HADOOP-12064.
>> * Ran mapreduce job, and it works well.
>>
>> https://issues.apache.org/jira/browse/HADOOP-12064
>>
>> Do you have any concern or opinion?  I would like to merge it to trunk
>> on this Friday if you have no objections.
>>
>> Best,
>> - Tsuyoshi
>>
>> -
>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>>
>>
>
>
> -
> To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
>



-- 
busbey

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Vinod Kumar Vavilapalli
My strong expectation is that we’ll have a version of classpath isolation in 
our first release of 3.x. I’m planning to spending some cycles right away on 
this.

Assuming classpath isolation gets in, it is reasonable to bump up our 
dependencies like Jetty / Guice to the latest stable versions.

Thanks
+Vinod

> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa  wrote:
> 
> Hi developers,
> 
> I will plan to upgrade Google Guice dependency on trunk. The change
> also includes asm and cglib upgrade.
> I checked following points:
> 
> * Both HDFS and YARN UIs work well.
> * All webIU-related tests pass as described on HADOOP-12064.
> * Ran mapreduce job, and it works well.
> 
> https://issues.apache.org/jira/browse/HADOOP-12064
> 
> Do you have any concern or opinion?  I would like to merge it to trunk
> on this Friday if you have no objections.
> 
> Best,
> - Tsuyoshi
> 
> -
> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> 
> 


-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Akira AJISAKA

As I commented in the jira, I'm +1 for upgrading.

-Akira

On 6/29/16 10:16, Tsuyoshi Ozawa wrote:

No objections here?

- Tsuyoshi

On Mon, Jun 27, 2016 at 6:01 AM, Tsuyoshi Ozawa  wrote:

Hi developers,

I will plan to upgrade Google Guice dependency on trunk. The change
also includes asm and cglib upgrade.
I checked following points:

* Both HDFS and YARN UIs work well.
* All webIU-related tests pass as described on HADOOP-12064.
* Ran mapreduce job, and it works well.

https://issues.apache.org/jira/browse/HADOOP-12064

Do you have any concern or opinion?  I would like to merge it to trunk
on this Friday if you have no objections.

Best,
- Tsuyoshi


-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org




-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Allen Wittenauer

> On Jun 29, 2016, at 10:16 AM, Tsuyoshi Ozawa  wrote:
> 
> No objections here?


I talked to a handful of non-committer ISV-type folks yesterday and the general 
consensus was that there is an expectation that 3.x will have all the 
dependencies updated to something relatively modern if we can't either remove 
from the client path[*] or shade them.  So I think it's a safe bet that there 
basically won't be any major complaints for upgrades.


* - We should be able to use the same trick that is happening in hadoop-tools 
to do this (effectively lazy loading). I'm not sure it's worth the 
time/effort/politics to make that sort of a change.
-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Tsuyoshi Ozawa
No objections here?

- Tsuyoshi

On Mon, Jun 27, 2016 at 6:01 AM, Tsuyoshi Ozawa  wrote:
> Hi developers,
>
> I will plan to upgrade Google Guice dependency on trunk. The change
> also includes asm and cglib upgrade.
> I checked following points:
>
> * Both HDFS and YARN UIs work well.
> * All webIU-related tests pass as described on HADOOP-12064.
> * Ran mapreduce job, and it works well.
>
> https://issues.apache.org/jira/browse/HADOOP-12064
>
> Do you have any concern or opinion?  I would like to merge it to trunk
> on this Friday if you have no objections.
>
> Best,
> - Tsuyoshi

-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-06-29 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/

[Jun 28, 2016 11:19:39 AM] (vinayakumarb) HDFS-10440. Improve DataNode web UI 
(Contributed by Weiwei Yang)
[Jun 28, 2016 12:53:03 PM] (aw) HADOOP-13209. replace slaves with workers (John 
Smith via aw)
[Jun 28, 2016 2:21:04 PM] (aw) HADOOP-13034. Log message about input options in 
distcp lacks some items
[Jun 28, 2016 2:22:51 PM] (aw) HADOOP-9888. KerberosName static initialization 
gets default realm,
[Jun 28, 2016 8:55:26 PM] (wang) HDFS-6434. Default permission for creating 
file should be 644 for
[Jun 28, 2016 9:25:02 PM] (wang) HADOOP-12864. Remove bin/rcc script. 
Contributed by Allen Wittenauer.
[Jun 29, 2016 3:37:42 AM] (aw) HADOOP-9321. fix coverage org.apache.hadoop.net 
(Ivan A. Veselovsky via
[Jun 29, 2016 3:40:41 AM] (aw) HADOOP-9330. Add custom JUnit4 test runner with 
configurable timeout
[Jun 29, 2016 3:47:05 AM] (aw) HDFS-9852. hdfs dfs -setfacl error message is 
misleading (Wei-Chiu
[Jun 29, 2016 4:38:30 AM] (rohithsharmaks) YARN-5262. Optimize sending 
RMNodeFinishedContainersPulledByAMEvent for
[Jun 29, 2016 6:15:13 AM] (yzhang) HDFS-10396. Using -diff option with DistCp 
may get "Comparison method




-1 overall


The following subsystems voted -1:
unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer 
   
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer 
   hadoop.yarn.server.resourcemanager.TestRMRestart 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.client.cli.TestLogsCLI 
   hadoop.yarn.client.api.impl.TestYarnClient 
   hadoop.mapreduce.tools.TestCLI 

Timed out junit tests :

   org.apache.hadoop.http.TestHttpServerLifecycle 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-compile-javac-root.txt
  [172K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-checkstyle-root.txt
  [16M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-patch-pylint.txt
  [16K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/whitespace-eol.txt
  [12M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/diff-javadoc-javadoc-root.txt
  [2.3M]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [116K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [144K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [28K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [52K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [268K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
  [16K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
  [60K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/79/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
  [124K]

Powered by Apache Yetus 0.4.0-SNAPSHOT   http://yetus.apache.org



-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands,