[ANNOUNCE] New Apache Hadoop Committer/PMC member

[Wangda Tan]

Hi Community,

It's my pleasure to announce that Jonathan Hung has been elected as an
Apache Hadoop PMC member. And Xun Liu/Zac Zhou have been elected as Apache
Hadoop committers. This is to recognize their contributions to the project.

Congratulations and welcome on board!

Wangda Tan
(On behalf of the Apache Hadoop PMC).

Re: Agenda & More Information about Hadoop Community Meetup @ Palo Alto, June 26

[Wangda Tan]

A friendly reminder,

The meetup will take place tomorrow at 9:00 AM PDT to 4:00 PM PDT.

The address is: 395 Page Mill Rd, Palo Alto, CA 94306
We’ll be in the Bigtop conference room on the 1st floor. Go left after
coming through the main entrance, and it will be on the right.

Zoom: https://cloudera.zoom.us/j/606607666

Please let me know if you have any questions. If you haven't RSVP yet,
please go ahead and RSVP so we can better prepare food, seat, etc.

Thanks,
Wangda

On Wed, Jun 19, 2019 at 4:49 PM Wangda Tan  wrote:

> Hi All,
>
> I want to let you know that we have confirmed most of the agenda for
> Hadoop Community Meetup. It will be a whole day event.
>
> Agenda & Dial-In info because see below, *please RSVP
> at https://www.meetup.com/Hadoop-Contributors/events/262055924/
> <https://www.meetup.com/Hadoop-Contributors/events/262055924/>*
>
> Huge thanks to Daniel Templeton, Wei-Chiu Chuang, Christina Vu for helping
> with organizing and logistics.
>
> *Please help to promote meetup information on Twitter, LinkedIn, etc.
> Appreciated! *
>
> Best,
> Wangda
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *AM:9:00: Arrival and check-in--9:30 -
> 10:15:-Talk: Hadoop storage in cloud-native
> environmentsAbstract: Hadoop is a mature storage system but designed years
> before the cloud-native movement. Kubernetes and other cloud-native tools
> are emerging solutions for containerized environments but sometimes they
> require different approaches.In this presentation we would like to share
> our experiences to run Apache Hadoop Ozone in Kubernetes and the connection
> point to other cloud-native ecosystem elements. We will compare the
> benefits and drawbacks to use Kubernetes and Hadoop storage together and
> show our current achievements and future plans.Speaker: Marton Elek
> (Cloudera)10:20 - 11:00:--Talk: Selective Wire Encryption In
> HDFSAbstract: Wire data encryption is a key component of the Hadoop
> Distributed File System (HDFS). However, such encryption enforcement comes
> in as an all-or-nothing feature. In our use case at LinkedIn, we would like
> to selectively expose fast unencrypted access to fully managed internal
> clients, which can be trusted, while only expose encrypted access to
> clients outside of the trusted circle with higher security risks. That way
> we minimize performance overhead for trusted internal clients while still
> securing data from potential outside threats. Our design extends HDFS
> NameNode to run on multiple ports, connecting to different NameNode ports
> would end up with different levels of encryption protection. This
> protection then gets enforced for both NameNode RPC and the subsequent data
> transfers to/from DataNode. This approach comes with minimum operational
> and performance overhead.Speaker: Konstantin Shvachko (LinkedIn), Chen
> Liang (LinkedIn)11:10 - 11:55:-Talk: YuniKorn: Next Generation
> Scheduling for YARN and K8sAbstract: We will talk about our open source
> work - YuniKorn scheduler project (Y for YARN, K for K8s, uni- for Unified)
> brings long-wanted features such as hierarchical queues, fairness between
> users/jobs/queues, preemption to Kubernetes; and it brings service
> scheduling enhancements to YARN. Any improvements to this scheduler can
> benefit both Kubernetes and YARN community.Speaker: Wangda Tan
> (Cloudera)PM:12:00 - 12:55 Lunch Break (Provided by
> Cloudera)1:00 -
> 1:25---Talk: Yarn Efficiency at UberAbstract: We will present the
> work done at Uber to improve YARN cluster utilization and job SOA with
> elastic resource management, low compute workload on passive datacenter,
> preemption, larger container, etc. We will also go through YARN upgrade in
> order to adopt new features and talk about the challenges.Speaker: Aihua Xu
> (Uber), Prashant Golash (Uber)1:30 - 2:10 One more
> talk-2:20 - 4:00---BoF sessions &
> Breakout Sessions & Group discussions: Talk about items like JDK 11
> support, next releases (2.10.0, 3.3.0, etc.), Hadoop on Cloud, etc.4:00:
> Reception provided by
> Cloudera.==Join Zoom
> Meetinghttps://cloudera.zoom.us/j/116816195
> <https://cloudera.zoom.us/j/116816195>*
>

Agenda & More Information about Hadoop Community Meetup @ Palo Alto, June 26

[Wangda Tan]

Hi All,

I want to let you know that we have confirmed most of the agenda for Hadoop
Community Meetup. It will be a whole day event.

Agenda & Dial-In info because see below, *please RSVP
at https://www.meetup.com/Hadoop-Contributors/events/262055924/
<https://www.meetup.com/Hadoop-Contributors/events/262055924/>*

Huge thanks to Daniel Templeton, Wei-Chiu Chuang, Christina Vu for helping
with organizing and logistics.

*Please help to promote meetup information on Twitter, LinkedIn, etc.
Appreciated! *

Best,
Wangda

























































*AM:9:00: Arrival and check-in--9:30 -
10:15:-Talk: Hadoop storage in cloud-native
environmentsAbstract: Hadoop is a mature storage system but designed years
before the cloud-native movement. Kubernetes and other cloud-native tools
are emerging solutions for containerized environments but sometimes they
require different approaches.In this presentation we would like to share
our experiences to run Apache Hadoop Ozone in Kubernetes and the connection
point to other cloud-native ecosystem elements. We will compare the
benefits and drawbacks to use Kubernetes and Hadoop storage together and
show our current achievements and future plans.Speaker: Marton Elek
(Cloudera)10:20 - 11:00:--Talk: Selective Wire Encryption In
HDFSAbstract: Wire data encryption is a key component of the Hadoop
Distributed File System (HDFS). However, such encryption enforcement comes
in as an all-or-nothing feature. In our use case at LinkedIn, we would like
to selectively expose fast unencrypted access to fully managed internal
clients, which can be trusted, while only expose encrypted access to
clients outside of the trusted circle with higher security risks. That way
we minimize performance overhead for trusted internal clients while still
securing data from potential outside threats. Our design extends HDFS
NameNode to run on multiple ports, connecting to different NameNode ports
would end up with different levels of encryption protection. This
protection then gets enforced for both NameNode RPC and the subsequent data
transfers to/from DataNode. This approach comes with minimum operational
and performance overhead.Speaker: Konstantin Shvachko (LinkedIn), Chen
Liang (LinkedIn)11:10 - 11:55:-Talk: YuniKorn: Next Generation
Scheduling for YARN and K8sAbstract: We will talk about our open source
work - YuniKorn scheduler project (Y for YARN, K for K8s, uni- for Unified)
brings long-wanted features such as hierarchical queues, fairness between
users/jobs/queues, preemption to Kubernetes; and it brings service
scheduling enhancements to YARN. Any improvements to this scheduler can
benefit both Kubernetes and YARN community.Speaker: Wangda Tan
(Cloudera)PM:12:00 - 12:55 Lunch Break (Provided by
Cloudera)1:00 -
1:25---Talk: Yarn Efficiency at UberAbstract: We will present the
work done at Uber to improve YARN cluster utilization and job SOA with
elastic resource management, low compute workload on passive datacenter,
preemption, larger container, etc. We will also go through YARN upgrade in
order to adopt new features and talk about the challenges.Speaker: Aihua Xu
(Uber), Prashant Golash (Uber)1:30 - 2:10 One more
talk-2:20 - 4:00---BoF sessions &
Breakout Sessions & Group discussions: Talk about items like JDK 11
support, next releases (2.10.0, 3.3.0, etc.), Hadoop on Cloud, etc.4:00:
Reception provided by
Cloudera.==Join Zoom
Meetinghttps://cloudera.zoom.us/j/116816195
<https://cloudera.zoom.us/j/116816195>*

[ANNOUNCE] Apache Hadoop 3.1.2 release

[Wangda Tan]

It gives us great pleasure to announce that the Apache Hadoop community has
voted to release Apache Hadoop 3.1.2.

IMPORTANT NOTES

3.1.2 is the second stable release of 3.1 line which is considered to be
production-ready.

Hadoop 3.1.2 brings a number of enhancements.

The Hadoop community fixed 325 JIRAs [1] in total as part of the 3.1.2
release. Of these fixes:

Apache Hadoop 3.1.2 contains a number of significant features and
enhancements. A few of them are noted below.

- Nvidia-docker-plugin v2 support for GPU support on YARN.
- YARN service upgrade improvements and bug fixes.
- YARN UIv2 improvements and bug fixes.
- AliyunOSS related improvements and bug fixes.
- Docker on YARN support related improvements and bug fixes.

Please see the Hadoop 3.1.2 CHANGES for the detailed list of issues
resolved. The release news is posted on the Apache Hadoop website too, you
can go to the downloads section.

Many thanks to everyone who contributed to the release, and everyone in the
Apache Hadoop community! The release is a result of direct and indirect
efforts from many contributors, listed below are the those who contributed
directly by submitting patches and/or reporting issues. (148 contributors,
Sorted by ID)

BilwaST, Charo Zhang, GeLiXin, Harsha1206, Huachao, Jim_Brennan, LiJinglun,
Naganarasimha, OrDTesters, RANith, Rakesh_Shah, Ray Burgemeestre, Sen Zhao,
SoumyaPN, SouryakantaDwivedy, Tao Yang, Zian Chen, abmodi, adam.antal,
ajayydv, ajisakaa, akhilpb, akhilsnaik, amihalyi, arpitagarwal, aw,
ayushtkn, banditka, belugabehr, benlau, bibinchundatt, billie.rinaldi,
boky01, bolke, borisvu, botong, brahmareddy, briandburton, bsteinbach,
candychencan, ccondit-target, charanh, cheersyang, cltlfcjin, collinma,
crh, csingh, csun, daisuke.kobayashi, daryn, dibyendu_hadoop,
dineshchitlangia, ebadger, eepayne, elgoiri, erwaman, eyang, fengchuang,
ferhui, fly_in_gis, gabor.bota, gezapeti, gsaha, haibochen, hexiaoqiao,
hfyang20071, hgadre, jeagles, jhung, jiangjianfei, jianliang.wu,
jira.shegalov, jiwq, jlowe, jojochuang, jonBoone, kanwaljeets, karams,
kennethlnnn, kgyrtkirk, kihwal, knanasi, kshukla, laszlok, leftnoteasy,
leiqiang, liaoyuxiangqin, linyiqun, ljain, lukmajercak, maniraj...@gmail.com,
masatana, nandakumar131, oliverhuh...@gmail.com, oshevchenko, pbacsko,
peruguusha, photogamrun, pj.fanning, prabham, pradeepambati, pranay_singh,
revans2, rkanter, rohithsharma, shaneku...@gmail.com, shubham.dewan,
shuzirra, shv, simonprewo, sinago, smeng, snemeth, sodonnell,
sreenivasulureddy, ssath...@hortonworks.com, ssulav, ste...@apache.org,
study, suma.shivaprasad, sunilg, surendrasingh, tangzhankun, tarunparimi,
tasanuma0829, templedf, thinktaocs, tlipcon, tmarquardt, trjianjianjiao,
uranus, varun_saxena, vinayrpet, vrushalic, wilfreds,
write2kish...@gmail.com, wujinhu, xiaochen, xiaoheipangzi, xkrogen,
yangjiandan, yeshavora, yiran, yoelee, yuzhih...@gmail.com, zichensun,
zvenczel

Wangda Tan and Sunil Govind

[1] JIRA query: project in (YARN, HADOOP, MAPREDUCE, HDFS) AND resolution =
Fixed AND fixVersion = 3.1.2 ORDER BY key ASC, updated ASC, created DESC,
priority DESC

Re: [ANNOUNCE] New Apache Hadoop PMC: Haibo Chen

[Wangda Tan]

Congrats!

Best,
Wangda

On Tue, Nov 20, 2018 at 9:26 AM Andrew Wang
 wrote:

> Congrats Haibo!
>
> On Tue, Nov 20, 2018 at 9:23 AM Sangjin Lee  wrote:
>
> > Congratulations!
> >
> > On Mon, Nov 19, 2018 at 10:18 PM Sunil Govindan 
> > wrote:
> >
> > > Congratulations Haibo!
> > >
> > > - Sunil
> > >
> > >
> > > On Tue, Nov 20, 2018 at 6:24 AM Daniel Templeton
> > >  wrote:
> > >
> > > > It is with great pleasure that I announce the latest addition to the
> > > > Hadoop PMC: Haibo Chen.  Welcome to the PMC, Haibo, and
> > congratulations!
> > > >
> > > > Daniel
> > > >
> > > > -
> > > > To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> > > > For additional commands, e-mail: general-h...@hadoop.apache.org
> > > >
> > > >
> > >
> >
>

Re: [ANNOUNCE] New Apache Hadoop PMC: Yiqun Lin

[Wangda Tan]

Congrats and welcome!

- Wangda

On Mon, Nov 19, 2018 at 1:23 PM Andrew Wang
 wrote:

> Congrats Yiqun, welcome!
>
> On Mon, Nov 19, 2018 at 11:35 AM Brahma Reddy Battula 
> wrote:
>
> > Hi all,
> >
> > It is my great pleasure to announce that Yiqun Lin has accepted the
> > invitation to become an Apache Hadoop PMC member.
> >
> > Please join me in congratulating him!
> >
> >
> >
> > Regards,
> > Brahma Reddy Battula
> >
>

[ANNOUNCE] New Hadoop Committer - Suma Shivaprasad

[Wangda Tan]

It is my pleasure to announce that Suma Shivaprasad has been elected as a
committer on the Apache Hadoop project. We appreciate her contributions to
Hadoop thus far, and look forward to more.

Please join me in congratulating Suma!

Regards,
Wangda Tan on behalf of the Apache Hadoop PMC

Re: Run Distributed TensorFlow on YARN

[Wangda Tan]

Hi Robert,

Submarine in 3.2.0 only support Docker container runtime, and in future
releases (maybe 3.2.1), we plan to add support for non-docker containers.

In order to try Submarine, you need to properly configure docker-on-yarn
first.

You can check
https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/site/markdown/InstallationScriptEN.md
for installation guide about how to properly setup Docker container on
multiple containers. Submarine embedded an interactive shell to help you
set up this should be straightforward. Added Xun Liu who is the original
author for the installation interactive shell.

Once you get Docker on YARN properly set up, you can follow
https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/site/markdown/QuickStart.md
to run the first application.

Also, you can check Submarine slides to better understand how it works.
See: https://www.dropbox.com/s/wuv19b3rt9k2kq6/submarine-v0.pptx?dl=0

Any questions please don't hesitate to let us know.

Thanks,
Wangda



On Thu, Nov 8, 2018 at 10:12 AM Robert Grandl 
wrote:

>  Thanks a lot for your reply.
> Sunil,
> I was trying to follow the steps from:
> https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/site/markdown/RunningDistributedCifar10TFJobs.md
>
> to run the tensorflow standalone using submarine. I have installed hadoop
> 3.3.0-SNAPSHOT.
> However, when I run the:yarn jar
> path/to/hadoop-yarn-applications-submarine-3.2.0-SNAPSHOT.jar \
>job run --name tf-job-001 --verbose --docker_image
> hadoopsubmarine/tf-1.8.0-gpu:0.0.1 \
>--input_path hdfs://default/dataset/cifar-10-data \
>--env DOCKER_JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre/
>--env DOCKER_HADOOP_HDFS_HOME=/hadoop-3.1.0
>--num_workers 1 --worker_resources memory=8G,vcores=2,gpu=1 \
>--worker_launch_cmd "cd /test/models/tutorials/image/cifar10_estimator
> && python cifar10_main.py --data-dir=%input_path%
> --job-dir=%checkpoint_path% --train-steps=1 --eval-batch-size=16
> --train-batch-size=16 --num-gpus=2 --sync" \
>--tensorboard --tensorboard_docker_image wtan/tf-1.8.0-cpu:0.0.3
> command, I get the following error:2018-11-07 21:48:55,831 INFO  [main]
> client.AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to
> Application History server at /128.105.144.236:10200Exception in thread
> "main" java.lang.IllegalArgumentException: Unacceptable no of cpus
> specified, either zero or negative for component master (or at the global
> level)at
> org.apache.hadoop.yarn.service.utils.ServiceApiUtil.validateServiceResource(ServiceApiUtil.java:457)
>   at
> org.apache.hadoop.yarn.service.utils.ServiceApiUtil.validateComponent(ServiceApiUtil.java:306)
>   at
> org.apache.hadoop.yarn.service.utils.ServiceApiUtil.validateAndResolveService(ServiceApiUtil.java:237)
>   at
> org.apache.hadoop.yarn.service.client.ServiceClient.actionCreate(ServiceClient.java:496)
>   at
> org.apache.hadoop.yarn.submarine.runtimes.yarnservice.YarnServiceJobSubmitter.submitJob(YarnServiceJobSubmitter.java:542)
>   at
> org.apache.hadoop.yarn.submarine.client.cli.RunJobCli.run(RunJobCli.java:231)
>   at org.apache.hadoop.yarn.submarine.client.cli.Cli.main(Cli.java:94)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)at
> org.apache.hadoop.util.RunJar.run(RunJar.java:323)at
> org.apache.hadoop.util.RunJar.main(RunJar.java:236)
>
> It seems that I don't configure somewhere some corresponding resources for
> a master component. However I have a hard time understanding where and what
> to configure. I also looked at the design document you pointed at:
> https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit#heading=h.vkxp9edl11m7
>
> and it has a --master_resources flag. However this is not available in
> 3.3.0.
> Could you please advise how to proceed with this?
> Thank you,- Robert
>
> On Tuesday, November 6, 2018, 10:40:20 PM PST, Jonathan Hung <
> jyhung2...@gmail.com> wrote:
>
>  Hi Robert, I also encourage you to check out
> https://github.com/linkedin/TonY (TensorFlow on YARN) which is a platform
> built for this purpose.
>
> Jonathan
> 
> From: Sunil G 
> Sent: Tuesday, November 6, 2018 10:05:14 PM
> To: Robert Grandl
> Cc: yarn-...@hadoop.apache.org; yarn-dev-h...@hadoop.apache.org; General
> Subject: Re: Run Distributed TensorFlow on YARN
>
> Hi Robert
>
> {Submarine} project helps to run Distributed Tensorflow on top of YARN with
> ease. YARN-8220 

Re: Run Distributed TensorFlow on YARN

[Wangda Tan]

Forgot to add Xun in my last email.

On Thu, Nov 8, 2018 at 11:55 AM Wangda Tan  wrote:

> Hi Robert,
>
> Submarine in 3.2.0 only support Docker container runtime, and in future
> releases (maybe 3.2.1), we plan to add support for non-docker containers.
>
> In order to try Submarine, you need to properly configure docker-on-yarn
> first.
>
> You can check
> https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/site/markdown/InstallationScriptEN.md
> for installation guide about how to properly setup Docker container on
> multiple containers. Submarine embedded an interactive shell to help you
> set up this should be straightforward. Added Xun Liu who is the original
> author for the installation interactive shell.
>
> Once you get Docker on YARN properly set up, you can follow
> https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/site/markdown/QuickStart.md
> to run the first application.
>
> Also, you can check Submarine slides to better understand how it works.
> See: https://www.dropbox.com/s/wuv19b3rt9k2kq6/submarine-v0.pptx?dl=0
>
> Any questions please don't hesitate to let us know.
>
> Thanks,
> Wangda
>
>
>
> On Thu, Nov 8, 2018 at 10:12 AM Robert Grandl 
> wrote:
>
>>  Thanks a lot for your reply.
>> Sunil,
>> I was trying to follow the steps from:
>> https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-submarine/src/site/markdown/RunningDistributedCifar10TFJobs.md
>>
>> to run the tensorflow standalone using submarine. I have installed hadoop
>> 3.3.0-SNAPSHOT.
>> However, when I run the:yarn jar
>> path/to/hadoop-yarn-applications-submarine-3.2.0-SNAPSHOT.jar \
>>job run --name tf-job-001 --verbose --docker_image
>> hadoopsubmarine/tf-1.8.0-gpu:0.0.1 \
>>--input_path hdfs://default/dataset/cifar-10-data \
>>--env DOCKER_JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre/
>>--env DOCKER_HADOOP_HDFS_HOME=/hadoop-3.1.0
>>--num_workers 1 --worker_resources memory=8G,vcores=2,gpu=1 \
>>--worker_launch_cmd "cd /test/models/tutorials/image/cifar10_estimator
>> && python cifar10_main.py --data-dir=%input_path%
>> --job-dir=%checkpoint_path% --train-steps=1 --eval-batch-size=16
>> --train-batch-size=16 --num-gpus=2 --sync" \
>>--tensorboard --tensorboard_docker_image wtan/tf-1.8.0-cpu:0.0.3
>> command, I get the following error:2018-11-07 21:48:55,831 INFO  [main]
>> client.AHSProxy (AHSProxy.java:createAHSProxy(42)) - Connecting to
>> Application History server at /128.105.144.236:10200Exception in thread
>> "main" java.lang.IllegalArgumentException: Unacceptable no of cpus
>> specified, either zero or negative for component master (or at the global
>> level)at
>> org.apache.hadoop.yarn.service.utils.ServiceApiUtil.validateServiceResource(ServiceApiUtil.java:457)
>>   at
>> org.apache.hadoop.yarn.service.utils.ServiceApiUtil.validateComponent(ServiceApiUtil.java:306)
>>   at
>> org.apache.hadoop.yarn.service.utils.ServiceApiUtil.validateAndResolveService(ServiceApiUtil.java:237)
>>   at
>> org.apache.hadoop.yarn.service.client.ServiceClient.actionCreate(ServiceClient.java:496)
>>   at
>> org.apache.hadoop.yarn.submarine.runtimes.yarnservice.YarnServiceJobSubmitter.submitJob(YarnServiceJobSubmitter.java:542)
>>   at
>> org.apache.hadoop.yarn.submarine.client.cli.RunJobCli.run(RunJobCli.java:231)
>>   at org.apache.hadoop.yarn.submarine.client.cli.Cli.main(Cli.java:94)
>>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>   at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>  at java.lang.reflect.Method.invoke(Method.java:498)at
>> org.apache.hadoop.util.RunJar.run(RunJar.java:323)at
>> org.apache.hadoop.util.RunJar.main(RunJar.java:236)
>>
>> It seems that I don't configure somewhere some corresponding resources
>> for a master component. However I have a hard time understanding where and
>> what to configure. I also looked at the design document you pointed at:
>> https://docs.google.com/document/d/199J4pB3blqgV9SCNvBbTqkEoQdjoyGMjESV4MktCo0k/edit#heading=h.vkxp9edl11m7
>>
>> and it has a --master_resources flag. However this is not available in
>> 3.3.0.
>> Could you please advise how to proceed with this?
>> 

Re: [ANNOUNCE] New Apache Hadoop PMC: Bibin A Chundutt

[Wangda Tan]

Congrats!

Best,
Wangda

On Wed, Aug 15, 2018 at 7:43 PM Brahma Reddy Battula <
brahmareddy.batt...@hotmail.com> wrote:

> Congratulations Bibin!!
>
>
>
> Brahma Reddy Battula
> 
> From: Naganarasimha Garla 
> Sent: Wednesday, August 15, 2018 6:44:42 AM
> To: general
> Subject: [ANNOUNCE] New Apache Hadoop PMC: Bibin A Chundutt
>
> Hi All,
>
> It is my pleasure to announce that the Apache Hadoop PMC voted to add Bibin
> A Chundutt as a PMC member. This is in recognition of Bibin's contributions
> to the Hadoop community. And i am glad that he has accepted the invitation.
>
> Please join me in congratulating Bibin!
>
> Regards,
>  + Naga
>

[ANNOUNCE] New Apache Hadoop PMC: Weiwei Yang

[Wangda Tan]

Hi all,

It is my great pleasure to announce that Weiwei Yang has accepted the
invitation to become an Apache Hadoop PMC member.

Please join me in congratulating him!

Thanks,
Wangda Tan

[ANNOUNCE] Apache Hadoop 3.1.1 release

[Wangda Tan]

It gives me great pleasure to announce that the Apache Hadoop community has
voted to release Apache Hadoop 3.1.1.

Hadoop 3.1.1 is the first stable maintenance release for the year 2018 in
the Hadoop-3.1 line and brings a number of enhancements.

IMPORTANT NOTES

3.1.1 is the first stable release of 3.1 line which is production-ready.

The Hadoop community fixed 435 JIRAs [1] in total as part of the 3.1.1
release. Of these fixes:

   -

   60 in Hadoop Common
   -

   139 in HDFS
   -

   223 in YARN
   -

   13 in MapReduce

--

Apache Hadoop 3.1.1 contains a number of significant features and
enhancements. A few of them are noted below.


   -

   ENTRY_POINT support for Docker containers.
   -

   Restart policy support for YARN native services.
   -

   Capacity Scheduler: Intra-queue preemption for fairness ordering policy.
   -

   Stabilization works for schedulers, YARN service, docker support, etc.


Please see the Hadoop 3.1.1 CHANGES
<http://hadoop.apache.org/docs/r3.1.1/hadoop-project-dist/hadoop-common/release/3.1.1/CHANGES.3.1.1.html>
for the detailed list of issues resolved. The release news is posted on the
Apache Hadoop website too, you can go to the downloads section.
<http://hadoop.apache.org/releases.html#Download>

--

Many thanks to everyone who contributed to the release, and everyone in the
Apache Hadoop community! The release is a result of direct and indirect
efforts from many contributors, listed below are the those who contributed
directly by submitting patches and reporting issues.

Abhishek Modi, Ajay Kumar, Akhil PB, Akira Ajisaka, Allen Wittenauer,
Anbang Hu, Andrew Wang, Arpit Agarwal, Atul Sikaria, BELUGA BEHR, Bharat
Viswanadham, Bibin A Chundatt, Billie Rinaldi, Bilwa S T, Botong Huang,
Brahma Reddy Battula, Brook Zhou, CR Hota, Chandni Singh, Chao Sun, Charan
Hebri, Chen Liang, Chetna Chaudhari, Chun Chen, Daniel Templeton, Davide
 Vergari, Dennis Huo, Dibyendu Karmakar, Ekanth Sethuramalingam, Eric
Badger, Eric Yang, Erik Krogen, Esfandiar Manii, Ewan Higgs, Gabor Bota,
Gang Li, Gang Xie, Genmao Yu, Gergely Novák, Gergo Repas, Giovanni Matteo
Fumarola, Gour Saha, Greg Senia, Haibo Yan, Hanisha Koneru, Hsin-Liang
Huang, Hu Ziqian, Istvan Fajth, Jack Bearden, Jason Lowe, Jeff Zhang, Jian
He, Jianchao Jia, Jiandan Yang , Jim Brennan, Jinglun, John Zhuge, Joseph
Fourny, K G Bakthavachalam, Karthik Palanisamy, Kihwal Lee, Kitti Nanasi,
Konstantin Shvachko, Lei (Eddy) Xu, LiXin Ge, Lokesh Jain, Lukas Majercak,
Miklos Szegedi, Mukul Kumar Singh, Namit Maheshwari, Nanda kumar, Nilotpal
Nandi, Pavel Avgustinov, Prabhu Joseph, Prasanth Jayachandran, Robert
Kanter, Rohith Sharma K S, Rushabh S Shah, Sailesh Patel, Sammi Chen, Sean
Mackrory, Sergey Shelukhin, Shane Kumpf, Shashikant Banerjee, Siyao Meng,
Sreenath Somarajapuram, Steve Loughran, Suma Shivaprasad, Sumana Sathish,
Sunil Govindan, Surendra Singh Lilhore, Szilard Nemeth, Takanobu Asanuma,
Tao Jie, Tao Yang, Ted Yu, Thomas Graves, Thomas Marquardt, Todd Lipcon,
Vinod Kumar Vavilapalli, Wangda Tan, Wei Yan, Wei-Chiu Chuang, Weiwei Yang,
Wilfred Spiegelenburg, Xiao Chen, Xiao Liang, Xintong Song, Xuan Gong, Yang
Wang, Yesha Vora, Yiqun Lin, Yiran Wu, Yongjun Zhang, Yuanbo Liu, Zian
Chen, Zoltan Haindrich, Zsolt Venczel, Zuoming Zhang, fang zhenyi, john
lilley, jwhitter, kyungwan nam, liaoyuxiangqin, liuhongtong, lujie, skrho,
yanghuafeng, yimeng, Íñigo Goiri.

Wangda Tan

[1] JIRA query: project in (YARN, HADOOP, MAPREDUCE, HDFS) AND resolution =
Fixed AND fixVersion = 3.1.1 ORDER BY key ASC, updated ASC, created DESC,
priority DESC

Re: [ANNOUNCE] New Apache Hadoop PMC: Yufei Gu

[Wangda Tan]

Congrats!

Best,
Wangda

On Wed, Aug 1, 2018 at 9:50 AM Mingliang Liu  wrote:

> Congrats, Yufei!
>
> On Tue, Jul 31, 2018 at 10:52 AM Robert Kanter  wrote:
>
> > Hi all,
> >
> > It is my great pleasure to announce that Yufei Gu has accepted the
> > invitation to become an Apache Hadoop PMC member.
> >
> > Please join me in congratulating him!
> >
> > thanks
> > - Robert
> >
> --
> Mingliang Liu
>

Re: [ANNOUNCE] New Apache Hadoop Committer: Shane Kumpf

[Wangda Tan]

Congrats!

Best,
Wangda

On Sun, May 13, 2018 at 6:50 PM, Naganarasimha Garla <
naganarasimha...@apache.org> wrote:

> Congratulations Shane !
>
> On Sun, May 13, 2018 at 7:10 PM, Sunil G  wrote:
>
> > Hearty Congratulations Shane!
> >
> > -Sunil
> >
> > On Sun 13 May, 2018, 03:00 jhe,  wrote:
> >
> > > Hi All
> > >
> > > It is my pleasure to announce that Shane Kumpf becomes a Hadoop
> > Committer.
> > > Please join me in congratulating Shane !
> > >
> > > Jian
> > >
> >
>

[ANNOUNCE] Apache Hadoop 3.1.0 release

[Wangda Tan]

Hi all,

It gives us great pleasure to announce that the Apache Hadoop community has
voted to release Apache Hadoop 3.1.0.

Hadoop 3.1.0 is the first minor release for the year 2018 in the Hadoop-3.x
line, and brings a number of enhancements.

IMPORTANT NOTES

   - This release is *not* yet ready for production use. Critical issues
   are being ironed out via testing and downstream adoption. Production
users
   should wait for a 3.1.1/3.1.2 release.

The Hadoop community fixed 768 JIRAs (
https://s.apache.org/apache-hadoop-3.1.0-all-tickets) in total as part of
the 3.1.0 release. Of these fixes:
   - 141 in Hadoop Common
   - 266 in HDFS
   - 329 in YARN
   - 32 in MapReduce

Apache Hadoop 3.1.0 contains a number of significant features and
enhancements. A few of
them are noted below.

Hadoop Common

   - HADOOP-14831 / HADOOP-14531 / HADOOP-14825 / HADOOP-14325.
S3/S3A/S3Guard related improvements.

Hadoop HDFS

   - HDFS-9806 - HDFS block replicas to be provided by an external storage
system

Hadoop YARN

   - YARN-6223. First class GPU support on YARN
   - YARN-5983. First class FPGA support on YARN
   - YARN-5079 / YARN-4793 / YARN-4757 / YARN-6419. YARN native service
support
   - YARN-6592. Rich placement constraints in YARN
   - YARN-5881. Enable configuration of queue capacity in terms of absolute
resources for Capacity Scheduler.
   - YARN-7117. Capacity Scheduler: Support auto-creation of leaf queues
while doing queue mapping


Please see the Hadoop 3.1.0 CHANGES (
http://hadoop.apache.org/docs/r3.1.0/hadoop-project-dist/hadoop-common/release/3.1.0/CHANGES.3.1.0.html)
for the detailed list of issues resolved.  The release news is posted on
the Apache Hadoop website too, you can go to the downloads section directly
(http://hadoop.apache.org/releases.html#Download)

Many thanks to everyone who contributed to the release, and everyone in the
Apache Hadoop community! The release is a result of direct and indirect
efforts from many contributors, listed below are the those who contributed
directly by submitting patches.

Aaron Fabbri, Aaron Gresch, Abdullah Yousufi, Ajay Kumar, Ajith S, Akhil
PB, Aki Tanaka, Akira Ajisaka, Alessandro Andrioni, Allen Wittenauer,
Andras Bokor, Andrew Wang, Anis Elleuch, Anu Engineer, Arpit Agarwal, Arun
Suresh, Atul Sikaria, BELUGA BEHR, Bharat Viswanadham, Bibin A Chunda,
Billie Rinaldi, Botong Huang, Brahma Reddy Battula, Carlo Curino, Chandni
Singh, Chang Li, Chao Sun, Charan Hebri, Chen Hongfei, Chen Liang, Chetna
Chaudhari, Chris Douglas, Da Ding, Daniel Templeton, Daryn Sharp, Devaraj
K, Dmitry Chuyko, Ekanth S, Elek,  Marton, Ellen Hui, Eric Badger, Eric
Payne, Eric Yang, Erik Krogen, Esther Kundin, Ewan Higgs, Gabor Bota,
Genmao Yu, Gera Shegalov, Gergely Novák, Gergo Repas, Gour Saha, Greg
Phillips, Grigori Rybkine, Haibo Chen, Haibo Yan, Hanisha Koneru, He
Xiaoqiao, Igor Dvorzhak, Jack Bearden, Jason Lowe, Jian He, Jiandan Yang,
Jianfei Jiang, Jim Brennan, Jinjiang Ling, Joe McDonnell, Johan Gustavsson,
Johannes Alberti, John Zhuge, Jonathan Eagles, Jonathan Hung, Jongyoul Lee,
Juan Rodríguez Hortalá, Junping Du, Kai Sasaki, Kannapiran Srinivasan,
Karthik Kambatla, Karthik Palaniappan, Karthik Palanisamy, Keqiu Hu, Kihwal
Lee, Konstantin Shvachko, Konstantinos Karanasos, Kuhu Shukla, Lei (Eddy)
Xu, LiXin Ge, Lokesh Jain, Lukas Majercak, Manikandan R, Manoj
Govindassamy, Masahiro Tanaka, Mikhail Erofeev, Miklos Szegedi, Ming Ma,
Mukul Kumar Singh, Nanda kumar, Nandor Kollar, Nishant Bangarwa, Oleg
Danilov, Panagiotis Garefalakis, PandaMonkey, Peter Bacsko, Ping Liu,
Prabhu Joseph, Rahul Pathak, Rajesh Balamohan, Ray Chiang, Remi Catherino,
Robert Kanter, Rohith Sharma K S, Rui Li, Rushabh S Shah, SammiChen,
Sampada Dehankar, Santhosh G Nayak, Sean Mackrory, Sean Po, Sen Zhao, Shane
Kumpf, Sharad Sonker, Shashikant Banerjee, Shawna Martell, Sivaguru
Sankaridurg, Soumabrata Chakraborty, Stephen ODonnell, Steve Loughran,
Steven Rand, Subru Krishnan, Suma Shivaprasad, Sunil G, Surendra Singh
Lilhore, Szilard Nemeth, Takanobu Asanuma, Tanuj Nayak, Tao Yang, Tarun
Parimi, Thejas M Nair, Thomas Marquard, Todd Lipcon, Tsz Wo Nicholas Sze,
Varada Hemeswari, Varun Saxena, Varun Vasudev, Vasudevan Skm, Vinayakumar
B, Vipin Rathor, Virajith Jalaparti, Vishwajeet Dusane, Wangda Tan, Wei
Yan, Weiwei Wu, Weiwei Yang, Wilfred Spiegelenburg, Xiao Chen, Xiao Liang,
Xiaoyu Yao, Xuan Gong, Yang Wang, Yeliang Cang, Yesha Vora, Yiqun Lin,
Yonger, Yongjun Zhang, Young Chen, Yu-Tang Lin, Yufei Gu, Zhankun Tang,
Zian Chen, Zsolt Venczel, chencan, fang zhenyi, hu xiaodong, kartheek
muthyala, liaoyuxiangqin, ligongyi, liuhongtong, lovekesh bansal, lufei,
lujie, maobaolong, shanyu zhao, tartarus, usharani, wangzhiyuan, wujinhu,
Íñigo Goiri.

Best,
Wangda Tan and Vinod Kumar Vavilapalli

Re: [ANNOUNCE] New Apache Hadoop PMC Member: Mingliang Liu

[Wangda Tan]

Congratulation, welcome aboard!

Thanks,
Wangda

On Fri, Sep 22, 2017 at 4:48 PM, Mingliang LIU  wrote:

> Thank you, Junping!
> On Fri, Sep 22, 2017 at 2:39 PM 俊平堵  wrote:
>
> > Hi All,
> >
> > It is my pleasure to announce that the Apache Hadoop PMC voted to add
> > Mingliang Liu as PMC member in recognition of his contributions to
> > Apache Hadoop project.
> >
> > Please join me in congratulating him!
> >
> >
> > Thanks,
> >
> > Junping
> >
>

Re: [ANNOUNCE] Anu Engineer added to the Apache Hadoop PMC

[Wangda Tan]

Congrats!

On Fri, Sep 15, 2017 at 2:38 PM, Ravi Prakash  wrote:

> Congratulations Anu! Thanks for bringing us Ozone! :-) Please keep up the
> great work!
>
> On Fri, Sep 15, 2017 at 1:53 PM, John Zhuge  wrote:
>
> > Congratulations Anu!!
> >
> > On Fri, Sep 15, 2017 at 1:19 PM, Junping Du  wrote:
> >
> > > Congrats, Anu!
> > >
> > > Thanks,
> > >
> > > Junping
> > > 
> > > From: Xiaoyu Yao 
> > > Sent: Friday, September 15, 2017 9:16 AM
> > > To: general@hadoop.apache.org
> > > Subject: [ANNOUNCE] Anu Engineer added to the Apache Hadoop PMC
> > >
> > > Hi All,
> > >
> > > It is my pleasure to announce that the Apache Hadoop PMC voted to add
> Anu
> > > Engineer as a PMC member in recognition of his continued contributions
> to
> > > the project.
> > >
> > > Congratulations, Anu!
> > >
> > > --Xiaoyu
> > > (on behalf of the Apache Hadoop Project Management Committee)
> > >
> > >
> > > -
> > > To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> > > For additional commands, e-mail: general-h...@hadoop.apache.org
> > >
> >
> >
> >
> > --
> > John
> >
>

Re: [ANNOUNCE] New Hadoop Committer: Chen Liang

[Wangda Tan]

Congrats!

On Fri, Sep 15, 2017 at 1:58 PM, Jing Zhao  wrote:

> Congratulations, Chen!
>
> On Fri, Sep 15, 2017 at 1:20 PM, Junping Du  wrote:
>
> > Congrats, Chen!
> >
> > Thanks,
> >
> > Junping
> > 
> > From: John Zhuge 
> > Sent: Friday, September 15, 2017 11:10 AM
> > To: Ajay Kumar
> > Cc: Xiaoyu Yao; general@hadoop.apache.org
> > Subject: Re: [ANNOUNCE] New Hadoop Committer: Chen Liang
> >
> > Congratulations Chen Liang!
> >
> > On Fri, Sep 15, 2017 at 11:07 AM, Ajay Kumar  >
> > wrote:
> >
> > > Congrats Chen!!
> > >
> > > On 9/15/17, 9:13 AM, "Xiaoyu Yao"  wrote:
> > >
> > > Hi All,
> > >
> > > It is my pleasure to announce that the Apache Hadoop PMC voted to
> add
> > > Chen Liang as a committer in recognition of his continued contributions
> > to
> > > the project.
> > > Please join me in congratulating Chen!
> > >
> > > Best regards,
> > > --Xiaoyu
> > > (on behalf of the Apache Hadoop Project Management Committee)
> > >
> > >
> > >
> > >
> > > -
> > > To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> > > For additional commands, e-mail: general-h...@hadoop.apache.org
> > >
> >
> >
> >
> > --
> > John
> >
> >
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: general-h...@hadoop.apache.org
> >
> >
>

Re: Re: [ANNOUNCE] Xiao Chen, Wei-Chiu Chuang, and John Zhuge as a new PMC members

[Wangda Tan]

Congrats Xiao/Wei-Chiu/John!

- Wangda

On Wed, Aug 30, 2017 at 9:48 AM, Andrew Wang 
wrote:

> Congrats Xiao, Wei-Chiu, John!
>
> On Wed, Aug 30, 2017 at 1:19 AM, JH Lin  wrote:
>
> > congrats and well deserved
> >
> >
> >
> >
> >
> >
> > 在2017年08月30 16时03分, "Sunil Govind"写道:
> >
> > Congratulations Xiao, Wei-Chiu and John!
> >
> > - Sunil
> >
> >
> > On Wed, Aug 30, 2017 at 9:22 AM Yongjun Zhang 
> > wrote:
> >
> > > Hi All,
> > >
> > > It is my pleasure to announce that the Apache Hadoop PMC voted to add
> > > Xiao Chen, Wei-Chiu Chuang and John Zhuge as PMC members in recognition
> > of
> > > their contributions to Apache Hadoop.
> > >
> > > Please join me in congratulating them!
> > >
> > > Best regards,
> > >
> > > --Yongjun
> > >
> >
>

Re: [ANNOUNCE] Daniel Templeton as a new PMC member

[Wangda Tan]

Congrats!

On Fri, Aug 25, 2017 at 12:55 PM, Lei Xu  wrote:

> Congratulation, Daniel!
>
> On Fri, Aug 25, 2017 at 12:54 PM, Robert Kanter 
> wrote:
> > Hi All,
> > It is my pleasure to announce that the Apache Hadoop PMC voted to add
> > Daniel Templeton as a PMC member in recognition of his contributions to
> > Apache Hadoop.
> >
> > Please join me in congratulating Daniel!
> >
> > - Robert
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> -
> To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: general-h...@hadoop.apache.org
>
>

Re: [ANNOUNCE] Ray Chiang as a new PMC member

[Wangda Tan]

Congrats!

On Fri, Aug 25, 2017 at 12:56 PM, Lei Xu  wrote:

> Congratulation, Ray!
>
> On Fri, Aug 25, 2017 at 12:54 PM, Robert Kanter 
> wrote:
> > Hi All,
> > It is my pleasure to announce that the Apache Hadoop PMC voted to add
> > Ray Chaing as a PMC member in recognition of his contributions to
> > Apache Hadoop.
> >
> > Please join me in congratulating Ray!
> >
> > - Robert
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> -
> To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: general-h...@hadoop.apache.org
>
>

[ANNOUNCE] New Hadoop Committer - Wei Yan

[Wangda Tan]

It is my pleasure to announce that Wei Yan has been elected as a
committer on the Apache Hadoop project. We appreciate his contributions to
Hadoop thus far, and look forward to more.

Please join me in congratulating Wei!

Regards,
Wangda Tan on behalf of the Apache Hadoop PMC

Re: [ANNOUNCE] Naganarasimha G R as a new PMC member

[Wangda Tan]

Congrats!

- Wangda

On Mon, Aug 14, 2017 at 11:37 PM, Yufei Gu  wrote:

> Congratulations Naga!
>
> Best,
>
> Yufei
>
> On Mon, Aug 14, 2017 at 9:03 PM, Sangjin Lee  wrote:
>
> > Congratulations Naga!
> >
> > On Mon, Aug 14, 2017 at 7:36 PM, Sunil Govind 
> > wrote:
> >
> > > Hearty congrats Naga!
> > >
> > > - Sunil
> > >
> > >
> > > On Tue 15 Aug, 2017, 05:52 Devaraj K,  wrote:
> > >
> > > > Hi All,
> > > > It is my pleasure to announce that the Apache Hadoop PMC voted to add
> > > > Naganarasimha G R as a PMC member in recognition of his contributions
> > to
> > > > Apache Hadoop.
> > > >
> > > > Please join me in congratulating Naga!
> > > >
> > > > --
> > > >
> > > >
> > > > Thanks
> > > > Devaraj K
> > > >
> > >
> >
>

[ANNOUNCE] Sunil Govind as a new PMC member

[Wangda Tan]

Hi everyone,

It is my pleasure to announce that the Apache Hadoop PMC has voted to add
Sunil Govind as a PMC member. This is in recognition of Sunil's many
contributions to the Hadoop community.

Please join me in congratulating Sunil!

Regards,
Wangda

Re: [ANNOUNCE] Eric Payne added to the Apache Hadoop PMC

[Wangda Tan]

Congrats, Eric! Welcome aboard!

- Wangda

On Tue, Jul 25, 2017 at 2:55 PM, Eric Badger 
wrote:

> Congrats, Eric!
>
> On Tuesday, July 25, 2017 4:09 PM, Jason Lowe
>  wrote:
>
>
>  It is my pleasure to announce that the Apache Hadoop PMC voted to add
> Eric Payne as a member in recognition of his contributions to Apache Hadoop.
> Congratulations, Eric!
> Jason
>
>
>
>

Re: [ANNOUNCE] New Hadoop Committer - Haibo Chen

[Wangda Tan]

Congratulations Haibo!

Thanks,
Wangda

On Thu, Apr 13, 2017 at 6:32 PM, Sangjin Lee  wrote:

> Congratulations Haibo!
>
> On Thu, Apr 13, 2017 at 6:21 PM, Junping Du  wrote:
>
> > Congrats, Haibo!
> >
> > Thanks,
> >
> > Junping
> > 
> > From: Robert Kanter 
> > Sent: Thursday, April 13, 2017 5:37 PM
> > To: general@hadoop.apache.org
> > Subject: [ANNOUNCE] New Hadoop Committer - Haibo Chen
> >
> > Hi,
> >
> > I am very pleased to announce that Haibo Chen has been
> > elected as a committer on the Apache Hadoop project
> > recognizing his continued contributions to the project so far.
> >
> > Congrats!
> >
> > - Robert Kanter
> > (On behalf of the Apache Hadoop PMC)
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: general-h...@hadoop.apache.org
> >
> >
>

Re: [ANNOUNCE] New committer: Konstantinos Karanasos

[Wangda Tan]

Congrats! Welcome aboard!

Best,
Wangda

On Fri, Jan 20, 2017 at 4:52 PM, Chris Douglas  wrote:

> The Apache Hadoop PMC voted to add Konstantinos Karanasos as a
> committer on the project. This recognizes his many contributions to
> YARN, particularly scheduling opportunistic containers in distributed
> and centralized configurations.
>
> Congratulations Konstantinos! -C
>
> -
> To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: general-h...@hadoop.apache.org
>
>

[ANNOUNCE] New PMC member Li Lu

[Wangda Tan]

Hi everyone,

I'm very pleased to announce that the Apache Hadoop PMC has voted to add
Li Lu as a PMC member. This is in recognition of Li's many contributions to
the Hadoop community.

Congratulations Li! Great work!

Best,
Wangda Tan

Re: [ANNOUNCE] New Apache Hadoop PMC member Varun Vasudev

[Wangda Tan]

Congrats!

Best,
Wangda

On Fri, Nov 11, 2016 at 7:38 AM, Junping Du  wrote:

> Congratulations, Varun! Well deserved!
>
> Thanks,
>
> Junping
> 
> From: Shane Kumpf 
> Sent: Friday, November 11, 2016 1:03 PM
> To: general@hadoop.apache.org
> Subject: Re: [ANNOUNCE] New Apache Hadoop PMC member Varun Vasudev
>
> Congrats, Varun!
>
> On Thu, Nov 10, 2016 at 7:09 PM, Brahma Reddy Battula <
> brahmareddy.batt...@huawei.com> wrote:
>
> >
> > Congratulations Varun Vasudev!!!
> >
> >
> >
> > Regards
> > Brahma Reddy Battula
> >
> > -Original Message-
> > From: Jian He [mailto:j...@hortonworks.com]
> > Sent: 11 November 2016 01:31
> > To: general@hadoop.apache.org
> > Subject: [ANNOUNCE] New Apache Hadoop PMC member Varun Vasudev
> >
> > Hi everyone,
> >
> > I'm very pleased to announce that the Apache Hadoop PMC has voted to add
> > Varun Vasudev as a PMC member. This is in recognition of Varun's many
> > contributions to the Hadoop community.
> >
> > Congratulations Varun!
> >
> > Thanks,
> > Jian
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: general-h...@hadoop.apache.org
> >
> >
> > -
> > To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: general-h...@hadoop.apache.org
> >
> >
>
> -
> To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: general-h...@hadoop.apache.org
>
>

Re: [ANNOUNCE] New Apache Hadoop PMC member Zhe Zhang

[Wangda Tan]

Congratulations!
Best, Wangda

Sent from my iPhone
On Wed, Nov 9, 2016 at 7:13 PM, Rakesh Radhakrishnan  
wrote:

Congratulations Zhe!

Regards,
Rakesh

On Thu, Nov 10, 2016 at 8:40 AM, Sunil Govind 
wrote:

> Congratulations Zhe!
>
> -Sunil
>
> On Thu, Nov 10, 2016 at 12:03 AM Andrew Wang 
> wrote:
>
> > Hi everyone,
> >
> > I'm very pleased to announce that the Apache Hadoop PMC has voted to 
add

> > Zhe Zhang as a PMC member. This is in recognition of Zhe's many
> > contributions to the Hadoop community.
> >
> > Congratulations Zhe! Great work!
> >
> > Best,
> > Andrew
> >
>

Re: [ANNOUNCE] New PMC member Ming Ma

[Wangda Tan]

Congratulations Ming!
Regards, Wangda

Sent from my iPhone
On Wed, Nov 9, 2016 at 4:31 PM, Jing Zhao  wrote:
Congratulations Ming!

Thanks,
-Jing

On Wed, Nov 9, 2016 at 4:21 PM, Brahma Reddy Battula <
brahmareddy.batt...@hotmail.com> wrote:

> Congratulations Ming Ma!!
>
>
>
>
>
> Thanks And Regards
> Brahma Reddy Battula
>
>
> 
> From: Andrew Wang 
> Sent: Thursday, November 10, 2016 2:32 AM
> To: general@hadoop.apache.org
> Subject: [ANNOUNCE] New PMC member Ming Ma
>
> Hi everyone,
>
> I'm very pleased to announce that the Apache Hadoop PMC has voted to add
> Ming Ma as a PMC member. This is in recognition of Ming's many
> contributions to the Hadoop community.
>
> Congratulations Ming! Great work!
>
> Best,
> Andrew
>

[ANNOUNCE] New Apache Hadoop Committer - Sunil Govind

[Wangda Tan]

(bcc: general@ - please avoid copying the list on any responses)

On behalf of the Apache Hadoop PMC, it is my pleasure to announce that
Sunil Govind has been elected to be a committer thanks to his sustained
contributions.

Please join me in congratulating him.

Congrats Sunil!

Best,
Wangda Tan

(On behalf of the Hadoop PMC)

Re: [ANNOUNCE] New Hadoop Committers - Xiao Chen and Wei-Chiu Chuang

[Wangda Tan]

Congratulations!

Best regards,
Wangda

On Fri, Jul 22, 2016 at 2:03 PM, Wei-Chiu Chuang  wrote:

> Thanks everyone. Hey, Xiao you stole my line :)
>
>
> On Fri, Jul 22, 2016 at 1:58 PM, Xiao Chen  wrote:
>
> > Thanks all for the wishes, and congrats Wei-Chiu!
> > I love open source. :)
> >
> > -Xiao
> >
> > On Fri, Jul 22, 2016 at 11:54 AM, Varun Saxena 
> > wrote:
> >
> >> Congratulations, Xiao and Wei-Chiu!
> >>
> >> - Varun.
> >>
> >> On Sat, Jul 23, 2016 at 12:18 AM, Eric Payne <
> >> eric.payne1...@yahoo.com.invalid> wrote:
> >>
> >> > Congratulations! Well done
> >> >
> >> >   From: Yongjun Zhang 
> >> >  To: general@hadoop.apache.org
> >> >  Sent: Wednesday, July 20, 2016 12:26 PM
> >> >  Subject: [ANNOUNCE] New Hadoop Committers - Xiao Chen and Wei-Chiu
> >> Chuang
> >> >
> >> > Hi,
> >> >
> >> > I am pleased to announce that Xiao Chen and Wei-Chiu Chuang have been
> >> > elected committers on the Apache Hadoop project.  Thanks them a lot
> for
> >> > their nice work and look forward to their continued contributions!
> >> >
> >> > Best,
> >> >
> >> > --Yongjun Zhang
> >> > (On behalf of the Apache Hadoop PMC)
> >> >
> >> >
> >> >
> >> >
> >>
> >
> >
>

Re: [ANNOUNCE] New Hadoop Committer - Varun Saxena

[Wangda Tan]

Congratulations Varun! Welcome aboard!

Thanks,

Sent from my iPhone

> On Jun 24, 2016, at 1:19 PM, Eric Payne  
> wrote:
> 
> Congratulations Varun!
> 
>  From: 俊平堵 
> To: general@hadoop.apache.org 
> Cc: varunsax...@apache.org
> Sent: Friday, June 24, 2016 1:51 PM
> Subject: [ANNOUNCE] New Hadoop Committer - Varun Saxena
> 
> On behalf of the Apache Hadoop PMC, I am pleased to announce that Varun
> Saxena
> has been elected a committer on the Apache Hadoop project.  We appreciate
> all
> of Varun's hard work thus far, and we look forward to his continued
> contributions.
> 
> Congratulations, Varun!
> 
> 
> Cheers,
> 
> Junping
> 
> 

-
To unsubscribe, e-mail: general-unsubscr...@hadoop.apache.org
For additional commands, e-mail: general-h...@hadoop.apache.org

Re: [ANNOUNCE] New Hadoop Committer - Larry McCay

[Wangda Tan]

Congratulations Larry!

- Wangda

On Wed, Apr 13, 2016 at 7:49 AM, Sean Busbey  wrote:

> congrats Larry!
>
> On Wed, Apr 13, 2016 at 12:57 AM, Chris Nauroth
>  wrote:
> > On behalf of the Apache Hadoop PMC, I am pleased to announce that Larry
> > McCay has been elected a committer on the Apache Hadoop project.  We
> > appreciate all of Larry's hard work thus far, and we look
> > forward to his continued contributions.
> >
> > Congratulations, Larry!
> >
> >
> > --Chris Nauroth
> >
>
>
>
> --
> busbey
>

Re: [ANNOUNCE] New Hadoop PMC Member - Sangjin Lee

[Wangda Tan]

Congrats Sangjin! Welcome aboard.

- Wangda

On Wed, Apr 13, 2016 at 9:54 AM, Ming Ma  wrote:

> Congrats Sangjin!
>
> On Tue, Apr 12, 2016 at 11:03 PM, Chris Nauroth 
> wrote:
>
> > On behalf of the Apache Hadoop PMC, I am very pleased to announce that
> > Sangjin Lee has been elected as a PMC Member on the Apache Hadoop
> project,
> > recognizing his continued contributions to the project so far.
> >
> > Please join me in congratulating Sangjin!
> >
> > --Chris Nauroth
> >
> >
>

[ANNOUNCE] New Hadoop Committer - Naganarasimha Garla

[Wangda Tan]

On behalf of the Apache Hadoop PMC, I am pleased to announce
that Naganarasimha Garla has been elected a committer on the Apache Hadoop
project.  We appreciate all of Naga's hard work thus far, and we look
forward to his continued contributions.

Welcome onboard and congratulations, Naga!

Thanks,
Wangda Tan

Re: [ANNOUNCE] Yongjun Zhang added to the Apache Hadoop PMC

[Wangda Tan]

Congratulations!

On Mon, Feb 29, 2016 at 8:43 AM, Sangjin Lee  wrote:

> Congratulations!
>
> On Mon, Feb 29, 2016 at 8:39 AM, Arun Suresh  wrote:
>
> > Hearty congratulations Yongjun !!
> > On Feb 28, 2016 11:51 PM, "Aaron T. Myers"  wrote:
> >
> > > On behalf of the Apache Hadoop PMC, I am very pleased to announce that
> > > Yongjun Zhang has been elected as a PMC member on the Apache Hadoop
> > > project. This is in recognition of Yongjun's sustained and significant
> > > contributions to the project, and we look forward to even more
> > > contributions from him in the future.
> > >
> > > Please join me in congratulating Yongjun on this accomplishment.
> > >
> > > Great work, Yongjun.
> > >
> > > Best,
> > > Aaron, on behalf of the Apache Hadoop PMC
> > >
> >
>

Re: [ANNOUNCE] New Hadoop Committer - Li Lu

[Wangda Tan]

Congrats! Welcome aboard.

Regards,
Wangda

On Mon, Feb 22, 2016 at 2:23 PM, Junping Du  wrote:

> On behalf of the Apache Hadoop PMC, I am pleased to announce that Li Lu
> has been elected a committer on the Apache Hadoop project.  We appreciate
> all of Li's hard work thus far, and we look forward to his continued
> contributions.
>
> Welcome onboard and congratulations, Li!
>
> Thanks,
>
> Junping?
>
>

Re: [ANNOUNCE] New Hadoop Committer - Eric Payne

[Wangda Tan]

Congrats and welcome!

Best regards,
Wangda

Sent from my iPhone

> On Feb 11, 2016, at 11:52 PM, Jason Lowe  wrote:
> 
> On behalf of the Apache Hadoop PMC, I am pleased to announce that Eric Payne 
> has been elected a committer on the Apache Hadoop project.  We appreciate all 
> of Eric's hard work thus far, and we look forward to his continued 
> contributions.
> 
> Welcome and congratulations, Eric!
> 
> Jason

Re: [ANNOUNCE] New Hadoop Committer - Masatake Iwasaki

[Wangda Tan]

Congratulations Masatake!

Regards,
Wangda

On Thu, Jan 28, 2016 at 2:40 PM, Chris Nauroth 
wrote:

> Congratulations, and welcome!
>
> --Chris Nauroth
>
>
>
>
> On 1/27/16, 6:37 PM, "Tsuyoshi OZAWA" 
> wrote:
>
> >On behalf of the Apache Hadoop PMC, I am pleased to announce that
> >Masatake Iwasaki has been elected as a committer on the Apache Hadoop
> >project. We appreciate all of Masatake's hard work thus far, and we
> >look forward to his continued contributions.
> >
> >Welcome Masatake!
> >
> >Regards,
> >- Tsuyoshi
> >
>
>

Re: [ANNOUNCE] New Apache Hadoop PMC - Yi Liu

[Wangda Tan]

Congratulations, Yi!

Regards,
Wangda

On Thu, Nov 19, 2015 at 8:16 PM, Tsuyoshi Ozawa  wrote:

> Congratulations, Yi!
>
> - Tsuyoshi
>
> On Fri, Nov 20, 2015 at 1:01 PM, Rakesh Radhakrishnan
>  wrote:
> > Congratulations, Yi !
> >
> > Best,
> > Rakesh
> >
> > On Fri, Nov 20, 2015 at 9:11 AM, Vinayakumar B 
> > wrote:
> >
> >> Congratulations Yi
> >>
> >> -vinay
> >> On Nov 20, 2015 8:48 AM, "Zhihai Xu"  wrote:
> >>
> >> > Congratulations, Yi Liu!
> >> >
> >> > zhihai
> >> >
> >> > On Thu, Nov 19, 2015 at 6:55 PM, Lei Xu  wrote:
> >> >
> >> > > Congratulation, Yi!
> >> > >
> >> > > On Fri, Nov 20, 2015 at 10:44 AM, Uma gangumalla <
> umamah...@apache.org
> >> >
> >> > > wrote:
> >> > > > On behalf of the Apache Hadoop PMC, I am very pleased to announce
> >> that
> >> > > > Yi Liu has been elected as a  PMC Member on the Apache Hadoop
> project
> >> > > > recognizing
> >> > > > his continued contributions to the project so far.
> >> > > >
> >> > > >  Please join me in congratulating Yi!
> >> > > >
> >> > > > Regards,
> >> > > > Uma Maheswara Rao Gangumalla
> >> > > > (on behalf of the Apache Hadoop Project Management Committee)
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > Lei (Eddy) Xu
> >> > > Software Engineer, Cloudera
> >> > >
> >> >
> >>
>

Re: [ANNOUNCE] New Apache Hadoop committer Zhe Zhang

[Wangda Tan]

Congratulations Zhe, welcome aboard!

Regards,
Wangda

On Wed, Oct 21, 2015 at 9:13 AM, Yongjun Zhang  wrote:

> Congratulations Zhe!
>
> --Yongjun
>
>
> On Wed, Oct 21, 2015 at 8:29 AM, Tsuyoshi Ozawa  wrote:
>
> > Congrats, Zhe Zhang! Welcome :-)
> >
> > - Tsuyoshi
> >
> > On Tue, Oct 20, 2015 at 11:18 PM, Joep Rottinghuis
> >  wrote:
> > > Congrats Zhe!
> > >
> > > Joep
> > >
> > > Sent from my iPhone
> > >
> > >> On Oct 19, 2015, at 7:42 PM, Rohith Sharma K S <
> > rohithsharm...@huawei.com> wrote:
> > >>
> > >> Congratulations 'Zhe Zhang'!
> > >>
> > >> -Original Message-
> > >> From: Andrew Wang [mailto:andrew.w...@cloudera.com]
> > >> Sent: 20 October 2015 02:26
> > >> To: general@hadoop.apache.org
> > >> Subject: [ANNOUNCE] New Apache Hadoop committer Zhe Zhang
> > >>
> > >> Hi all,
> > >>
> > >> It is my pleasure to welcome Zhe Zhang as an Apache Hadoop committer.
> > Zhe has been working on the project for over a year now, notably on the
> > HDFS erasure coding feature (HDFS-7285) as well as other bug fixes and
> > improvements.
> > >>
> > >> Please join me in congratulating Zhe!
> > >>
> > >> Best,
> > >> Andrew
> >
>

Re: [ANNOUNCE] New Hadoop Committer - Sangjin Lee

[Wangda Tan]

Congrats, Sangjin!

Regards,
Wangda

On Wed, Sep 30, 2015 at 9:47 PM, Chris Nauroth 
wrote:

> Congratulations, Sangjin!
>
> --Chris Nauroth
>
>
>
>
> On 9/30/15, 5:17 PM, "Karthik Kambatla"  wrote:
>
> >[bcc: general@, please bcc: (and not cc:) general@ if you want to
> include]
> >
> >On behalf of the Apache Hadoop PMC, I am very pleased to announce that
> >Sanjin Lee has been elected a committer on the Apache Hadoop project
> >recognizing his continued contributions to the project.
> >
> >Sangjin is already a branch committer on YARN-2928 and can hit the ground
> >running :)
> >
> >Welcome Sangjin!
> >
> >Cheers!
>
>

Re: [ANNOUNCE] New Hadoop Committer - Anubhav dhoot

[Wangda Tan]

Congrats, Anubhav!

Regards,
Wangda

On Wed, Sep 23, 2015 at 11:21 AM, Bikas Saha  wrote:

> Congrats!
>
> Bikas
>
> -Original Message-
> From: Vinod Vavilapalli [mailto:vino...@hortonworks.com]
> Sent: Wednesday, September 23, 2015 11:14 AM
> To: general@hadoop.apache.org
> Cc: Anubhav Dhoot 
> Subject: Re: [ANNOUNCE] New Hadoop Committer - Anubhav dhoot
>
> Welcome aboard, Anubhav. Keep up the good work!
>
> +Vinod
>
> > On Sep 20, 2015, at 9:56 PM, Karthik Kambatla 
> wrote:
> >
> > On behalf of the Apache Hadoop PMC, I am pleased to announce that
> > Anubhav Dhoot has been elected a committer on the Apache Hadoop
> > project recognizing his contributions to the project.
> >
> > We appreciate Anubhav's hard work thus far, and and look forward to
> > his contributions.
> >
> > Welcome Anubhav!
> >
> > Cheers!
>
>
>

Re: [ANNOUNCE] Welcoming Devaraj K to Apache Hadoop PMC

[Wangda Tan]

Congrats, Devaraj!

Regards,
Wangda

On Fri, Aug 7, 2015 at 8:28 AM, Zhijie Shen zs...@hortonworks.com wrote:

 Congrats, Devaraj!

 - Zhijie
 
 From: Kiran Kumar.M.R kiran.kumar...@huawei.com
 Sent: Thursday, August 06, 2015 10:31 PM
 To: general@hadoop.apache.org
 Subject: RE: [ANNOUNCE] Welcoming Devaraj K to Apache Hadoop PMC

 Congrats Deva!


 Regards,
 Kiran

 __
 This e-mail and its attachments contain confidential information from
 HUAWEI, which is intended only for the person or entity whose address is
 listed above. Any use of the information contained herein in any way
 (including, but not limited to, total or partial disclosure, reproduction,
 or dissemination) by persons other than the intended recipient(s) is
 prohibited. If you receive this e-mail in error, please notify the sender
 by phone or email immediately and delete it!

 __




  -Original Message-
  From: umaganguma...@gmail.com [mailto:umaganguma...@gmail.com] On
  Behalf Of Uma gangumalla
  Sent: Thursday, August 06, 2015 05:27
  To: general@hadoop.apache.org
  Subject: [ANNOUNCE] Welcoming Devaraj K to Apache Hadoop PMC
 
  Hi,
 
   On behalf of the Apache Hadoop Project Management Committee (PMC), it
  gives me great pleasure to announce that Devaraj K is recently welcomed
  to join as a member of Apache Hadoop PMC. He has done lot of good work
  to hadoop and looking forward to his greater achievements in the future!
 
  Please join me in welcoming Deva to Hadoop PMC!
 
  Congratulations Deva!
 
 
  Regards,
  Uma  (On behalf of the Apache Hadoop Project Management Committee)

Re: [ANNOUNCE] Welcoming Junping Du to Apache Hadoop PMC

[Wangda Tan]

Congrats Junping!

Regards,
Wangda

On Thu, Jul 9, 2015 at 7:47 PM, Binglin Chang decst...@gmail.com wrote:

 Congrats Junping!

 On Thu, Jul 9, 2015 at 5:23 AM, Naganarasimha G R (Naga) 
 garlanaganarasi...@huawei.com wrote:

  Congrats Junping !
  
  From: Vrushali Channapattan [vrushal...@gmail.com]
  Sent: Wednesday, July 08, 2015 01:33
  To: general@hadoop.apache.org
  Cc: junping...@apache.org; vino...@apache.org
  Subject: Re: [ANNOUNCE] Welcoming Junping Du to Apache Hadoop PMC
 
  Congratulations Junping!
 
  On Tue, Jul 7, 2015 at 12:49 PM, Vinod Kumar Vavilapalli
  vino...@apache.org wrote:
   Hi all,
  
   It gives me great pleasure to announce that Junping Du is welcomed to
  join
   as a member of Apache Hadoop PMC. Here's appreciating all his work so
 far
   into the project and looking forward to greater achievements in the
  future!
  
   Please join me in welcoming Junping to Hadoop PMC!
  
   Congratulations Junping!
  
   Thanks,
   +Vinod
   On behalf of the Apache Hadoop PMC
 

Re: [ANNOUNCE] Welcoming Xuan Gong to Apache Hadoop PMC

[Wangda Tan]

Congrats Xuan!

Regards,
Wangda

On Wed, Jul 8, 2015 at 2:22 PM, Naganarasimha G R (Naga) 
garlanaganarasi...@huawei.com wrote:

 Congrats Xuan !
 
 From: Devaraj K [deva...@apache.org]
 Sent: Wednesday, July 08, 2015 10:10
 To: general@hadoop.apache.org
 Subject: Re: [ANNOUNCE] Welcoming Xuan Gong to Apache Hadoop PMC

 Congrats Xuan!

 On Wed, Jul 8, 2015 at 8:14 AM, Brahma Reddy Battula 
 brahmareddy.batt...@hotmail.com wrote:

  Congratulations Xuan!
   Date: Tue, 7 Jul 2015 17:43:20 -0700
   Subject: Re: [ANNOUNCE] Welcoming Xuan Gong to Apache Hadoop PMC
   From: g...@shegalov.com
   To: general@hadoop.apache.org
   CC: jeffgx...@gmail.com
  
   Congratulations, Xuan!
  
   On Tue, Jul 7, 2015 at 5:18 PM, Liu, Yi A yi.a@intel.com wrote:
  
Congratulations, Xuan Gong!
   
Regards,
Yi Liu
   
   
-Original Message-
From: Vinod Kumar Vavilapalli [mailto:vino...@apache.org]
Sent: Wednesday, July 08, 2015 3:50 AM
To: general@hadoop.apache.org
Cc: jeffgx...@gmail.com; vino...@apache.org
Subject: [ANNOUNCE] Welcoming Xuan Gong to Apache Hadoop PMC
   
Hi all,
   
It gives me great pleasure to announce that Xuan Gong is welcomed to
  join
as a member of Apache Hadoop PMC. Here's appreciating all his work so
  far
into the project and looking forward to greater achievements in the
  future!
   
Please join me in welcoming Xuan to Hadoop PMC!
   
Congratulations Xuan!
   
Thanks,
+Vinod
On behalf of the Apache Hadoop PMC
   
 
 



 --


 Thanks
 Devaraj K

Re: [ANNOUNCE] New Hadoop Committer - Rohith Sharma K S

[Wangda Tan]

Congrats Rohith!

Regards,
Wangda

On Wed, Jul 8, 2015 at 12:14 PM, Naganarasimha G R (Naga) 
garlanaganarasi...@huawei.com wrote:

 Congrats Rohith!
 
 From: Varun Vasudev [vvasu...@apache.org]
 Sent: Thursday, July 09, 2015 00:09
 To: general@hadoop.apache.org
 Cc: Rohith Sharma
 Subject: Re: [ANNOUNCE] New Hadoop Committer - Rohith Sharma K S

 Congratulations Rohith!

 -Varun




 On 7/8/15, 1:54 AM, Jian He j...@hortonworks.com wrote:

 On behalf of the Apache Hadoop PMC, I am pleased to announce that Rohith
 Sharma K S
 has been elected as a committer on the Apache Hadoop project.  We
 appreciate all of Rohith’s hard work thus far, and we look forward to his
 continued contributions.
 
 Thanks,
 Jian He