[ANNOUNCE] New Hadoop PMC member - Mukund Thakur

and welcome, Mukund ! -Vinayakumar B -- -Vinay

Re: [DISCUSS] Race condition in ProtobufRpcEngine2

Call.toString() was used only while sending the response, in the response processor thread. At this point, header would be already read and processed. So no chance of race conditions. This race condition was not introduced by the HADOOP-17046 ,

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

+1 (Binding) 1. Built from Tag. 2. Successful Native Build on Ubuntu 20.04 3. Verified Checksums 4. Deployed the docker cluster with 3 nodes 5. Ran sample MR Jobs -Vinay On Sat, Jun 12, 2021 at 6:40 PM Ayush Saxena wrote: > +1, > Built from Source. > Successful Native Build on Ubuntu 20.04 >

Re: [DISCUSS] Hadoop 3.3.1 release

Hi David, >> Still hoping for help here: >> https://issues.apache.org/jira/browse/HDFS-15790 I will raise a PR for the said solution soon (in a day or two). -Vinay On Thu, 11 Mar 2021 at 5:39 AM, David wrote: > Hello, > > Still hoping for help here: > >

Re: Wire compatibility between Hadoop 3.x client and 2.x server

iled jira https://issues.apache.org/jira/browse/HDFS-15660 for details > > > 2020年10月28日 17:08，Vinayakumar B 写道： > > Hi Wu,Jianliang, > Have you created the Jira for the issue you mentioned due to > getContentSummary? > > I might have a fix for this. Of-course it needs t

Re: Wire compatibility between Hadoop 3.x client and 2.x server

Hi Wu,Jianliang, Have you created the Jira for the issue you mentioned due to getContentSummary? I might have a fix for this. Of-course it needs to be applied both client and server side. Let me know. -Vinay On Wed, Oct 14, 2020 at 12:26 PM Wu,Jianliang(vip.com) < jianliang...@vipshop.com>

Re: [VOTE] Moving Ozone to a separated Apache project

+1 -Vinay On Fri, 25 Sep 2020 at 6:22 PM, Lin, Yiqun wrote: > +1. > > > > Thanks, > > Yiqun > > > > On 2020/9/25, 2:08 PM, "Elek, Marton" wrote: > > > > External Email > > > > Hi all, > > > > Thank you for all the feedback and requests, > > > > As we discussed in the previous

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Apologies for delayed voting. +1 (Binding) 1. Verified the signature. Signatures are good. 2. Verified the sha512 checksum (I tried to use the sha512sum tool to verify. But ".sha512" files doesn't have the expected format. I guess these files are regenerated using "gpg --print-md",

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

+1 (Binding) -Verified all checksums and Signatures. -Verified site, Release notes and Change logs + May be changelog and release notes could be grouped based on the project at second level for better look (this needs to be supported from yetus) -Tested in x86 local 3-node docker cluster. +

[jira] [Created] (YARN-10314) YarnClient throws NoClassDefFoundError for WebSocketException with only shaded client jars

Vinayakumar B created YARN-10314: Summary: YarnClient throws NoClassDefFoundError for WebSocketException with only shaded client jars Key: YARN-10314 URL: https://issues.apache.org/jira/browse/YARN-10314

Re: [NOTICE] Removal of protobuf classes from Hadoop Token's public APIs' signature

rotocolPB/StorageContainerLocationProtocolClientSideTranslatorPB.java:[116,47] > > incompatible types: com.google.protobuf.ServiceException cannot be > > converted to org.apache.hadoop.thirdparty.protobuf.ServiceException > > 17:01:19 2020/04/16 00:01:19 INFO: [INFO] 2 errors > > > > > > There's anoth

Re: [DISCUSS] making Ozone a separate Apache project

+1 -Vinay On Thu, 14 May 2020, 12:20 pm Surendra Singh Lilhore, < surendralilh...@gmail.com> wrote: > +1 > > -Surendra > > > On Thu, 14 May, 2020, 9:30 am yisheng lien, wrote: > > > +1 > > > > Thank you Marton for the detailed description. > > > > > > Wanqiang Ji 於 2020年5月14日 週四 上午11:27 寫道： >

Re: [RESULT] [VOTE] Release Apache Hadoop Thirdparty 1.0.0 - RC1

Thanks brahma. So total 5 +1s (4 binding, 1 non-binding). Done with pushing bits. Should get mirrored in next 24 hours. -Vinay On Thu, Mar 19, 2020 at 12:55 AM Brahma Reddy Battula wrote: > > My late +1.. I missed this.. > > > On Thu, 19 Mar 2020 at 12:43 AM, Vinayak

[RESULT] [VOTE] Release Apache Hadoop Thirdparty 1.0.0 - RC1

trunk with hadoop-thirdparty 1.0.0 >> - Checked rat files and documents >> - Checked LICENSE and NOTICE files >> >> Thanks, >> Akira >> >> On Thu, Mar 12, 2020 at 5:26 AM Vinayakumar B >> wrote: >> >> > Hi folks, >> &g

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

Making ARM artifact optional, makes the release process simpler for RM and unblocks release process (if there is unavailability of ARM resources). Still there are possible options to collaborate with RM ( as brahma mentioned earlier) and provide ARM artifact may be before or after vote. If

[VOTE] Release Apache Hadoop Thirdparty 1.0.0 - RC1

Hi folks, Thanks to everyone's help on this release. I have re-created a release candidate (RC1) for Apache Hadoop Thirdparty 1.0.0. RC Release artifacts are available at : http://home.apache.org/~vinayakumarb/release/hadoop-thirdparty-1.0.0-RC1/ Maven artifacts are available in staging

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0

checksums and tried building from source. > Everything seems to be working fine. > But I feel the concerns regarding licences are valid. > IMO we should fix them and include HADOOP-16895 too in the release > > -Ayush > > > On 29-Feb-2020, at 1:45 AM, Vinayakumar B > wrote

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0

> > ps: I am not experienced with licensing enough to judge which one of > these are blocking and I might be wrong. > > IMO, none of these should be blocking and can be handled before next release. Still if someone feels this should be fixed and RC should be cut again, I am open to it.

[VOTE] Release Apache Hadoop Thirdparty 1.0.0

Hi folks, Thanks to everyone's help on this release. I have created a release candidate (RC0) for Apache Hadoop Thirdparty 1.0.0. RC Release artifacts are available at : http://home.apache.org/~vinayakumarb/release/hadoop-thirdparty-1.0.0-RC0/ Maven artifacts are available in staging repo:

[DISCUSS] hadoop-thirdparty 1.0.0 release

Hi All, Since Hadoop-3.3.0 release is around the corner, its time to release hadoop-thirdparty's first ever release, without which hadoop-3.3.0 cannot proceed for release. Below are the tentative date for RC and release. Since there is no much activity in this repo (other than the opentracing

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

unification we can think > > parallel thread as Vinay mentioned). > > > > > > > > On Mon, 6 Jan 2020 at 6:21 PM, Vinayakumar B > > wrote: > > > >> Hi Sree, > >> > >>> apache/hadoop-thirdparty, How would it fit into ASF ? As an Incubating >

[NOTICE] Removal of protobuf classes from Hadoop Token's public APIs' signature

Hi All, This mail is to notify about the Removal of following public APIs from Hadoop Common. ClassName: org.apache.hadoop.security.token.Token APIs: public Token(TokenProto tokenPB); public TokenProto toTokenProto(); Reason: These APIs are having Generated

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

st course of action.I am looking at, no projects > > should ever had to shade any artifacts except as an absolute necessary > > alternative. > > > > > > Thank you./Sree > > > > > > > > On Saturday, January 4, 2020, 7:49:18 AM PST, Vinayakumar B < > > v

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

? Looking at HBase > as an example, it looks like everything that are known to break a lot after > an update get shaded into the hbase-thirdparty artifact: guava, netty, ... > etc. > Is it the purpose to isolate these naughty dependencies? > > On Wed, Oct 9, 2019 at 12:38 PM Vinayakumar B

[jira] [Resolved] (YARN-10041) Should not use AbstractPath to create unix domain socket

[ https://issues.apache.org/jira/browse/YARN-10041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved YARN-10041. -- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Assignee: liusheng Resolution

Re: [DISCUSS] ARM/aarch64 support for Hadoop

, > > On Fri, Sep 6, 2019 at 6:11 AM Vinayakumar B > wrote: > >> Thanks @Anu >> >> I understand the concern. I took it in different manner. >> >> Anyway, since protobuf upgrade looks huge, and need everyone's eyes on >> changes as early as possible,

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

> > > https://lists.apache.org/thread.html/f12c589baabbc79c7fb2843422d4590bea982cd102e2bd9d21e9884b@%3Cdev.hbase.apache.org%3E > > > Thanks. > > Vinayakumar B 于2019年9月28日周六 上午1:28写道： > > > Please find replies inline. > > > > -Vinay > > > > On Fri

Re: Daily Builds Getting Aborted Due To Timeout

Thanks Ayush, I think possible other ways are improving the test runtime. 1. try "parallel-tests" profile if applicable on all modules whichever is okay with tests running in parallel. This may reduce the total unit tests runtime drastically. ex: I can see hadoop-hdfs-rbf takes around ~22 min.

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

llowed in HBase. May be people involved in HBase can add some points here. Thoughts? > > .. Owen > > On Fri, Sep 27, 2019 at 8:38 AM Vinayakumar B > wrote: > >> Hi All, >> >>I wanted to discuss about the separate repo for thirdparty dependencies >> which

[DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

ed with the proposal. -Thanks, Vinay On Fri, Sep 27, 2019 at 11:54 AM Vinod Kumar Vavilapalli wrote: > Moving the thread to the dev lists. > > Thanks > +Vinod > > > On Sep 23, 2019, at 11:43 PM, Vinayakumar B > wrote: > > > > Thanks Marto

Re: [NOTICE] Building trunk needs protoc 3.7.1

this only when there are changes related to shaded dependencies. -Vinay On Sun, 22 Sep 2019, 10:11 pm Steve Loughran, wrote: > > > On Sun, Sep 22, 2019 at 3:22 PM Vinayakumar B > wrote: > >>Protobuf provides Wire compatibility between releases.. but not >

Re: [NOTICE] Building trunk needs protoc 3.7.1

> On Sep 21, 2019, at 9:55 AM, Vinayakumar B > wrote: > > > > @Wangda Tan , > > Sorry for the confusion. HADOOP-13363 is umbrella jira to track multiple > > stages of protobuf upgrade in subtasks. (jar upgrade, Docker update, > plugin > > upgrade, sha

Re: [NOTICE] Building trunk needs protoc 3.7.1

Hi Vinay, > > > > A bit confused, I saw the HADOOP-13363 is still pending. Do we need to > > upgrade protobuf version to 3.7.1 NOW or once HADOOP-13363 is completed? > > > > Thanks, > > Wangda > > > > On Fri, Sep 20, 2019 at 8:11 AM Vinayakumar B >

Re: [DISCUSS] ARM/aarch64 support for Hadoop

t even without ARM, this is a > great idea. > > If you like we can get together during one of the HDFS meetups hosted by > Wei-chiu. > > Thanks > Anu > > > > On Thu, Sep 5, 2019 at 3:19 AM Vinayakumar B > wrote: > >> Hi all, >> >> Thanks fo

Re: [DISCUSS] ARM/aarch64 support for Hadoop

t;> separate >> >> >>> branch with it's own ARM CI seems a really good idea. >> >> >>> By doing this we won't break any of the undergoing development in >> >> trunk >> >> >> and >> >> >>> a CI can be a very

Re: [VOTE] Moving Submarine to a separate Apache project proposal

+1 Thanks for the proposal. Its very interesting project and looks very promising one by looking at the participations from various companies and the speed of development. I would also like to participate in the project. Please add me as well. Thanks, -Vinay On Tue, 3 Sep 2019, 12:38 pm Rakesh

[DISCUSS] ARM/aarch64 support for Hadoop

Hi Folks, ARM is becoming famous lately in its processing capability and has got the potential to run Bigdata workloads. Many users have been moving to ARM machines due to its low cost. In the past there were attempts to compile Hadoop on ARM (Rasberry PI) for experimental purposes. Today ARM

Re: Including Original Author in git commits.

So.. if we started doing that already.. we can encourage contributors to attach formatted patch.. or create PRs. And update wiki to follow exact steps to contribute and commit. -Vinay On Thu, 14 Feb 2019, 4:54 pm Steve Loughran I've been trying to do that recently, though as it forces me to

Including Original Author in git commits.

Hi all, Right now we are committing with commitrer name as author and adding contributor name in commit message. This way of committing will not reflect in contributors git profile. I believe current way of crediting.. is based on SVN days.. Since now all apache repos are following git.. we can

Re: [VOTE] Release Apache Hadoop 3.1.2 - RC1

Sorry for being late. Thanks everyone for the Release efforts. +1 (Binding) -Built from tag on Ubuntu-18.04 -Successful Native build. -Deployed a 3-Node docker cluster with kerberos Security Enabled on Centos7 images. -Verified basic HDFS Commands -Ran basic wordcount Job. -Vinay On Wed, Feb

Re: [DISCUSS] Move to gitbox

+1 -Vinay On Mon, 10 Dec 2018, 1:22 pm Elek, Marton > Thanks Akira, > > +1 (non-binding) > > I think it's better to do it now at a planned date. > > If I understood well the only bigger task here is to update all the > jenkins jobs. (I am happy to help/contribute what I can do) > > > Marton > >

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC0)

+1 Binding, 1. Checked out code from tag. 2. Built and deployed a 3-node docker cluster in secure mode (HDFS HA, Non-HA YARN). Docker script available in [1], if anyone need, 3. Ran wordcount job successfully. 4. Verified basic webhdfs commands using curl. 5. Verified basic HDFS commands [1]

RE: [VOTE] Release Apache Hadoop 2.7.3 RC0

+1 (binding) 1. Downloaded and Built from branch-2.7.3 2. Started up HDFS and YARN in Single Node cluster. 3. Ran WordCount job multiple times and Success. 4. Verified the "Release Notes" available at the URL mentioned by Vinod. Apart from that, Faced same issues as Andrew wang, while running

Re: Different JIRA permissions for HADOOP and HDFS

Thanks Akira. On 17 May 2016 10:59, "Akira Ajisaka" <aajis...@apache.org> wrote: > Hi Vinay, > > Added you into committer roles for HADOOP/MAPREDUCE/YARN. > > Regards, > Akira > > On 5/17/16 13:45, Vinayakumar B wrote: > >> Hi Junping, >> &g

Re: Different JIRA permissions for HADOOP and HDFS

Hi Junping, It looks like, I too dont have permissions in projects except HDFS. Please grant me also to the group. Thanks in advance, -Vinay On 17 May 2016 6:10 a.m., "Sangjin Lee" wrote: Thanks Junping! It seems to work now. On Mon, May 16, 2016 at 5:22 PM, Junping Du

RE: [VOTE] Release Apache Hadoop 2.7.2 RC0

I think one recent critical issue HDFS-9413, getContentSummary() on standby should throw StandbyException, Found by Brahma, is a good candidate for 2.7.2 as well. -vinay On Nov 14, 2015 5:20 AM, "Naganarasimha G R (Naga)" < garlanaganarasi...@huawei.com> wrote: > Hi Vinod, > > Can you also look

Re: [VOTE] Release Apache Hadoop 2.6.2

+1 binding, 1. Built the tar from the git tag checkout 2. Verified the release notes both downloaded and built 3. Installed single node cluster and ran some jobs successfully 4. Verified documents, Found "svn" link instead of git in the header of document. This could be corrected either in next

Re: IMPORTANT: automatic changelog creation

+1 for the auto generation. bq. Besides, after a release R1 is out, someone may (accidentally or intentionally) modify the JIRA summary. Is there any possibility that, we can restrict someone from editing the issue in jira once its marked as closed after release? Regards, Vinay On Fri, Jul 3,

Re: 2.7.1 status

Hi Vinod, https://issues.apache.org/jira/browse/HDFS-8270 seems to create some issue for the downstream projects in NonHA case. I will try to get it in for 2.7.1 if everyone agrees to remove IPC level retries only in case of NonHA for *create() *request. -Vinay On Wed, May 27, 2015 at 12:34 PM,

Re: Unable to run Hadoop on Windows 8.1 64bit

I think you need to add *bin* directory to your *PATH* variable to execute *hdfs namenode -format* -Vinay On Fri, Mar 27, 2015 at 7:56 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Hello Did you open a command window in administrator mode.? Another link which will guide

Re: [VOTE] Migration from subversion to git for version control

+1 non-binding Once this movement is done, detailed steps to checkout, commit and merge to/from different branches needs to be updated. Many (including me ;) ) might not know some advanced commands. Regards, Vinay On Tue, Aug 12, 2014 at 5:08 AM, Zhijie Shen zs...@hortonworks.com wrote: +1

Re: Submitting patch

Hi Hou, GuoboX, You can submit the patches for the trunk, and QA also will verify for the same. If the patch applies for the trunk, then it would automatically( In most cases unless there are some differences from trunk to branch) apply to branch-2. If in case, whatever issue you are facing is

Re: 答复: SIMPLE authentication is not enabled error for secured hdfs read

an authentication failure. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jun 25, 2014 at 3:14 AM, Vinayakumar B vinayakum...@apache.org wrote: Hi, In first snippet of the code following method can be used by providing the corresponding AuthMethod. /** * Create a user from

Re: Pls subscribe to to this group

Hi Vishal Send a simple mail to yarn-dev-subscr...@hadoop.apache.org for subscription. Regards, Vinay On Apr 9, 2014 4:31 AM, Vishal Saxena vsaxen...@gmail.com wrote: Hi, Pls subscribe me to this group. Thanks, Vishal