Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

+1 (Binding) 1. Built from Tag. 2. Successful Native Build on Ubuntu 20.04 3. Verified Checksums 4. Deployed the docker cluster with 3 nodes 5. Ran sample MR Jobs -Vinay On Sat, Jun 12, 2021 at 6:40 PM Ayush Saxena wrote: > +1, > Built from Source. > Successful Native Build on Ubuntu 20.04 >

Re: [DISCUSS] Race condition in ProtobufRpcEngine2

Call.toString() was used only while sending the response, in the response processor thread. At this point, header would be already read and processed. So no chance of race conditions. This race condition was not introduced by the HADOOP-17046 , i

[ANNOUNCE] New Hadoop PMC member - Mukund Thakur

s and welcome, Mukund ! -Vinayakumar B -- -Vinay

Re: [DISCUSS] ARM/aarch64 support for Hadoop

, > > On Fri, Sep 6, 2019 at 6:11 AM Vinayakumar B > wrote: > >> Thanks @Anu >> >> I understand the concern. I took it in different manner. >> >> Anyway, since protobuf upgrade looks huge, and need everyone's eyes on >> changes as early as possi

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

g at HBase > as an example, it looks like everything that are known to break a lot after > an update get shaded into the hbase-thirdparty artifact: guava, netty, ... > etc. > Is it the purpose to isolate these naughty dependencies? > > On Wed, Oct 9, 2019 at 12:38 PM Vinayakumar B

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

t; > one room and decide best course of action.I am looking at, no projects > > should ever had to shade any artifacts except as an absolute necessary > > alternative. > > > > > > Thank you./Sree > > > > > > > > On Saturday, January 4, 2020, 7:49:18 AM PST,

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

ink > > parallel thread as Vinay mentioned). > > > > > > > > On Mon, 6 Jan 2020 at 6:21 PM, Vinayakumar B > > wrote: > > > >> Hi Sree, > >> > >>> apache/hadoop-thirdparty, How would it fit into ASF ? As an Incubating >

[DISCUSS] hadoop-thirdparty 1.0.0 release

Hi All, Since Hadoop-3.3.0 release is around the corner, its time to release hadoop-thirdparty's first ever release, without which hadoop-3.3.0 cannot proceed for release. Below are the tentative date for RC and release. Since there is no much activity in this repo (other than the opentracing rel

[VOTE] Release Apache Hadoop Thirdparty 1.0.0

Hi folks, Thanks to everyone's help on this release. I have created a release candidate (RC0) for Apache Hadoop Thirdparty 1.0.0. RC Release artifacts are available at : http://home.apache.org/~vinayakumarb/release/hadoop-thirdparty-1.0.0-RC0/ Maven artifacts are available in staging repo:

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0

k on this, > Marton > > ps: I am not experienced with licensing enough to judge which one of > these are blocking and I might be wrong. > > IMO, none of these should be blocking and can be handled before next release. Still if someone feels this should be fixed and RC should be cut

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0

https://issues.apache.org/jira/browse/HADOOP-16895 jira created for handling LICENCE and NOTICEs PR also has been raised for a proposal. Please validate https://github.com/apache/hadoop-thirdparty/pull/6 -Vinay On Fri, Feb 28, 2020 at 11:48 PM Vinayakumar B wrote: > Thanks Elek for detai

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0

checksums and tried building from source. > Everything seems to be working fine. > But I feel the concerns regarding licences are valid. > IMO we should fix them and include HADOOP-16895 too in the release > > -Ayush > > > On 29-Feb-2020, at 1:45 AM, Vinayakumar B > wrote

[VOTE] Release Apache Hadoop Thirdparty 1.0.0 - RC1

Hi folks, Thanks to everyone's help on this release. I have re-created a release candidate (RC1) for Apache Hadoop Thirdparty 1.0.0. RC Release artifacts are available at : http://home.apache.org/~vinayakumarb/release/hadoop-thirdparty-1.0.0-RC1/ Maven artifacts are available in staging repo:

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

Making ARM artifact optional, makes the release process simpler for RM and unblocks release process (if there is unavailability of ARM resources). Still there are possible options to collaborate with RM ( as brahma mentioned earlier) and provide ARM artifact may be before or after vote. If feasib

[RESULT] [VOTE] Release Apache Hadoop Thirdparty 1.0.0 - RC1

trunk with hadoop-thirdparty 1.0.0 >> - Checked rat files and documents >> - Checked LICENSE and NOTICE files >> >> Thanks, >> Akira >> >> On Thu, Mar 12, 2020 at 5:26 AM Vinayakumar B >> wrote: >> >> > Hi folks, >> &g

Re: [RESULT] [VOTE] Release Apache Hadoop Thirdparty 1.0.0 - RC1

Thanks brahma. So total 5 +1s (4 binding, 1 non-binding). Done with pushing bits. Should get mirrored in next 24 hours. -Vinay On Thu, Mar 19, 2020 at 12:55 AM Brahma Reddy Battula wrote: > > My late +1.. I missed this.. > > > On Thu, 19 Mar 2020 at 12:43 AM, Vinayak

Re: [NOTICE] Removal of protobuf classes from Hadoop Token's public APIs' signature

transition much easier. > > Other downstreamers that break with the relocated protobuf include: Ozone > and HBase. but neither of them use the removed Token API. > > > On Wed, Jan 8, 2020 at 4:40 AM Vinayakumar B > wrote: > >> Hi All, >> &

Re: [DISCUSS] making Ozone a separate Apache project

+1 -Vinay On Thu, 14 May 2020, 12:20 pm Surendra Singh Lilhore, < surendralilh...@gmail.com> wrote: > +1 > > -Surendra > > > On Thu, 14 May, 2020, 9:30 am yisheng lien, wrote: > > > +1 > > > > Thank you Marton for the detailed description. > > > > > > Wanqiang Ji 於 2020年5月14日 週四 上午11:27 寫道： >

Re: [NOTICE] Removal of protobuf classes from Hadoop Token's public APIs' signature

ES/ozone/hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/protocolPB/StorageContainerLocationProtocolClientSideTranslatorPB.java:[116,47] > > incompatible types: com.google.protobuf.ServiceException cannot be > > converted to org.apache.hadoop.thirdparty.protobuf.ServiceException > > 17:01:19 2020/04/16 00:01:19

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

+1 (Binding) -Verified all checksums and Signatures. -Verified site, Release notes and Change logs + May be changelog and release notes could be grouped based on the project at second level for better look (this needs to be supported from yetus) -Tested in x86 local 3-node docker cluster. + Bu

[ANNOUNCE] New Apache Hadoop PMC member : Ayush Saxena

Hi all, I am very glad to announce that Ayush Saxena was voted to join Apache Hadoop PMC. Congratulations Ayush! Well deserved and thank you for your dedication to the project. Please keep up the good work. Thanks, -Vinay

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

Apologies for delayed voting. +1 (Binding) 1. Verified the signature. Signatures are good. 2. Verified the sha512 checksum (I tried to use the sha512sum tool to verify. But ".sha512" files doesn't have the expected format. I guess these files are regenerated using "gpg --print-md", not

Re: Collect feedback for HDFS-15638

IIUC, hive renames are from hive’s staging directory during write to final destination within table. Why not set the default ACLs of staging directory to whatever expected, and then continue write remaining files. In this way even after rename you will have expected ACLs on the final files. Sett

Re: Wire compatibility between Hadoop 3.x client and 2.x server

Hi Wu,Jianliang, Have you created the Jira for the issue you mentioned due to getContentSummary? I might have a fix for this. Of-course it needs to be applied both client and server side. Let me know. -Vinay On Wed, Oct 14, 2020 at 12:26 PM Wu,Jianliang(vip.com) < jianliang...@vipshop.com> wro

Re: Wire compatibility between Hadoop 3.x client and 2.x server

iled jira https://issues.apache.org/jira/browse/HDFS-15660 for details > > > 2020年10月28日 17:08，Vinayakumar B 写道： > > Hi Wu,Jianliang, > Have you created the Jira for the issue you mentioned due to > getContentSummary? > > I might have a fix for this. Of-course it needs t

Re: [DISCUSS] Hadoop 3.3.1 release

Hi David, >> Still hoping for help here: >> https://issues.apache.org/jira/browse/HDFS-15790 I will raise a PR for the said solution soon (in a day or two). -Vinay On Thu, 11 Mar 2021 at 5:39 AM, David wrote: > Hello, > > Still hoping for help here: > > https://issues.apache.org/jira/browse/

Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk

to trunk > > > > > > +1 (non-binding) > > > I have been involved in the development and code review on the feature > > > branch. It's a great feature and I think it's ready to merge it into > > trunk. > > > > > > Thanks all for th

Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk

for offering the help. > > --- > Zhe Zhang > > On Mon, Oct 5, 2015 at 12:19 PM, Gangumalla, Uma > > wrote: > > > Vinay, > > > > > > I would merge them as part of HDFS-9182. > > > > Thanks, > > Uma > > > > > > >

Re: [VOTE] Release Apache Hadoop 2.6.2

+1 binding, 1. Built the tar from the git tag checkout 2. Verified the release notes both downloaded and built 3. Installed single node cluster and ran some jobs successfully 4. Verified documents, Found "svn" link instead of git in the header of document. This could be corrected either in next re

RE: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

some time next year. With EC and > >>JDK8 in a good spot, the only big feature remaining is classpath > >>isolation. > >> > >> EC is also a pretty fundamental change to HDFS. Even if it's > >>compatible, in terms of size and impact

RE: [VOTE] Release Apache Hadoop 2.7.2 RC0

I think one recent critical issue HDFS-9413, getContentSummary() on standby should throw StandbyException, Found by Brahma, is a good candidate for 2.7.2 as well. -vinay On Nov 14, 2015 5:20 AM, "Naganarasimha G R (Naga)" < garlanaganarasi...@huawei.com> wrote: > Hi Vinod, > > Can you also look

[Review Request] For HDFS patches

browse/HDFS-3618> HDFS-3493<https://issues.apache.org/jira/browse/HDFS-3493> HDFS-3405<https://issues.apache.org/jira/browse/HDFS-3405> Regards, Vinayakumar B., This e-mail and attachments contain confidential

RE: HDFS upgrade problem of fsImage

Looks like you have already have upgraded cluster.. And you are trying to upgrade one more time. -Original Message- From: Azuryy Yu [mailto:azury...@gmail.com] Sent: 21 November 2013 09:49 To: hdfs-dev@hadoop.apache.org; u...@hadoop.apache.org Subject: HDFS upgrade problem of fsImage H

RE: Deprecate BackupNode

+1 for removing Checkpoint Node and Backup node -Original Message- From: Chris Nauroth [mailto:cnaur...@hortonworks.com] Sent: 06 December 2013 06:27 To: hdfs-dev@hadoop.apache.org Subject: Re: Deprecate BackupNode +1 Chris Nauroth Hortonworks http://hortonworks.com/ On Thu, Dec 5, 2

Re: does it make sense to get remaining space by sum all the ones of the datanode

in which version of Hadoop you are seeing this? -Vinay On 29 Jan 2018 3:26 pm, "Xie Gang" wrote: Hello, We recently hit a issue that almost all the disk of the datanode got full even we configured the du .reserved. After tracking down the code, found that when we choose a target datanode and

Re: does it make sense to get remaining space by sum all the ones of the datanode

torageInfos()) { > if (s.getStorageType() == t) { > remaining += s.getRemaining(); > } > } > return remaining; > } > > > On Mon, Jan 29, 2018 at 6:12 PM, Vinayakumar B > wrote: > >> in which version of Hadoop you are seeing this? >>

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC0)

+1 Binding, 1. Checked out code from tag. 2. Built and deployed a 3-node docker cluster in secure mode (HDFS HA, Non-HA YARN). Docker script available in [1], if anyone need, 3. Ran wordcount job successfully. 4. Verified basic webhdfs commands using curl. 5. Verified basic HDFS commands [1] htt

Re: [DISCUSS] Merging HDFS-8707 (C++ HDFS client) to trunk

Definitely this would be great addition. Kudos to everyone's contributions. I am not a C++ expert. So cannot vote on code. ---A libhdfs/libhdfs3 compatible C API that allows libhdfs++ to serve as a drop-in replacement for clients that only need read support (until libhdfs++ also supports writes

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

+1 for the subproject of HDSL Instead of maintaining directly as part of main repo itself, may be we can explore 'git submodules' -Vinay On 23 Mar 2018 11:47 am, "Takanobu Asanuma" wrote: +1 (non-binding). Thanks, -Takanobu Asanuma > All, > > Following our discussions on the previous threa

Re: 回复：[VOTE] Merge Storage Policy Satisfier (SPS) [HDFS-10285] feature branch to trunk

+1 Great work guys. -Vinay On Tue, 7 Aug 2018, 7:20 pm Anu Engineer, wrote: > +1, Sorry for the late vote. Thanks for the perseverance and seeing this > thru. > > --Anu > > > On 8/7/18, 1:04 AM, "郑锴(铁杰)" wrote: > > +1 for the work to be in. Thanks Uma and folks for the hard taking! > >

Re: HADOOP-14163 proposal for new hadoop.apache.org

+1, New site looks great. Just one nit in README '--refresh' flag for hugo server no longer available. -Vinay On Mon, 3 Sep 2018, 10:21 am Shashikant Banerjee, wrote: > +1 > > Thanks > Shashi > > On 9/3/18, 9:23 AM, "Mukul Kumar Singh" wrote: > > +1, Thanks for working on this Marton. >

RE: Rise of the Dragon

I think, he cloned main HDFS-7285 jira. By default, "clone all subtasks" will be enabled. So in one shot all 206 subtasks also cloned, Creating huge mess in mails. Anyway I have deleted the cloned Jira, along with subtasks. -Vinay -Original Message- From: Zhe Zhang [mailto:z...@apache

Re: upstream jenkins build broken?

When I see the history of these kind of builds, All these are failed on node H9. I think some or the other uncommitted patch would have created the problem and left it there. Regards, Vinay On Thu, Mar 12, 2015 at 6:16 AM, Sean Busbey wrote: > You could rely on a destructive git clean call in

Re: upstream jenkins build broken?

; i++) { FileUtil.setExecutable(new File(dataDir, "data"+(2*i+1)), true); FileUtil.setExecutable(new File(dataDir, "data"+(2*i+2)), true); } } Regards, Vinay On Thu, Mar 12, 2015 at 12:35 PM, Vinayakumar B wrote: > When I see the history of these kind of builds, All the

Re: upstream jenkins build broken?

t;> >> I filed HDFS-7917 to change the way to simulate disk failures. > >> >> > >> >> But I think we still need infrastructure folks to help with jenkins > >> >> scripts to clean the dirs left today. > >> >> > >> >>

Re: upstream jenkins build broken?

clean -fdx" returned status code 1: stdout: stderr: Can someone remove "git clean -fdx" from build configurations of Precommit-HDFS-Build ? Regards, Vinay On Tue, Mar 17, 2015 at 12:59 PM, Vinayakumar B wrote: > I have simulated the problem in my env and verified that, both

Re: upstream jenkins build broken?

t on the directory? I'd > like to get something I can reproduce locally. > > On Tue, Mar 17, 2015 at 2:29 AM, Vinayakumar B > wrote: > > > I have simulated the problem in my env and verified that, both 'git clean > > -xdf' and 'mvn clean' will no

Re: upstream jenkins build broken?

, Vinayakumar B wrote: > Yes, Just create some directory with some contents in it within target > directory. And set permission to 600. > Then can run either 'mvn clean' or 'git clean' > > -Vinay > > On Tue, Mar 17, 2015 at 9:13 PM, Sean Busbey wrote:

Re: Why DFSClient in HA-cluster tries to resolve HA cluster name?

Thats a good find Dmitry Simonov. Even in DFSAdmin, everywhere its used just to print to console. You can raise a jira and post a patch to refactor this. -Vinay On Tue, Mar 31, 2015 at 12:34 PM, Dmitry Simonov wrote: > Hello! > > Why DFSClient in HA-cluster tries to resolve HA cluster name? >

Re: Is implicit Retry for create() required on AlreadyBeingCreatedException in NonHA ?

Good find, andreina. I am unaware of the fact, why AlreadyBeingCreatedException was considered for retry before throwing back the exception. But I find it strange that only NonHA its being retried. And retry upto 5 min is really un-acceptable. IMO, keep the behaviour in sync in both HA and Non-H

Re: DISCUSS: is the order in FS.listStatus() required to be sorted?

I think the patch just updates the doc as of now, not changing any code to affect the existing usage. Sorting depends on the underlying implementations. Linux *ls *implementation returns alphanumerically sorted array by default ( Current implementation might have assumed from here to sort by defa

Re: NameNode as a single point of failure

Hi.. Did you look at the HDFS Namenode high availability? -Vinay On Jul 2, 2015 11:50 AM, "Dmitry Salychev" wrote: > Hello, HDFS Developers. > > I know that NN is a single point of failure of an entire HDFS cluster. If > it fails, the cluster will be unavailable no matter how many DN there. I >

Re: IMPORTANT: automatic changelog creation

+1 for the auto generation. bq. Besides, after a release R1 is out, someone may (accidentally or intentionally) modify the JIRA summary. Is there any possibility that, we can restrict someone from editing the issue in jira once its marked as "closed" after release? Regards, Vinay On Fri, Jul 3,

Request for installing ISA-L library in build machines

Hi, Request to install *Intel® Intelligent Storage Acceleration-Library(Intel® ISA-L)* on all hadoop build machines. This is required for testing the Recent work in Erasure Coding in Hadoop HDFS. ISA-L available @ https://01.org/intel%C2%AE-storage-acceleration-library-open-source-version Th

Re: Request for installing ISA-L library in build machines

gt; > On Tue, Jul 28, 2015 at 10:55 AM, Vinayakumar B > wrote: > > > Hi, > > > > Request to install *Intel® Intelligent Storage > > Acceleration-Library(Intel® ISA-L)* on all hadoop build machines. This is > > required for testing the Recent work in Erasu

Re: Request for installing ISA-L library in build machines

Thank you Allen for pointer. On Jul 28, 2015 11:30 PM, "Allen Wittenauer" wrote: > > On Jul 28, 2015, at 3:15 AM, Vinayakumar B > wrote: > > > Have you tried package available at > > > https://01.org/intel%C2%AE-storage-acceleration-library-open-source-ve

Re: Planning Hadoop 2.6.1 release

FYI, Some of the issues in https://wiki.apache.org/hadoop/Release-2.6.1-Working-Notes are already merged in 2.6.1. Regards, Vinay On Fri, Aug 14, 2015 at 12:43 PM, Sangjin Lee wrote: > HDFS-8850 is a fix for > VolumeScanner which was added to

Re: Hadoop 2.6.1 Release process thread

1. HDFS-7446 : HDFS inotify should have the ability to determine what txid it has read up to This is also marked for 2.6.1, but this changes the client protocol and protobuf messages. Please confirm whether this is Compatible change with 2.

Re: How to bring standby namenode to active mode in case of active host node down?

Actually SSH fencing was introduced before QuorumJournal was there to ensure only one active writer at all times. If you are using QuorumJournal for shared edits.. you dont need to configure SSH fencing. QuorumJournal will ensure its allowing only one writer at a time. -Vinay

Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk

the plan. The most > > >basic functionalities have been extensively tested and verified in > > >several real clusters with different hardware configurations; results > > >have been very stable. We have created follow-on tasks for more > > >advanced error handling

[Important] Checksum Error while appending to the file.

block size in Step 4 and Step 5 are matching, but metafile sizes are not matching. Thanks and Regards, Vinayakumar B

HDFS append on upgraded cluster

..? Regards, Vinayakumar B., This e-mail and attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information

RE: [VOTE] Release Apache Hadoop 2.7.3 RC0

+1 (binding) 1. Downloaded and Built from branch-2.7.3 2. Started up HDFS and YARN in Single Node cluster. 3. Ran WordCount job multiple times and Success. 4. Verified the "Release Notes" available at the URL mentioned by Vinod. Apart from that, Faced same issues as Andrew wang, while running t

[DISCUSS] Retire BKJM from trunk?

Hi All, BKJM was Active and made much stable when the NameNode HA was implemented and there was no QJM implemented. Now QJM is present and is much stable which is adopted by many production environment. I wonder whether it would be a good time to retire BKJM from trunk? Are there an

Need Help with review

Hi, Please help in reviewing below Jiras https://issues.apache.org/jira/browse/HDFS-5042 https://issues.apache.org/jira/browse/HDFS-11875 https://issues.apache.org/jira/browse/HDFS-11856 https://issues.apache.org/jira/browse/HDFS-11708 https://issues.apache.org/jira/browse/HDFS-11738 https://issu

RollingUpgrade Rollback openfiles issue

Hi all, Have a doubt with expected behavior in case of RollingUpgrade and rollback. Scenario: 1. file was being written before rolling upgrade started and written some bytes, say X, with hsync(). 2. Rolling upgrade done and writer continued to write and added some more bytes and file closed w

RE: RollingUpgrade Rollback openfiles issue

considering these usecases. Any thoughts? -Vinay From: Kihwal Lee [mailto:kih...@yahoo-inc.com] Sent: 25 May 2017 22:16 To: Vinayakumar B ; hdfs-dev@hadoop.apache.org Subject: Re: RollingUpgrade Rollback openfiles issue Hi Vinay, If I rephrase the question, Does a RU rollback snapshot provide a

Re: RollingUpgrade Rollback openfiles issue

in a RU. What do you think about truncate? Unlike append, it is utilizing the block recovery /commitBlockSynchronization facility. Then what about regular block recoveries? Kihwal ________ From: Vinayakumar B To: Kihwal Lee ; "hdfs-dev@hadoop.apache.org" <

Re: When permission is disabled, why setOwner() && setPermission() still check the permission?

Hi Brahma, Thanks for bringing this up. According to history of git, there is no historical reasons found for me. May be someone with branch-1 experience, can answer this ..? -Vinay On Tue, Aug 1, 2017 at 6:50 PM, Brahma Reddy Battula < brahmareddy.batt...@huawei.com> wrote: > Hi All > > why

RE: confirm expected HA behavior

is appropriate. Is there any problem you are seeing here? Regards, Vinayakumar B -Original Message- From: Arpit Gupta [mailto:ar...@hortonworks.com] Sent: 06 February 2014 03:58 To: hdfs-dev@hadoop.apache.org Subject: confirm expected HA behavior Hi I have a scenario where i am trying t

New NameNode UI does not support Internet Explorer

any plan to provide same in future? Regards, Vinayakumar B

RE: New NameNode UI does not support Internet Explorer

Some problem with Image. Attached the same image as file. From: Vinayakumar B [mailto:vinayakuma...@huawei.com] Sent: 06 February 2014 14:15 To: hdfs-dev@hadoop.apache.org Subject: New NameNode UI does not support Internet Explorer Hi, Currently new UI for namenode does not support Internet

Re: New NameNode UI does not support Internet Explorer

[image: Inline image 1] [image: Inline image 2] Attaching the Image from home. On Thu, Feb 6, 2014 at 6:40 PM, Ted Yu wrote: > Attachment didn't go through. > Consider using third party website for the image. > > Cheers > > On Feb 6, 2014, at 1:16 AM, Vinayakumar

RE: New NameNode UI does not support Internet Explorer

I checked in both Internet explorer 8 and 9 with windows 7. In both I got same problem. I will dig more and try to findout the problem. Regards, Vinayakumar B -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: 07 February 2014 02:40 To: hdfs-dev@hadoop.apache.org

RE: New NameNode UI does not support Internet Explorer

ed-one-too-many-times 2. in dfshealth.html and explorer.html JSON object was not being initialized. Adding to both html files solved issue. Found this here, http://stackoverflow.com/questions/4715373/json-object-undefined-in-internet-explorer-8-dom I will post a patch fo

RE: [VOTE] Merge HDFS-4685 HDFS ACLs to trunk

+1 (non-binding) This feature is important and was pending for long time. Thanks everyone for all efforts. I have been part of the implementation, reviewed patches and design document. Good work guys. Cheers, Vinayakumar B. -Original Message- From: Chris Nauroth [mailto:cnaur

How patch for renamed file handled while committing?

original file will be lost. So, the question to committers is , Whether such kind of renames handled explicitly though svn rename command before committing to retain the history? Or any workaround is there to generate patch to include rename information. ? Regards, Vinayakumar B.,

RE: How patch for renamed file handled while committing?

Thanks for information Suresh, I will explicitly mention while submitting such patches. Regards, Vinayakumar B -Original Message- From: Suresh Srinivas [mailto:sur...@hortonworks.com] Sent: 12 February 2014 13:00 To: hdfs-dev@hadoop.apache.org Subject: Re: How patch for renamed file

RE: [VOTE] Merge HDFS-5535 Rolling Upgrade Improvement

a test plan (Haohui is working on it.) > > - Execute the manual tests (Haohui and Fengdong will work on it.) > > > > The work was a collective effort of Nathan Roberts, Sanjay Radia, > > Suresh Srinivas, Kihwal Lee, Jing Zhao, Arpit Agarwal, Brandon Li, > > Haohui Ma

RE: [DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

explicitly mention about the compatibility of existing APIs in both versions. Anyway this is not applicable for the new APIs in latest client and this is understood. We can make it explicit in the document though. Regards, Vinayakumar B -Original Message- From: Chris Nauroth [mailto:cnaur

Re: HDFS-573: Windows builds will require CMake

Thanks Chris for the work on HDFS-573. Installing cmake in windows is just a trivial task. Download cmake zip extract and keep directory in PATH. Regards, Vinay On Mon, Aug 4, 2014 at 8:23 AM, Chris Nauroth wrote: > FYI, I plan to commit HDFS-573 next week, which ports libhdfs to Windows.

Re: [VOTE] Merge HDFS-6584 Archival Storage to trunk

ing > user documentation, adding a test plan doc, adding more tests and fixing > some > minor bugs. We will finish all of the > remaining work before merging the branch to trunk. > > The contributors of this work include Jing Zhao, Arpit > Agarwal, Vinayakumar B, Suresh Srin

[DISCUSS] Allow continue reading from being-written file using same stream

Hi all, Currently *DFSInputStream *doen't allow reading a write-inprogress file, once all written bytes, by the time of opening an input stream, are read. To read further update on the same file, needs to be read by opening another stream to the same file again. Instead how about refreshing leng

Re: [DISCUSS] Allow continue reading from being-written file using same stream

is the seek that > fails, not the read. > -PositionedReadable had better handle this too, even if it isn't done via a > seek()-read()-seek() sequence > > > On 18 September 2014 08:48, Vinayakumar B wrote: > > > Hi all, > > > > Currently *DFSInputStream *doe

Re: [DISCUSS] Allow continue reading from being-written file using same stream

Thanks Colin for the detailed explanation. On Fri, Sep 19, 2014 at 9:38 PM, Colin McCabe wrote: > > On Thu, Sep 18, 2014 at 11:06 AM, Vinayakumar B wrote: > > bq. I don't know about the merits of this, but I do know that native > > filesystems > > implement this by

Re: [DISCUSS] Allow continue reading from being-written file using same stream

On Fri, Sep 19, 2014 at 10:32 PM, Colin McCabe wrote: > > On Fri, Sep 19, 2014 at 9:41 AM, Vinayakumar B > wrote: > > Thanks Colin for the detailed explanation. > > > > On Fri, Sep 19, 2014 at 9:38 PM, Colin McCabe > > wrote: > >> > >> On Thu,

Re: [DISCUSS] Allow continue reading from being-written file using same stream

Yes stack.. Regards, Vinay On Sep 20, 2014 1:03 AM, "Stack" wrote: > On Thu, Sep 18, 2014 at 12:48 AM, Vinayakumar B > wrote: > > > Hi all, > > > > Currently *DFSInputStream *doen't allow reading a write-inprogress file, > > once all written by

Re: Issue with DN and NN connection.

Hi Surendra, Since, both public and private IPs are in same subnet, DN machien choosing public interface to connect to NN, for which no mapping present in NN machine. Separate your IPs to different segments for private and public, then communication will happen through corresponding interface. R

Why Mover moves only one replica in one iteration ?

Hi, Why we cant schedule all replica's movement together in one iteration.? I have seen while executing test, it needs one iteration to schedule movement of each replica of a block from one storage to another storage. Regards, Vinay

Clarification related to ACL with setPermission

Hi, Here is the scenario. 1. owner : *user1, *ownerGroup: *group1* *2. /dir *have permissions set 700 (rwx--) using setPermission(). 3. Now another Named group ACL has been set to allow access to another group group:*group2:r-x* 4. Now, when */dir is *accessed from a user belongs to *gro

Re: Block creation in HDFS

Hi abhishek, Is Your partitions of same sizes? If yes, then you can set that as block size. If not you can use the latest feature.. variable block size. To verify your use case. You can close the current block after each partition data is written and append to new block for new partition data. Thi

Re: [DISCUSS] Move to gitbox

+1 -Vinay On Mon, 10 Dec 2018, 1:22 pm Elek, Marton > Thanks Akira, > > +1 (non-binding) > > I think it's better to do it now at a planned date. > > If I understood well the only bigger task here is to update all the > jenkins jobs. (I am happy to help/contribute what I can do) > > > Marton > >

Re: [VOTE] Release Apache Hadoop 3.1.2 - RC1

Sorry for being late. Thanks everyone for the Release efforts. +1 (Binding) -Built from tag on Ubuntu-18.04 -Successful Native build. -Deployed a 3-Node docker cluster with kerberos Security Enabled on Centos7 images. -Verified basic HDFS Commands -Ran basic wordcount Job. -Vinay On Wed, Feb 6

Including Original Author in git commits.

Hi all, Right now we are committing with commitrer name as author and adding contributor name in commit message. This way of committing will not reflect in contributors git profile. I believe current way of crediting.. is based on SVN days.. Since now all apache repos are following git.. we can

Re: Including Original Author in git commits.

So.. if we started doing that already.. we can encourage contributors to attach formatted patch.. or create PRs. And update wiki to follow exact steps to contribute and commit. -Vinay On Thu, 14 Feb 2019, 4:54 pm Steve Loughran I've been trying to do that recently, though as it forces me to go

Re: [VOTE]: Support for RBF data locality Solution

+1 for approach A. On Thu, 11 Apr 2019, 12:23 pm Akira Ajisaka, wrote: > The Approach A looks good to me. > > Thanks, > Akira > > On Thu, Apr 11, 2019 at 2:30 PM Xiaoqiao He wrote: > > > > Hi forks, > > > > The current implementation of RBF is not sensitive about data locality, > > since NameNo

[ANNOUNCE] New Apache Hadoop Committer - Ayush Saxena

earty Congratulations & Welcome aboard Ayush! Vinayakumar B (On behalf of the Hadoop PMC)

[DISCUSS] ARM/aarch64 support for Hadoop

Hi Folks, ARM is becoming famous lately in its processing capability and has got the potential to run Bigdata workloads. Many users have been moving to ARM machines due to its low cost. In the past there were attempts to compile Hadoop on ARM (Rasberry PI) for experimental purposes. Today ARM arc

Re: [VOTE] Moving Submarine to a separate Apache project proposal

+1 Thanks for the proposal. Its very interesting project and looks very promising one by looking at the participations from various companies and the speed of development. I would also like to participate in the project. Please add me as well. Thanks, -Vinay On Tue, 3 Sep 2019, 12:38 pm Rakesh

Re: [DISCUSS] ARM/aarch64 support for Hadoop

s Vinaya for bring this up and thanks Sheng for the idea. A >> >> separate >> >> >>> branch with it's own ARM CI seems a really good idea. >> >> >>> By doing this we won't break any of the undergoing development in >> >> trun

  1   2   3   >