Re: [VOTE] Merging branch HDFS-7240 to trunk

> On Mar 5, 2018, at 4:08 PM, Andrew Wang wrote: > > - NN on top HDSL where the NN uses the new block layer (Both Daryn and Owen > acknowledge the benefit of the new block layer). We have two choices here > ** a) Evolve NN so that it can interact with both old and

Re: [VOTE] Merging branch HDFS-7240 to trunk

Joep, You raise a number of points: (1) Ozone vs and object stores. “Some users would choose Ozone as that layer, some might use S3, others GCS, or Azure, or something else”. (2) How HDSL/Ozone fits into Hadoop and whether it is necessary. (3) You raise the release issue which we will respond

Re: [VOTE] Merging branch HDFS-7240 to trunk

HDSL), which >> is >>> a distributed, replicated block layer. >>>The old HDFS namespace and NN can be connected to this new block >> layer >>> as we have described in HDFS-10419. >>>We also introduce a key-value namespace called Ozone built on HDSL. &

Re: [VOTE] Merging branch HDFS-7240 to trunk

e a key-value namespace called Ozone built on HDSL. >>> >>>The code is in a separate module and is turned off by default. In a >>> secure setup, HDSL and Ozone daemons cannot be started. >>> >>>The detailed documentation

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

Konstantine Thanks for your feedback and comments over the last few months. Have we addressed all your issues and concerns? sanjay > On Feb 13, 2018, at 6:28 PM, sanjay Radia <sanjayo...@gmail.com> wrote: > > Sorry the formatting got messed by my email client. H

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

Sorry the formatting got messed by my email client. Here it is again Dear Hadoop Community Members, We had multiple community discussions, a few meetings in smaller groups and also jira discussions with respect to this thread. We express our gratitude for participation and valuable

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

Dear Hadoop Community Members, We had multiple community discussions, a few meetings in smaller groups and also jira discussions with respect to this thread. We express our gratitude for participation and valuable comments. The key questions raised were following How the new block storage

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

Konstantine, Thanks for your comments, questions and feedback. I have attached a document to the HDFS-7240 jira that explains a design for scaling HDFS and how Ozone paves the way towards the full solution.

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

sultancy on the > corners of S3, everyone who tested in (including our QA team), Sanjay Radia, > & others. > > I've already done a couple of iterations of fixing checksyles & code reviews, > so I think it is ready. I also have a branch-2 patch based on earlier work by > Min

Re: LinkedIn Dynamometer Tool (was About 2.7.4 Release)

Erik Great stuff. BTW did you build on top of the “simulated data nodes” in HDFS which has a way to storing only the length of data (but not real data)? That work allowed supplementing with a matching editsLog for the NN. Your approach of using a real image has the advantage of being able

Re: Looking to a Hadoop 3 release

On Mar 5, 2015, at 3:21 PM, Siddharth Seth ss...@apache.org wrote: 2) Simplification of configs - potentially separating client side configs and those used by daemons. This is another source of perpetual confusion for users. + 1 on this. sanjay

Re: Looking to a Hadoop 3 release

On Mar 3, 2015, at 9:36 AM, Karthik Kambatla ka...@cloudera.com wrote: If we preserve API compat and try to preserve wire compat, I don't see the harm in bumping the major release. If we preserve compatibility, then there is no need to bump major number. It allows us to include several

Re: Looking to a Hadoop 3 release

Andrew Thanks for bringing up the issue of moving to Java8. Java8 is important However, I am not seeing a strong motivation for changing the major number. We can go to Java8 in the 2.series. The classpath issue for Hadoop-11656 is too minor to force a major number change (no pun intended).

Re: [VOTE] Merge fs-encryption branch to trunk

transparent encryption in a 2.x release for pubic consumption, let us at least complete item 1 (ie distcp and cp) and the flag to turn this feature on/of. This is a great work; thanks team for contributing this important feature. sanjay On Aug 14, 2014, at 1:05 AM, sanjay Radia san

Re: [VOTE] Merge fs-encryption branch to trunk

While I was originally skeptical of transparent encryption, I like the value proposition of transparent encryption. HDFS has several layers, protocols and tools. While the HDFS core part seems to be well done in the Jira, inserting the matching transparency in the other tools or protocols need

Re: [VOTE] Migration from subversion to git for version control

+1 sanjay On Fri, Aug 8, 2014 at 7:57 PM, Karthik Kambatla ka...@cloudera.com wrote: I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7 days. 1. Migrate from subversion to git for version control. 2.

Re: Moving to JDK7, JDK8 and new major releases

Andrew thanks for writing the proposal. In the proposal you mention: Dropping support for a JDK in a minor release is incompatible, so this would require a change to our compatibility guidelines. Why is dropping a JDK incompatible? sanjay On Jun 24, 2014, at 11:17 AM, Andrew Wang

Re: [VOTE] Release Apache Hadoop 2.4.0

+1 binding Verified binaries, ran from binary on single node cluster. Tested some HDFS clis and wordcount. sanjay On Apr 7, 2014, at 9:52 AM, Suresh Srinivas sur...@hortonworks.com wrote: +1 (binding) Verified the signatures and hashes for both src and binary tars. Built from the source,

Re: [VOTE] Release Apache Hadoop 2.4.0

On Thu, Apr 3, 2014 at 4:55 PM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.comwrote: Hi, Ran tests and confirmed that some tests(TestSymlinkLocalFSFileSystem) fail. The log of the test failure is as follows: https://gist.github.com/oza/9965197 Should we fix or disable the feature? Symlinks is

[jira] [Created] (HADOOP-10044) Improve the javadoc of rpc code

Sanjay Radia created HADOOP-10044: - Summary: Improve the javadoc of rpc code Key: HADOOP-10044 URL: https://issues.apache.org/jira/browse/HADOOP-10044 Project: Hadoop Common Issue Type

Re: symlink support in Hadoop 2 GA

There are a number of issues (some minor, some more than minor). GA is close and we are are still in discussion on the some of them; while I believe we will close on these very very shortly, code change like this so close to GA is dangerous. I suggest we do the following: 1) Disable Symlinks

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

+1 for naming the new branch 2.2.0 sanjay On Oct 1, 2013, at 4:55 PM, Suresh Srinivas wrote: (This time copying all the lists) I am +1 for naming the new branch 2.2.0. On Tue, Oct 1, 2013 at 4:15 PM, Arun C Murthy a...@hortonworks.com wrote: Guys, I took a look at the content in

[jira] [Created] (HADOOP-9671) Improve Hadoop security - master jira

Sanjay Radia created HADOOP-9671: Summary: Improve Hadoop security - master jira Key: HADOOP-9671 URL: https://issues.apache.org/jira/browse/HADOOP-9671 Project: Hadoop Common Issue Type

Re: [DISCUSS] Ensuring Consistent Behavior for Alternative Hadoop FileSystems + Workshop

I plan to attend. A 9:30 time is a little better for me. sanjay On Jun 5, 2013, at 8:14 PM, Stephen Watt wrote: Hi Folks Per Roman's recommendation I've created a Wiki Page for organizing the work and managing the logistics - https://wiki.apache.org/hadoop/HCFS/Progress I'd like to

[jira] [Created] (HADOOP-9619) Mark stability of .proto files

Sanjay Radia created HADOOP-9619: Summary: Mark stability of .proto files Key: HADOOP-9619 URL: https://issues.apache.org/jira/browse/HADOOP-9619 Project: Hadoop Common Issue Type: Sub-task

Re: [VOTE] - Release 2.0.5-beta

+1 on 2.0.5 defined in this thread with the new features. But I am supportive of an earlier release that has ALL the compatibility changes, without the features. sanjay On May 15, 2013, at 10:57 AM, Arun C Murthy wrote: Folks, ... I propose we continue the original plan and make a

[jira] [Created] (HADOOP-9425) Add error codes to rpc-response

Sanjay Radia created HADOOP-9425: Summary: Add error codes to rpc-response Key: HADOOP-9425 URL: https://issues.apache.org/jira/browse/HADOOP-9425 Project: Hadoop Common Issue Type: Sub-task

[jira] [Created] (HADOOP-9421) Add full length to SASL response to allow non-blocking readers

Sanjay Radia created HADOOP-9421: Summary: Add full length to SASL response to allow non-blocking readers Key: HADOOP-9421 URL: https://issues.apache.org/jira/browse/HADOOP-9421 Project: Hadoop

[jira] [Created] (HADOOP-9380) Add totalLength to rpc response

Sanjay Radia created HADOOP-9380: Summary: Add totalLength to rpc response Key: HADOOP-9380 URL: https://issues.apache.org/jira/browse/HADOOP-9380 Project: Hadoop Common Issue Type: Sub-task

Re: [Vote] Merge branch-trunk-win to trunk

On Mar 1, 2013, at 1:57 PM, Konstantin Shvachko wrote: Commitment is a good thing. I think the two builds that I proposed are a prerequisite for Win support. If we commit windows patch people will start breaking it the next day. Which we wont know without the nightly build and wont be able

Re: [Vote] Merge branch-trunk-win to trunk

+1 Java has done the bulk of the work in making Hadoop multi-platform. Windows specific code is a tiny percentage of the code. Jeninks support for windows is going help us keep the platform portable going forward. I expect that the vast majority of new commits have no problems. I propose that

[jira] [Created] (HADOOP-9163) The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy

Sanjay Radia created HADOOP-9163: Summary: The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy Key: HADOOP-9163 URL: https://issues.apache.org/jira/browse/HADOOP-9163

[jira] [Created] (HADOOP-9151) Include RPC error info in RpcResponseHeader instead of sending it separately

Sanjay Radia created HADOOP-9151: Summary: Include RPC error info in RpcResponseHeader instead of sending it separately Key: HADOOP-9151 URL: https://issues.apache.org/jira/browse/HADOOP-9151 Project

[jira] [Created] (HADOOP-9140) Cleanup rpc PB protos

Sanjay Radia created HADOOP-9140: Summary: Cleanup rpc PB protos Key: HADOOP-9140 URL: https://issues.apache.org/jira/browse/HADOOP-9140 Project: Hadoop Common Issue Type: Improvement

[jira] [Resolved] (HADOOP-7347) IPC Wire Compatibility

[ https://issues.apache.org/jira/browse/HADOOP-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-7347. -- Resolution: Fixed Fix Version/s: 2.0.0-alpha Hadoop Flags: Incompatible change

[jira] [Resolved] (HADOOP-8544) Move an assertion location in 'winutils chmod'

[ https://issues.apache.org/jira/browse/HADOOP-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8544. -- Resolution: Fixed Committed to branch-1 windows; thanks Chuan. Move

[jira] [Resolved] (HADOOP-8414) Address problems related to localhost resolving to 127.0.0.1 on Windows

[ https://issues.apache.org/jira/browse/HADOOP-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8414. -- Resolution: Fixed Thanks Ivan, committed to branch-1 windows. Address

[jira] [Resolved] (HADOOP-8534) Some tests leave a config file open causing failure on windows

[ https://issues.apache.org/jira/browse/HADOOP-8534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8534. -- Resolution: Fixed Committed to Hadoop-1 windows branch. Thanks Ivan. Some

[jira] [Resolved] (HADOOP-8454) Fix the ‘chmod =[perm]’ bug in winutils

[ https://issues.apache.org/jira/browse/HADOOP-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8454. -- Resolution: Fixed Reviewed and committed patch to Hadoop-1 windows branch. Thanks Chuan Lin

[jira] [Resolved] (HADOOP-8101) Access Control support for Non-secure deployment of Hadoop on Windows

[ https://issues.apache.org/jira/browse/HADOOP-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8101. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0, 0.24.0

[jira] [Resolved] (HADOOP-8411) TestStorageDirecotyFailure, TestTaskLogsTruncater, TestWebHdfsUrl and TestSecurityUtil fail on Windows

[ https://issues.apache.org/jira/browse/HADOOP-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8411. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0) Committed patch

[jira] [Resolved] (HADOOP-8440) HarFileSystem.decodeHarURI fails for URIs whose host contains numbers

[ https://issues.apache.org/jira/browse/HADOOP-8440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8440. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0) Committed

[jira] [Resolved] (HADOOP-8374) Improve support for hard link manipulation on Windows

[ https://issues.apache.org/jira/browse/HADOOP-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8374. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0) Committed

[jira] [Resolved] (HADOOP-8223) Initial patch for branch-1-win

[ https://issues.apache.org/jira/browse/HADOOP-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8223. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows Initial patch for branch

[jira] [Created] (HADOOP-8366) Use ProtoBuf for RpcResponseHeader

Sanjay Radia created HADOOP-8366: Summary: Use ProtoBuf for RpcResponseHeader Key: HADOOP-8366 URL: https://issues.apache.org/jira/browse/HADOOP-8366 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-7775) RPC Layer improvements to support protocol compatibility

[ https://issues.apache.org/jira/browse/HADOOP-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-7775. -- Resolution: Fixed All subtasks done. RPC Layer improvements to support

[jira] [Created] (HADOOP-8367) ProtoBufRpcEngine's rpc request header does not need declaringClass name

Sanjay Radia created HADOOP-8367: Summary: ProtoBufRpcEngine's rpc request header does not need declaringClass name Key: HADOOP-8367 URL: https://issues.apache.org/jira/browse/HADOOP-8367 Project

[jira] [Created] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader

Use ProtoBuf for RpcPayLoadHeader - Key: HADOOP-8285 URL: https://issues.apache.org/jira/browse/HADOOP-8285 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia

[jira] [Created] (HADOOP-8184) ProtoBuf RPC engine does not need it own reply packet - it can use the IPC layer reply packet.

Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https

[jira] [Created] (HADOOP-8161) Support for Azure Storage

Support for Azure Storage - Key: HADOOP-8161 URL: https://issues.apache.org/jira/browse/HADOOP-8161 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia -- This message is automatically

[jira] [Created] (HADOOP-8120) Refactor IPC client and server so shared parts in separate class

: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia Priority: Minor -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure

[jira] [Created] (HADOOP-8101) Security changes for Hadoop for Windows

Security changes for Hadoop for Windows --- Key: HADOOP-8101 URL: https://issues.apache.org/jira/browse/HADOOP-8101 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia

[jira] [Created] (HADOOP-8102) General Util Changes for Hadoop for Windows

General Util Changes for Hadoop for Windows Key: HADOOP-8102 URL: https://issues.apache.org/jira/browse/HADOOP-8102 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia

[jira] [Created] (HADOOP-8103) Hadoop-bin commands for windows

Hadoop-bin commands for windows --- Key: HADOOP-8103 URL: https://issues.apache.org/jira/browse/HADOOP-8103 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia -- This message

[jira] [Created] (HADOOP-7913) Fix bug in ProtoBufRpcEngine -

Fix bug in ProtoBufRpcEngine - --- Key: HADOOP-7913 URL: https://issues.apache.org/jira/browse/HADOOP-7913 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia Assignee

[jira] [Created] (HADOOP-7862) Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it

/HADOOP-7862 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https

[jira] [Created] (HADOOP-7776) Make the Ipc-Header in a RPC-Payload an explicit header

Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see

[jira] [Created] (HADOOP-7716) Multiple protocol does not log the protocol name only the class which may not be the same

Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia Priority: Minor -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https

[jira] [Created] (HADOOP-7719) On protocol version mismatch, return the list of valid versions for the requested protocol

Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira

[jira] [Created] (HADOOP-7687) Make getProtocolSignature public

Make getProtocolSignature public - Key: HADOOP-7687 URL: https://issues.apache.org/jira/browse/HADOOP-7687 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia

[jira] [Resolved] (HADOOP-7119) add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles

[ https://issues.apache.org/jira/browse/HADOOP-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-7119. -- Resolution: Fixed committed to branch-0.20-security to go into 20.205 add Kerberos HTTP

[jira] [Created] (HADOOP-7557) Make IPC and RPC headers be extensible

Make IPC and RPC headers be extensible --- Key: HADOOP-7557 URL: https://issues.apache.org/jira/browse/HADOOP-7557 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia

[jira] [Created] (HADOOP-7524) Change RPC to allow multiple protocols including multuple versions of the same protocol

Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-7479) Sperate data types

Sperate data types -- Key: HADOOP-7479 URL: https://issues.apache.org/jira/browse/HADOOP-7479 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia Assignee: Sanjay Radia

[jira] [Resolved] (HADOOP-7479) Separate data types

[ https://issues.apache.org/jira/browse/HADOOP-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-7479. -- Resolution: Duplicate Separate data types --- Key: HADOOP

[jira] [Created] (HADOOP-7426) User Guide for how to use viewfs with federation

: Sanjay Radia Assignee: Sanjay Radia Priority: Minor -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-7391) Copy the interrface classification documentation of HADOOP-5073 into javadoc

Issue Type: Bug Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.22.0 The documentation for interface classification in Jira Hadoop-5073 was not copied to the Javadoc of the classification. -- This message is automatically generated by JIRA

[jira] [Created] (HADOOP-7375) Add resolvePath method to FileContext

Add resolvePath method to FileContext - Key: HADOOP-7375 URL: https://issues.apache.org/jira/browse/HADOOP-7375 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia

[jira] [Created] (HADOOP-7347) HDFS Wire compatibility

HDFS Wire compatibility --- Key: HADOOP-7347 URL: https://issues.apache.org/jira/browse/HADOOP-7347 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia

[jira] [Created] (HADOOP-7284) Trash and shell's rm does not work for viewfs

Trash and shell's rm does not work for viewfs - Key: HADOOP-7284 URL: https://issues.apache.org/jira/browse/HADOOP-7284 Project: Hadoop Common Issue Type: Bug Reporter: Sanjay Radia

[jira] Created: (HADOOP-7054) Change NN LoadGenerator to use the new FileContext api

Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.22.0 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (HADOOP-7018) FileContext's list operation should return local names in the status object rather then the full path.

/browse/HADOOP-7018 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (HADOOP-6903) Make AbstractFileSystem's methods public to allow filter-Fs like implementions in a differnt package than fs

://issues.apache.org/jira/browse/HADOOP-6903 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Make AbstractFileSystem's methods public to allow filter-Fs like implementions in a differnt package than fs -- This message is automatically generated by JIRA

[jira] Created: (HADOOP-6899) FileSystem#setWorkingDir() does not work for relative names

Affects Versions: 0.20.2 Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.22.0 FileSystem#setWorkingDir() does not work for relative names -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue

[jira] Created: (HADOOP-6775) Update Hadoop Common Site's

Update Hadoop Common Site's Key: HADOOP-6775 URL: https://issues.apache.org/jira/browse/HADOOP-6775 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay

[jira] Resolved: (HADOOP-6421) Symbolic links

[ https://issues.apache.org/jira/browse/HADOOP-6421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-6421. -- Resolution: Fixed Release Note: Adds Symbolic links to FileContext, AbstractFileSystem

Re: HDFS-758 in Hadoop-21 , Updates to Namenode health page

On Nov 25, 2009, at 12:46 PM, Allen Wittenauer wrote: Then you'll have no issues patching other things in 0.21 that are actual bug fixes that also meet this criteria, right? Or does this only apply to things that Yahoo! is hitting/deemed worthy? Allen raises a good point that the

Re: Private, LimitedPrivate and contrib modules

Sorry for the late reply .. I missed in in my inbox. On Sep 18, 2009, at 1:29 PM, Tom White wrote: I'm trying to better understand the meaning of the annotations defined in org.apache.hadoop.classification.InterfaceAudience. 1. Private is documented as being Intended for use only within

Re: Private, LimitedPrivate and contrib modules

the tag for limited-private). sanjay thanks, dhruba On Thu, Nov 5, 2009 at 11:05 AM, Sanjay Radia sra...@yahoo-inc.com wrote: Sorry for the late reply .. I missed in in my inbox. On Sep 18, 2009, at 1:29 PM, Tom White wrote: I'm trying to better understand the meaning

[jira] Created: (HADOOP-6356) Add a Cache for AbstractFileSystem in the new FileContext/AbstractFileSystem framework.

Project: Hadoop Common Issue Type: Improvement Affects Versions: 0.22.0 Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.22.0 The new filesystem framework, FileContext and AbstractFileSystem does not implement a cache

[jira] Created: (HADOOP-6327) Fix build error for one of the FileContext errors

Fix build error for one of the FileContext errors - Key: HADOOP-6327 URL: https://issues.apache.org/jira/browse/HADOOP-6327 Project: Hadoop Common Issue Type: Bug Reporter: Sanjay

Re: [VOTE] Should we freeze the public stable APIs after 0.21.0?

+1 On Sep 25, 2009, at 10:16 AM, Owen O'Malley wrote: We are getting closer to being able to release a Common/HDFS/MapReduce 1.0. I'd hope that we'll get the last set of things in to 0.22 that mean that it would be labelled 1.0. Toward that end, I'd like to start locking down the APIs that

Re: Towards Hadoop 1.0: Stronger API Compatibility from 0.21 onwards

On Sep 28, 2009, at 3:15 AM, Steve Loughran wrote: Dhruba Borthakur wrote: It is really nice to have wire-compatibility between clients and servers running different versions of hadoop. The reason we would like this is because we can allow the same client (Hive, etc) submit jobs to two

Re: Towards Hadoop 1.0: Stronger API Compatibility from 0.21 onwards

On Sep 25, 2009, at 12:03 PM, Allen Wittenauer wrote: On 9/25/09 10:13 AM, Dhruba Borthakur dhr...@gmail.com wrote: It is really nice to have wire-compatibility between clients and servers running different versions of hadoop. The reason we would like this is because we can allow the

[jira] Created: (HADOOP-6271) Fix FileContext to allow both recursive and non recursive create and mkdir

Issue Type: Bug Affects Versions: 0.21.0 Reporter: Sanjay Radia Assignee: Sanjay Radia Modify FileContext to allow recursive and non-recursive create and mkdir (see HADOOP-4952) -- This message is automatically generated by JIRA. - You can reply to this email

[jira] Created: (HADOOP-6265) Remove deprecated protected methods added to FileSystem to support FileContext.

Common Issue Type: Bug Affects Versions: 0.21.0 Reporter: Sanjay Radia These Deprecated methods can be removed when FileContext is implemented on top of the new file system class as described in HADOOP-6223 -- This message is automatically generated by JIRA. - You can

[jira] Created: (HADOOP-6266) Cleanup class Path

Cleanup class Path -- Key: HADOOP-6266 URL: https://issues.apache.org/jira/browse/HADOOP-6266 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.21.0 Reporter: Sanjay Radia Class Path is a key class

[jira] Created: (HADOOP-6223) New improved FileSystem interface for those implementing new files systems.

Issue Type: Sub-task Reporter: Sanjay Radia The FileContext API (HADOOP-4952) provides an improved interface for the application writer. This lets us simplify the FileSystem API since it will no longer need to deal with notions of default filesystem [ / ], wd, and config

Towards Hadoop 1.0: Stronger API Compatibility from 0.21 onwards

Hadoop 1.0's goal was compatibility on several fronts. (See https://issues.apache.org/jira/browse/HADOOP-5071) for details. Due to the amount of work involved, it has been necessary to split this work across several releases prior to 1.0. Turns out that release 0.21 has a number of Jiras

Re: [VOTE] Push back code freeze for 0.21

On Jul 24, 2009, at 5:11 PM, Eric Baldeschwieler wrote: AGGHH! Let's not push out the general freeze even as far as sept 4th if possible. I'd suggest oct 31st. You mean Aug 31? sanjay If we push out the general freeze until append is complete, we will delay having a stable release with

[jira] Created: (HADOOP-6147) Hadoop Filesystem Plugin for Amazon Elastic Block Storage (EBS)

Feature Reporter: Sanjay Radia Amazon has introduced a new storage mechanism called EBS. Supposedly it is a lot more efficient than S3 for Hadoop. A filesystem plugin for hadoop would we be very useful for the community. -- This message is automatically generated by JIRA. - You can