[jira] [Created] (HDFS-13505) Turn on HDFS ACLs by default.

2018-04-25 Thread Ajay Kumar (JIRA) 
Ajay Kumar created HDFS-13505:
-

 Summary: Turn on HDFS ACLs by default.
 Key: HDFS-13505
 URL: https://issues.apache.org/jira/browse/HDFS-13505
 Project: Hadoop HDFS
  Issue Type: Improvement
Reporter: Ajay Kumar
Assignee: Ajay Kumar


Turn on HDFS ACLs by default.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [RESULT][VOTE] Merge HDDS (HDFS-7240) *code* into trunk

2018-04-25 Thread Xiaoyu Yao 
We followed the process laid out in a mail thread from 2015 that had two 
workflows proposed.

“Git rebase” workflows and “Git merge” workflows.
Ozone had followed git merge workflow, which merged trunk at a regular 
frequency into ozone, and then ozone was merged back.

Here is the mail that we followed for the merge process.
https://lists.apache.org/thread.html/43cd65c6b6c3c0e8ac

Thanks
Xiaoyu


From: Owen O'Malley 
Date: Wednesday, April 25, 2018 at 11:15 AM
To: Chris Douglas 
Cc: Xiaoyu Yao , Jitendra Pandey 
, Hdfs-dev 
Subject: Re: [RESULT][VOTE] Merge HDDS (HDFS-7240) *code* into trunk

*sigh*

I asked you guys to rebase this before merge. It is tempting to squash it into 
a single commit.

.. Owen

On Wed, Apr 25, 2018 at 11:06 AM, Chris Douglas 
> wrote:
This really made a mess of trunk. Periodically merging trunk into the
HDFS-7240 branch, then merging the whole thing back, created a tangle
of references that's very difficult to work with (look at the output
of git log --graph).

I'm not sure it's even possible to fix this, but this is why feature
branches should rebase and create a merge commit with --no-ff. -C


On Tue, Apr 24, 2018 at 1:20 PM, Xiaoyu Yao 
> wrote:
> I just merged the branch to trunk (834 commits in total)
> Again, thanks for all who contributed to HDDS/Ozone!
>
> Cheers
> -Xiaoyu
>
> On 4/23/18, 7:26 PM, "Jitendra Pandey" 
> > wrote:
>
> The vote passes with many +1s (12 committers + 5 contributors) and no -1.
>
> Thanks everyone for voting.
>
> On 4/17/18, 5:19 AM, "Jitendra Pandey" 
> > wrote:
>
> Hi All,
>
>The community unanimously voted 
> (https://s.apache.org/HDDSMergeResult) to adopt
> HDDS/Ozone as a sub-project of Hadoop, here is the formal vote 
> for code merge.
>
> Here is a quick summary of the code changes:
>
> - As decided in the JIRA HDFS-10419, the project has been renamed 
> to Hadoop Distributed Data Store or HDDS.
> - HDDS becomes a sub-project of Hadoop.
> - Added a Maven profile that disables HDDS compilation by default.
> - The releases of HDDS will be independent of Hadoop and will 
> have no impact to current Hadoop release process.
> - We have made HDDS a loadable module.
> - Cleaned up changes in HDFS/Hadoop Common to make sure HDDS does 
> not impact current users of HDFS.
>
> The vote will run for 7 days, I will start this vote with my +1.
>
> Thanks
> Jitendra
>
>
> 
> -
> To unsubscribe, e-mail: 
> hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: 
> hdfs-dev-h...@hadoop.apache.org
>
>
>
>
>
>
> -
> To unsubscribe, e-mail: 
> hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: 
> hdfs-dev-h...@hadoop.apache.org
>
>
>

-
To unsubscribe, e-mail: 
hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: 
hdfs-dev-h...@hadoop.apache.org

Re: [RESULT][VOTE] Merge HDDS (HDFS-7240) *code* into trunk

2018-04-25 Thread Owen O'Malley 
*sigh*

I asked you guys to rebase this before merge. It is tempting to squash it
into a single commit.

.. Owen

On Wed, Apr 25, 2018 at 11:06 AM, Chris Douglas  wrote:

> This really made a mess of trunk. Periodically merging trunk into the
> HDFS-7240 branch, then merging the whole thing back, created a tangle
> of references that's very difficult to work with (look at the output
> of git log --graph).
>
> I'm not sure it's even possible to fix this, but this is why feature
> branches should rebase and create a merge commit with --no-ff. -C
>
>
> On Tue, Apr 24, 2018 at 1:20 PM, Xiaoyu Yao  wrote:
> > I just merged the branch to trunk (834 commits in total)
> > Again, thanks for all who contributed to HDDS/Ozone!
> >
> > Cheers
> > -Xiaoyu
> >
> > On 4/23/18, 7:26 PM, "Jitendra Pandey" 
> wrote:
> >
> > The vote passes with many +1s (12 committers + 5 contributors) and
> no -1.
> >
> > Thanks everyone for voting.
> >
> > On 4/17/18, 5:19 AM, "Jitendra Pandey" 
> wrote:
> >
> > Hi All,
> >
> >The community unanimously voted (https://s.apache.org/
> HDDSMergeResult) to adopt
> > HDDS/Ozone as a sub-project of Hadoop, here is the formal
> vote for code merge.
> >
> > Here is a quick summary of the code changes:
> >
> > - As decided in the JIRA HDFS-10419, the project has been
> renamed to Hadoop Distributed Data Store or HDDS.
> > - HDDS becomes a sub-project of Hadoop.
> > - Added a Maven profile that disables HDDS compilation by
> default.
> > - The releases of HDDS will be independent of Hadoop and
> will have no impact to current Hadoop release process.
> > - We have made HDDS a loadable module.
> > - Cleaned up changes in HDFS/Hadoop Common to make sure HDDS
> does not impact current users of HDFS.
> >
> > The vote will run for 7 days, I will start this vote with my
> +1.
> >
> > Thanks
> > Jitendra
> >
> >
> > 
> -
> > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.
> apache.org
> > For additional commands, e-mail:
> hdfs-dev-h...@hadoop.apache.org
> >
> >
> >
> >
> >
> >
> > 
> -
> > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
> >
> >
> >
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>

Re: [RESULT][VOTE] Merge HDDS (HDFS-7240) *code* into trunk

2018-04-25 Thread Chris Douglas 
This really made a mess of trunk. Periodically merging trunk into the
HDFS-7240 branch, then merging the whole thing back, created a tangle
of references that's very difficult to work with (look at the output
of git log --graph).

I'm not sure it's even possible to fix this, but this is why feature
branches should rebase and create a merge commit with --no-ff. -C


On Tue, Apr 24, 2018 at 1:20 PM, Xiaoyu Yao  wrote:
> I just merged the branch to trunk (834 commits in total)
> Again, thanks for all who contributed to HDDS/Ozone!
>
> Cheers
> -Xiaoyu
>
> On 4/23/18, 7:26 PM, "Jitendra Pandey"  wrote:
>
> The vote passes with many +1s (12 committers + 5 contributors) and no -1.
>
> Thanks everyone for voting.
>
> On 4/17/18, 5:19 AM, "Jitendra Pandey"  
> wrote:
>
> Hi All,
>
>The community unanimously voted 
> (https://s.apache.org/HDDSMergeResult) to adopt
> HDDS/Ozone as a sub-project of Hadoop, here is the formal vote 
> for code merge.
>
> Here is a quick summary of the code changes:
>
> - As decided in the JIRA HDFS-10419, the project has been renamed 
> to Hadoop Distributed Data Store or HDDS.
> - HDDS becomes a sub-project of Hadoop.
> - Added a Maven profile that disables HDDS compilation by default.
> - The releases of HDDS will be independent of Hadoop and will 
> have no impact to current Hadoop release process.
> - We have made HDDS a loadable module.
> - Cleaned up changes in HDFS/Hadoop Common to make sure HDDS does 
> not impact current users of HDFS.
>
> The vote will run for 7 days, I will start this vote with my +1.
>
> Thanks
> Jitendra
>
>
> 
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>
>
>
>
>
> -
> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
>
>
>

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13504) Ozone: Remove SCM Block DB

2018-04-25 Thread Xiaoyu Yao (JIRA) 
Xiaoyu Yao created HDFS-13504:
-

 Summary: Ozone: Remove SCM Block DB
 Key: HDFS-13504
 URL: https://issues.apache.org/jira/browse/HDFS-13504
 Project: Hadoop HDFS
  Issue Type: Improvement
Reporter: Xiaoyu Yao
Assignee: Xiaoyu Yao


The block/key information is maintained by Ozone Master (a.k.a. KSM). This 
ticket is opened to remove the redundant block db at SCM. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-04-25 Thread Apache Jenkins Server 
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/762/

[Mar 11, 2016 8:56:29 PM] (arp) HDFS-8456. Introduce STORAGE_CONTAINER_SERVICE 
as a new NodeType.
[Mar 11, 2016 8:56:44 PM] (arp) HDFS-8614. OzoneHandler : Add Quota Support. 
(Contributed by Anu
[Mar 11, 2016 8:57:05 PM] (arp) HDFS-8448. Create REST Interface for Volumes. 
Contributed by Anu
[Mar 11, 2016 8:57:06 PM] (arp) HDFS-8637. OzoneHandler : Add Error Table. 
(Contributed by Anu Engineer)
[Mar 11, 2016 8:57:06 PM] (arp) HDFS-8634. OzoneHandler: Add userAuth Interface 
and Simple userAuth
[Mar 11, 2016 8:57:06 PM] (arp) HDFS-8644. OzoneHandler : Add volume handler. 
(Contributed by Anu
[Mar 11, 2016 8:57:06 PM] (arp) HDFS-8654. OzoneHandler : Add ACL support. 
(Contributed by Anu Engineer)
[Mar 11, 2016 8:57:07 PM] (arp) HDFS-8680. OzoneHandler : Add Local 
StorageHandler support for volumes.
[Mar 11, 2016 8:57:07 PM] (arp) HDFS-8717. OzoneHandler : Add common bucket 
objects. (Contributed by Anu
[Mar 11, 2016 8:57:07 PM] (arp) HDFS-8753. Ozone: Unify 
StorageContainerConfiguration with
[Mar 11, 2016 8:57:07 PM] (arp) HDFS-8695. OzoneHandler : Add Bucket REST 
Interface. (aengineer)
[Mar 11, 2016 8:57:07 PM] (arp) HDFS-8527. OzoneHandler: Integration of REST 
interface and container
[Mar 11, 2016 8:57:08 PM] (arp) HDFS-8757 : OzoneHandler : Add 
localStorageHandler support for Buckets.
[Mar 11, 2016 8:57:08 PM] (arp) HDFS-9834. OzoneHandler : Enable MiniDFSCluster 
based testing for Ozone.
[Mar 11, 2016 8:57:08 PM] (arp) HDFS-9845. OzoneHandler : Support List and Info 
Volumes. Contributed by
[Mar 11, 2016 8:57:08 PM] (arp) HDFS-9853. Ozone: Add container definitions. 
Contributed by Anu
[Mar 11, 2016 8:57:08 PM] (arp) HDFS-9848. Ozone: Add Ozone Client lib for 
volume handling. Contributed
[Mar 11, 2016 8:57:09 PM] (arp) HDFS-9907. Exclude Ozone protobuf-generated 
classes from Findbugs
[Mar 11, 2016 8:57:09 PM] (arp) HDFS-9873. Ozone: Add container transport 
server. Contributed by Anu
[Mar 11, 2016 8:57:09 PM] (arp) HDFS-9891. Ozone: Add container transport 
client. Contributed by Anu
[Mar 11, 2016 8:57:09 PM] (arp) HDFS-9920. Stop tracking CHANGES.txt in the 
HDFS-7240 feature branch.
[Mar 11, 2016 8:57:10 PM] (arp) HDFS-9916. OzoneHandler : Add Key handler. 
Contributed by Anu Engineer.
[Mar 11, 2016 8:57:10 PM] (arp) HDFS-9916. OzoneHandler : Add Key handler. 
Contributed by Anu Engineer.
[Mar 11, 2016 9:03:15 PM] (arp) HDFS-9925. Ozone: Add Ozone Client lib for 
bucket handling. Contributed
[Mar 14, 2016 5:50:54 PM] (cnauroth) HDFS-9926. ozone : Add volume commands to 
CLI. Contributed by Anu
[Mar 14, 2016 11:16:35 PM] (cnauroth) HDFS-9944. Ozone : Add container 
dispatcher. Contributed by Anu
[Mar 16, 2016 4:27:53 AM] (cnauroth) HDFS-9961. Ozone: Add buckets commands to 
CLI. Contributed by Anu
[Mar 18, 2016 8:46:56 PM] (cnauroth) HDFS-10180. Ozone: Refactor container 
Namespace. Contributed by Anu
[Mar 19, 2016 8:36:18 PM] (cnauroth) HDFS-9960. OzoneHandler : Add localstorage 
support for keys. Contributed
[Mar 19, 2016 8:59:00 PM] (cnauroth) HDFS-10179. Ozone: Adding logging support. 
Contributed by Anu Engineer.
[Mar 24, 2016 4:27:10 PM] (cnauroth) HDFS-10196. Ozone : Enable better error 
reporting for failed commands in
[Mar 25, 2016 4:50:58 PM] (cnauroth) HDFS-10202. ozone : Add key commands to 
CLI. Contributed by Anu
[Mar 26, 2016 6:40:00 PM] (cnauroth) HDFS-10195. Ozone: Add container 
persistence. Contributed by Anu
[Mar 30, 2016 9:49:55 PM] (aengineer) HDFS-8210. Ozone: Implement storage 
container manager. Contributed by
[Apr 1, 2016 5:52:38 PM] (cnauroth) HDFS-10238. Ozone : Add chunk persistance. 
Contributed by Anu Engineer.
[Apr 5, 2016 7:59:45 PM] (cnauroth) HDFS-10250. Ozone: Add key Persistence. 
Contributed by Anu Engineer.
[Apr 7, 2016 9:38:54 PM] (aengineer) HDFS-10268. Ozone: end-to-end integration 
for create/get volumes,
[Apr 13, 2016 1:00:24 AM] (aengineer) HDFS-10251. Ozone: Shutdown cleanly. 
Contributed by Anu Engineer
[Apr 13, 2016 1:08:48 AM] (aengineer) HDFS-10278. Ozone: Add paging support to 
list Volumes. Contributed by
[Apr 18, 2016 11:52:40 PM] (aengineer) HDFS-10232. Ozone: Make config key 
naming consistent. Contributed by Anu
[Apr 30, 2016 3:44:38 AM] (cnauroth) HDFS-10349. Ozone: StorageContainerManager 
fails to compile after merge
[May 2, 2016 9:50:40 PM] (aengineer) HDFS-10351. Ozone: Optimize key writes to 
chunks by providing a bulk
[May 5, 2016 10:09:59 PM] (arp) HDFS-10361. Support starting 
StorageContainerManager as a daemon.
[May 19, 2016 6:02:40 PM] (aengineer) HDFS-10363. Ozone: Introduce new config 
keys for SCM service endpoints.
[May 20, 2016 10:19:09 PM] (arp) HDFS-10420. Fix Ozone unit tests to use 
MiniOzoneCluster. Contributed by
[Sep 29, 2016 5:36:25 PM] (aengineer) HDFS-10897. Ozone: SCM: Add NodeManager. 
Contributed by Anu Engineer.
[Oct 1, 2016 12:12:43 AM] (aengineer) HDFS-10932. Ozone: fix XceiverClient slow 
shutdown. Contributed by