Re: [onap-discuss] [SDNC] sdnc/oam: removing and purging files from git history

2018-08-31 Thread Alexis de Talhouet 
James,

Thanks for providing the history, I wasn’t aware, but glad to see this has 
bothered people already in the past.

Instead of granting us the permission, maybe they could do it themselves with 
PTL acknowledgement.
Could this be something LF would accept?

Thanks,
Alexis

> On Aug 31, 2018, at 8:22 AM, James MacNider  wrote:
> 
> Hi Alexis,
>
> Dan and I looked into this a while back as well, see 
> https://jira.onap.org/browse/SDNC-29 <https://jira.onap.org/browse/SDNC-29>.  
> It reached a dead end because the LF would not grant the permissions required 
> to clean up the history of the repo.  The suggested alternative is to do 
> shallow clones ( use “ –depth=1” ) when cloning this repository.
>
> Not ideal, I agree.
>
> Thanks,
> James
>
>
> From: onap-discuss@lists.onap.org  On Behalf Of 
> Alexis de Talhouet
> Sent: Thursday, August 30, 2018 9:37 AM
> To: onap-s...@lists.onap.org; onap-discuss ; 
> helpd...@onap.org
> Subject: [onap-discuss] [SDNC] sdnc/oam: removing and purging files from git 
> history
>
> Greetings,
> 
> The sdnc/oam project has some large deleted filed remaining in its git 
> repository, making the git clone pretty long, as almost 1GB has to be 
> transfer.
> 
> I found through this website a way to get rid of that: 
> https://blog.ostermiller.org/git-remove-from-history 
> <https://blog.ostermiller.org/git-remove-from-history>
> 
> So locally I’ve done the following, the main culprit are the two odl distro:
> 
> $ git rev-list --objects --all | git cat-file --batch-check='%(objecttype) 
> %(objectname) %(objectsize) %(rest)' | sed -n 's/^blob //p' | sort 
> --numeric-sort --key=2 | cut -c 1-12,41-
> 
> SHASIZE   FILE NAME
> e3c6abcc979f 295660449 
> installation/sdnc/src/main/resources/distribution-karaf-0.4.2-Beryllium-SR2.tar.gz
> b6c13a8f784e 424102999 
> installation/sdnc/src/main/resources/distribution-karaf-0.5.1-Boron-SR1.tar.gz
> 
> $ git filter-branch --tag-name-filter cat --index-filter 'git rm -r --cached 
> --ignore-unmatch 
> installation/sdnc/src/main/resources/distribution-karaf-0.4.2-Beryllium-SR2.tar.gz'
>  --prune-empty -f -- --all
> $ git filter-branch --tag-name-filter cat --index-filter 'git rm -r --cached 
> --ignore-unmatch 
> installation/sdnc/src/main/resources/distribution-karaf-0.5.1-Boron-SR1.tar.gz'
>  --prune-empty -f -- —all
> 
> $ rm -rf .git/refs/original/
> $ git reflog expire --expire=now --all
> $ git gc --aggressive --prune=now
> 
> 
> I have submitted https://gerrit.onap.org/r/#/c/63805/ 
> <https://gerrit.onap.org/r/#/c/63805/> to get rid of the first one.
> 
> But the second one was already removed, but still remain somewhere as an 
> object in the git repository.
> 
> Is it possible for the gerrit administrator to run some clean-up command in 
> the git repo to get rid of objects that were deleted?
>
> Regards,
> Alexis
> 
> “Amdocs’ email platform is based on a third-party, worldwide, cloud-based 
> system. Any emails sent to Amdocs will be processed and stored using such 
> system and are accessible by third party providers of such system on a 
> limited basis. Your sending of emails to Amdocs evidences your consent to the 
> use of such system and such processing, storing and access”.


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#12183): https://lists.onap.org/g/onap-discuss/message/12183
Mute This Topic: https://lists.onap.org/mt/25108379/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [onap-discuss] [SDNC] sdnc/oam: removing and purging files from git history

2018-08-31 Thread James MacNider 
Hi Alexis,

Dan and I looked into this a while back as well, see 
https://jira.onap.org/browse/SDNC-29.  It reached a dead end because the LF 
would not grant the permissions required to clean up the history of the repo.  
The suggested alternative is to do shallow clones ( use “ –depth=1” ) when 
cloning this repository.

Not ideal, I agree.

Thanks,
James


From: onap-discuss@lists.onap.org  On Behalf Of 
Alexis de Talhouet
Sent: Thursday, August 30, 2018 9:37 AM
To: onap-s...@lists.onap.org; onap-discuss ; 
helpd...@onap.org
Subject: [onap-discuss] [SDNC] sdnc/oam: removing and purging files from git 
history

Greetings,

The sdnc/oam project has some large deleted filed remaining in its git 
repository, making the git clone pretty long, as almost 1GB has to be transfer.

I found through this website a way to get rid of that: 
https://blog.ostermiller.org/git-remove-from-history

So locally I’ve done the following, the main culprit are the two odl distro:

$ git rev-list --objects --all | git cat-file --batch-check='%(objecttype) 
%(objectname) %(objectsize) %(rest)' | sed -n 's/^blob //p' | sort 
--numeric-sort --key=2 | cut -c 1-12,41-

SHASIZE   FILE NAME
e3c6abcc979f 295660449 
installation/sdnc/src/main/resources/distribution-karaf-0.4.2-Beryllium-SR2.tar.gz
b6c13a8f784e 424102999 
installation/sdnc/src/main/resources/distribution-karaf-0.5.1-Boron-SR1.tar.gz

$ git filter-branch --tag-name-filter cat --index-filter 'git rm -r --cached 
--ignore-unmatch 
installation/sdnc/src/main/resources/distribution-karaf-0.4.2-Beryllium-SR2.tar.gz'
 --prune-empty -f -- --all
$ git filter-branch --tag-name-filter cat --index-filter 'git rm -r --cached 
--ignore-unmatch 
installation/sdnc/src/main/resources/distribution-karaf-0.5.1-Boron-SR1.tar.gz' 
--prune-empty -f -- —all

$ rm -rf .git/refs/original/
$ git reflog expire --expire=now --all
$ git gc --aggressive --prune=now


I have submitted https://gerrit.onap.org/r/#/c/63805/ to get rid of the first 
one.

But the second one was already removed, but still remain somewhere as an object 
in the git repository.

Is it possible for the gerrit administrator to run some clean-up command in the 
git repo to get rid of objects that were deleted?

Regards,
Alexis

“Amdocs’ email platform is based on a third-party, worldwide, cloud-based 
system. Any emails sent to Amdocs will be processed and stored using such 
system and are accessible by third party providers of such system on a limited 
basis. Your sending of emails to Amdocs evidences your consent to the use of 
such system and such processing, storing and access”.

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#12182): https://lists.onap.org/g/onap-discuss/message/12182
Mute This Topic: https://lists.onap.org/mt/25108379/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[onap-discuss] [SDNC] sdnc/oam: removing and purging files from git history

2018-08-30 Thread Alexis de Talhouet 
Greetings,

The sdnc/oam project has some large deleted filed remaining in its git 
repository, making the git clone pretty long, as almost 1GB has to be transfer.

I found through this website a way to get rid of that: 
https://blog.ostermiller.org/git-remove-from-history 


So locally I’ve done the following, the main culprit are the two odl distro:

$ git rev-list --objects --all | git cat-file --batch-check='%(objecttype) 
%(objectname) %(objectsize) %(rest)' | sed -n 's/^blob //p' | sort 
--numeric-sort --key=2 | cut -c 1-12,41-

SHASIZE   FILE NAME
e3c6abcc979f 295660449 
installation/sdnc/src/main/resources/distribution-karaf-0.4.2-Beryllium-SR2.tar.gz
b6c13a8f784e 424102999 
installation/sdnc/src/main/resources/distribution-karaf-0.5.1-Boron-SR1.tar.gz

$ git filter-branch --tag-name-filter cat --index-filter 'git rm -r --cached 
--ignore-unmatch 
installation/sdnc/src/main/resources/distribution-karaf-0.4.2-Beryllium-SR2.tar.gz'
 --prune-empty -f -- --all
$ git filter-branch --tag-name-filter cat --index-filter 'git rm -r --cached 
--ignore-unmatch 
installation/sdnc/src/main/resources/distribution-karaf-0.5.1-Boron-SR1.tar.gz' 
--prune-empty -f -- —all

$ rm -rf .git/refs/original/
$ git reflog expire --expire=now --all
$ git gc --aggressive --prune=now


I have submitted https://gerrit.onap.org/r/#/c/63805/ 
 to get rid of the first one.

But the second one was already removed, but still remain somewhere as an object 
in the git repository.

Is it possible for the gerrit administrator to run some clean-up command in the 
git repo to get rid of objects that were deleted?

Regards,
Alexis
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#12150): https://lists.onap.org/g/onap-discuss/message/12150
Mute This Topic: https://lists.onap.org/mt/25108379/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub  
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-