Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in .glusterfs/changelogs

2017-04-06 Thread mabi 
Amazing, thanks Amar for creating the issue!

Cheers,
M.

 Original Message 
Subject: Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in 
.glusterfs/changelogs
Local Time: April 6, 2017 4:08 AM
UTC Time: April 6, 2017 2:08 AM
From: atumb...@redhat.com
To: mabi <m...@protonmail.ch>
Mohammed Rafi K C <rkavu...@redhat.com>, Gluster Users 
<gluster-users@gluster.org>

On Wed, Apr 5, 2017 at 10:58 PM, mabi <m...@protonmail.ch> wrote:
Thanks to all of you for your answers.
I will try the archive tool as recommended by Aravinda.
Just for your information I suppose you are aware that having tons of files 
such as the CHANGELOGS in one single directory is really sub-optimal. Maybe 
better would be to have a 2 level hierarchy and store the files using an 
algorithm to distribute the files among that 2 level hierarchy of 
sub-directories, especially if there is no archiving of these files by default. 
Just my two cents ;-)

These 2 cents helps when summed up later :-)

Created a github issues so that we don't miss it : 
https://github.com/gluster/glusterfs/issues/154
Regards,
Amar

Cheers

 Original Message ----
Subject: Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in 
.glusterfs/changelogs
Local Time: April 5, 2017 8:44 AM
UTC Time: April 5, 2017 6:44 AM
From: atumb...@redhat.com
To: Mohammed Rafi K C <rkavu...@redhat.com>
mabi <m...@protonmail.ch>, Gluster Users <gluster-users@gluster.org>

Local Time: March 31, 2017 11:22 PM
UTC Time: March 31, 2017 9:22 PM
From: m...@protonmail.ch
To: Gluster Users 
[<gluster-users@gluster.org>](mailto:gluster-users@gluster.org)

Hi,

I am using geo-replication since now over a year on my 3.7.20 GlusterFS volumes 
and noticed that the CHANGELOG. in the .glusterfs/changelogs 
directory of a brick never get deleted. I have for example over 120k files in 
one of these directories and it is growing constantly.

So my question, does GlusterFS have any mechanism to automatically delete old 
and processed CHANGELOG files? If not is it safe to delete them manually?

I will try to answer the question, I'm not an expert in geo-replication, So I 
could be wrong here. I think GlusterFS won't delete the changelogs 
automatically, reason being geo-replication is not the author of changelogs, it 
is just a consumer any other application could use changelogs.

+1 for the reasoning.

You can safely delete *all processed* changelogs from actual changelogs 
directory and geo-replication directory. You can look into the stime set as the 
extended attribute on the root to see the time which geo-replication last 
synced.

If georep is the only consumer, you can use [Aravinda's 
tool](https://github.com/aravindavk/archive_gluster_changelogs)to move the 
files to another dir, and delete them.

Regards,
Amar

--

Amar Tumballi (amarts)___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in .glusterfs/changelogs

2017-04-05 Thread Amar Tumballi 
On Wed, Apr 5, 2017 at 10:58 PM, mabi <m...@protonmail.ch> wrote:

> Thanks to all of you for your answers.
> I will try the archive tool as recommended by Aravinda.
> Just for your information I suppose you are aware that having tons of
> files such as the CHANGELOGS in one single directory is really sub-optimal.
> Maybe better would be to have a 2 level hierarchy and store the files using
> an algorithm to distribute the files among that 2 level hierarchy of
> sub-directories, especially if there is no archiving of these files by
> default. Just my two cents ;-)
>
>
These 2 cents helps when summed up later :-)

Created a github issues so that we don't miss it :
https://github.com/gluster/glusterfs/issues/154

Regards,
Amar



> Cheers
>
>
>
> ---- Original Message ----
> Subject: Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in
> .glusterfs/changelogs
> Local Time: April 5, 2017 8:44 AM
> UTC Time: April 5, 2017 6:44 AM
> From: atumb...@redhat.com
> To: Mohammed Rafi K C <rkavu...@redhat.com>
> mabi <m...@protonmail.ch>, Gluster Users <gluster-users@gluster.org>
>
>
> Local Time: March 31, 2017 11:22 PM
>> UTC Time: March 31, 2017 9:22 PM
>> From: m...@protonmail.ch
>> To: Gluster Users <gluster-users@gluster.org> <gluster-users@gluster.org>
>>
>> Hi,
>>
>> I am using geo-replication since now over a year on my 3.7.20 GlusterFS
>> volumes and noticed that the CHANGELOG. in the
>> .glusterfs/changelogs directory of a brick never get deleted. I have for
>> example over 120k files in one of these directories and it is growing
>> constantly.
>>
>> So my question, does GlusterFS have any mechanism to automatically delete
>> old and processed CHANGELOG files? If not is it safe to delete them
>> manually?
>>
>>
>> I will try to answer the question, I'm not an expert in geo-replication,
>> So I could be wrong here. I think GlusterFS won't delete the changelogs
>> automatically, reason being geo-replication is not the author of
>> changelogs, it is just a consumer any other application could use
>> changelogs.
>>
>
> +1 for the reasoning.
>
>
>>
>> You can safely delete* *all processed** changelogs from actual
>> changelogs directory and geo-replication directory. You can look into the
>> stime set as the extended attribute on the root to see the time which
>> geo-replication last synced.
>>
>>
> If georep is the only consumer, you can use Aravinda's tool
> <https://github.com/aravindavk/archive_gluster_changelogs>to move the
> files to another dir, and delete them.
>
> Regards,
> Amar
>
>
>
>


-- 
Amar Tumballi (amarts)
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in .glusterfs/changelogs

2017-04-05 Thread mabi 
Thanks to all of you for your answers.
I will try the archive tool as recommended by Aravinda.
Just for your information I suppose you are aware that having tons of files 
such as the CHANGELOGS in one single directory is really sub-optimal. Maybe 
better would be to have a 2 level hierarchy and store the files using an 
algorithm to distribute the files among that 2 level hierarchy of 
sub-directories, especially if there is no archiving of these files by default. 
Just my two cents ;-)

Cheers

 Original Message 
Subject: Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in 
.glusterfs/changelogs
Local Time: April 5, 2017 8:44 AM
UTC Time: April 5, 2017 6:44 AM
From: atumb...@redhat.com
To: Mohammed Rafi K C <rkavu...@redhat.com>
mabi <m...@protonmail.ch>, Gluster Users <gluster-users@gluster.org>

Local Time: March 31, 2017 11:22 PM
UTC Time: March 31, 2017 9:22 PM
From: m...@protonmail.ch
To: Gluster Users 
[<gluster-users@gluster.org>](mailto:gluster-users@gluster.org)

Hi,

I am using geo-replication since now over a year on my 3.7.20 GlusterFS volumes 
and noticed that the CHANGELOG. in the .glusterfs/changelogs 
directory of a brick never get deleted. I have for example over 120k files in 
one of these directories and it is growing constantly.

So my question, does GlusterFS have any mechanism to automatically delete old 
and processed CHANGELOG files? If not is it safe to delete them manually?

I will try to answer the question, I'm not an expert in geo-replication, So I 
could be wrong here. I think GlusterFS won't delete the changelogs 
automatically, reason being geo-replication is not the author of changelogs, it 
is just a consumer any other application could use changelogs.

+1 for the reasoning.

You can safely delete *all processed* changelogs from actual changelogs 
directory and geo-replication directory. You can look into the stime set as the 
extended attribute on the root to see the time which geo-replication last 
synced.

If georep is the only consumer, you can use [Aravinda's 
tool](https://github.com/aravindavk/archive_gluster_changelogs)to move the 
files to another dir, and delete them.

Regards,
Amar___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in .glusterfs/changelogs

2017-04-05 Thread Amar Tumballi 
> Local Time: March 31, 2017 11:22 PM
> UTC Time: March 31, 2017 9:22 PM
> From: m...@protonmail.ch
> To: Gluster Users  
>
> Hi,
>
> I am using geo-replication since now over a year on my 3.7.20 GlusterFS
> volumes and noticed that the CHANGELOG. in the
> .glusterfs/changelogs directory of a brick never get deleted. I have for
> example over 120k files in one of these directories and it is growing
> constantly.
>
> So my question, does GlusterFS have any mechanism to automatically delete
> old and processed CHANGELOG files? If not is it safe to delete them
> manually?
>
>
> I will try to answer the question, I'm not an expert in geo-replication,
> So I could be wrong here. I think GlusterFS won't delete the changelogs
> automatically, reason being geo-replication is not the author of
> changelogs, it is just a consumer any other application could use
> changelogs.
>


+1 for the reasoning.


>
> You can safely delete* *all processed** changelogs from actual changelogs
> directory and geo-replication directory. You can look into the stime set as
> the extended attribute on the root to see the time which geo-replication
> last synced.
>
>
If georep is the only consumer, you can use Aravinda's tool
to move the files
to another dir, and delete them.

Regards,
Amar
___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in .glusterfs/changelogs

2017-04-04 Thread Aravinda 

This tool can be used to archive Gluster Changelogs to different directory
https://github.com/aravindavk/archive_gluster_changelogs

regards
Aravinda

On 04/05/2017 11:22 AM, Mohammed Rafi K C wrote:




On 04/04/2017 10:53 PM, mabi wrote:

Anyone?




 Original Message 
Subject: Deletion of old CHANGELOG files in .glusterfs/changelogs
Local Time: March 31, 2017 11:22 PM
UTC Time: March 31, 2017 9:22 PM
From: m...@protonmail.ch
To: Gluster Users 

Hi,

I am using geo-replication since now over a year on my 3.7.20 
GlusterFS volumes and noticed that the CHANGELOG. in the 
.glusterfs/changelogs directory of a brick never get deleted. I have 
for example over 120k files in one of these directories and it is 
growing constantly.


So my question, does GlusterFS have any mechanism to automatically 
delete old and processed CHANGELOG files? If not is it safe to 
delete them manually?


I will try to answer the question, I'm not an expert in 
geo-replication, So I could be wrong here. I think GlusterFS won't 
delete the changelogs automatically, reason being geo-replication is 
not the author of changelogs, it is just a consumer any other 
application could use changelogs.


You can safely delete**all processed** changelogs from actual 
changelogs directory and geo-replication directory. You can look into 
the stime set as the extended attribute on the root to see the time 
which geo-replication last synced.


Adding Kotresh, and Aravinda .

Regards
Rafi KC






Regards,
Mabi



___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users




___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Fw: Deletion of old CHANGELOG files in .glusterfs/changelogs

2017-04-04 Thread Mohammed Rafi K C 


On 04/04/2017 10:53 PM, mabi wrote:
> Anyone?
>
>
>
>>  Original Message 
>> Subject: Deletion of old CHANGELOG files in .glusterfs/changelogs
>> Local Time: March 31, 2017 11:22 PM
>> UTC Time: March 31, 2017 9:22 PM
>> From: m...@protonmail.ch
>> To: Gluster Users 
>>
>> Hi,
>>
>> I am using geo-replication since now over a year on my 3.7.20
>> GlusterFS volumes and noticed that the CHANGELOG. in the
>> .glusterfs/changelogs directory of a brick never get deleted. I have
>> for example over 120k files in one of these directories and it is
>> growing constantly.
>>
>> So my question, does GlusterFS have any mechanism to automatically
>> delete old and processed CHANGELOG files? If not is it safe to delete
>> them manually?

I will try to answer the question, I'm not an expert in geo-replication,
So I could be wrong here. I think GlusterFS won't delete the changelogs
automatically, reason being geo-replication is not the author of
changelogs, it is just a consumer any other application could use
changelogs.

You can safely delete**all processed** changelogs from actual changelogs
directory and geo-replication directory. You can look into the stime set
as the extended attribute on the root to see the time which
geo-replication last synced.

Adding Kotresh, and Aravinda .

Regards
Rafi KC


>>
>>
>>
>> Regards,
>> Mabi
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users

___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] Fw: Deletion of old CHANGELOG files in .glusterfs/changelogs

2017-04-04 Thread mabi 
Anyone?

 Original Message 
Subject: Deletion of old CHANGELOG files in .glusterfs/changelogs
Local Time: March 31, 2017 11:22 PM
UTC Time: March 31, 2017 9:22 PM
From: m...@protonmail.ch
To: Gluster Users 

Hi,

I am using geo-replication since now over a year on my 3.7.20 GlusterFS volumes 
and noticed that the CHANGELOG. in the .glusterfs/changelogs 
directory of a brick never get deleted. I have for example over 120k files in 
one of these directories and it is growing constantly.

So my question, does GlusterFS have any mechanism to automatically delete old 
and processed CHANGELOG files? If not is it safe to delete them manually?

Regards,
Mabi___
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users