[Gluster-users] volume heal statistics heal-count replica

2016-10-14 Thread Lindsay Mathieson 

What does the subject line cmd do?

e.g

 gluster v heal datastore4 statistics heal-count replica 
vnb.proxmox.softlog:/tank/vmdata/datastore4


seems to have exactly the same output as:

 gluster v heal datastore4 statistics heal-count


Gathering count of entries to be healed per replica on volume datastore4 
has been successful


Brick vnb.proxmox.softlog:/tank/vmdata/datastore4
Number of entries: 0

Brick vng.proxmox.softlog:/tank/vmdata/datastore4
Number of entries: 0

Brick vna.proxmox.softlog:/tank/vmdata/datastore4
Number of entries: 0

Setting up some zabbix monitoring and it would be good to see statistics 
for individual bricks.



--
Lindsay Mathieson

___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] [Gluster-devel] opportunist for outreachy

2016-10-14 Thread Pranith Kumar Karampuri 
On Fri, Oct 14, 2016 at 9:27 PM, Shyam  wrote:

> On 10/14/2016 10:48 AM, Manikandan Selvaganesh wrote:
>
>> Hi Soumya,
>>
>> Welcome to the community.
>>
>> Here[1] is the link for Gluster Documentation. I would suggest you to
>> google and
>> read a bit about GlusterFS and then get started with "Quick Start
>> Guide[2]".
>> Once you have done your setup and have played a bit around the
>> installation and
>> configuration move on with "Developers Guide[3]".
>>
>> If you want to get started with Code contributions pick some EasyFix
>> bugs which
>> can be found here[4]. After this I hope you would have got a minimal
>> idea and then
>> explore more in depth and pick up the project/component which interests
>> you more.
>> Again, we have some list of projects[5] already listed, check out if
>> anything interests
>> you here. Feel free to bring your own ideas as well. These are quite
>> generic for anyone
>> who is new to the community and in case if  you want to know
>> specifically about
>> Outreachy, someone in the community will surely respond to you shortly.
>>
>
> Let me take the Outreachy part up.
>
> There are 2 projects there, one relating to the documentation, for which
> Manikandan has filled in some links and thoughts. The other being the
> instrumentation tooling around performance.
>
> For the latter, I would suggest that you get a gluster volume up and
> running, and attempt the GlusterBench.py [6] against it, and start with
> reporting the results. Again, Manikandan has covered getting gluster up and
> running. For any questions, or things that you get stuck on when running
> the bench script, post back here and we will help as needed.
>
>
>> If you have queries, please mail us back. Also, we are always available
>> on #gluster-dev
>> and #gluster-meeting in Freenode.
>>
>> All the best :-)
>>
>> [1] https://gluster.readthedocs.io/en/latest/
>>
>> [2] https://gluster.readthedocs.io/en/latest/Quick-Start-Guide/
>> Quickstart/
>>
>> [3] https://gluster.readthedocs.io/en/latest/Developer-guide/Dev
>> elopers-Index/
>>
>> [4] https://gluster.readthedocs.io/en/latest/Developer-guide/Eas
>> y-Fix-Bugs/
>>
>> [5] https://gluster.readthedocs.io/en/latest/Developer-guide/Projects/
>>
>
> [6] GlusterBench.py : https://github.com/gluster/gbe
> nch/tree/master/bench-tests/bt--0001


Hi Soumya,
I see that the important information is already given by Mani and
Shyam. I went to IIIT-Hyderabad for my Engineering (2003-2007). It is
really good to see you here :-). I will be happy to visit the campus next
time I visit Hyderabad and introduce folks to gluster (I am hoping Linux
Users Group is still as active as it used to be). I heard that our college
is very famous now because of the performances in ACM ICPC, may be we
should make it famous for open-source contributions too in future :-).

All the best!


>
>
>>
>> --
>> Cheers,
>> Manikandan Selvaganesh.
>>
>> On Fri, Oct 14, 2016 at 7:56 PM, Ms ms > > wrote:
>>
>> Hi,
>>
>> I'm a research student pursuing my Masters in IIIT-Hyderabad. I am
>> keen on working on Gluster's Outreachy project.
>>
>> I have prior experience in configuring, maintaining and managing
>> systems in an MHRD project. I have completed the required course
>> credits towards my degree and am working on my Thesis currently. It
>> would be great opportunity for me to learn and contribute to the
>> project as well.
>>
>> As I am a bit new to the community it would be nice if anyone can
>> guide me a few useful resources to get me started.
>>
>> Thanks and regards,
>> Soumya
>>
>> ___
>> Gluster-users mailing list
>> Gluster-users@gluster.org 
>> http://www.gluster.org/mailman/listinfo/gluster-users
>> 
>>
>>
>>
>>
>> ___
>> Gluster-users mailing list
>> Gluster-users@gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-users
>>
>> ___
> Gluster-devel mailing list
> gluster-de...@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
>



-- 
Pranith
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] Rebalancing after adding larger bricks

2016-10-14 Thread Nithya Balachandran 
On 11 October 2016 at 22:32, Jackie Tung  wrote:

> Joe,
>
> Thanks for that, that was educational.  Gluster docs claim that since 3.7,
> DHT hash ranges are weighted based on brick sizes by default:
>
> $ gluster volume get  Option  Value
>
> --  -
>
> cluster.weighted-rebalance  on
>
>
> When running rebalance with force, I see this in the rebalance log:
>
> ...
> [2016-10-11 16:38:37.655144] I [MSGID: 109045]
> [dht-selfheal.c:1751:dht_fix_layout_of_directory] 0-cronut-dht: subvolume
> 10 (cronut-replicate-10): *5721127* chunks
> [2016-10-11 16:38:37.655154] I [MSGID: 109045]
> [dht-selfheal.c:1751:dht_fix_layout_of_directory] 0-cronut-dht: subvolume
> 11 (cronut-replicate-11): *7628846* chunks
> …
>
> subvolume >=11 are 8TB, subvolume <= 10 is are 6TB.
>
> Do you think it is possible to even out usage on all bricks by % utilized
> now?  This would be the case if gluster rebalanced simply by what the
> scaled DHT says, including all required data migrations?
>
>
Can you please send the following:

1. The rebalance logs (/var/log/gluster/-rebalance.log) from each
node
2. The output of the following for the root of each brick:
  getfattr -e hex -m . -d 
3. gluster volume info
4. The version of glusterfs that you are running.
5. gluster volume rebalance  status

Are the file sizes more or less the same or are there large variations in
them?


Thanks,
Nithya


> It would be preferable for us to avoid having to depend on
> cluster.min-free-disk to manage overflow later on - as this introduces one
> extra read of the link followed by the actual IOP.
>
> Thanks,
> Jackie
>
> On Oct 10, 2016, at 11:13 AM, Joe Julian  wrote:
>
> I've written an example of how gluster's dht works on my blog at
> https://joejulian.name/blog/dht-misses-are-expensive/ which might make it
> clear why the end result is not what you expected.
>
> By setting cluster.min-free-disk (defaults to 10%) you can, at least,
> ensure that your new bricks are utilized as needed to prevent over filling
> your smaller bricks.
> On 10/10/2016 10:13 AM, Jackie Tung wrote:
>
> Hi,
>
> We have a 2 node, distributed replicated setup (11 bricks on each node).
> Each of these bricks are 6TB in size.
>
> node_A:/brick1 replicates node_B:/brick1
> node_A:/brick2 replicates node_B:/brick2
> node_A:/brick3 replicates node_B:/brick3
> …
> …
> node_A:/brick11 replicates node_B:/brick11
>
> We recently added 5 more bricks to make it 16 bricks on each node in
> total.  Each of these new bricks are 8TB in size.
>
> We completed a full rebalance operation (status says “completed”).
>
> However the end result is somewhat unexpected:
> */dev/sdl1 7.3T 2.2T 5.2T 29%*
> */dev/sdk1 7.3T 2.0T 5.3T 28%*
> */dev/sdj1 7.3T 2.0T 5.3T 28%*
> */dev/sdn1 7.3T 2.2T 5.2T 30%*
> */dev/sdp1 7.3T 2.2T 5.2T 30%*
> /dev/sdc1 5.5T 2.3T 3.2T 42%
> /dev/sdf1 5.5T 2.3T 3.2T 43%
> /dev/sdo1 5.5T 2.3T 3.2T 42%
> /dev/sda1 5.5T 2.3T 3.2T 43%
> /dev/sdi1 5.5T 2.3T 3.2T 42%
> /dev/sdh1 5.5T 2.3T 3.2T 43%
> /dev/sde1 5.5T 2.3T 3.2T 42%
> /dev/sdb1 5.5T 2.3T 3.2T 42%
> /dev/sdm1 5.5T 2.3T 3.2T 42%
> /dev/sdg1 5.5T 2.3T 3.2T 42%
> /dev/sdd1 5.5T 2.3T 3.2T 42%
>
> The df output in *bold* are the new 8TB drives.
> Was I wrong to expect the % usage to be roughly equal?  Is there some
> parameter I need to tweak to make rebalance account for disk sizes properly?
>
> I’m using Gluster 3.8 on Ubuntu.
>
> Thanks,
> Jackie
>
> The information in this email is confidential and may be legally
> privileged. It is intended solely for the addressee. Access to this email
> by anyone else is unauthorized. If you are not the intended recipient, any
> disclosure, copying, distribution or any action taken or omitted to be
> taken in reliance on it, is prohibited and may be unlawful.
>
>
> ___
> Gluster-users mailing 
> listGluster-users@gluster.orghttp://www.gluster.org/mailman/listinfo/gluster-users
>
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
>
>
> The information in this email is confidential and may be legally
> privileged. It is intended solely for the addressee. Access to this email
> by anyone else is unauthorized. If you are not the intended recipient, any
> disclosure, copying, distribution or any action taken or omitted to be
> taken in reliance on it, is prohibited and may be unlawful.
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] opportunist for outreachy

2016-10-14 Thread Shyam 

On 10/14/2016 10:48 AM, Manikandan Selvaganesh wrote:

Hi Soumya,

Welcome to the community.

Here[1] is the link for Gluster Documentation. I would suggest you to
google and
read a bit about GlusterFS and then get started with "Quick Start
Guide[2]".
Once you have done your setup and have played a bit around the
installation and
configuration move on with "Developers Guide[3]".

If you want to get started with Code contributions pick some EasyFix
bugs which
can be found here[4]. After this I hope you would have got a minimal
idea and then
explore more in depth and pick up the project/component which interests
you more.
Again, we have some list of projects[5] already listed, check out if
anything interests
you here. Feel free to bring your own ideas as well. These are quite
generic for anyone
who is new to the community and in case if  you want to know
specifically about
Outreachy, someone in the community will surely respond to you shortly.


Let me take the Outreachy part up.

There are 2 projects there, one relating to the documentation, for which 
Manikandan has filled in some links and thoughts. The other being the 
instrumentation tooling around performance.


For the latter, I would suggest that you get a gluster volume up and 
running, and attempt the GlusterBench.py [6] against it, and start with 
reporting the results. Again, Manikandan has covered getting gluster up 
and running. For any questions, or things that you get stuck on when 
running the bench script, post back here and we will help as needed.




If you have queries, please mail us back. Also, we are always available
on #gluster-dev
and #gluster-meeting in Freenode.

All the best :-)

[1] https://gluster.readthedocs.io/en/latest/

[2] https://gluster.readthedocs.io/en/latest/Quick-Start-Guide/Quickstart/

[3] https://gluster.readthedocs.io/en/latest/Developer-guide/Developers-Index/

[4] https://gluster.readthedocs.io/en/latest/Developer-guide/Easy-Fix-Bugs/

[5] https://gluster.readthedocs.io/en/latest/Developer-guide/Projects/


[6] GlusterBench.py : 
https://github.com/gluster/gbench/tree/master/bench-tests/bt--0001





--
Cheers,
Manikandan Selvaganesh.

On Fri, Oct 14, 2016 at 7:56 PM, Ms ms > wrote:

Hi,

I'm a research student pursuing my Masters in IIIT-Hyderabad. I am
keen on working on Gluster's Outreachy project.

I have prior experience in configuring, maintaining and managing
systems in an MHRD project. I have completed the required course
credits towards my degree and am working on my Thesis currently. It
would be great opportunity for me to learn and contribute to the
project as well.

As I am a bit new to the community it would be nice if anyone can
guide me a few useful resources to get me started.

Thanks and regards,
Soumya

___
Gluster-users mailing list
Gluster-users@gluster.org 
http://www.gluster.org/mailman/listinfo/gluster-users





___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users


___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] [Gluster-devel] Weekly Community Meeting 12 Oct 2016 - Minutes

2016-10-14 Thread Shyam 

On 10/13/2016 09:20 AM, Joe Julian wrote:

You forgot to count yourself: 6.

But still ... 6 when there was 60(?) in Berlin seems light. I know the
4am time doesn't work for the west coast of America, but that only
eliminates a very small percentage of those.

What's up, everyone else? Can something change to make participation
possible for you?


It would be a crime not to respond :)

This falls bang at 8:00 AM (eastern TZ) for me, and I have kid duties at 
that particular hour. 8:30 AM Eastern would be just fine, or earlier, 
but this is just me.


I read the meeting notes religiously every week though (just stating, in 
case that counts towards not absolving my duties).




On October 13, 2016 4:36:38 AM PDT, "Kaleb S. KEITHLEY"
 wrote:

Hi all,

Thank you to the five participants in today's community meeting. The
next meeting is scheduled next week (October 19th) at #gluster-meeting.

___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] [URGENT] Add-bricks to a volume corrupted the files

2016-10-14 Thread David Gossage 
Sorry to resurrect an old email but did any resolution occur for this or a
cause found?  I just see this as a potential task I may need to also run
through some day and if their are pitfalls to watch for would be good to
know.

*David Gossage*
*Carousel Checks Inc. | System Administrator*
*Office* 708.613.2284

On Tue, Sep 6, 2016 at 5:38 AM, Kevin Lemonnier 
wrote:

> Hi,
>
> Here is the info :
>
> Volume Name: VMs
> Type: Replicate
> Volume ID: c5272382-d0c8-4aa4-aced-dd25a064e45c
> Status: Started
> Number of Bricks: 1 x 3 = 3
> Transport-type: tcp
> Bricks:
> Brick1: ips4adm.name:/mnt/storage/VMs
> Brick2: ips5adm.name:/mnt/storage/VMs
> Brick3: ips6adm.name:/mnt/storage/VMs
> Options Reconfigured:
> performance.readdir-ahead: on
> cluster.quorum-type: auto
> cluster.server-quorum-type: server
> network.remote-dio: enable
> cluster.eager-lock: enable
> performance.quick-read: off
> performance.read-ahead: off
> performance.io-cache: off
> performance.stat-prefetch: off
> features.shard: on
> features.shard-block-size: 64MB
> cluster.data-self-heal-algorithm: full
> network.ping-timeout: 15
>
>
> For the logs I'm sending that over to you in private.
>
>
> On Tue, Sep 06, 2016 at 09:48:07AM +0530, Krutika Dhananjay wrote:
> >Could you please attach the glusterfs client and brick logs?
> >Also provide output of `gluster volume info`.
> >-Krutika
> >On Tue, Sep 6, 2016 at 4:29 AM, Kevin Lemonnier  >
> >wrote:
> >
> >  >A  A  - What was the original (and current) geometry? (status and
> info)
> >
> >  It was a 1x3 that I was trying to bump to 2x3.
> >  >A  A  - what parameters did you use when adding the bricks?
> >  >
> >
> >  Just a simple add-brick node1:/path node2:/path node3:/path
> >  Then a fix-layout when everything started going wrong.
> >
> >  I was able to salvage some VMs by stopping them then starting them
> >  again,
> >  but most won't start for various reasons (disk corrupted, grub not
> found
> >  ...).
> >  For those we are deleting the disks then importing them from
> backups,
> >  that's
> >  a huge loss but everything has been down for so long, no choice ..
> >  >A  A  On 6/09/2016 8:00 AM, Kevin Lemonnier wrote:
> >  >
> >  >A  I tried a fix-layout, and since that didn't work I removed the
> brick
> >  (start then commit when it showed
> >  >A  completed). Not better, the volume is now running on the 3
> original
> >  bricks (replica 3) but the VMs
> >  >A  are still corrupted. I have 880 Mb of shards on the bricks I
> removed
> >  for some reason, thos shards do exist
> >  >A  (and are bigger) on the "live" volume. I don't understand why
> now
> >  that I have removed the new bricks
> >  >A  everything isn't working like before ..
> >  >
> >  >A  On Mon, Sep 05, 2016 at 11:06:16PM +0200, Kevin Lemonnier wrote:
> >  >
> >  >A  Hi,
> >  >
> >  >A  I just added 3 bricks to a volume and all the VMs are doing I/O
> >  errors now.
> >  >A  I rebooted a VM to see and it can't start again, am I missing
> >  something ? Is the reblance required
> >  >A  to make everything run ?
> >  >
> >  >A  That's urgent, thanks.
> >  >
> >  >A  --
> >  >A  Kevin Lemonnier
> >  >A  PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
> >  >
> >  >
> >  >
> >  >
> >  >A  ___
> >  >A  Gluster-users mailing list
> >  >A  Gluster-users@gluster.org
> >  >A  http://www.gluster.org/mailman/listinfo/gluster-users
> >  >
> >  >
> >  >
> >  >A  ___
> >  >A  Gluster-users mailing list
> >  >A  Gluster-users@gluster.org
> >  >A  http://www.gluster.org/mailman/listinfo/gluster-users
> >  >
> >  >A  --
> >  >A  Lindsay Mathieson
> >
> >  > ___
> >  > Gluster-users mailing list
> >  > Gluster-users@gluster.org
> >  > http://www.gluster.org/mailman/listinfo/gluster-users
> >
> >  --
> >  Kevin Lemonnier
> >  PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
> >  ___
> >  Gluster-users mailing list
> >  Gluster-users@gluster.org
> >  http://www.gluster.org/mailman/listinfo/gluster-users
>
> --
> Kevin Lemonnier
> PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

Re: [Gluster-users] opportunist for outreachy

2016-10-14 Thread Manikandan Selvaganesh 
Hi Soumya,

Welcome to the community.

Here[1] is the link for Gluster Documentation. I would suggest you to
google and
read a bit about GlusterFS and then get started with "Quick Start
Guide[2]".
Once you have done your setup and have played a bit around the installation
and
configuration move on with "Developers Guide[3]".

If you want to get started with Code contributions pick some EasyFix bugs
which
can be found here[4]. After this I hope you would have got a minimal idea
and then
explore more in depth and pick up the project/component which interests you
more.
Again, we have some list of projects[5] already listed, check out if
anything interests
you here. Feel free to bring your own ideas as well. These are quite
generic for anyone
who is new to the community and in case if  you want to know specifically
about
Outreachy, someone in the community will surely respond to you shortly.

If you have queries, please mail us back. Also, we are always available on
#gluster-dev
and #gluster-meeting in Freenode.

All the best :-)

[1] https://gluster.readthedocs.io/en/latest/

[2] https://gluster.readthedocs.io/en/latest/Quick-Start-Guide/Quickstart/

[3]
https://gluster.readthedocs.io/en/latest/Developer-guide/Developers-Index/

[4] https://gluster.readthedocs.io/en/latest/Developer-guide/Easy-Fix-Bugs/

[5] https://gluster.readthedocs.io/en/latest/Developer-guide/Projects/


--
Cheers,
Manikandan Selvaganesh.

On Fri, Oct 14, 2016 at 7:56 PM, Ms ms  wrote:

> Hi,
>
> I'm a research student pursuing my Masters in IIIT-Hyderabad. I am keen on
> working on Gluster's Outreachy project.
>
> I have prior experience in configuring, maintaining and managing systems
> in an MHRD project. I have completed the required course credits towards my
> degree and am working on my Thesis currently. It would be great opportunity
> for me to learn and contribute to the project as well.
>
> As I am a bit new to the community it would be nice if anyone can guide me
> a few useful resources to get me started.
>
> Thanks and regards,
> Soumya
>
> ___
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] opportunist for outreachy

2016-10-14 Thread Ms ms 
Hi,

I'm a research student pursuing my Masters in IIIT-Hyderabad. I am keen on
working on Gluster's Outreachy project.

I have prior experience in configuring, maintaining and managing systems in
an MHRD project. I have completed the required course credits towards my
degree and am working on my Thesis currently. It would be great opportunity
for me to learn and contribute to the project as well.

As I am a bit new to the community it would be nice if anyone can guide me
a few useful resources to get me started.

Thanks and regards,
Soumya
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users

[Gluster-users] Check the possibility to incorporate DEBUG info permanently in build

2016-10-14 Thread ABHISHEK PALIWAL 
Hi Team,

As we are seeing many issues in gluster. And we are failing to address most
of the gluster issues due to lack of information for fault analysis.

And for the many issue unfortunately with the initial gluster logs we get a
very limited information which is not at all possible to find the root
cause/conclude the issue.
Every time enabling the LOG_LEVEL to DEBUG is not feasible and few of the
cases are very rarely seen.

Hence, I request you to check if there is a possibility  to incorporate the
debug information in build or check if its possible to introduce a new
debug level that can always be activated.

Please come back on this!

-- 

Regards
Abhishek Paliwal
___
Gluster-users mailing list
Gluster-users@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users