Re: [Gluster-devel] Rebalance source code

[Nithya Balachandran]

On 8 June 2017 at 09:35, Raghavendra Gowdappa <rgowd...@redhat.com> wrote:

>
>
> - Original Message -
> > From: "Tahereh Fattahi" <t28.fatt...@gmail.com>
> > To: "Nithya Balachandran" <nbala...@redhat.com>, "Susant Palai" <
> spa...@redhat.com>, "Gluster Devel"
> > <gluster-devel@gluster.org>
> > Sent: Wednesday, June 7, 2017 8:05:35 PM
> > Subject: Re: [Gluster-devel] Rebalance source code
> >
> > I had seen this function before but when dht xlator is not loaded in
> server
> > side, how this function will be called?
>
> rebalance process is not a server process.


Well, it runs on the server nodes but it is, as Raghavendra said, a
clustering/client process. I think you probably meant the brick processes
when you referred to the server process.

Other processes which run on the server nodes but load client translators
include the selfheal daemon(AFR/EC) or the tier process (DHT) or even the
NFS server which loads the cluster translators.


> Instead its a client (albeit a special one - doesn't have an interface
> layer like fuse/gfapi, xlator graph is rooted at dht , dht xlator itself
> has the option "rebalance-cmd" set which won't be on normal clients, once
> crawling starts it continues in same graph even if there are graph changes
> during course of rebalance). You can check logs of rebalance process
> (*rebalance*.log in gluster log directory) for the exact set of translators
> loaded.
>
> As to when the crawling starts, it is done when dht gets at least one of
> CHILD_UP/CHILD_DOWN/CHILD_CONNECTING from _all_ of its subvols. You can
> check dht_notify for more details where we create a thread with
> gf_defrag_start as entry function.
>
> >
> > On Wed, Jun 7, 2017 at 4:58 PM, Nithya Balachandran <
> nbala...@redhat.com >
> > wrote:
> >
> >
> >
> >
> >
> > On 7 June 2017 at 17:31, Tahereh Fattahi < t28.fatt...@gmail.com >
> wrote:
> >
> >
> >
> > Hi
> > I want to follow the process when rebalance command is done.
> > Which files should I read?
> > I see something in cli directory that sends request to another abject.
> But I
> > need to find function that do core operation of rebalance.
> > I expect to see something like this in one function:
> > function rebalance
> > {
> > check all bricks
> > fix_layout for all directories
> > start files migration
> > }
> > Where can I find the core functions of rebalance in server side?
> >
> > You can start with gf_defrag_start_crawl in dht-rebalance.c
> >
> > Regards,
> > Nithya
> >
> >
> >
> > ___
> > Gluster-devel mailing list
> > Gluster-devel@gluster.org
> > http://lists.gluster.org/mailman/listinfo/gluster-devel
> >
> >
> >
> > ___
> > Gluster-devel mailing list
> > Gluster-devel@gluster.org
> > http://lists.gluster.org/mailman/listinfo/gluster-devel
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Rebalance source code

[Raghavendra Gowdappa]

- Original Message -
> From: "Tahereh Fattahi" <t28.fatt...@gmail.com>
> To: "Nithya Balachandran" <nbala...@redhat.com>, "Susant Palai" 
> <spa...@redhat.com>, "Gluster Devel"
> <gluster-devel@gluster.org>
> Sent: Wednesday, June 7, 2017 8:05:35 PM
> Subject: Re: [Gluster-devel] Rebalance source code
> 
> I had seen this function before but when dht xlator is not loaded in server
> side, how this function will be called?

rebalance process is not a server process. Instead its a client (albeit a 
special one - doesn't have an interface layer like fuse/gfapi, xlator graph is 
rooted at dht , dht xlator itself has the option "rebalance-cmd" set which 
won't be on normal clients, once crawling starts it continues in same graph 
even if there are graph changes during course of rebalance). You can check logs 
of rebalance process (*rebalance*.log in gluster log directory) for the exact 
set of translators loaded.

As to when the crawling starts, it is done when dht gets at least one of 
CHILD_UP/CHILD_DOWN/CHILD_CONNECTING from _all_ of its subvols. You can check 
dht_notify for more details where we create a thread with gf_defrag_start as 
entry function.

> 
> On Wed, Jun 7, 2017 at 4:58 PM, Nithya Balachandran < nbala...@redhat.com >
> wrote:
> 
> 
> 
> 
> 
> On 7 June 2017 at 17:31, Tahereh Fattahi < t28.fatt...@gmail.com > wrote:
> 
> 
> 
> Hi
> I want to follow the process when rebalance command is done.
> Which files should I read?
> I see something in cli directory that sends request to another abject. But I
> need to find function that do core operation of rebalance.
> I expect to see something like this in one function:
> function rebalance
> {
> check all bricks
> fix_layout for all directories
> start files migration
> }
> Where can I find the core functions of rebalance in server side?
> 
> You can start with gf_defrag_start_crawl in dht-rebalance.c
> 
> Regards,
> Nithya
> 
> 
> 
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-devel
> 
> 
> 
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-devel
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] Rebalance source code

[Tahereh Fattahi]

I had seen this function before but when dht xlator is not loaded in server
side, how this function will be called?

On Wed, Jun 7, 2017 at 4:58 PM, Nithya Balachandran 
wrote:

>
>
> On 7 June 2017 at 17:31, Tahereh Fattahi  wrote:
>
>> Hi
>> I want to follow the process when rebalance command is done.
>> Which files should I read?
>> I see something in cli directory that sends request to another abject.
>> But I need to find function that do core operation of rebalance.
>> I expect to see something like this in one function:
>> function rebalance
>> {
>> check all bricks
>> fix_layout for all directories
>> start files migration
>> }
>> Where can I find the core functions of rebalance in server side?
>>
>
> You can start with gf_defrag_start_crawl in dht-rebalance.c
>
> Regards,
> Nithya
>
>
>>
>> ___
>> Gluster-devel mailing list
>> Gluster-devel@gluster.org
>> http://lists.gluster.org/mailman/listinfo/gluster-devel
>>
>
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-devel