Re: [Gluster-devel] Question on merging zfs snapshot support into the mainline glusterfs

[sriram]

Hi Rajesh,
 
I'd thought about moving the zfs specific implementation to
something like
 
xlators/mgmt/glusterd/src/plugins/zfs-specifs-stuffs for the inital
go. Could you let me know if this works or in sync with what you'd
thought about?
 
Sriram
 
 
On Tue, Jul 12, 2016, at 03:52 PM, sri...@marirs.net.in wrote:
> Hi Rajesh,
>
> Sure thanks.
>
> Sriram
>
>
> On Tue, Jul 12, 2016, at 03:07 PM, Rajesh Joseph wrote:
>> Hi Sriram,
>> The interface is not yet finalized. May be this is the right time to
>> re-ignite discussion on this.
>> I can create an etherpad which will explain the initial thoughts and
>> design ideas on the same.
>> Thanks & Regards,
>> Rajesh
>>
>> On Mon, Jul 11, 2016 at 11:57 PM,  wrote:
>>> __
>>> Hi Rajesh,
>>>
>>> Could you let us know the idea on how to go about this?
>>>
>>> Sriram
>>>
>>>
>>> On Wed, Jul 6, 2016, at 03:18 PM, Pranith Kumar Karampuri wrote:
 I believe Rajesh already has something here. May be he can post an
 outline so that we can take it from there?

 On Tue, Jul 5, 2016 at 10:52 PM,  wrote:
> __
> Hi,
>
> I tried to go through the patch and find the reason behind the
> question posted. But could'nt get any concrete details about the
> same.
>
> When going through the mail chain, there were mentions of generic
> snapshot interface. I'd be interested in doing the changes if you
> guys could fill me with some initial information. Thanks.
>
> Sriram
>
>
> On Mon, Jul 4, 2016, at 01:59 PM, B.K.Raghuram wrote:
>> Hi Rajesh,
>> I did not want to respond to the question that you'd posed on the
>> zfs snapshot code (about the volume backend backup) as I am not
>> too familiar with the code and the person who's coded it is not
>> with us anymore. This was done in bit of a hurry so it could be
>> that it was just kept for later..
>>
>> However, Sriram who is cc'd on this email, has been helping us by
>> starting to look at the gluster code  and has expressed an
>> interest in taking the zfs code changes on. So he can probably
>> dig out an answer to your question. Sriram, Rajesh had a question
>> on one of the zfs related patches -
>> (https://github.com/fractalio/glusterfs/commit/39a163eca338b6da146f72f380237abd4c671db2#commitcomment-18109851)
>>
>> Sriram is also interested in contributing to the process of
>> creating a generic snapshot interface in the gluster code which
>> you and Pranith mentioned above. If this is ok with you all,
>> could you fill him in on what your thoughts are on that and how
>> he could get started?
>> Thanks!
>> -Ram
>>
>> On Wed, Jun 22, 2016 at 11:45 AM, Rajesh Joseph
>>  wrote:
>>>
>>>
>>> On Tue, Jun 21, 2016 at 4:24 PM, Pranith Kumar Karampuri
>>>  wrote:
 hi,
   Is there a plan to come up with an interface for snapshot
   functionality? For example, in handling different types
   of sockets in gluster all we need to do is to specify
   which interface we want to use and ib,network-socket,unix-
   domain sockets all implement the interface. The code
   doesn't have to assume anything about underlying socket
   type. Do you guys think it is a worthwhile effort to
   separate out the logic of interface and the code which
   uses snapshots? I see quite a few of if (strcmp ("zfs",
   fstype)) code which can all be removed if we do this.
   Giving btrfs snapshots in future will be a breeze as
   well, this way? All we need to do is implementing
   snapshot interface using btrfs snapshot commands. I am
   not talking about this patch per se. Just wanted to seek
   your inputs about future plans for ease of maintaining
   the feature.
>>>
>>>
>>> As I said in my previous mail this is in plan and we will be
>>> doing it. But due to other priorities this was not taken in yet.
>>>
>>>


 On Tue, Jun 21, 2016 at 11:46 AM, Atin Mukherjee
  wrote:
>
>
> On 06/21/2016 11:41 AM, Rajesh Joseph wrote:
>  > What kind of locking issues you see? If you can provide
>  > some more information I can be able to help you.
>
> That's related to stale lock issues on GlusterD which are
> there in 3.6.1 since the fixes landed in the branch post
> 3.6.1. I have already provided the workaround/way to fix them
> [1]
>
>  
> [1]http://www.gluster.org/pipermail/gluster-users/2016-June/thread.html#26995
>
>  ~Atin
>
> ___
>  Gluster-devel mailing 

Re: [Gluster-devel] [Gluster-Maintainers] Gluster Events API - Help required to identify the list of Events from each component

[Atin Mukherjee]

So the framework is in now mainline branch [1]. I'd request all of you to
start thinking about all the important events required to be captured as a
next step and feedback.

[1] http://review.gluster.org/14248

~Atin

On Thu, Jul 14, 2016 at 1:45 PM, Aravinda  wrote:

> +gluster-users
>
> regards
> Aravinda
>
> On 07/13/2016 09:03 PM, Vijay Bellur wrote:
>
>> On 07/13/2016 10:23 AM, Aravinda wrote:
>>
>>> Hi,
>>>
>>> We are working on Eventing feature for Gluster, Sent feature patch for
>>> the same.
>>> Design: http://review.gluster.org/13115
>>> Patch:  http://review.gluster.org/14248
>>> Demo: http://aravindavk.in/blog/10-mins-intro-to-gluster-eventing
>>>
>>> Following document lists the events(mostly user driven events are
>>> covered in the doc). Please let us know the Events from your components
>>> to be supported by the Eventing Framework.
>>>
>>>
>>> https://docs.google.com/document/d/1oMOLxCbtryypdN8BRdBx30Ykquj4E31JsaJNeyGJCNo/edit?usp=sharing
>>>
>>>
>>>
>> Thanks for putting this together, Aravinda! Might be worth to poll -users
>> ML also about events of interest.
>>
>> -Vijay
>>
>
> ___
> maintainers mailing list
> maintain...@gluster.org
> http://www.gluster.org/mailman/listinfo/maintainers
>



-- 

--Atin
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Raghavendra Talur]

On Mon, Jul 18, 2016 at 4:35 PM, Raghavendra Talur 
wrote:

>
>
> On Mon, Jul 18, 2016 at 4:10 PM, Prasanna Kalever 
> wrote:
>
>> Hey Team,
>>
>>
>> My understanding is that @transport argumet in
>> glfs_set_volfile_server() is meant for specifying transport used in
>> fetching volfile server,
>>
>
> Yes, @transport arg here is transport to use for fetching volfile.
>
>
>> IIRC which currently supports tcp and unix only...
>>
> Yes, this is correct too.
>
>
>>
>> The doc here
>> https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
>> +166 shows the rdma as well, which is something I cannot digest.
>>
> This is doc written with assumption that rdma would work too.
>
>
>>
>>
>> Can someone correct me ?
>>
>> Have we ever supported volfile fetch over rdma ?
>>
>
> I think no. To test, you would have to set rdma as only transport option
> in glusterd.vol and see what happens in volfile fetch.
>

Rafi, Prasanna and I looked at the code and verified that volfile is
fetched over tcp in the above case.

Here is the complete scenario
1. option: unix, volfile is fetched over unix.
2. option:tcp, volfile is fetched over socket.
3. option:rdma, volfile is fetched over socket with no warning about no
support for rdma.

This gives an illusion to user that volfile is also fetched over rdma,
whereas we used tcp connection for it. I would recommend deprecating the
volfile-server-transport option's overloaded usecase of deciding IO
transport in 3.9 version of Gluster and having a different option name for
it.

Thanks,
Raghavendra Talur


>
>
> IMO, fetching volfile over rdma is an overkill and would not be required.
> RDMA should be kept only for IO operations.
>
> We should just remove it from the docs.
>
> Thanks,
> Raghavendra Talur
>
>
>>
>> Thanks,
>> --
>> Prasanna
>>
>
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

[Gluster-devel] Need feedback on vagrant based Gluster cluster creator

[Raghavendra Talur]

Hi All,

Here is a patch for quick cluster creation of gluster.
http://review.gluster.org/#/c/14930/

I need feedback on the features/design/implementation etc.

I am currently planning to move these files to extras/devel-tools/ unless
there is any other suggestion.

Thanks,
Raghavendra Talur
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Prasanna Kalever]

On Mon, Jul 18, 2016 at 4:31 PM, Raghavendra Gowdappa
 wrote:
>
>
> - Original Message -
>> From: "Prasanna Kalever" 
>> To: "gluster-devel" 
>> Cc: "Kaushal Madappa" 
>> Sent: Monday, July 18, 2016 4:10:24 PM
>> Subject: [Gluster-devel] What tranpsort type in glfs_set_volfile_server()
>>  exactly mean ?
>>
>> Hey Team,
>>
>>
>> My understanding is that @transport argumet in
>> glfs_set_volfile_server() is meant for specifying transport used in
>> fetching volfile server,
>> IIRC which currently supports tcp and unix only...
>
> Yes, its hard-coded to use only "socket" transport. See [1]. However if 
> required its not difficult to add rdma option. However, infiniband need not 
> be present on all nodes.
>
> [1] 
> https://github.com/gluster/glusterfs/blob/master/glusterfsd/src/glusterfsd-mgmt.c#L2132
>

Thanks for the info Raghavendra,

According to me, even addition of rdma transport for fetching a
volfile server is zero and perhaps not needed at all. :)

--
Prasanna

>>
>> The doc here https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
>> +166 shows the rdma as well, which is something I cannot digest.
>>
>>
>> Can someone correct me ?
>>
>> Have we ever supported volfile fetch over rdma ?
>>
>>
>> Thanks,
>> --
>> Prasanna
>> ___
>> Gluster-devel mailing list
>> Gluster-devel@gluster.org
>> http://www.gluster.org/mailman/listinfo/gluster-devel
>>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Raghavendra Talur]

On Mon, Jul 18, 2016 at 4:10 PM, Prasanna Kalever 
wrote:

> Hey Team,
>
>
> My understanding is that @transport argumet in
> glfs_set_volfile_server() is meant for specifying transport used in
> fetching volfile server,
>

Yes, @transport arg here is transport to use for fetching volfile.


> IIRC which currently supports tcp and unix only...
>
Yes, this is correct too.


>
> The doc here
> https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
> +166 shows the rdma as well, which is something I cannot digest.
>
This is doc written with assumption that rdma would work too.


>
>
> Can someone correct me ?
>
> Have we ever supported volfile fetch over rdma ?
>

I think no. To test, you would have to set rdma as only transport option in
glusterd.vol and see what happens in volfile fetch.


IMO, fetching volfile over rdma is an overkill and would not be required.
RDMA should be kept only for IO operations.

We should just remove it from the docs.

Thanks,
Raghavendra Talur


>
> Thanks,
> --
> Prasanna
>
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Raghavendra Gowdappa]

- Original Message -
> From: "Prasanna Kalever" 
> To: "gluster-devel" 
> Cc: "Kaushal Madappa" 
> Sent: Monday, July 18, 2016 4:10:24 PM
> Subject: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() 
> exactly mean ?
> 
> Hey Team,
> 
> 
> My understanding is that @transport argumet in
> glfs_set_volfile_server() is meant for specifying transport used in
> fetching volfile server,
> IIRC which currently supports tcp and unix only...

Yes, its hard-coded to use only "socket" transport. See [1]. However if 
required its not difficult to add rdma option. However, infiniband need not be 
present on all nodes.

[1] 
https://github.com/gluster/glusterfs/blob/master/glusterfsd/src/glusterfsd-mgmt.c#L2132

> 
> The doc here https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
> +166 shows the rdma as well, which is something I cannot digest.
> 
> 
> Can someone correct me ?
> 
> Have we ever supported volfile fetch over rdma ?
> 
> 
> Thanks,
> --
> Prasanna
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
> 
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

[Gluster-devel] ./tests/basic/afr/split-brain-favorite-child-policy.t regressin failure on NetBSD

[Kotresh Hiremath Ravishankar]

Hi,

The above mentioned test has failed for the patch 
http://review.gluster.org/#/c/14927/1 
and is not related to my patch. Can someone from AFR team look into it?

https://build.gluster.org/job/rackspace-netbsd7-regression-triggered/18132/console

Thanks and Regards,
Kotresh H R

___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Kaushal M]

On Mon, Jul 18, 2016 at 4:10 PM, Prasanna Kalever  wrote:
> Hey Team,
>
>
> My understanding is that @transport argumet in
> glfs_set_volfile_server() is meant for specifying transport used in
> fetching volfile server,
> IIRC which currently supports tcp and unix only...
>
> The doc here https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
> +166 shows the rdma as well, which is something I cannot digest.
>
>
> Can someone correct me ?
>
> Have we ever supported volfile fetch over rdma ?

That used to be the case. But there were  rdma related fixes done last
year that changed this behaviour.
Rafi and Raghavendra should be able to give you more information.

>
>
> Thanks,
> --
> Prasanna
> ___
> Gluster-devel mailing list
> Gluster-devel@gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-devel
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel

[Gluster-devel] What tranpsort type in glfs_set_volfile_server() exactly mean ?

[Prasanna Kalever]

Hey Team,


My understanding is that @transport argumet in
glfs_set_volfile_server() is meant for specifying transport used in
fetching volfile server,
IIRC which currently supports tcp and unix only...

The doc here https://github.com/gluster/glusterfs/blob/master/api/src/glfs.h
+166 shows the rdma as well, which is something I cannot digest.


Can someone correct me ?

Have we ever supported volfile fetch over rdma ?


Thanks,
--
Prasanna
___
Gluster-devel mailing list
Gluster-devel@gluster.org
http://www.gluster.org/mailman/listinfo/gluster-devel