Re: [Gluster-devel] Gluster Coreutils
The initial versions of the commands will establish independent connections to a cluster node (specified by a Gluster URL scheme). Then I think I could evolve the code to implement the shell idea that was in the design doc. Then, if I have time left, I could try to tackle the daemon that would keep connections open (whether this would be a client side or a server side proxy is yet to be determined). I'm leaving that for the end since that would require the most design and I don't want to end up going down a rabbit hole at this point trying to fight DBUS, for example. I have been reading through the document posted earlier to get a sense of the overall direction the project should move in. As for the language, I already have functioning code in C and that's a requirement of my project, so that's what I'm moving forward with. Craig On Jun 15, 2015, at 12:04 AM, Poornima Gurusiddaiah pguru...@redhat.com wrote: Hi Craig, That's cool! I was more interested in knowing how you plan to implement the commands. To be specific, do you plan to connect/disconnect(glfs_init/glfs_fini) to the gluster server for each command or persist the connection across commands? Regards, Poornima - Original Message - From: Craig Cabrey craigcab...@fb.com To: Joe Julian j...@julianfamily.org Cc: gluster-devel@gluster.org Sent: Monday, June 15, 2015 3:19:07 AM Subject: Re: [Gluster-devel] Gluster Coreutils I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing
Re: [Gluster-devel] Gluster Coreutils
I'm Craig's manager for the duration of his internship @ FB, so I thought I'd better chime in here :). As Craig mentioned, our project plan is to implement C-based CLI utilities similar to what we have for NFS CLI utilities (we'll be open sourcing this in the coming days so you can see what we have there). Our time to completion is very aggressive for a project coded in C (~10 weeks or less), so we need to keep our project goals very focused (feature creep, architecture rabbit holes etc) to keep it on schedule and come out with a working product that scales to our use-cases. As such, rather than have too many cook in the kitchen, I'd propose the initial implementation of ls/tail/cat/put/mkdir/rm/stat/cp be implemented by Craig, and we'll put the code up on the public repo as early as possible for public review and comment. We've definitely heard some great ideas from the list, and we've changed our approach to include: 1. Shell based interaction 2. Single binary (behavior changes based on symlink; any cons to this?) 3. Separate code repo/packaging (we'll probably go C99 because of this since we are no longer bound by the legacy C89 standards of the GFS repo). On the language debate (Python vs Go vs C), rather than get into this debate (which has good arguments on all sides) I'd simply encourage anyone who feels strongly about implementing the CLI in a different language to simply do so! More choice and competition among tools is never a bad thing, as it will only make them both better. Suffice it to say though, we feel strongly about the C based implementation so we are taking it on to provide parity with our NFS CLI utilities (which I'm working to get open-sourced in the coming weeks). And finally, with respect to scaling: we feel reasonably confident we can scale the tools without any sort of proxy to work on the order of 100's of simultaneous CLI clients hitting a cluster. We are going to experiment with some proxy approaches others to try to scale this to 1000's of CLI clients into a single cluster. Though, the proxy will be optional as we feel the simplicity/reliability of a standalone client (hitting a standard load-balanced or DNS RR end point) will work well for vast majority of users (envision a -p proxy option in the tools for those who need to really scale them). Thanks for this. I was getting tempted to jump in and address some of the feature creep myself, but it's a lot better for you to have done it. :) The point about just do it and choice/competition is IMO particularly important with this crowd. ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
As many might have guessed, I meant to send that to Richard and not the entire list. Oh well. Haven't made that mistake for a few years, so I guess I was due. Just as well I wasn't having one of my snarkier moments. ;) Apologies to anyone who might have seen it as criticism. ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Hey all, I'm Craig's manager for the duration of his internship @ FB, so I thought I'd better chime in here :). As Craig mentioned, our project plan is to implement C-based CLI utilities similar to what we have for NFS CLI utilities (we'll be open sourcing this in the coming days so you can see what we have there). Our time to completion is very aggressive for a project coded in C (~10 weeks or less), so we need to keep our project goals very focused (feature creep, architecture rabbit holes etc) to keep it on schedule and come out with a working product that scales to our use-cases. As such, rather than have too many cook in the kitchen, I'd propose the initial implementation of ls/tail/cat/put/mkdir/rm/stat/cp be implemented by Craig, and we'll put the code up on the public repo as early as possible for public review and comment. We've definitely heard some great ideas from the list, and we've changed our approach to include: 1. Shell based interaction 2. Single binary (behavior changes based on symlink; any cons to this?) 3. Separate code repo/packaging (we'll probably go C99 because of this since we are no longer bound by the legacy C89 standards of the GFS repo). On the language debate (Python vs Go vs C), rather than get into this debate (which has good arguments on all sides) I'd simply encourage anyone who feels strongly about implementing the CLI in a different language to simply do so! More choice and competition among tools is never a bad thing, as it will only make them both better. Suffice it to say though, we feel strongly about the C based implementation so we are taking it on to provide parity with our NFS CLI utilities (which I'm working to get open-sourced in the coming weeks). And finally, with respect to scaling: we feel reasonably confident we can scale the tools without any sort of proxy to work on the order of 100's of simultaneous CLI clients hitting a cluster. We are going to experiment with some proxy approaches others to try to scale this to 1000's of CLI clients into a single cluster. Though, the proxy will be optional as we feel the simplicity/reliability of a standalone client (hitting a standard load-balanced or DNS RR end point) will work well for vast majority of users (envision a -p proxy option in the tools for those who need to really scale them). Richard From: gluster-devel-boun...@gluster.org [gluster-devel-boun...@gluster.org] on behalf of Craig Cabrey [craigcab...@fb.com] Sent: Monday, June 15, 2015 10:50 AM To: Poornima Gurusiddaiah Cc: gluster-devel@gluster.org Subject: Re: [Gluster-devel] Gluster Coreutils The initial versions of the commands will establish independent connections to a cluster node (specified by a Gluster URL scheme). Then I think I could evolve the code to implement the shell idea that was in the design doc. Then, if I have time left, I could try to tackle the daemon that would keep connections open (whether this would be a client side or a server side proxy is yet to be determined). I'm leaving that for the end since that would require the most design and I don't want to end up going down a rabbit hole at this point trying to fight DBUS, for example. I have been reading through the document posted earlier to get a sense of the overall direction the project should move in. As for the language, I already have functioning code in C and that's a requirement of my project, so that's what I'm moving forward with. Craig On Jun 15, 2015, at 12:04 AM, Poornima Gurusiddaiah pguru...@redhat.com wrote: Hi Craig, That's cool! I was more interested in knowing how you plan to implement the commands. To be specific, do you plan to connect/disconnect(glfs_init/glfs_fini) to the gluster server for each command or persist the connection across commands? Regards, Poornima - Original Message - From: Craig Cabrey craigcab...@fb.com To: Joe Julian j...@julianfamily.org Cc: gluster-devel@gluster.org Sent: Monday, June 15, 2015 3:19:07 AM Subject: Re: [Gluster-devel] Gluster Coreutils I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically
Re: [Gluster-devel] Gluster Coreutils
On Monday 15 June 2015 03:14 AM, Joe Julian wrote: On 06/14/2015 11:43 AM, Raghavendra Talur wrote: On Sun, Jun 14, 2015 at 11:02 PM, chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Welcome to the party Matthew! Nice to see you're still keeping an eye on on the list. I'm excited to see this collaboration. This is going to turn out great :) On 06/14/2015 01:58 AM, Matthew McKeen wrote: Hey Craig and Chris: I might be interested in collaborating on this as well. Will be useful when I come back to FB in September. Let me know where the public repository ends up being. Thanks, Matthew McKeen P.S. Tell Richard I said hello On Fri, Jun 12, 2015 at 11:29 AM chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com mailto:chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com mailto:chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Hi Craig, That's cool! I was more interested in knowing how you plan to implement the commands. To be specific, do you plan to connect/disconnect(glfs_init/glfs_fini) to the gluster server for each command or persist the connection across commands? Regards, Poornima - Original Message - From: Craig Cabrey craigcab...@fb.com To: Joe Julian j...@julianfamily.org Cc: gluster-devel@gluster.org Sent: Monday, June 15, 2015 3:19:07 AM Subject: Re: [Gluster-devel] Gluster Coreutils I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0As=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1 ___ Gluster-devel mailing list
Re: [Gluster-devel] Gluster Coreutils
On Fri, Jun 12, 2015 at 11:29:51AM -0700, chris holcombe wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils If you decide on a name, we can create a repository for you under the https://github.com/gluster organization. That will make it easier for others to find the repository and start contributuing or using it. Personally, I'd like a name like gluster-coreutils or something similar, because I think the intention is to match the functionality and usage of the standard coreutils as much as possible? Thanks, Niels On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Hey Craig and Chris: I might be interested in collaborating on this as well. Will be useful when I come back to FB in September. Let me know where the public repository ends up being. Thanks, Matthew McKeen P.S. Tell Richard I said hello On Fri, Jun 12, 2015 at 11:29 AM chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
On Sun, Jun 14, 2015 at 04:58:23PM +, Craig Cabrey wrote: I think it does make sense to have it under the gluster organization. As for naming gluster-coreutils works as the intention is indeed to match the functionality of coreutils as much as possible. I've created an empty repository for you now. Please start with explaining the purpose/goals/ideas/... on the GitHub wiki: https://github.com/gluster/gluster-coreutils/wiki When you have an idea how to get seriously started, push the code to the repository. The explanation to do so can be found here: https://github.com/gluster/gluster-coreutils Let me know if you need any assistance. Thanks, Niels Craig On Jun 14, 2015, at 2:29 AM, Niels de Vos nde...@redhat.com wrote: On Fri, Jun 12, 2015 at 11:29:51AM -0700, chris holcombe wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils If you decide on a name, we can create a repository for you under the https://github.com/gluster organization. That will make it easier for others to find the repository and start contributuing or using it. Personally, I'd like a name like gluster-coreutils or something similar, because I think the intention is to match the functionality and usage of the standard coreutils as much as possible? Thanks, Niels On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=yiRXm4P%2B7jkUD8T8QucHmE7RAd14NXpACGukNZ0KKRA%3D%0As=b0b8784ae9e5b4a6cc7cde03172898945f0e26a16ea086bc9ed3ca642162446f ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
On Sun, Jun 14, 2015 at 11:02 PM, chris holcombe chris.holco...@canonical.com wrote: Welcome to the party Matthew! Nice to see you're still keeping an eye on on the list. I'm excited to see this collaboration. This is going to turn out great :) On 06/14/2015 01:58 AM, Matthew McKeen wrote: Hey Craig and Chris: I might be interested in collaborating on this as well. Will be useful when I come back to FB in September. Let me know where the public repository ends up being. Thanks, Matthew McKeen P.S. Tell Richard I said hello On Fri, Jun 12, 2015 at 11:29 AM chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel Hi Craig, Chris and Matthew, Welcome to the project :) We are really excited to see so many interested in getting core utils like feature in Gluster. As Jeff mentioned earlier, we have put up a very similar proposal recently. He also shared the design doc in the same mail. Here is an illustration of how we imagined it: In gist, all the core utils commands would be functions in what we are calling glusterclientd. The functions would return the output in a format like JSON or XML. It would be the handlers which will send the data to a *real* client. To support one-off commands, we were thinking of having a cli-direct handler, which when invoked will behave like a one-off command and output directly to cli. Also, we were of the opinion that python would be a good language to get this done. As you can see, core-utils would be part of a bigger project and it would be really useful for all of us to have same code base. Please read the design doc and give your reviews either in doc or here in mail. Thanks! *Raghavendra Talur * ___
Re: [Gluster-devel] Gluster Coreutils
I think it does make sense to have it under the gluster organization. As for naming gluster-coreutils works as the intention is indeed to match the functionality of coreutils as much as possible. Craig On Jun 14, 2015, at 2:29 AM, Niels de Vos nde...@redhat.com wrote: On Fri, Jun 12, 2015 at 11:29:51AM -0700, chris holcombe wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils If you decide on a name, we can create a repository for you under the https://github.com/gluster organization. That will make it easier for others to find the repository and start contributuing or using it. Personally, I'd like a name like gluster-coreutils or something similar, because I think the intention is to match the functionality and usage of the standard coreutils as much as possible? Thanks, Niels On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=yiRXm4P%2B7jkUD8T8QucHmE7RAd14NXpACGukNZ0KKRA%3D%0As=b0b8784ae9e5b4a6cc7cde03172898945f0e26a16ea086bc9ed3ca642162446f ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Do you want to split up who does what utility? I could pick off some easier ones like mv or rm or something. I imagine there will be some common functions we will want to share between them. We can split things out as we go. No big deal On 06/14/2015 02:49 PM, Craig Cabrey wrote: I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0As=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1 ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0As=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1 ___ Gluster-devel mailing list Gluster-devel@gluster.org
Re: [Gluster-devel] Gluster Coreutils
I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Welcome to the party Matthew! Nice to see you're still keeping an eye on on the list. I'm excited to see this collaboration. This is going to turn out great :) On 06/14/2015 01:58 AM, Matthew McKeen wrote: Hey Craig and Chris: I might be interested in collaborating on this as well. Will be useful when I come back to FB in September. Let me know where the public repository ends up being. Thanks, Matthew McKeen P.S. Tell Richard I said hello On Fri, Jun 12, 2015 at 11:29 AM chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
On 06/14/2015 11:43 AM, Raghavendra Talur wrote: On Sun, Jun 14, 2015 at 11:02 PM, chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Welcome to the party Matthew! Nice to see you're still keeping an eye on on the list. I'm excited to see this collaboration. This is going to turn out great :) On 06/14/2015 01:58 AM, Matthew McKeen wrote: Hey Craig and Chris: I might be interested in collaborating on this as well. Will be useful when I come back to FB in September. Let me know where the public repository ends up being. Thanks, Matthew McKeen P.S. Tell Richard I said hello On Fri, Jun 12, 2015 at 11:29 AM chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com mailto:chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com mailto:chris.holco...@canonical.com mailto:chris.holco...@canonical.com mailto:chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org mailto:Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org
Re: [Gluster-devel] Gluster Coreutils
I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0As=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1 ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0As=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1 ___ Gluster-devel mailing list Gluster-devel@gluster.org
Re: [Gluster-devel] Gluster Coreutils
Having previously worked at Facebook myself I know that it's absolutely critical that these tools be as performant as possible. I understand the desire to program these in Python because it allows more people to participate but unfortunately in this case it's not possible. Craig - Let us know when you push your code. I'll start lending a hand as soon as I can. On 06/14/2015 02:49 PM, Craig Cabrey wrote: I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=vXGpsdu0VQkkhe9HG68hcfca%2F938GTXmmbz4t56hNMg%3D%0As=33c038573fdbc5f7914eefe2f0a5e8cfc57ea8c652a1cb42358e6d1a401628f1 ___ Gluster-devel mailing list Gluster-devel@gluster.org
Re: [Gluster-devel] Gluster Coreutils
MS On 15 Jun 2015 10:20 am, Prashanth Pai p...@redhat.com wrote: Personally, I'd use Go which is performant as you put it. You could reuse(read fork) this project: https://github.com/aisola/go-coreutils And also leverage Kaushal's go bindings ( https://forge.gluster.org/gogfapi#more) which itself can grow along with glusterfs-coreutils project. +1 I'd prefer Go myself. Cheers, Vishwanath Regards, -Prashanth Pai - chris holcombe chris.holco...@canonical.com wrote: Having previously worked at Facebook myself I know that it's absolutely critical that these tools be as performant as possible. I understand the desire to program these in Python because it allows more people to participate but unfortunately in this case it's not possible. Craig - Let us know when you push your code. I'll start lending a hand as soon as I can. On 06/14/2015 02:49 PM, Craig Cabrey wrote: I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3
Re: [Gluster-devel] Gluster Coreutils
Just a heads up on gogfapi. It is not complete as the directory listing functions are yet to be implemented and it hasn't been tested a lot. The gogfapi package replicates golang's file API, which makes it very easy to convert an existing go application to support gfapi. Converting go-coreutils should be easy. Also, the I'll not be maintaining the Gluster Forge repository, as the forge is about to be closed. Use the github repository http://github.com/kshlm/gogfapi instead. ~kaushal On Mon, Jun 15, 2015 at 10:26 AM, Matthew McKeen matt...@mmckeen.net wrote: I agree, go would be perfect for these tools. Static compilation makes deployment trivial. +1 On Sun, Jun 14, 2015, 9:50 PM Prashanth Pai p...@redhat.com wrote: Personally, I'd use Go which is performant as you put it. You could reuse(read fork) this project: https://github.com/aisola/go-coreutils And also leverage Kaushal's go bindings (https://forge.gluster.org/gogfapi#more) which itself can grow along with glusterfs-coreutils project. Regards, -Prashanth Pai - chris holcombe chris.holco...@canonical.com wrote: Having previously worked at Facebook myself I know that it's absolutely critical that these tools be as performant as possible. I understand the desire to program these in Python because it allows more people to participate but unfortunately in this case it's not possible. Craig - Let us know when you push your code. I'll start lending a hand as soon as I can. On 06/14/2015 02:49 PM, Craig Cabrey wrote: I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago.
Re: [Gluster-devel] Gluster Coreutils
I agree, go would be perfect for these tools. Static compilation makes deployment trivial. +1 On Sun, Jun 14, 2015, 9:50 PM Prashanth Pai p...@redhat.com wrote: Personally, I'd use Go which is performant as you put it. You could reuse(read fork) this project: https://github.com/aisola/go-coreutils And also leverage Kaushal's go bindings ( https://forge.gluster.org/gogfapi#more) which itself can grow along with glusterfs-coreutils project. Regards, -Prashanth Pai - chris holcombe chris.holco...@canonical.com wrote: Having previously worked at Facebook myself I know that it's absolutely critical that these tools be as performant as possible. I understand the desire to program these in Python because it allows more people to participate but unfortunately in this case it's not possible. Craig - Let us know when you push your code. I'll start lending a hand as soon as I can. On 06/14/2015 02:49 PM, Craig Cabrey wrote: I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org
Re: [Gluster-devel] Gluster Coreutils
Personally, I'd use Go which is performant as you put it. You could reuse(read fork) this project: https://github.com/aisola/go-coreutils And also leverage Kaushal's go bindings (https://forge.gluster.org/gogfapi#more) which itself can grow along with glusterfs-coreutils project. Regards, -Prashanth Pai - chris holcombe chris.holco...@canonical.com wrote: Having previously worked at Facebook myself I know that it's absolutely critical that these tools be as performant as possible. I understand the desire to program these in Python because it allows more people to participate but unfortunately in this case it's not possible. Craig - Let us know when you push your code. I'll start lending a hand as soon as I can. On 06/14/2015 02:49 PM, Craig Cabrey wrote: I've already started writing the utilities in C per my internship project. I'll push these up when ready (most probably sometime this week) as a POC. Maybe then we can look into implementing with Python? Craig On Jun 14, 2015, at 2:47 PM, Joe Julian j...@julianfamily.org wrote: I was thinking the other way around. Write it in python then optimize if it's necessary. On 06/14/2015 02:45 PM, chris holcombe wrote: Maybe we could write these in C and setup python bindings for them. Thoughts? I'm down with writing them in C. I could use more practice. On 06/14/2015 02:36 PM, Joe Julian wrote: I would prefer python. On 06/14/2015 11:18 AM, Niels de Vos wrote: On Sat, Jun 13, 2015 at 06:45:45PM +0530, M S Vishwanath Bhat wrote: On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Depending on the target systems, Python may not be suitable. There are cloud deployments that do not have Python installed. I think that even includes the minimal cloud images Fedora and CentOS provide. IMHO would be nice to be able to support those systems too, without pulling in too many dependencies. But, I'll leave it up to the people writing the code ;-) Cheers, Niels Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org
Re: [Gluster-devel] Gluster Coreutils
On 12 June 2015 at 23:59, chris holcombe chris.holco...@canonical.com wrote: Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils AFAIK the plan is to collaborate through a git repo in github.com/gluster account. But anything that works should be good... And the choice of language seems to be python. Best Regards, Vishwanath On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Craig Cabrey craigcab...@fb.com wrote: Again, any feedback will be welcome. Archive commands are extremely slow on any distributed fs, and they could benefit a lot from a smart native support. The canonical example is tar. -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz m...@netbsd.org ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp=sharing This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
[Gluster-devel] Gluster Coreutils
Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Thanks, -- Craig Cabrey craigcab...@fb.com ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp=sharing This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Yeah I have this repo but it's basically empty: https://github.com/cholcombe973/GlusterUtils On 06/12/2015 11:27 AM, Craig Cabrey wrote: Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
Re: [Gluster-devel] Gluster Coreutils
Chris, That sounds good to me. I already have started on implementation, just to get familiar with the codebase and GFAPI. Is there a public repo that we can use for collaboration? Craig On Jun 12, 2015, at 10:46 AM, chris holcombe chris.holco...@canonical.com wrote: Craig, I was actually planning on building the same tool set. I would like to work with you also on this if that's ok. -Chris On 06/12/2015 10:43 AM, Jeff Darcy wrote: Hi everyone, This summer I am an intern at Facebook working on the Gluster team. Part of my project for the summer includes developing a set of coreutils that utilizes the Gluster C API natively. This project is similar in nature to the NFS coreutils that some of you may have heard about from the other Facebook engineers at the Gluster summit recently. I just wanted to reach out to the Gluster community to gather ideas, potential features, feedback, and direction. The initial set of utilities that I am developing includes the following: * cat * mkdir * put (read from stdin and write to a file) * mv * ls * rm * tail Again, any feedback will be welcome. Hi, Craig, and welcome to the project. :) There seems to be some overlap with a proposal Ragahavendra Talur sent out a couple of days ago. https://urldefense.proofpoint.com/v1/url?u=https://docs.google.com/document/d/1yuRLRbdccx_0V0UDAxqWbz4g983q5inuINHgM1YO040/edit?usp%3Dsharingk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=8d55bb5770b8ed1d683a6908a05af32b79289735c537c660252fcaa7c690e162 This seems like an excellent opportunity to collaborate. Ideally, I think it would be useful to have both an FTP-client-like shell and a set of standalone one shot commands, based on as much common code as possible. ___ Gluster-devel mailing list Gluster-devel@gluster.org https://urldefense.proofpoint.com/v1/url?u=http://www.gluster.org/mailman/listinfo/gluster-develk=ZVNjlDMF0FElm4dQtryO4A%3D%3D%0Ar=ThH6JMKaB%2Fxgkh9d2jPjehcdps8B69L0q04jdBbZvX4%3D%0Am=86la5Xg7nlxAzIR6E5c2v2SgQSd6VssYzB%2BklM3wf%2BI%3D%0As=28546cdc6fdf6f75f4cfa4b8260abc595eee96601a5f849ebb230ddbd1faf8b3 ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel
