I'm ready to take up ACCUMULO-1256. With your permission of course. Shall I post a rough outline right now?
On Thu, Jul 18, 2013 at 4:56 PM, Keith Turner <[email protected]> wrote: > I can mentor for 1256. I would like to see that done for Accumulo 1.6.0. > > > On Thu, Jul 18, 2013 at 5:33 AM, Sreejith Ramakrishnan < > [email protected]> wrote: > > > Hey, > > > > I'm sooo interested in this Jira. But, Luciano (Community Development, > > Apache) told me I should proceed with some simpler Jiras for the time > being > > since its my first involvement with open source. So I decided I'll work > on > > 1197 after 2months which is when this programme ends. > > > > So, I was thinking about ACCUMULO-1256 or ACCUMULO-1198. These are > > relatively smaller projects. Can you or any experts be a mentor for me? > > > > [1] https://issues.apache.org/jira/browse/ACCUMULO-1256 > > [2] https://issues.apache.org/jira/browse/ACCUMULO-1198 > > > > > > On Thu, Jul 18, 2013 at 7:21 AM, Billie Rinaldi < > [email protected] > > >wrote: > > > > > It's unfortunate he's on vacation this week. So, you could write the > > > proposal of what you think the integration will look like before > talking > > to > > > him, but there are a couple of risks: maybe he won't want to work with > > > someone, or won't have time to do the part of the work you'd be > > integrating > > > into during the 3 months of your programme. > > > > > > If you're willing to take the risk, we'll be able to find mentors for > you > > > on the Accumulo side. > > > > > > Billie > > > I got a reply from the HDFS list. Seems this person Andrew is actually > > > working on this Jira. Here's the email: > > > > > > > > > > > > http://mail-archives.apache.org/mod_mbox/hadoop-hdfs-dev/201307.mbox/%3CCA%2BqbEUM_ps2Nihqh4d2c2hA6neXJw5Xep3ceMxqFajmL10Adrw%40mail.gmail.com%3E > > > > > > > > > On Thu, Jul 18, 2013 at 12:37 AM, Sreejith Ramakrishnan < > > > [email protected]> wrote: > > > > > > > Thank you :) Alright. I'll put such an email and get back at the > > > earliest. > > > > > > > > > > > > On Thu, Jul 18, 2013 at 12:21 AM, Billie Rinaldi < > > > [email protected] > > > > > wrote: > > > > > > > >> Both. You could also mention that it could be useful for HBase as > > well, > > > >> but > > > >> that you aren't planning to do the HBase integration as part of your > > > >> project. > > > >> On Jul 17, 2013 2:41 PM, "Sreejith Ramakrishnan" < > > > [email protected] > > > >> > > > > >> wrote: > > > >> > > > >> > So, when I'm putting an email in the HDFS list, shall I cite > > > >> ACCUMULO-1197 > > > >> > or HDFS-4680? > > > >> > > > > >> > > > > >> > On Thu, Jul 18, 2013 at 12:03 AM, Billie Rinaldi > > > >> > <[email protected]>wrote: > > > >> > > > > >> > > I suspect people may be reluctant due to the unknown nature of > > > making > > > >> > > changes to HDFS. Perhaps if you could find someone to agree to > be > > > >> your > > > >> > > mentor on the HDFS side, it would be easier to find an Accumulo > > > mentor > > > >> > for > > > >> > > the part of the project that involves integrating the HDFS > changes > > > >> with > > > >> > > Accumulo. > > > >> > > > > > >> > > Billie > > > >> > > > > > >> > > > > > >> > > On Wed, Jul 17, 2013 at 11:23 AM, Sreejith Ramakrishnan < > > > >> > > [email protected]> wrote: > > > >> > > > > > >> > > > Oh. I saw the ticket. I'll try that direction as well. Also, > > what > > > do > > > >> > you > > > >> > > > think are my odds at getting a mentor since its too close to > the > > > >> > > deadline? > > > >> > > > > > > >> > > > I'm still requesting mentorship since its a formality for the > > > >> > programme. > > > >> > > > Still keeping my hopes up. > > > >> > > > > > > >> > > > > > > >> > > > On Wed, Jul 17, 2013 at 11:45 PM, Billie Rinaldi > > > >> > > > <[email protected]>wrote: > > > >> > > > > > > >> > > > > I realize there isn't a lot of time before the deadline, but > > if > > > >> you > > > >> > are > > > >> > > > > interested in submitting a patch to HDFS I would encourage > you > > > to > > > >> > > engage > > > >> > > > > with the HDFS community to see if they are interested in > such > > a > > > >> > feature > > > >> > > > to > > > >> > > > > increase the likelihood of your patch being accepted. Their > > dev > > > >> > > mailing > > > >> > > > > list is [email protected]. > > > >> > > > > > > > >> > > > > I found one reference to Dapper in the HDFS tickets, > > HDFS-4680. > > > >> The > > > >> > > > ticket > > > >> > > > > isn't about tracing, but Todd Lipcon comments that he's > > > >> experimented > > > >> > > with > > > >> > > > > adding tracing to Hadoop RPC and asks if people would find > > that > > > >> > useful. > > > >> > > > > (There doesn't appear to be a reply.) > > > >> > > > > > > > >> > > > > Billie > > > >> > > > > > > > >> > > > > > > > >> > > > > On Wed, Jul 17, 2013 at 11:01 AM, Sreejith Ramakrishnan < > > > >> > > > > [email protected]> wrote: > > > >> > > > > > > > >> > > > > > I think its a good idea to modify HDFS and Accumulo to > > support > > > >> > HTrace > > > >> > > > > since > > > >> > > > > > HBase has also started working in this direction. The > > progress > > > >> made > > > >> > > > could > > > >> > > > > > benefit both projects. And also, HTrace follows the Dapper > > > >> > > conventions. > > > >> > > > > > > > > >> > > > > > I'm not an expert. But from what I read in Google's paper > > and > > > >> > what's > > > >> > > > > being > > > >> > > > > > provided in HTrace, we can modify HDFS instrumentation to > > add > > > a > > > >> > > 64-bit > > > >> > > > > > span-id to the RPC when tracing is enabled. And on the > > > receiver > > > >> > side, > > > >> > > > if > > > >> > > > > it > > > >> > > > > > receives a span-id, it shall also be traced with both the > > > parent > > > >> > and > > > >> > > > > child > > > >> > > > > > nodes having the same trace-id. > > > >> > > > > > > > > >> > > > > > What do you think? Please do correct me if I'm wrong. > > > >> > > > > > > > > >> > > > > > P.S: Also, the last date for application for the mentoring > > > ends > > > >> on > > > >> > > 19th > > > >> > > > > > July. So, I request all the experts here to please let me > > know > > > >> if > > > >> > > > you're > > > >> > > > > > ready to be a mentor. And I assure you, I won't bug you > too > > > >> much in > > > >> > > > your > > > >> > > > > > busy scheduler. It's a mandatory rule for the ICFOSS > > programme > > > - > > > >> > > > > > > > > >> http://community.apache.org/mentoringprogramme-icfoss-pilot.html > > > >> > > > > > > > > >> > > > > > > > > >> > > > > > On Wed, Jul 17, 2013 at 6:01 PM, Keith Turner < > > > [email protected] > > > >> > > > > >> > > > wrote: > > > >> > > > > > > > > >> > > > > > > On Wed, Jul 17, 2013 at 7:32 AM, Sreejith Ramakrishnan < > > > >> > > > > > > [email protected]> wrote: > > > >> > > > > > > > > > >> > > > > > > > Wouldn't modifying HDFS in any way mean forking the > > > project? > > > >> > > > Wouldn't > > > >> > > > > > > that > > > >> > > > > > > > have problems in the long run? > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > Forking HDFS is not the way to go. Getting your ideas > and > > > >> > patches > > > >> > > > > > accepted > > > >> > > > > > > by HDFS is the way to go. > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > On Wed, Jul 17, 2013 at 12:04 AM, Sreejith > Ramakrishnan > > < > > > >> > > > > > > > [email protected]> wrote: > > > >> > > > > > > > > > > >> > > > > > > > > Hey, > > > >> > > > > > > > > > > > >> > > > > > > > > I have an idea to tackle this Jira. I've read the > > dapper > > > >> > paper > > > >> > > > and > > > >> > > > > > > > > currently examining the work done in thrift. Shall I > > > make > > > >> a > > > >> > > > > detailed > > > >> > > > > > > post > > > >> > > > > > > > > here? > > > >> > > > > > > > > > > > >> > > > > > > > > I'm part of the ICFOSS Joint Mentoring Programme. So > > if > > > >> > someone > > > >> > > > can > > > >> > > > > > > > please > > > >> > > > > > > > > be my mentor, I'll be happy to work with you :) > > > >> > > > > > > > > > > > >> > > > > > > > > [1] > > > >> > > > > > > > http://community.apache.org/mentoringprogramme-icfoss-pilot.html > > > >> > > > > > > > > > > > >> > > > > > > > > Thank you, > > > >> > > > > > > > > Sreejith R > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > On Tue, Jul 16, 2013 at 8:46 AM, German Gutierrez < > > > >> > > > > > > > [email protected] > > > >> > > > > > > > > > wrote: > > > >> > > > > > > > > > > > >> > > > > > > > >> On Jul 12, 2013 8:53 PM, "Keith Turner" < > > > >> [email protected]> > > > >> > > > wrote: > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > On Thu, Jul 11, 2013 at 11:47 AM, Ajay Bhat < > > > >> > > > > > [email protected]> > > > >> > > > > > > > >> wrote: > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > > Thanks Keith. I am looking into it now. > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > > Accumulo has done Dapper design based tracing > and > > > >> called > > > >> > > it > > > >> > > > > > > > >> Cloudtrace. > > > >> > > > > > > > >> I > > > >> > > > > > > > >> > > am not aware of the ins and outs of this and > > would > > > >> like > > > >> > to > > > >> > > > > know > > > >> > > > > > > more > > > >> > > > > > > > >> > > indepth about it. Can anyone help out here? > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > Cloudtrace is an implementation of the ideas > > > mentioned > > > >> in > > > >> > > the > > > >> > > > > > Dapper > > > >> > > > > > > > >> paper. > > > >> > > > > > > > >> > Its only used by Accumulo at this point. The > > > reason > > > >> I > > > >> > > > > mentioned > > > >> > > > > > > the > > > >> > > > > > > > >> > HBase work is so you could asses the status of > that > > > >> work. > > > >> > > You > > > >> > > > > > > should > > > >> > > > > > > > >> > determine if any other work besides the HBase and > > > >> Accumulo > > > >> > > > > efforts > > > >> > > > > > > > >> exists. > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > I can think of a few ways to tackle this problem. > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > 1. Modify HDFS to use cloudtrace. Cloudtrace is > > > >> > currently > > > >> > > > > > > > implemented > > > >> > > > > > > > >> on > > > >> > > > > > > > >> > top of thrift, HDFS does not use thrift. > > > >> > > > > > > > >> > 2. Modify HDFS and Accumulo to use HBase > tracing. > > > >> > > > > > > > >> > 3. Modify HDFS to support hooks for tracing. > Make > > > >> > > cloudtrace > > > >> > > > > use > > > >> > > > > > > > these > > > >> > > > > > > > >> > hooks. > > > >> > > > > > > > >> > 4. Create completely new tracing system > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > What are your thoughts on this project? What do > > you > > > >> hope > > > >> > to > > > >> > > > > > > > accomplish? > > > >> > > > > > > > >> > What is your timeframe? > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > > > > >> > > > > > > > >> > > I have checked out the HBase trunk also. > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > > Some additional info about ASF ICFOSS: The > > > >> ASF-ICFOSS > > > >> > > > > > Programme [ > > > >> > > > > > > > >> > > http://icfoss.org/mentor.html] was conducted > by > > > >> Luciano > > > >> > > > > > Resende [ > > > >> > > > > > > > >> > > http://people.apache.org/~lresende] on June > > > 21-23rd, > > > >> > 2013 > > > >> > > > and > > > >> > > > > > as > > > >> > > > > > > > >> part of > > > >> > > > > > > > >> > > the Programme, students are encouraged to take > up > > > an > > > >> > > Apache > > > >> > > > > JIRA > > > >> > > > > > > as > > > >> > > > > > > > a > > > >> > > > > > > > >> > > project. > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > > On Thu, Jul 11, 2013 at 7:27 PM, Keith Turner < > > > >> > > > > [email protected] > > > >> > > > > > > > > > >> > > > > > > > >> wrote: > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > > > Some HBase guys were also looking into doing > > > >> something > > > >> > > w/ > > > >> > > > > > > tracing. > > > >> > > > > > > > >> I > > > >> > > > > > > > >> am > > > >> > > > > > > > >> > > > not sure what has been done, but it would be > > > >> useful to > > > >> > > > look > > > >> > > > > > into > > > >> > > > > > > > >> that. I > > > >> > > > > > > > >> > > > linked HBASE-6449 to the Accumulo ticket. > > > >> > > > > > > > >> > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > >> > > > On Wed, Jul 10, 2013 at 8:41 PM, Ajay Bhat < > > > >> > > > > > > [email protected] > > > >> > > > > > > > > > > > >> > > > > > > > >> > > wrote: > > > >> > > > > > > > >> > > > > > > >> > > > > > > > >> > > > > Hi all, > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > I had attended the ASF-ICFOSS workshop held > > in > > > >> June. > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > > > > >> > http://community.apache.org/mentoringprogramme-icfoss-pilot.html > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > I'd like to take up this issue as a > project. > > > >> > > > > > > > >> > > > > > > > >> https://issues.apache.org/jira/browse/ACCUMULO-1197 > > > >> > > > > > > > >> > > > > Could someone in the community act as a > > mentor > > > >> for > > > >> > > this > > > >> > > > > > > project? > > > >> > > > > > > > >> The > > > >> > > > > > > > >> > > > > process of selection is very similar to > GSoC. > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > I've checked out the source code and used > > > >> Accumulo. > > > >> > I > > > >> > > > hope > > > >> > > > > > to > > > >> > > > > > > > have > > > >> > > > > > > > >> > > made a > > > >> > > > > > > > >> > > > > formal proposal by Saturday, July 13th. I'd > > be > > > >> happy > > > >> > > to > > > >> > > > > get > > > >> > > > > > > some > > > >> > > > > > > > >> advice > > > >> > > > > > > > >> > > > on > > > >> > > > > > > > >> > > > > how I could get started on it, and also any > > > minor > > > >> > > > issues I > > > >> > > > > > > could > > > >> > > > > > > > >> work > > > >> > > > > > > > >> > > on > > > >> > > > > > > > >> > > > in > > > >> > > > > > > > >> > > > > the interim. > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > Regards, > > > >> > > > > > > > >> > > > > Ajay > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > >> > > > > > >> > > > > > > > >> > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > > > > > > > > > > > >
