Re: GSoC Ideas

2018-03-27 Thread Talat Uyarer
Thank you Kevin! you saved my life. On Mon, Mar 26, 2018 at 10:14 PM, Kevin Ratnasekera wrote: > Hi Talat, > > Please make sure you submit a proposal before the deadline. Deadline is > March 27 16:00 UTC. > > Regards > Kevin > > On Fri, Mar 16, 2018 at 6:18 AM, lewis john mcgibbney > wrote: > >

Re: GSoC Ideas

2018-03-26 Thread Kevin Ratnasekera
Hi Talat, Please make sure you submit a proposal before the deadline. Deadline is March 27 16:00 UTC. Regards Kevin On Fri, Mar 16, 2018 at 6:18 AM, lewis john mcgibbney wrote: > Hi Talat, > In all honesty I don't have the same time I used to, to look into this. > I have been experimenting usi

Re: GSoC Ideas

2018-03-15 Thread lewis john mcgibbney
Hi Talat, In all honesty I don't have the same time I used to, to look into this. I have been experimenting using Arrow with multi-dimensional array-based data but nothing else. I would therefore be learning probably as much as you if this project was to go ahead. Lewis On Thu, Mar 15, 2018 at 3:4

Re: GSoC Ideas

2018-03-15 Thread Talat Uyarer
@Lewis I found a PR[0] on Arrow Git repo. I guess they stuck with avro-c library. Do you know do they need implement same thing for all languages which are supported by them or they just need to implement a wrapper ? If we can use Arrow for our internal serialization, Gora will be super fast with

Re: GSoC Ideas

2018-03-15 Thread Renato Marroquín Mogrovejo
That also sounds like a great project Furkan! Hopefully someone takes it. I will be happy to provide code reviews and comments :) Best, Renato M. 2018-03-15 11:57 GMT+01:00 Furkan KAMACI : > Hi Fellows, > > I'll also mentor a project this year and I can help for the topics already > mentioned.

Re: GSoC Ideas

2018-03-15 Thread Furkan KAMACI
Hi Fellows, I'll also mentor a project this year and I can help for the topics already mentioned. I think that https://issues.apache.org/jira/browse/GORA-532 could be another issue for GSoC. Also, https://issues.apache.org/jira/browse/GORA-450 can be a warm-up issue for any GSoC projects which can

Re: GSoC Ideas

2018-03-15 Thread Renato Marroquín Mogrovejo
Hi Lewis, Thanks for pointing out [0]! I guess it makes sense, and there might be some performance to be gained when doing the transformation directly from Avro to Arrow. Yes, Lewis I totally agree with you in that having Gora to serialize all Hadoop metrics would be an awesome project. Is that a

Re: GSoC Ideas

2018-03-15 Thread lewis john mcgibbney
I should also say, ALL of the projects below which I have named require the Gora dependency to be upgraded. Lewis On Thu, Mar 15, 2018 at 12:24 AM, lewis john mcgibbney wrote: > Hi Renato, > > On Wed, Mar 14, 2018 at 3:22 PM, Renato Marroquín Mogrovejo < > renatoj.marroq...@gmail.com> wrote: > >

Re: GSoC Ideas

2018-03-15 Thread lewis john mcgibbney
Hi Renato, On Wed, Mar 14, 2018 at 3:22 PM, Renato Marroquín Mogrovejo < renatoj.marroq...@gmail.com> wrote: > Hey guys, > > There might not be an integration/convertors of Arrow to Avro (and/or > viceversa) because there are parquet readers that can take avro and once > stuff is in parquet, then

Re: GSoC Ideas

2018-03-14 Thread Renato Marroquín Mogrovejo
Hey guys, There might not be an integration/convertors of Arrow to Avro (and/or viceversa) because there are parquet readers that can take avro and once stuff is in parquet, then arrow can be used directly. Regarding if an integration of Parquet with Gora, I think it would be interesting to make i

Re: GSoC Ideas

2018-03-13 Thread lewis john mcgibbney
Hi Talat, On Tue, Mar 13, 2018 at 9:07 AM, Talat Uyarer wrote: > Hi Lewis, > Yes I checked the Jira i saw Redis and Apache Ignite integration. I just > wanted to ask you guys how more curial issues. > > What about Apache Arrow ? Most of projects start using that. I have one > concern about it.

Re: GSoC Ideas

2018-03-13 Thread Talat Uyarer
Hi Lewis, Yes I checked the Jira i saw Redis and Apache Ignite integration. I just wanted to ask you guys how more curial issues. What about Apache Arrow ? Most of projects start using that. I have one concern about it. Parquet and Arrow both of them are columnar. Avro provide us flexibility. [1]

Re: GSoC Ideas

2018-03-12 Thread lewis john mcgibbney
Hi Talat, Head over to JIRA and look for GORA issues tagged with ‘gsoc2018’ Another issue I could potential really think of would be to implement parquet as a potential underlying SerDe implementation alongside Avro. Lewis Mon, Mar 12, 2018 at 14:43 Talat Uyarer wrote: > Hi All, > > I have a ch