Re: Benchmark Module Results

2020-04-02 Thread Renato Marroquín Mogrovejo
Hi Furkan, I think that is a very good idea! I guess we all agree that having a better understanding on the performance overheads of Gora is very valuable, specially for project adoption. Thanks Furkan and Sheriffo for taking the initiative :) Best, Renato M. El mar., 31 mar. 2020 a las 23:13,

Re: [WELCOME] John Mora to Gora PMC and Committership

2019-10-15 Thread Renato Marroquín Mogrovejo
Congrats John! Welcome onboard! El mar., 15 oct. 2019 a las 11:32, Furkan KAMACI () escribió: > > Hi, > > Congrats and welcome on board John! > > Kind Regards, > Furkan KAMACI > > 15 Eki 2019 Sal, saat 12:13 tarihinde Sheriffo Ceesay > şunu yazdı: > > > Congratulations John! Welcome onboard. > >

Re: [WELCOME] Sheriffo Ceesay to Gora PMC and Committership

2019-09-26 Thread Renato Marroquín Mogrovejo
Welcome Sheriffo! Looking forward to more awesome contributions! El jue., 26 sept. 2019 a las 21:40, lewis john mcgibbney () escribió: > > Hi dev@, > I'm very happy to welcome Sheriffo Ceesay to our ranks. Sheriffo was one of > our GSoC students this year with his work resulting in a benchmarking

Re: Hive Backend Support in Gora is now available

2019-08-31 Thread Renato Marroquín Mogrovejo
Great work guys! El vie., 30 ago. 2019 a las 2:46, Kevin Ratnasekera () escribió: > > Hi Chanaka, > > Actually Lewis and myself both reviewed your PR, we were very happy about > your contribution related to Apache Hive datastore. Thank you for taking > over that task. We are looking forward to you

Re: YCSB dependency issue -- Plan B?

2019-08-30 Thread Renato Marroquín Mogrovejo
Hey Sheriffo, Yes, I agree with the others, let's wait until the end of the weekend and then see where we are and decide at that point. Best, Renato M. El vie., 30 ago. 2019 a las 4:29, Furkan KAMACI () escribió: > > Hi Sheriffo, > > There are some ways to overcome that issue i.e. using JitPac

Re: Final Report

2019-08-22 Thread Renato Marroquín Mogrovejo
Hey Sheriffo, Thanks for the report and all the work! Gora performing worst when inserting data in the HBase case I think it can make sense, because Gora still needs to serialize every data bean through Avro, (maybe some caching? but Sheriffo also deactivated this with gora.hbasestore.hbase.client

Re: Week 7 Report

2019-07-22 Thread Renato Marroquín Mogrovejo
Hey Sheriffo, Very nice work! I am sorry for the silence in the past weeks, but I have been swamped with things. I hope I can be of more help now. Anyway, regarding your progress reports, I have some questions: - Regarding using Google Cloud credits, did you see this? [1] Maybe that would also be

Re: Week 2 Report and A Question

2019-06-11 Thread Renato Marroquín Mogrovejo
performance. > > First, I read from [1] related to [2] that the following oneliner code should > be executed for better HBase performance when using YCSB. It basically avoids > overloading a single region server. > > hbase(main):001:0> n_splits = 200 # HBase recommends (10 * nu

Re: Week 2 Report and A Question

2019-06-10 Thread Renato Marroquín Mogrovejo
@Alfonso, Thank you very much for the suggestions! you are totally right about all of your points! Sheriffo, please benefit from them ;) Also what is strange is this (although it can be optimized as Alfonso pointed out) is that it works for the MongoDB backend. So I would also suspect on the confi

Re: Week 1 Report and Some Questions

2019-06-02 Thread Renato Marroquín Mogrovejo
Hi Sheriffo, Some opinions about your questions, but others are more than welcome to suggest other things as well. Q1: Are we going to consider arbitrary field length, e.g. if we set the fieldcount to 100 then we have to create the respective Avro and mapping files? Currently, I don't think this

Re: Basic Benchmark Module

2019-06-02 Thread Renato Marroquín Mogrovejo
Hi Sheriffo, Thanks for putting this together. It will definitely be of use. Could I also ask to please share the GitHub account where the development is happening? So we can also keep track of it. I will go through the document now, and leave some comments. From your email, I imagine that you hav

Re: GSoC 2019: Congratulations, your proposal with The Apache Software Foundation has been accepted!

2019-05-11 Thread Renato Marroquín Mogrovejo
Congrats Lahiru! El sáb., 11 may. 2019 a las 0:22, Madhawa Kasun Gunasekara () escribió: > > Hi Lahiru, > > Congratulations and Welcome, Looking forward to your future contributions > for Apache > Gora project. > > Regards > Madhawa > > > On Tue, May 7, 2019 at 8:32 AM Lahiru Jayasekera > wrote:

Re: GSoC 2019: Congratulations, your proposal with The Apache Software Foundation has been accepted!

2019-05-08 Thread Renato Marroquín Mogrovejo
Congrats John! El mié., 8 may. 2019 a las 0:47, Alfonso Nishikawa (< alfonso.nishik...@gmail.com>) escribió: > Hi, John. > > Congratulations and welcome! (although you already got in touch solving > issues :) > > Just out of curiosity, have you heard or read about > https://www.goraexplore.com? :

Re: GSoC 2019: Congratulations, your proposal with The Apache Software Foundation has been accepted!

2019-05-08 Thread Renato Marroquín Mogrovejo
Congrats Sheriffo! Looking forward to some awesome contributions :) El mar., 7 may. 2019 a las 10:49, Sheriffo Ceesay () escribió: > All, > > FYI, My proposal has been accepted by GSoC. Thank you all for having > confidence in me. I will endeavour by all means to deliver my best in this > excitin

Re: Apache Gora Benchmark

2019-03-25 Thread Renato Marroquín Mogrovejo
our ideas can be added to > the implementation. > > Below is the Google doc file, please feel free to add comments. > > > https://docs.google.com/document/d/1djelY4yVwTuWPA310E_JBinOPnt5PJh3x67z0ZxgBLg/edit?usp=sharing > > Thank you. > > **Sheriffo Ceesay** > >

Re: Apache Gora Benchmark

2019-03-24 Thread Renato Marroquín Mogrovejo
Hi Sheriffo, Thanks for your interest in Gora and in this project. We have discussed this a bit already and what the important bit is to figure out Gora's overhead compared to using just the kv stores. Obviously, we incurr in overheads, but it'd be interesting to know where exactly (most likely se

Re: Nutch crawler issue with more depth value

2019-01-24 Thread Renato Marroquín Mogrovejo
Hi there, Can I ask you which backend you are using? If it is HBase, then you have update the max KeyValue size configuration. This configuration is on the hbase-site.xml file which by default is 10MB hbase.client.keyvalue.maxsize 10485760 I am copying the Gora mailing list as well, as they mi

Re: GoraExplorer update

2018-07-06 Thread Renato Marroquín Mogrovejo
Congrats on the degree Alonso! 2018-07-05 23:18 GMT+02:00 lewis john mcgibbney : > Nice Alfonso. Congratulations on your degree. > Lewis > > On Thu, Jul 5, 2018 at 14:10 wrote: > > > > > dev Digest 5 Jul 2018 21:10:59 - Issue 1056 > > > > Topics (messages 10639 through 10639) > > > > GoraExp

Re: 3-union fields

2018-06-20 Thread Renato Marroquín Mogrovejo
Hi Alfonso, I think while there is people using JSON with multi-typed attributes, then we should. But in general, I don't think people use them too much, it's funny that people rather have more "structured" data. So I'd say that if supporting them for a few a users makes the rest of development ov

Re: [GSoC][GORA-535] Add a data store for Apache Ignite

2018-03-22 Thread Renato Marroquín Mogrovejo
Hi Chanuka, Thanks for reaching out! Yes, this project would consist in adding such functionality i.e. being able to read, write and query Ignite through Gora. @Nishadi would you like to add anything else to this? Best, Renato M. 2018-03-20 19:06 GMT+01:00 Chanuka Abeysinghe : > Hi, > I am Ch

Re: [VOTE] Apache Gora 0.8 RC#1

2017-09-17 Thread Renato Marroquín Mogrovejo
+1 2017-09-16 19:19 GMT+02:00 Madhawa Kasun Gunasekara : > ++1 > > > Madhawa > > On Sat, Sep 16, 2017 at 8:30 AM, Furkan KAMACI > wrote: > >> +1 >> >> On Sat, Sep 16, 2017 at 1:50 PM, Alfonso Nishikawa < >> alfonso.nishik...@gmail.com> wrote: >> >>> +1 >>> >>> 2017-09-15 9:40 GMT-01:00 lewis joh

Re: GORA-497 Migrate Cassandra Thrift to CQL - Final Evaluation

2017-08-27 Thread Renato Marroquín Mogrovejo
Great job Madhawa! Looking forward for more cool contributions in the future :) Best, Renato M. 2017-08-26 14:18 GMT-07:00 Furkan KAMACI : > Great! > > > 26 Ağu 2017 Cmt, saat 21:26 tarihinde Alfonso Nishikawa < > alfonso.nishik...@gmail.com> şunu yazdı: > >> Great! Good job! >> >> Regards, >>

Re: Gora- Aerospike Module : GSoC Final Evaluation

2017-08-27 Thread Renato Marroquín Mogrovejo
Hi Nishadi, Thanks for your awesome contributions! and we hope to see more in the future :) Best, Renato M. 2017-08-26 7:04 GMT-07:00 Nishadi Kirielle : > Hi all, > > Thanks a lot for the feedback. It has been an honor to work with the > community. I would like to continue my contributions :)

Re: Gora- Aerospike Module : GSoC Project Status

2017-07-27 Thread Renato Marroquín Mogrovejo
+1 to merge! I went quickly over the code and looks good to me. I think you guys already commented the most pressing issues. Thanks! Renato M. 2017-07-27 8:13 GMT-07:00 Furkan KAMACI : > +1 to merge! > > On Wed, Jul 26, 2017 at 7:13 PM, Nishadi Kirielle < > ndimeshi...@cse.mrt.ac.lk > > wrote:

Re: [Gora- Aerospkie] Weekly update

2017-07-21 Thread Renato Marroquín Mogrovejo
05f13 > a00c91fdc3 > [2]. > https://github.com/nishadi/gora/commit/c485f5bed92b784a4dd915c6fe5d7b > 95a9990618 > [3]. > https://github.com/nishadi/gora/blob/issue-502/gora- > aerospike/src/test/java/org/apache/gora/aerospike/store/ > TestAerospikeStore.java > > On 21

Re: [Gora- Aerospkie] Weekly update

2017-07-20 Thread Renato Marroquín Mogrovejo
Hi Nishadi, Thanks for sharing your GSoC status. I think one safe assumption you can make is that if the user wants to use the query feature of Aerospike then he should create it through Aerospike tools. Gora basically provides access to multiple datastores, but it doesn't offer support for execut

Re: [UPDATE] [GORA-CASSANDRA] GSOC Project Progress

2017-07-13 Thread Renato Marroquín Mogrovejo
Thanks for the contributions Madhawa! I am also looking forward to have this module working back ! Best, Renato M. 2017-07-13 10:27 GMT-07:00 lewis john mcgibbney : > Thank you very much for this update Madhawa. > The code is looking excellent so far and I am looking forward to seeing > your T

Re: [GORA-AEROSPIKE] GSoC project mid evaluation progress

2017-07-13 Thread Renato Marroquín Mogrovejo
Nice work on your google docs btw ! 2017-07-13 23:42 GMT-07:00 Renato Marroquín Mogrovejo < renatoj.marroq...@gmail.com>: > Thanks Nishadi for the good work and the bug fixes! > Hoping to see more great contributions :) > > > Best, > > Renato M. > > 2017-07-13

Re: [GORA-AEROSPIKE] GSoC project mid evaluation progress

2017-07-13 Thread Renato Marroquín Mogrovejo
Thanks Nishadi for the good work and the bug fixes! Hoping to see more great contributions :) Best, Renato M. 2017-07-13 11:39 GMT-07:00 Kevin Ratnasekera : > Hi Nishadi, > > Your work has been excellent so far. You have produced well tested quality > code. Thanks for your contributions toward

Re: Upgrading solr version in solr module

2017-05-28 Thread Renato Marroquín Mogrovejo
Hi Madhawa, I agree with you and Lewis on creating a single module with the latest version. Are the Solr API's incompatible across versions? Maybe we can just create a different maven profile for having both versions, if they are the same though, then probably is fine to let users recompile when t

Re: GSoC 2017: You are a mentor for Madhawa Gunasekara

2017-05-07 Thread Renato Marroquín Mogrovejo
Congrats Madhawa! Looking forward to them :) 2017-05-05 16:59 GMT+02:00 Madhawa Kasun Gunasekara : > Thanks Kevin. Looking forward to doing more contributions to gora project. > > Regards, > Madhawa > > Madhawa > > On Thu, May 4, 2017 at 10:15 PM, Kevin Ratnasekera < > djkevincr1...@gmail.com> >

Re: GSoC Acceptance - Implement Aerospike Datastore

2017-05-06 Thread Renato Marroquín Mogrovejo
Congrats Nishadi! Looking forward to your contributions! Best, Renato M. 2017-05-05 16:30 GMT+02:00 Nishadi Kirielle : > Thanks a lot for accepting my proposal. > > Looking forward to have a good project experience working with Apache Gora > community throughout the GSoC period. > > Thank you

Re: [Cassandra Store] Need to migrate to CQL Interface

2017-02-07 Thread Renato Marroquín Mogrovejo
Hey guys, Sorry for the late reply, but I am writing on the jira page so we can keep track of this over there. But if you can take this on Madhawa, it'd be great! :) Best, Renato M. 2017-01-30 19:07 GMT+01:00 lewis john mcgibbney : > Once we fix https://issues.apache.org/jira/browse/GORA-443

Re: Slides for Apache Gora JCache data store talk - ApacheCon Europe Nov 2016 - Seville, Spain

2016-11-22 Thread Renato Marroquín Mogrovejo
Awesome news Kevin! Thanks for bringing Gora to the masses :) Best, Renato M. 2016-11-22 12:12 GMT+01:00 Kevin Ratnasekera : > Hi Gora Community, > > As some of you might aware, I participated last year GSoC with Gora > community on project JCache data store. And I was able to present project

Re: [CassandraStore Tests] attempted to delete non-existing file...

2016-09-26 Thread Renato Marroquín Mogrovejo
Maybe Jenkins can't modify the path where Cassandra is writing to? http://stackoverflow.com/questions/26881066/how-to-solve-var-lib-cassandra-data-system-schema-columnfamilies-system-schema-c Lewis you are a Jenkins expert, any thoughts on this? Best, Renato M. 2016-09-22 23:20 GMT+02:00 Alfo

Re: GSoC completion with Apache Gora Community

2016-09-01 Thread Renato Marroquín Mogrovejo
Hi Kevin, Thanks a lot for your work and effort! Code looks great, and we look forward for future contributions from you :) Best, Renato M. 2016-08-30 12:03 GMT+02:00 Kevin Ratnasekera : > Hi Gora Community, > > This ends one of the awesome period I had with Apache Gora Community as a > GSoC

Re: to test using docker

2016-07-07 Thread Renato Marroquín Mogrovejo
Yeah I think for some of the key-value stores there is some type of mock server, or something like that (Cassandra and HBase do), but I don't know if for CouchDb is such a thing. Maybe asking in their mailing lists would be a good option too. Best, Renato M. 2016-07-07 22:45 GMT+02:00 Lewis Joh

Re: JProfiling

2016-05-30 Thread Renato Marroquín Mogrovejo
Maybe some of our unit tests should also be comparing the running times of using Gora vs not using Gora for data persistency. Then we would get at least an idea of how much Gora's flexibility "costs". Renato M. 2016-05-18 20:59 GMT+02:00 Henry Saputra : > Unfortunately I never did it. Does Gora

Re: GSOC GORA-437

2016-05-23 Thread Renato Marroquín Mogrovejo
Thanks Cihad! And looking forward to your cool contributions! 2016-05-22 20:42 GMT+02:00 Lewis John Mcgibbney : > Brilliant Cihad this is a good account of what you've been doing and what > you plan. > Thanks for your time and effort on the software. I am sure that this years > project will be as

Re: GSoC 2016: You are a mentor for cihad guzel

2016-04-25 Thread Renato Marroquín Mogrovejo
Congrats Cihad! And welcome on-board! 2016-04-25 22:34 GMT+02:00 Cihad Guzel : > Hi, > > I'm very happy to join in GSOC 2016. This is the second time I have > participated. I patipicated the GSoC 2015 for Apache Nutch Project. The > work was completed successfully. This year my goal is also to co

Re: GSoC 2016 with Apache Gora

2016-04-24 Thread Renato Marroquín Mogrovejo
Great news Kevin! Welcome to the GoraCommunity! Renato M. 2016-04-22 22:21 GMT+02:00 Lewis John Mcgibbney : > Hi Kevin, > Thanks for checking in. > We will kick off events soon. > Thanks > Lewis > > On Friday, April 22, 2016, Kevin Ratnasekera > wrote: > > > Hi Gora Community, > > > > I must r

Re: [POSSIBLE MAJOR BUG] gora-mongodb

2016-02-24 Thread Renato Marroquín Mogrovejo
Hi Lewis, So is the problem that updates are not being persisted correctly through Gora? I think there could be two places where the problem could be. Gora or Nutch. Could you point us to a Nutch test case to try replicate from Nutch itself? The tests we have in Gora they actually test updates and

Re: Improving Gora Wiki

2016-01-13 Thread Renato Marroquín Mogrovejo
Hey Furkan! This would be really great, if you can bootstrap this, it'd be really cool. Best, Renato M. 2015-10-30 0:17 GMT+01:00 Furkan KAMACI : > Hi, > > As you know that we have Apache Gora website: http://gora.apache.org/ and > Apache wiki: https://cwiki.apache.org/confluence/display/GORA

Re: Support for Infinispan

2015-12-26 Thread Renato Marroquín Mogrovejo
Hello Pierre, This is great! and congrats on the paper as well! We would be definitely interested in having a module over infinispan for Gora, so if you could open up a JIRA issue and then submit the pull request, we would be more than happy to help getting the code into Gora's code base. Thanks a

Re: Gora Storage System for Chukwa Logs

2015-12-13 Thread Renato Marroquín Mogrovejo
Those are awesome news Lewis! Is there a JIRA issue linked to that? Renato M. 2015-12-13 21:06 GMT+01:00 Lewis John Mcgibbney : > hi folks, > Quick heads up that Gora is now in use of in Chukwa [0] for persisting log > data. There are a number of improvements which I'll be working on over the >

Re: [REPORT] Apache Gora Board Report

2015-11-22 Thread Renato Marroquín Mogrovejo
Thanks for doing this Lewis! 2015-11-18 7:23 GMT+01:00 Henry Saputra : > Thank for writing up the report, Lewis > > On Tue, Nov 17, 2015 at 11:37 AM, Lewis John Mcgibbney > wrote: > > Description: > >The Apache Gora open source framework provides an in-memory data model > >and persistenc

Re: Benchmark For Apache Gora

2015-10-30 Thread Renato Marroquín Mogrovejo
nt to run > it on two different datasets. > > Kind Regards, > Furkan KAMACI > > On Fri, Oct 30, 2015 at 1:20 AM, Renato Marroquín Mogrovejo < > renatoj.marroq...@gmail.com> wrote: > > > Hi Talat, > > > > This would be great! This is something that mig

Re: Benchmark For Apache Gora

2015-10-29 Thread Renato Marroquín Mogrovejo
Hi Talat, This would be great! This is something that might be really interesting and useful for Gora's community! I think you could use as a baseline, the native data access of Spark to different available stores, and then compare it against the GoraRDD integration. We have GoraCI which has been

Re: Fancy UI for Gora Website

2015-10-29 Thread Renato Marroquín Mogrovejo
Hi Furkan, This would be great! If you are up for it, it'd be great to renew Gora's website. Renato M. 2015-10-29 21:38 GMT+01:00 Furkan KAMACI : > Hi All, > > Is it possible to have a fancy UI for Gora's website: > http://gora.apache.org/ > > I like Solr's website: http://lucene.apache.org/so

Re: DataStoretestUtil#testGetEmployeeWithFields Incorrect?

2015-10-03 Thread Renato Marroquín Mogrovejo
Hi Lewis, I think you might just be overlooking that the newly created one gets their values added in the for-loop https://github.com/apache/gora/blob/master/gora-core/src/test/java/org/apache/gora/store/DataStoreTestUtil.java#L273-L276 The values it gets are from the object that was persisted,

Re: NUTCH-1946 Upgrade to Gora 0.6.1

2015-09-18 Thread Renato Marroquín Mogrovejo
Hey Lewis, I checked the patch and all changes seem reasonable. Looking forward to this release! Renato M. 2015-09-17 8:29 GMT+02:00 Lewis John Mcgibbney : > Hi user@ and dev@, > > Quick message to ask kindly for a call to arms. I pushed a patch to > NUTCH-1946 [0] for Nutch 2.X HEAD [1] > > T

Re: [ANNOUNCE] Apache Gora 0.6.1 Release

2015-09-15 Thread Renato Marroquín Mogrovejo
Awesome news Lewis! Thanks for driving this! Renato M. 2015-09-15 8:26 GMT+02:00 lewis john mcgibbney : > Hi All, > > The Apache Gora team are pleased to announce the immediate availability of > Apache Gora 0.6.1. > > What is Gora? > Gora is a framework which provides an in-memory data model an

Re: [ANN] Furkan Kamaci new Gora PMC member and Committer

2015-09-13 Thread Renato Marroquín Mogrovejo
Welcome Furkan! Great having you on board! Renato M. 2015-09-11 20:42 GMT+02:00 Alfonso Nishikawa : > Welcome! :) > > 2015-09-11 13:00 GMT-01:00 Mattmann, Chris A (3980) < > chris.a.mattm...@jpl.nasa.gov>: > >> Welcome!! >> >> ++ >

Re: [VOTE] Release Apache Gora 0.6.1

2015-09-05 Thread Renato Marroquín Mogrovejo
Hey guys, I downloaded the tar.gz, decompress and run mvn clean package, keys seems fine as well. Here is my +1 Renato M. 2015-09-05 18:53 GMT+02:00 Lewis John Mcgibbney : > Hi Folks, > I am very happy to get a VOTE out for Apache Gora 0.6.1 Release Candidate. > > We solved 21 issues: http://s

Re: [discuss] roadmap for next release

2015-09-03 Thread Renato Marroquín Mogrovejo
Sounds good to me Lewis! Thanks for pushing this forward! 2015-09-03 21:14 GMT+02:00 Lewis John Mcgibbney : > Hi Everyone, > I would like to push a release candidate by the end of the weekend. > Furkan has a couple of issues which are pretty trivial to patch (I think) > so we may include these ho

Re: Unnecessary Variable

2015-09-02 Thread Renato Marroquín Mogrovejo
t; > @Renato, I've checked Hadoop source codes and I see that we have to find an > appropriate way to pass that property. We do not instantiate that class at > Gora. What do you suggest? > > > On Thu, Aug 27, 2015 at 7:03 AM, Renato Marroquín Mogrovejo < > renatoj.ma

Re: Connection Problem at Testing of GoraSparkEngine at Hbase

2015-08-30 Thread Renato Marroquín Mogrovejo
Hi Furkan, The error seems like Zookeeper is closing the HBase connections ahead of time. This is a very common problem when starting zookeeper and hbase together. Check [1] hopefully that will be it. Renato M. [1] http://stackoverflow.com/questions/1019/hbase-connection-refused 2015-08-27

Re: [discuss] roadmap for next release

2015-08-30 Thread Renato Marroquín Mogrovejo
Sounds good Lewis! I am working on my fork the gora-cassandra rewrite using the datastax java client. I will give more news when I have more things done :) Thanks for pushing this forward Lewis! Renato M. 2015-08-30 0:47 GMT+02:00 Lewis John Mcgibbney : > Hi Folks, > A quick heads up here. Ther

Re: [discuss] roadmap for next release

2015-08-28 Thread Renato Marroquín Mogrovejo
Hey Lewis, I think we should release as well, specially because gora-mongo has had some good improvements :) Maybe we should do like a minor release because the gora-cassandra stuff is kinda broken right now, and I don't think we should do an official release if some modules are not working proper

Re: Unnecessary Variable

2015-08-26 Thread Renato Marroquín Mogrovejo
:09 GMT+02:00 Furkan KAMACI : > They are all passed to > > GoraMapReduceUtils.setIOSerializations(conf, reuseObjects); > > at that two examples, am I right? However, it is not used at there. > 18 Ağu 2015 00:47 tarihinde "Renato Marroquín Mogrovejo" < > renato

Re: Unnecessary Variable

2015-08-17 Thread Renato Marroquín Mogrovejo
/GoraMapper.java#L62 2015-08-17 14:45 GMT-07:00 Renato Marroquín Mogrovejo < renatoj.marroq...@gmail.com>: > What about ... > https://github.com/apache/gora/blob/master/gora-core/src/main/java/org/apache/gora/mapreduce/GoraReducer.java#L47 > > 2015-08-17 14:38 GMT-0

Re: Unnecessary Variable

2015-08-17 Thread Renato Marroquín Mogrovejo
What about ... https://github.com/apache/gora/blob/master/gora-core/src/main/java/org/apache/gora/mapreduce/GoraReducer.java#L47 2015-08-17 14:38 GMT-07:00 Furkan KAMACI : > Whether you set *reuseObjects *to true or false, it is not considered at > source code.. > > On Tue, Aug 18, 2015 at 12:35

Re: Unnecessary Variable

2015-08-17 Thread Renato Marroquín Mogrovejo
I think it was this [1], but this was specific to hadoop I think. I think you could safely pass there, so we can keep it to stay compatible with Hadoop API. Just a quick question, how does the HadoopRDD deals with it? does it expose this parameter? Maybe it's worth checking it out as well. Renat

Re: HBaseStore configuration-based schemaName

2015-06-15 Thread Renato Marroquín Mogrovejo
Hi Harry, Your use case totally makes sense. I have opened a new JIRA issue, could you post a full patch or a pull request so we can review it please? Thanks! Renato M. [1] https://issues.apache.org/jira/browse/GORA-425 2015-06-05 5:13 GMT-07:00 Harry Papaxenopoulos : > All, > > I'm working o

Re: Apache Gora Wiki Theme Change

2015-05-20 Thread Renato Marroquín Mogrovejo
Cool thanks Furkan! Renato M. 2015-05-19 19:09 GMT+02:00 Henry Saputra : > Thanks for the update, Furkan > > On Mon, May 18, 2015 at 2:01 PM, Furkan KAMACI > wrote: > > Hi All, > > > > After my suggestion and approval, I've changed the theme of Apache Gora > > wiki from Default Theme to Docume

Re: Does anyone hear about Hibernate OGM?

2015-03-04 Thread Renato Marroquín Mogrovejo
Hi all, I think there are many of these ORM nowadays, and they share some similarities with Gora. Of course they have some advantages over our project but they also lack some cool features we have (integration with other projects, native Avro serialization for data stores like HBase, etc.). We def

Re: [ANNOUNCE] Apache Gora 0.6 Released

2015-02-19 Thread Renato Marroquín Mogrovejo
Awesome news Lewis! Renato M. 2015-02-20 1:58 GMT+01:00 Lewis John Mcgibbney : > Hi Folks, > > The Apache Gora team are pleased to announce the immediate availability of > Apache Gora 0.6. > > This release addresses a modest 47 issues > with some being major impro

Re: Using Gora from other jvm languages

2015-02-09 Thread Renato Marroquín Mogrovejo
Thanks Chris! I will look into those too, I added a binding for Py4j now :) Renato M.

Using Gora from other jvm languages

2015-02-09 Thread Renato Marroquín Mogrovejo
Hello everyone, After talking with Lewis for a while about supporting Gora from other JVM based languages I started playing around and got some of them working (clojure[2] and jython[3]) but I think for any other language it would as straightforward as it was for those ones. Right now I am just ex

Re: [DISCUSS] Release Apache Gora 0.6

2015-01-28 Thread Renato Marroquín Mogrovejo
I think we can roll this one out as major upgrades have been done for HBase, and as I think most people use HBase with Nutch, this would be good. +1 Lewis Renato M. 2015-01-28 3:59 GMT+01:00 Henry Saputra : > There are major changes so I think we need 0.6. > > Is the versioned doc in svn or Git

Re: [DISCUSS] Creation of Gora Roadmap Page

2015-01-11 Thread Renato Marroquín Mogrovejo
+1 for roadmap as well. I think a really important issue is the shim layers. We have to fully test them and document them so people can actually use this code. And we should try to standardize the functionality across the data stores so we can keep on accepting new ones, or integrate with other sys

Re: Failing to run Giraph with Gora

2014-12-02 Thread Renato Marroquín Mogrovejo
Hi there, Could you check the logs in the application containers? They probably have a more detailed error message that we can look at. Renato M. 2014-12-01 18:03 GMT+01:00 Chahinez Benkoussas : > Hi!, > > I've stored a simple graph into HBase and now I want to run Giraph on the > Graph by th

Re: [REPORT] Apache Gora

2014-11-11 Thread Renato Marroquín Mogrovejo
Thanks for pushing this forward Lewis! Renato M. 2014-11-11 1:14 GMT+01:00 lewis john mcgibbney : > Hi Board@, > > > +The Apache Gora open source framework provides an in-memory data model and > +persistence for big data. Gora supports persisting to column stores, key > +value stores, document

Re: Working with arrays in HBase. Do they only grow?

2014-10-27 Thread Renato Marroquín Mogrovejo
Hi Alfonso, You are right, the array can not be shrinked at the moment and yes, it is wrong having to write the whole array back if you just want to change a single element. The column qualifier used for each item is the original index that means if your original array had 10 elements, then you'd

Re: Should MongoDB know about Utf8?

2014-10-16 Thread Renato Marroquín Mogrovejo
Hi Damien, I created a MongoDataStore and create a query object to get objects from a certain range, and when I wanted to iterate through the result set that it returned, I got just a bunch of MongoResult objects instead of webPages. It was just a class that I created to do that, if you can not re

Re: Should MongoDB know about Utf8?

2014-10-10 Thread Renato Marroquín Mogrovejo
#x27;t an option. > > > I end up with a bunch of MongoResults instead of WebPages > > Are the WebPages "serialized" into Mongo, but not out of Mongo? > > Tyler > > On Fri, Oct 10, 2014 at 5:37 AM, Renato Marroquín Mogrovejo < > renatoj.marroq...@gmail.com>

Re: Should MongoDB know about Utf8?

2014-10-10 Thread Renato Marroquín Mogrovejo
Hi guys, So I have just tried putting and getting elements (Nutch's WebPage) entries specifically and everything works fine. So this is confusing, I guess Nutch is doing something in the middle there that may have to do with the mapping file or something like it. Because I tried changing the key t

Re: Gora Spark Backend

2014-10-09 Thread Renato Marroquín Mogrovejo
Hi Talat, This is something we have discussing (online and offline) with other people. I mean Gora provides access to data, and it also has a good integration with Hadoop. In theory, it shouldn't be too hard to make Spark read data through Gora, and yeah it would be great to have some examples on

Re: GORA-227

2014-10-09 Thread Renato Marroquín Mogrovejo
Hi Sergey, I am sorry we missed you on JIRA, but here we are :) So the main issue for me with MemStore is that it actually is just a regular HashMap wrapped around Gora. MemStore lives inside the same JVM where you have instantiate it. So as you pointed out, when you create two different instance

Re: Possible collaboration between Gora and MetaModel to deliver datastore concept?

2014-09-24 Thread Renato Marroquín Mogrovejo
Hi Kasper, I think it would be better to have the gora-metamodel as metamodel supports other input formats than just sql. This would be great! Renato M. 2014-09-22 19:06 GMT+02:00 Kasper Sørensen : > Hi again guys, > > So to get this started I would like to try and hack away on some (probably

Re: [VOTE] Apache Gora 0.5 Release Candidate #1

2014-09-16 Thread Renato Marroquín Mogrovejo
+1 Signatures are ok and all tests pass. Thanks for driving this through Lewis! Renato M. 2014-09-16 17:22 GMT+02:00 Mattmann, Chris A (3980) < chris.a.mattm...@jpl.nasa.gov>: > +1 from me: > > [chipotle:~/tmp/apache-gora-0.5-rc1] mattmann% $HOME/bin/stage_apache_rc > apache-gora 0.5-src https:

Re: Persistence within gora-cassandra

2014-09-13 Thread Renato Marroquín Mogrovejo
Hi Lewis, IMHO we are not gaining anything right now. I think we already had this discussion back in 2012 when creating the DynamoDb module as it didn't gain anything from storing in bytes (they were not even supported at the time). Binary formats tend to use up less memory and provide faster acce

Re: Gora Sonar Analysis Job

2014-09-01 Thread Renato Marroquín Mogrovejo
Hi Damien, Of course you could ;) but it wouldn't be really the Apache way. The idea is that we get to discuss about optimizations we could agree as a community. Please open as many JIRA as you want, and let put them down :) Renato M. 2014-08-31 23:57 GMT+02:00 Damien Raude-Morvan : > 2014-08

Re: Gora Sonar Analysis Job

2014-08-31 Thread Renato Marroquín Mogrovejo
Great job as usual Lewis! Thanks for this! Renato M. 2014-08-31 20:40 GMT+02:00 Henry Saputra : > Awesome! Lewis, as usual, thanks for driving this effort =) > > - Henry > > On Sun, Aug 31, 2014 at 11:15 AM, Lewis John Mcgibbney > wrote: > > Hi Folks, > > INFRA rebooted the Sonar analysis job

Re: Gora Executive Summary

2014-08-23 Thread Renato Marroquín Mogrovejo
Awesome Lewis! Thanks for doing this! Renato M. 2014-08-22 6:12 GMT+02:00 Lewis John Mcgibbney : > WIKI updated, summary added there. > > https://cwiki.apache.org/confluence/display/GORA/Index > > > On Thu, Aug 21, 2014 at 8:39 PM, Mattmann, Chris A (3980) < > chris.a.mattm...@jpl.nasa.gov> w

Re: Test error on [gora-core] TestDataFileAvroStoreMapReduce

2014-08-18 Thread Renato Marroquín Mogrovejo
Hi Alfonso, I just checked out a fresh copy of Gora's master and run as well, and I didn't run into this problem. Could you please try again with a fresh copy as well? Thanks! Renato M. 2014-08-17 23:32 GMT+02:00 Alfonso Nishikawa : > Hi! > > I made a "mvn verify" on master and I got this t

Re: gora-trunk - Build # 1181 - Failure

2014-08-18 Thread Renato Marroquín Mogrovejo
Hi everybody, The error produced when committed GORA-354 was this one: Waiting for Jenkins to finish collecting data[ERROR] Failed to execute goal org.apache.maven.plugins:maven-deploy-plugin:2.5:deploy (default-deploy) on project gora: Failed to deploy artifacts: Could not transfer artifact org

Re: Populating text fields within Gora data beans

2014-08-05 Thread Renato Marroquín Mogrovejo
n since "get(0)" should be of type byte (=ByteBuffer) :( > > > Regards, > > Alfonso Nishikawa > > > > 2014-08-05 12:41 GMT+02:00 Renato Marroquín Mogrovejo < > renatoj.marroq...@gmail.com>: > > > I will try to :) > > So GORA-189 is for f

Re: Populating text fields within Gora data beans

2014-08-05 Thread Renato Marroquín Mogrovejo
elp me > :) where is the modified method "setDirty()"? How will be finally the > management of dirty values? > > Thanks! > > Alfonso Nishikawa > > > > 2014-08-05 11:05 GMT+02:00 Renato Marroquín Mogrovejo < > renatoj.marroq...@gmail.com>: > > >

Re: Populating text fields within Gora data beans

2014-08-05 Thread Renato Marroquín Mogrovejo
Hi Alfonso, The patch in GORA-326 has to be rebased as there are other fixes that have come in before this one :( I will try to do that this week, but I wasn't able to reproduce Lewis' error reported there. GORA-326 aims to make dirty_bytes part of the class hierarchy instead of copying the array

Re: [DISCUSS] Abstracting away Hadoop/MapReduce as Data Processing Layer

2014-07-09 Thread Renato Marroquín Mogrovejo
2014-07-09 11:10 GMT+02:00 Henry Saputra : > Internally, Apache Spark can use Hadoop input format for its > distributed data structure (a.k.a RDD). > So, I guess we could still join the cool kids with Spark via our input > format implementation. > Cool Henry! I didn't know about we could use Hado

Re: Intended Behaviour of DataStoreFactory#findProperty

2014-07-07 Thread Renato Marroquín Mogrovejo
+1 Using the classname in lower case is much better than forcing the user to take care of all properties to be right. 2014-07-07 14:45 GMT+02:00 Lewis John Mcgibbney : > Hi Folks, > Right now I am slightly puzzled by the above method but specifically the > following line > > String fullKey = GOR

Re: [ANNOUNCEMENT] Apache Gora added to DARPA's Open Catalog

2014-07-01 Thread Renato Marroquín Mogrovejo
Let's keep on making Gora great guys! Renato M. 2014-07-01 9:04 GMT+02:00 Henry Saputra : > I have tweeted the announcement, feel free to retweet > > https://twitter.com/Kingwulf/status/483824969093087232 > > - Henry > > On Mon, Jun 30, 2014 at 9:00 PM, Henry Saputra > wrote: > > W00t! This i

ApacheCon CFP closes June 25

2014-06-10 Thread Renato Marroquín Mogrovejo
Dear Apache Gora enthusiast, As you may be aware, ApacheCon will be held this year in Budapest, on November 17-23. (See http://apachecon.eu for more info.) The Call For Papers for that conference is still open, but will be closing soon. We need your talk proposals, to represent Apache Gora at Apa

Re: [DISCUSS] Enabling Github integration with Apache Gora git repo

2014-06-07 Thread Renato Marroquín Mogrovejo
+1 On Jun 7, 2014 8:57 PM, "Henry Saputra" wrote: > Hi guys, > > Based on the blog post from INFRA [1] to support ASF git repo with > Github mirror, I would like to submit INFRA ticket to enable it. > > If no objection I will file ticket by end of day tomorrow. > > Thanks, > > - Henry > > [1] > h

Re: Apache Camel now using Gora

2014-05-30 Thread Renato Marroquín Mogrovejo
Congrats Ioannis!!! This is going to be awesome for sure! Looking forward for more documentation ;) Renato M. 2014-05-30 14:29 GMT+02:00 Ioannis Polyzos : > Hi guys, > > Thank you, its a pleasure to work with ASF people and interesting > projects like Gora :D > > Regards, > *Ioannis* > > On

Re: [DICUSS] Project Description

2014-05-20 Thread Renato Marroquín Mogrovejo
Hi all, I agree with Alfonso. We should describe what Gora is and not just what it does. On a lot of presentations an easy way to describe Gora to people is saying that I like to think of Gora as the "JDBC for NoSQL" which is sort of true. I mean we do provide object mapping capabilities, but we h

Re: IRCCHAT gora

2014-05-20 Thread Renato Marroquín Mogrovejo
Awesome Lewis! Renato M. 2014-05-20 17:33 GMT+02:00 Apostolis Giannakidis : > Cool!!! > > On Tue, May 20, 2014 at 4:26 PM, Lewis John Mcgibbney > wrote: > > Hi Folks, > > I've got an IRC client running and will be on freenode #gora from now on. > > Please log on if you want to tell some jokes

Re: GSoC

2014-05-20 Thread Renato Marroquín Mogrovejo
cases Hazelcast provide. Now, I need to know which of those use cases > community prefers to have in this module ? > > Thanks, > Ahsan > > > > > On Tue, May 13, 2014 at 3:18 PM, Renato Marroquín Mogrovejo < > renatoj.marroq...@gmail.com> wrote: > >> Hi Ahsan,

Re: London HBase Meetup Slides

2014-05-20 Thread Renato Marroquín Mogrovejo
Cool stuff as usual Lewis! Thank you for taking the time to do this. Renato M. 2014-05-20 6:18 GMT+02:00 Lewis John Mcgibbney : > Hi Folks, > Slides can now be found on Gora site... took a while for the site to update > http://gora.apache.org/ > Thanks > Lewis > > -- > *Lewis* >

  1   2   3   >