Congrats John! Welcome onboard!
El mar., 15 oct. 2019 a las 11:32, Furkan KAMACI
> Congrats and welcome on board John!
> Kind Regards,
> Furkan KAMACI
> 15 Eki 2019 Sal, saat 12:13 tarihinde Sheriffo Ceesay
> şunu yazdı:
> > Congratulations John! Welcome onboard.
Looking forward to more awesome contributions!
El jue., 26 sept. 2019 a las 21:40, lewis john mcgibbney
> Hi dev@,
> I'm very happy to welcome Sheriffo Ceesay to our ranks. Sheriffo was one of
> our GSoC students this year with his work resulting in a benchmarking
Great work guys!
El vie., 30 ago. 2019 a las 2:46, Kevin Ratnasekera
> Hi Chanaka,
> Actually Lewis and myself both reviewed your PR, we were very happy about
> your contribution related to Apache Hive datastore. Thank you for taking
> over that task. We are looking forward to
Yes, I agree with the others, let's wait until the end of the weekend
and then see where we are and decide at that point.
El vie., 30 ago. 2019 a las 4:29, Furkan KAMACI
> Hi Sheriffo,
> There are some ways to overcome that issue i.e. using
Thanks for the report and all the work!
Gora performing worst when inserting data in the HBase case I think it
can make sense, because Gora still needs to serialize every data bean
through Avro, (maybe some caching? but Sheriffo also deactivated this
Very nice work! I am sorry for the silence in the past weeks, but I
have been swamped with things. I hope I can be of more help now.
Anyway, regarding your progress reports, I have some questions:
- Regarding using Google Cloud credits, did you see this?  Maybe
that would also
gt; First, I read from  related to  that the following oneliner code should
> be executed for better HBase performance when using YCSB. It basically avoids
> overloading a single region server.
> hbase(main):001:0> n_splits = 200 # HBase recommends (10 * number of
Thank you very much for the suggestions! you are totally right about
all of your points! Sheriffo, please benefit from them ;)
Also what is strange is this (although it can be optimized as Alfonso
pointed out) is that it works for the MongoDB backend. So I would also
suspect on the
Some opinions about your questions, but others are more than welcome
to suggest other things as well.
Q1: Are we going to consider arbitrary field length, e.g. if we set
the fieldcount to 100 then we have to create the respective Avro and
mapping files? Currently,
I don't think this
Thanks for putting this together. It will definitely be of use.
Could I also ask to please share the GitHub account where the
development is happening? So we can also keep track of it.
I will go through the document now, and leave some comments. From your
email, I imagine that you
El sáb., 11 may. 2019 a las 0:22, Madhawa Kasun Gunasekara
> Hi Lahiru,
> Congratulations and Welcome, Looking forward to your future contributions
> for Apache
> Gora project.
> On Tue, May 7, 2019 at 8:32 AM Lahiru Jayasekera
El mié., 8 may. 2019 a las 0:47, Alfonso Nishikawa (<
> Hi, John.
> Congratulations and welcome! (although you already got in touch solving
> issues :)
> Just out of curiosity, have you heard or read about
Looking forward to some awesome contributions :)
El mar., 7 may. 2019 a las 10:49, Sheriffo Ceesay ()
> FYI, My proposal has been accepted by GSoC. Thank you all for having
> confidence in me. I will endeavour by all means to deliver my best in this
as can be added to
> the implementation.
> Below is the Google doc file, please feel free to add comments.
> Thank you.
> **Sheriffo Ceesay**
> On Su
Thanks for your interest in Gora and in this project.
We have discussed this a bit already and what the important bit is to
figure out Gora's overhead compared to using just the kv stores.
Obviously, we incurr in overheads, but it'd be interesting to know where
exactly (most likely
Can I ask you which backend you are using?
If it is HBase, then you have update the max KeyValue size configuration.
This configuration is on the hbase-site.xml file which by default is 10MB
I am copying the Gora mailing list as well, as they
Congrats on the degree Alonso!
2018-07-05 23:18 GMT+02:00 lewis john mcgibbney :
> Nice Alfonso. Congratulations on your degree.
> On Thu, Jul 5, 2018 at 14:10 wrote:
> > dev Digest 5 Jul 2018 21:10:59 - Issue 1056
> > Topics (messages 10639 through 10639)
I think while there is people using JSON with multi-typed attributes, then
we should. But in general, I don't think people use them too much, it's
funny that people rather have more "structured" data.
So I'd say that if supporting them for a few a users makes the rest of
Thanks for reaching out! Yes, this project would consist in adding such
functionality i.e. being able to read, write and query Ignite through Gora.
@Nishadi would you like to add anything else to this?
2018-03-20 19:06 GMT+01:00 Chanuka Abeysinghe
2017-09-16 19:19 GMT+02:00 Madhawa Kasun Gunasekara :
> On Sat, Sep 16, 2017 at 8:30 AM, Furkan KAMACI
>> On Sat, Sep 16, 2017 at 1:50 PM, Alfonso Nishikawa <
>> alfonso.nishik...@gmail.com> wrote:
Great job Madhawa! Looking forward for more cool contributions in the
2017-08-26 14:18 GMT-07:00 Furkan KAMACI :
> 26 Ağu 2017 Cmt, saat 21:26 tarihinde Alfonso Nishikawa <
> alfonso.nishik...@gmail.com> şunu yazdı:
Thanks for your awesome contributions! and we hope to see more in the
2017-08-26 7:04 GMT-07:00 Nishadi Kirielle :
> Hi all,
> Thanks a lot for the feedback. It has been an honor to work with the
> community. I would like to
+1 to merge!
I went quickly over the code and looks good to me. I think you guys already
commented the most pressing issues. Thanks!
2017-07-27 8:13 GMT-07:00 Furkan KAMACI :
> +1 to merge!
> On Wed, Jul 26, 2017 at 7:13 PM, Nishadi Kirielle <
Thanks for the contributions Madhawa!
I am also looking forward to have this module working back !
2017-07-13 10:27 GMT-07:00 lewis john mcgibbney :
> Thank you very much for this update Madhawa.
> The code is looking excellent so far and I am looking
Thanks Nishadi for the good work and the bug fixes!
Hoping to see more great contributions :)
2017-07-13 11:39 GMT-07:00 Kevin Ratnasekera :
> Hi Nishadi,
> Your work has been excellent so far. You have produced well tested quality
> code. Thanks for
Congrats Madhawa! Looking forward to them :)
2017-05-05 16:59 GMT+02:00 Madhawa Kasun Gunasekara :
> Thanks Kevin. Looking forward to doing more contributions to gora project.
> On Thu, May 4, 2017 at 10:15 PM, Kevin Ratnasekera <
Congrats Nishadi! Looking forward to your contributions!
2017-05-05 16:30 GMT+02:00 Nishadi Kirielle :
> Thanks a lot for accepting my proposal.
> Looking forward to have a good project experience working with Apache Gora
> community throughout the
Sorry for the late reply, but I am writing on the jira page so we can keep
track of this over there.
But if you can take this on Madhawa, it'd be great! :)
2017-01-30 19:07 GMT+01:00 lewis john mcgibbney :
> Once we fix
Awesome news Kevin!
Thanks for bringing Gora to the masses :)
2016-11-22 12:12 GMT+01:00 Kevin Ratnasekera :
> Hi Gora Community,
> As some of you might aware, I participated last year GSoC with Gora
> community on project JCache data store. And I
Maybe Jenkins can't modify the path where Cassandra is writing to?
Lewis you are a Jenkins expert, any thoughts on this?
2016-09-22 23:20 GMT+02:00
Thanks a lot for your work and effort!
Code looks great, and we look forward for future contributions from you :)
2016-08-30 12:03 GMT+02:00 Kevin Ratnasekera :
> Hi Gora Community,
> This ends one of the awesome period I had with Apache
Yeah I think for some of the key-value stores there is some type of mock
server, or something like that (Cassandra and HBase do), but I don't know
if for CouchDb is such a thing. Maybe asking in their mailing lists would
be a good option too.
2016-07-07 22:45 GMT+02:00 Lewis
Maybe some of our unit tests should also be comparing the running times of
using Gora vs not using Gora for data persistency. Then we would get at
least an idea of how much Gora's flexibility "costs".
2016-05-18 20:59 GMT+02:00 Henry Saputra :
Thanks Cihad! And looking forward to your cool contributions!
2016-05-22 20:42 GMT+02:00 Lewis John Mcgibbney :
> Brilliant Cihad this is a good account of what you've been doing and what
> you plan.
> Thanks for your time and effort on the software. I am sure that
Congrats Cihad! And welcome on-board!
2016-04-25 22:34 GMT+02:00 Cihad Guzel :
> I'm very happy to join in GSOC 2016. This is the second time I have
> participated. I patipicated the GSoC 2015 for Apache Nutch Project. The
> work was completed successfully. This year
Great news Kevin! Welcome to the GoraCommunity!
2016-04-22 22:21 GMT+02:00 Lewis John Mcgibbney :
> Hi Kevin,
> Thanks for checking in.
> We will kick off events soon.
> On Friday, April 22, 2016, Kevin Ratnasekera
So is the problem that updates are not being persisted correctly through
I think there could be two places where the problem could be. Gora or
Nutch. Could you point us to a Nutch test case to try replicate from Nutch
itself? The tests we have in Gora they actually test updates
This would be really great, if you can bootstrap this, it'd be really cool.
2015-10-30 0:17 GMT+01:00 Furkan KAMACI :
> As you know that we have Apache Gora website: http://gora.apache.org/ and
> Apache wiki:
This is great! and congrats on the paper as well!
We would be definitely interested in having a module over infinispan for
Gora, so if you could open up a JIRA issue and then submit the pull
request, we would be more than happy to help getting the code into Gora's
Those are awesome news Lewis!
Is there a JIRA issue linked to that?
2015-12-13 21:06 GMT+01:00 Lewis John Mcgibbney :
> hi folks,
> Quick heads up that Gora is now in use of in Chukwa  for persisting log
> data. There are a number of improvements which
Thanks for doing this Lewis!
2015-11-18 7:23 GMT+01:00 Henry Saputra :
> Thank for writing up the report, Lewis
> On Tue, Nov 17, 2015 at 11:37 AM, Lewis John Mcgibbney
> > Description:
> >The Apache Gora open source framework
ries on it) and thats why I want to run
> it on two different datasets.
> Kind Regards,
> Furkan KAMACI
> On Fri, Oct 30, 2015 at 1:20 AM, Renato Marroquín Mogrovejo <
> renatoj.marroq...@gmail.com> wrote:
> > Hi Talat,
> > This would be
This would be great! If you are up for it, it'd be great to renew Gora's
2015-10-29 21:38 GMT+01:00 Furkan KAMACI :
> Hi All,
> Is it possible to have a fancy UI for Gora's website:
> I like Solr's website:
This would be great! This is something that might be really interesting and
useful for Gora's community!
I think you could use as a baseline, the native data access of Spark to
different available stores, and then compare it against the GoraRDD
integration. We have GoraCI which has been
I checked the patch and all changes seem reasonable.
Looking forward to this release!
2015-09-17 8:29 GMT+02:00 Lewis John Mcgibbney :
> Hi user@ and dev@,
> Quick message to ask kindly for a call to arms. I pushed a patch to
> NUTCH-1946 
Awesome news Lewis! Thanks for driving this!
2015-09-15 8:26 GMT+02:00 lewis john mcgibbney :
> Hi All,
> The Apache Gora team are pleased to announce the immediate availability of
> Apache Gora 0.6.1.
> What is Gora?
> Gora is a framework which provides an
Welcome Furkan! Great having you on board!
2015-09-11 20:42 GMT+02:00 Alfonso Nishikawa :
> Welcome! :)
> 2015-09-11 13:00 GMT-01:00 Mattmann, Chris A (3980) <
I downloaded the tar.gz, decompress and run mvn clean package, keys seems
fine as well.
Here is my +1
2015-09-05 18:53 GMT+02:00 Lewis John Mcgibbney :
> Hi Folks,
> I am very happy to get a VOTE out for Apache Gora 0.6.1 Release Candidate.
Sounds good to me Lewis! Thanks for pushing this forward!
2015-09-03 21:14 GMT+02:00 Lewis John Mcgibbney :
> Hi Everyone,
> I would like to push a release candidate by the end of the weekend.
> Furkan has a couple of issues which are pretty trivial to patch (I think)
> @Renato, I've checked Hadoop source codes and I see that we have to find an
> appropriate way to pass that property. We do not instantiate that class at
> Gora. What do you suggest?
> On Thu, Aug 27, 2015 at 7:03 AM, Renato Marroquín Mogrovejo <
The error seems like Zookeeper is closing the HBase connections ahead of
time. This is a very common problem when starting zookeeper and hbase
together. Check  hopefully that will be it.
Sounds good Lewis!
I am working on my fork the gora-cassandra rewrite using the datastax java
client. I will give more news when I have more things done :)
Thanks for pushing this forward Lewis!
2015-08-30 0:47 GMT+02:00 Lewis John Mcgibbney lewis.mcgibb...@gmail.com:
I think we should release as well, specially because gora-mongo has had
some good improvements :)
Maybe we should do like a minor release because the gora-cassandra stuff is
kinda broken right now, and I don't think we should do an official release
if some modules are not working
+02:00 Furkan KAMACI furkankam...@gmail.com:
They are all passed to
at that two examples, am I right? However, it is not used at there.
18 Ağu 2015 00:47 tarihinde Renato Marroquín Mogrovejo
2015-08-17 14:45 GMT-07:00 Renato Marroquín Mogrovejo
What about ...
2015-08-17 14:38 GMT-07:00 Furkan KAMACI furkankam
I think it was this , but this was specific to hadoop I think. I think
you could safely pass false there, so we can keep it to stay compatible
with Hadoop API.
Just a quick question, how does the HadoopRDD deals with it? does it expose
this parameter? Maybe it's worth checking it out as well.
Your use case totally makes sense. I have opened a new JIRA issue, could
you post a full patch or a pull request so we can review it please?
2015-06-05 5:13 GMT-07:00 Harry Papaxenopoulos hpapa...@gmail.com:
Cool thanks Furkan!
2015-05-19 19:09 GMT+02:00 Henry Saputra henry.sapu...@gmail.com:
Thanks for the update, Furkan
On Mon, May 18, 2015 at 2:01 PM, Furkan KAMACI furkankam...@gmail.com
After my suggestion and approval, I've changed the theme of Apache Gora
Awesome news Lewis!
2015-02-20 1:58 GMT+01:00 Lewis John Mcgibbney lewis.mcgibb...@gmail.com:
The Apache Gora team are pleased to announce the immediate availability of
Apache Gora 0.6.
This release addresses a modest 47 issues http://s.apache.org/gora-0.6
Thanks Chris! I will look into those too, I added a binding for Py4j now :)
After talking with Lewis for a while about supporting Gora from other JVM
based languages I started playing around and got some of them working
(clojure and jython) but I think for any other language it would as
straightforward as it was for those ones. Right now I am just
I think we can roll this one out as major upgrades have been done for
HBase, and as I think most people use HBase with Nutch, this would be good.
2015-01-28 3:59 GMT+01:00 Henry Saputra henry.sapu...@gmail.com:
There are major changes so I think we need 0.6.
+1 for roadmap as well.
I think a really important issue is the shim layers. We have to fully test
them and document them so people can actually use this code. And we should
try to standardize the functionality across the data stores so we can keep
on accepting new ones, or integrate with other
Could you check the logs in the application containers? They probably have
a more detailed error message that we can look at.
2014-12-01 18:03 GMT+01:00 Chahinez Benkoussas melle.benkous...@gmail.com:
I've stored a simple graph into HBase and now I want to run
Thanks for pushing this forward Lewis!
2014-11-11 1:14 GMT+01:00 lewis john mcgibbney lewi...@apache.org:
+The Apache Gora open source framework provides an in-memory data model and
+persistence for big data. Gora supports persisting to column stores, key
You are right, the array can not be shrinked at the moment and yes, it is
wrong having to write the whole array back if you just want to change a
The column qualifier used for each item is the original index that means if
your original array had 10 elements, then you'd
I created a MongoDataStore and create a query object to get objects from a
certain range, and when I wanted to iterate through the result set that it
returned, I got just a bunch of MongoResult objects instead of webPages.
It was just a class that I created to do that, if you can not
So I have just tried putting and getting elements (Nutch's WebPage) entries
specifically and everything works fine. So this is confusing, I guess Nutch
is doing something in the middle there that may have to do with the mapping
file or something like it. Because I tried changing the key
I end up with a bunch of MongoResults instead of WebPages
Are the WebPages serialized into Mongo, but not out of Mongo?
On Fri, Oct 10, 2014 at 5:37 AM, Renato Marroquín Mogrovejo
So I have just tried putting and getting
I am sorry we missed you on JIRA, but here we are :)
So the main issue for me with MemStore is that it actually is just a
regular HashMap wrapped around Gora. MemStore lives inside the same JVM
where you have instantiate it. So as you pointed out, when you create two
This is something we have discussing (online and offline) with other
people. I mean Gora provides access to data, and it also has a good
integration with Hadoop. In theory, it shouldn't be too hard to make Spark
read data through Gora, and yeah it would be great to have some examples on
Signatures are ok and all tests pass. Thanks for driving this through Lewis!
2014-09-16 17:22 GMT+02:00 Mattmann, Chris A (3980)
+1 from me:
[chipotle:~/tmp/apache-gora-0.5-rc1] mattmann% $HOME/bin/stage_apache_rc
IMHO we are not gaining anything right now. I think we already had this
discussion back in 2012 when creating the DynamoDb module as it didn't gain
anything from storing in bytes (they were not even supported at the time).
Binary formats tend to use up less memory and provide faster
Of course you could ;) but it wouldn't be really the Apache way. The idea
is that we get to discuss about optimizations we could agree as a community.
Please open as many JIRA as you want, and let put them down :)
2014-08-31 23:57 GMT+02:00 Damien Raude-Morvan
Great job as usual Lewis! Thanks for this!
2014-08-31 20:40 GMT+02:00 Henry Saputra henry.sapu...@gmail.com:
Awesome! Lewis, as usual, thanks for driving this effort =)
On Sun, Aug 31, 2014 at 11:15 AM, Lewis John Mcgibbney
Awesome Lewis! Thanks for doing this!
2014-08-22 6:12 GMT+02:00 Lewis John Mcgibbney lewis.mcgibb...@gmail.com:
WIKI updated, summary added there.
On Thu, Aug 21, 2014 at 8:39 PM, Mattmann, Chris A (3980)
The error produced when committed GORA-354 was this one:
Waiting for Jenkins to finish collecting data[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-deploy-plugin:2.5:deploy (default-deploy) on
project gora: Failed to deploy artifacts: Could not transfer artifact
I just checked out a fresh copy of Gora's master and run mvn verify as
well, and I didn't run into this problem.
Could you please try again with a fresh copy as well? Thanks!
2014-08-17 23:32 GMT+02:00 Alfonso Nishikawa alfonso.nishik...@gmail.com:
I made a mvn
method setDirty()? How will be finally the
management of dirty values?
2014-08-05 11:05 GMT+02:00 Renato Marroquín Mogrovejo
The patch in GORA-326 has to be rebased as there are other fixes that
By the way, I am quite disconnected of GORA-326, but surely you can
:) where is the modified method setDirty()? How will be finally the
management of dirty values?
2014-08-05 11:05 GMT+02:00 Renato Marroquín Mogrovejo
2014-07-09 11:10 GMT+02:00 Henry Saputra henry.sapu...@gmail.com:
Internally, Apache Spark can use Hadoop input format for its
distributed data structure (a.k.a RDD).
So, I guess we could still join the cool kids with Spark via our input
Cool Henry! I didn't know
Using the classname in lower case is much better than forcing the user to
take care of all properties to be right.
2014-07-07 14:45 GMT+02:00 Lewis John Mcgibbney lewis.mcgibb...@gmail.com:
Right now I am slightly puzzled by the above method but specifically the
Let's keep on making Gora great guys!
2014-07-01 9:04 GMT+02:00 Henry Saputra henry.sapu...@gmail.com:
I have tweeted the announcement, feel free to retweet
On Mon, Jun 30, 2014 at 9:00 PM, Henry Saputra
Dear Apache Gora enthusiast,
As you may be aware, ApacheCon will be held this year in Budapest, on
November 17-23. (See http://apachecon.eu for more info.)
The Call For Papers for that conference is still open, but will be
closing soon. We need your talk proposals, to represent Apache Gora at
On Jun 7, 2014 8:57 PM, Henry Saputra henry.sapu...@gmail.com wrote:
Based on the blog post from INFRA  to support ASF git repo with
Github mirror, I would like to submit INFRA ticket to enable it.
If no objection I will file ticket by end of day tomorrow.
Congrats Ioannis!!! This is going to be awesome for sure!
Looking forward for more documentation ;)
2014-05-30 14:29 GMT+02:00 Ioannis Polyzos i.poly...@gmail.com:
Thank you, its a pleasure to work with ASF people and interesting
projects like Gora :D
Cool stuff as usual Lewis! Thank you for taking the time to do this.
2014-05-20 6:18 GMT+02:00 Lewis John Mcgibbney lewis.mcgibb...@gmail.com:
Slides can now be found on Gora site... took a while for the site to update
community prefers to have in this module ?
On Tue, May 13, 2014 at 3:18 PM, Renato Marroquín Mogrovejo
No problem at all, but please let's try to synchronize a little bit more
often so we don't have too many risks
2014-05-20 17:33 GMT+02:00 Apostolis Giannakidis ap.giannaki...@gmail.com:
On Tue, May 20, 2014 at 4:26 PM, Lewis John Mcgibbney
I've got an IRC client running and will be on freenode #gora from now on.
I agree with Alfonso. We should describe what Gora is and not just what it
On a lot of presentations an easy way to describe Gora to people is saying
that I like to think of Gora as the JDBC for NoSQL which is sort of true.
I mean we do provide object mapping capabilities, but we
On May 17, 2014 6:05 PM, Alfonso Nishikawa alfonso.nishik...@gmail.com
I think this is because we are not able to know before hand how many tuples
are going to be read or fetched. We could do this but then we would have to
do an extra operation to figure this out.
I think this is the same behaviour inside the MapReduce examples from HBase
Great job Lewis! I will post it as well :D
2014-05-06 18:25 GMT+02:00 Henry Saputra henry.sapu...@gmail.com:
Great job Lewis, I like the blog.
Will definitely share the blog to the world :)
On Tuesday, May 6, 2014, Lewis John Mcgibbney lewis.mcgibb...@gmail.com
So what is the time for this? I might be able to join as well.
2014-05-03 23:34 GMT+02:00 Lewis John Mcgibbney lewis.mcgibb...@gmail.com:
I was decently approached by Jibran who is the organiser of hbase meet up
They want to cover some of the
This totally makes sense, and specially because __g__dirty is an internal
field, and users shouldn't be given tools to bad things ;)
If you put a patch for this, I will happily review it.
2014-05-02 13:08 GMT+02:00 Alparslan Avcı alparslana...@gmail.com:
Cool Lewis! Thank you very much for this!
2014-04-26 23:27 GMT+02:00 Apostolis Giannakidis ap.giannaki...@gmail.com:
Amazingly helpful and very informative Lewis!! It is highly
appreciated! Thank you!!
On Sat, Apr 26, 2014 at 9:45 PM, Lewis John Mcgibbney
I had seen this before and as Apos said, this was specifically for MacOS
and it was supposed to be harmless. But it is annoying for sure. I am using
Java7 and I followed this for making this message disappear.
Great news for sure!
2014-04-23 14:56 GMT+02:00 Julien Nioche lists.digitalpeb...@gmail.com:
Great news! Well done and thanks to everyone involved. I am sure this will
be popular with the Nutch 2.x users.
BTW I can smell a rematch of
It's in central repository :)
But not yet in the Apache mirrors, I'd say let's wait for a little longer.
2014-04-23 21:48 GMT+02:00 Henry Saputra henry.sapu...@gmail.com:
Seems like the 0.4 has not been fully replicated to the mirrors.
Shall we wait end of today?
On Wed, Apr 23,
Thank you Chris! The talk on ApacheCon 2014 was exactly about this
integration  :)
2014-04-20 21:51 GMT+02:00 Mattmann, Chris A (3980)
1 - 100 of 191 matches
Mail list logo