Re: Kudu datastore reports

2019-08-22 Thread Alfonso Nishikawa
Hi, John. I finally managed to pass the tests!!! It seems it needs the packages ntp-wait and/or chronyc, so in order to fix the error: java.io.IOException: failed to start masters: Unable to start Master at index 0:

Re: Kudu datastore reports

2019-08-09 Thread John Mora
Hi. I updated my PR[2] with some improvements. Also, I tested my code with this docker image [3] and it worked fine. This what I did: Run docker container: docker run --hostname localhost -d --rm --name apache-kudu -p 7051:7051 -p 7050:7050 -p 8051:8051 -p 8050:8050

Re: Kudu datastore reports

2019-08-09 Thread John Mora
Hi Alfonso, Please take into a consideration that the property 'gora.datastore.kudu.masterAddress' is overridden in the class GoraKuduTestDriver [1]. Because KuduTestHarness generates random ports which need to be configured at runtime. Probably, you should change the property there too. I will

Re: Kudu datastore reports

2019-08-07 Thread Kevin Ratnasekera
Hi John, Thank you for the Clarification. If the current implementation has no issues with build in those environments, I think there is *no* need to invest time in other approaches Eg:- Docker. Simply just do build test whether tests pass for those operating systems. Regards Kevin On Wed, Aug

Re: Kudu datastore reports

2019-08-06 Thread John Mora
Hi Kevin. KuduTestHarness, theoretically should detect environment through this plugin "os-maven-plugin" and download the corresponding kudu binaries [1], and it have worked fine for me. Nonetheless, docker is a good idea. I will give a look to testcontainers and docker. [1]

Re: Kudu datastore reports

2019-08-05 Thread Kevin Ratnasekera
Hi John, Can't we spin up Kudu docker [1] instance for testing purposes? We have used Test containers [2] some data stores like couch DB. Gora build should work in both Linux and Non Linux environments. Eg:- Windows. Is classifier [3] depend on the environment the build is running? Kudu is

Re: Kudu datastore reports

2019-08-05 Thread John Mora
Hi Alfonso, Unfortunately, I have not been able to reproduce the issue. Maybe it is related with my Java version (Oracle), I will try with OpenJDK. Some details about my development environment: os.detected.name: linux os.detected.arch: x86_64 os.detected.version: 4.10 os.detected.version.major:

Re: Kudu datastore reports

2019-08-05 Thread Alfonso Nishikawa
Hi, I am using now the following pom configuration I got from executing `mvn dependency:tree`: org.apache.kudu kudu-binary linux-x86_64 1.9.0 test When I execute `mvn clen package` on gora-kudu I find that it spawns the following command: kudu-master

Re: Kudu datastore reports

2019-08-05 Thread Alfonso Nishikawa
Hi, John. I get a core dump from the binary kudu server when trying to run the tests. Didn't find a log file, but will search thoroughly later. Happened anytime to you? Does it happens to anyone? I am using Ubuntu 18.04 Thank you! Regards, Alfonso Nishikawa El dom., 4 ago. 2019 20:10, Furkan

Re: Kudu datastore reports

2019-08-04 Thread Furkan KAMACI
Hi John, I've already made my comments at your PR. Please check them carefully and ask me if you need help. For the documentation, I've checked what you've done. On the other hand, I would want to encourage you to write a blog post about your Kudu implementation and demonstrate an example of

Re: Kudu datastore reports

2019-08-03 Thread John Mora
Hi all. I have updated my report in the Wiki[1]. Also, I have sent a PR with my last commits for review [2]. Please give it a look if you have time. This week, I will continue working on the documentation of the kudu datastore. Please let me know if you have suggestions. [1]

Re: Kudu datastore reports

2019-07-31 Thread carlos muñoz
Hi John, Thanks for the update. I reviewed your code a little bit, it is looking good. I think tha you should send a PR in order to receive feedback from other community members. Best, Carlos El dom., 28 jul. 2019 a las 23:20, John Mora () escribió: > Hi all. > > I updated my report in the

Re: Kudu datastore reports

2019-07-28 Thread John Mora
Hi all. I updated my report in the Wiki[1]. Also, I pushed my last commits to my branch [2]. Please give it a look if you have time. This week, I will give a look to the documentation of datastores. Please let me know if you have suggestions. [1]

Re: Kudu datastore reports

2019-07-23 Thread Alfonso Nishikawa
Hi, John. I checked out your code and it looks good :) I found that you use javafx, but that is not present in OpenJDK and fails to compile, and since we don't stick to Oracle JVM I would suggest to change it. Good job, keep it going :) Regards, Alfonso Nishikawa El sáb., 20 jul. 2019 a

Re: Kudu datastore reports

2019-07-20 Thread John Mora
Hi. I updated my report in the Wiki[1]. Also, I pushed my last commits to my branch [2]. Please give it a look if you have time. This week, I will give a look to the map reduce tests for DataStores. Please let me know if you have suggestions. [1]

Re: Kudu datastore reports

2019-07-13 Thread John Mora
Hi all I updated my report in the Wiki[1]. Also, I pushed my last commits to my branch [2]. Please give it a look if you have time. This week, I will be working in the getPartitions and deleteByQuery methods and testing the other tests in the DataStoreTestBase class. Please let me know if you

Re: Kudu datastore reports

2019-07-10 Thread John Mora
Hi Alfonso, Thanks so much for your time and support for this project. I will work on your comments. Responses inline :) El mar., 9 jul. 2019 a las 16:38, Alfonso Nishikawa (< alfonso.nishik...@gmail.com>) escribió: > Hi, John. > > Sorry for the delay, I am changing work and I have been very

Re: Kudu datastore reports

2019-07-09 Thread Alfonso Nishikawa
Hi, John. Sorry for the delay, I am changing work and I have been very busy :( I will try to answer your questions :) *> In the Employee example there is a field called 'dateOfBirth'. I tried to map that field with the UNIXTIME_MICROS datatype of Kudu (I intuitively assumed this is a date.).

Re: Kudu datastore reports

2019-07-07 Thread John Mora
Hi all. As every week I updated my report in the Wiki[1]. Also, I pushed my last commits to my branch [2]. Please give it a look if you have time. This week, I will be continue working in the Queries implementation, please reach me out if you have any suggestions. Also, while reviewing the

Re: Kudu datastore reports

2019-06-30 Thread John Mora
Hi all. I received my first evaluation from the Google Summer of Code program with a positive result. Thanks so much for your support and confidence to the project and me. I updated my report of this week in the Wiki[1]. Also, I pushed my last commits to my branch [2]. This week, I will be

Re: Kudu datastore reports

2019-06-27 Thread John Mora
Hi Carlos. Thanks for the reminder. I submitted the form yesterday. :D Best, John. El jue., 27 jun. 2019 a las 17:34, carlos muñoz () escribió: > Hi John > > The first Google Summer of Code evaluation is due on June 28th. Please > make sure you submit your Mentors' evaluation on time. > >

Re: Kudu datastore reports

2019-06-27 Thread carlos muñoz
Hi John The first Google Summer of Code evaluation is due on June 28th. Please make sure you submit your Mentors' evaluation on time. Regards, Carlos El dom., 23 jun. 2019 a las 18:29, John Mora () escribió: > Hi all. > > FYI, I updated my report of this week on the Wiki[1]. Also, I pushed my

Re: Kudu datastore reports

2019-06-17 Thread carlos muñoz
Hi John Your last changes look good to me. Keep it up. But, I noticed that you have created an Enumeration for datatypes, which is very similar to the kudu-client's [2]. Probably you should replace [1] for [2] in order to avoid code duplication. [1]

Re: Kudu datastore reports

2019-06-15 Thread John Mora
Hi all. I updated my report of this week on the Wiki[1]. I noticed that my code is lacking some javadoc documentation I think I will be working on that this week, also I would like to enable and check schema management tests (createSchema, existsSchema, etc.). [1]

Re: Kudu datastore reports

2019-06-10 Thread John Mora
Hi Alfonso. Thanks so much for your feedback. I am working on your comments. Best, John El lun., 10 jun. 2019 a las 16:11, Alfonso Nishikawa (< alfonso.nishik...@gmail.com>) escribió: > Hi, John. > > Regarding your questions at the report [1]: > > >- How to represent partitioning

Re: Kudu datastore reports

2019-06-10 Thread Alfonso Nishikawa
Hi, John. Regarding your questions at the report [1]: - How to represent partitioning configurations on the mapping file. This was discussed in other emails, isn't it? :) - KuduTestHarness requires the Maven plugin os-maven-plugin, which needs Maven 3.1.1+, is it a problem for Apache

Re: Kudu datastore reports

2019-06-10 Thread Alfonso Nishikawa
Hi, John. Thank you! Things I have seen: - The version of a maven dependency [1] should go on the Dependency Management of the root pom [2]. Same for [3] and from there, should not set the version there. - Set test dependencies' scope to test, at [4] and from there. - Set the indentation to 2

Kudu datastore reports

2019-06-08 Thread John Mora
Hi all. I have just updated my weekly reports on Cwiki [1]. This next week I think I should be focusing on the create schema operation and solving the issue of the partitioning configurations in the mapping file. Please let me know if you have suggestions, my last commits are available here [2]