Re: Student proposal for GSOC 2019

[Lahiru Jayasekera]

Hi Carols,
Enabled the comments. Please add your comments.

https://docs.google.com/document/d/1jt1bVlcVyDk1cytS8g-oNJoqZ9hminHWUsY5vBAmvQc/edit?usp=drivesdkr

Thanks and regards

On Tue, Apr 2, 2019, 08:38 carlos muñoz  Hi Lahiru,
>
> Thanks for your interest in Apache Gora.
> The proposal looks interesting, could you please enable the suggestions
> mode on the document?.
> I would like to leave a couple of comments.
>
> Cheers,
> Carlos
>
>
> El lun., 1 abr. 2019 a las 14:06, Lahiru Jayasekera (<
> mlpjayasek...@gmail.com>) escribió:
>
> > Hi all,
> > I would like to do the project "Hazelcast Jet execution engine
> support"[1],
> > for gsoc 2019. I have created a proposal with the help of you. I have
> > attached the draft proposal here and would like to get your kind feed
> back.
> >
> >
> >
> https://docs.google.com/document/d/1jt1bVlcVyDk1cytS8g-oNJoqZ9hminHWUsY5vBAmvQc/edit?usp=sharing
> >
> > Thanks and Regards
> > Lahiru
> >
> > 1. https://issues.apache.org/jira/browse/GORA-546
> >
> > --
> > Lahiru Jayasekara
> > Batch 15
> > Faculty of Information Technology
> > University of Moratuwa
> > 0716492170
> >
>

Re: Student proposal for GSOC 2019

[Lahiru Jayasekera]

Thanks Carlos

On Tue, Apr 2, 2019 at 9:26 AM carlos muñoz  wrote:

> Thanks Lahiru.
>
> Nice work, I have left a few comments.
>
> Regards,
> Carlos.
>
> El lun., 1 abr. 2019 a las 22:22, Lahiru Jayasekera (<
> mlpjayasek...@gmail.com>) escribió:
>
> > Hi Carols,
> > Enabled the comments. Please add your comments.
> >
> >
> >
> https://docs.google.com/document/d/1jt1bVlcVyDk1cytS8g-oNJoqZ9hminHWUsY5vBAmvQc/edit?usp=drivesdkr
> >
> > Thanks and regards
> >
> > On Tue, Apr 2, 2019, 08:38 carlos muñoz  >
> > > Hi Lahiru,
> > >
> > > Thanks for your interest in Apache Gora.
> > > The proposal looks interesting, could you please enable the suggestions
> > > mode on the document?.
> > > I would like to leave a couple of comments.
> > >
> > > Cheers,
> > > Carlos
> > >
> > >
> > > El lun., 1 abr. 2019 a las 14:06, Lahiru Jayasekera (<
> > > mlpjayasek...@gmail.com>) escribió:
> > >
> > > > Hi all,
> > > > I would like to do the project "Hazelcast Jet execution engine
> > > support"[1],
> > > > for gsoc 2019. I have created a proposal with the help of you. I have
> > > > attached the draft proposal here and would like to get your kind feed
> > > back.
> > > >
> > > >
> > > >
> > >
> >
> https://docs.google.com/document/d/1jt1bVlcVyDk1cytS8g-oNJoqZ9hminHWUsY5vBAmvQc/edit?usp=sharing
> > > >
> > > > Thanks and Regards
> > > > Lahiru
> > > >
> > > > 1. https://issues.apache.org/jira/browse/GORA-546
> > > >
> > > > --
> > > > Lahiru Jayasekara
> > > > Batch 15
> > > > Faculty of Information Technology
> > > > University of Moratuwa
> > > > 0716492170
> > > >
> > >
> >
>


-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: HBase test failure

[Lahiru Jayasekera]

All right
Thanks Kevin

On Sat, Apr 6, 2019 at 10:40 AM Kevin Ratnasekera 
wrote:

> Hi Lahiru,
>
> From time to time, I am also noticing the same, however Jenkins build
> always get through as success. Thank you for bringing this up, currently I
> am looking into this issue, will get back to you with an update.
>
> Regards
> Kevin
>
> On Sat, Apr 6, 2019 at 10:37 AM Lahiru Jayasekera  >
> wrote:
>
> > Hi all,
> > I'm experiencing following test failures on a newly fetched branch.
> >
> > [INFO] Running org.apache.gora.hbase.store.TestHBaseStore
> > Formatting using clusterid: testClusterID
> > [ERROR] Tests run: 46, Failures: 4, Errors: 0, Skipped: 3, Time elapsed:
> > 129.085 s <<< FAILURE! - in org.apache.gora.hbase.store.TestHBaseStore
> > [ERROR] testQueryStartKey(org.apache.gora.hbase.store.TestHBaseStore)
> Time
> > elapsed: 0.148 s  <<< FAILURE!
> > java.lang.AssertionError: expected:<10> but was:<9>
> >
> > [ERROR] testQueryEndKey(org.apache.gora.hbase.store.TestHBaseStore)  Time
> > elapsed: 0.179 s  <<< FAILURE!
> > java.lang.AssertionError: expected:<9> but was:<8>
> >
> > [ERROR] testQueryKeyRange(org.apache.gora.hbase.store.TestHBaseStore)
> Time
> > elapsed: 0.149 s  <<< FAILURE!
> > java.lang.AssertionError: expected:<10> but was:<9>
> >
> > [ERROR] testDelete(org.apache.gora.hbase.store.TestHBaseStore)  Time
> > elapsed: 0.128 s  <<< FAILURE!
> > java.lang.AssertionError: expected:<9> but was:<8>
> >
> > java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10]
> > Thread[IPC Client (346592919) connection to localhost/
> 127.0.0.1:45253
> > from mlpj,5,PEWorkerGroup]
> > [INFO] Running org.apache.gora.hbase.mapreduce.TestHBaseStoreWordCount
> > Formatting using clusterid: testClusterID
> > [WARNING] Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
> > 95.501 s - in org.apache.gora.hbase.mapreduce.TestHBaseStoreWordCount
> > java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10]
> > Thread[IPC Client (515135084) connection to localhost/
> 127.0.0.1:41135
> > from mlpj,5,PEWorkerGroup]
> > [INFO] Running org.apache.gora.hbase.mapreduce.TestHBaseStoreCountQuery
> > Formatting using clusterid: testClusterID
> > [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> > 21.271 s - in org.apache.gora.hbase.mapreduce.TestHBaseStoreCountQuery
> > [INFO] Running
> > org.apache.gora.hbase.mapreduce.TestHBaseStoreMapReduceSerialization
> > Formatting using clusterid: testClusterID
> > [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> > 22.393 s - in
> > org.apache.gora.hbase.mapreduce.TestHBaseStoreMapReduceSerialization
> > [INFO]
> > [INFO] Results:
> > [INFO]
> > [ERROR] Failures:
> > [ERROR]   TestHBaseStore>DataStoreTestBase.testDelete:341 expected:<9>
> but
> > was:<8>
> > [ERROR]   TestHBaseStore>DataStoreTestBase.testQueryEndKey:311
> expected:<9>
> > but was:<8>
> > [ERROR]   TestHBaseStore>DataStoreTestBase.testQueryKeyRange:317
> > expected:<10> but was:<9>
> > [ERROR]   TestHBaseStore>DataStoreTestBase.testQueryStartKey:305
> > expected:<10> but was:<9>
> > [INFO]
> > [ERROR] Tests run: 53, Failures: 4, Errors: 0, Skipped: 4
> > [INFO]
> > [INFO]
> > 
> > [INFO] BUILD FAILURE
> > [INFO]
> > 
> > [INFO] Total time:  05:00 min
> > [INFO] Finished at: 2019-04-06T10:28:15+05:30
> > [INFO]
> > 
> > [ERROR] Failed to execute goal
> > org.apache.maven.plugins:maven-surefire-plugin:2.20:test (default-test)
> on
> > project gora-hbase: There are test failures.
> > [ERROR]
> > [ERROR] Please refer to
> > /home/mlpj/Documents/gora/gora-hbase/target/surefire-reports for the
> > individual test results.
> > [ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump,
> > [date].dumpstream and [date]-jvmRun[N].dumpstream.
> > [ERROR] -> [Help 1]
> > [ERROR]
> > [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e
> > switch.
> > [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> > [ERROR]
> > [ERROR] For more information about the errors and possible solutions,
> > please read the following articles:
> > [ERROR] [Help 1]
> > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
> >
> >
> > Can someone help me on this please.
> >
> > --
> > Lahiru Jayasekara
> > Batch 15
> > Faculty of Information Technology
> > University of Moratuwa
> > 0716492170
> >
>


-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Student proposal for GSOC 2019

[Lahiru Jayasekera]

Hi all,
I would like to do the project "Hazelcast Jet execution engine support"[1],
for gsoc 2019. I have created a proposal with the help of you. I have
attached the draft proposal here and would like to get your kind feed back.

https://docs.google.com/document/d/1jt1bVlcVyDk1cytS8g-oNJoqZ9hminHWUsY5vBAmvQc/edit?usp=sharing

Thanks and Regards
Lahiru

1. https://issues.apache.org/jira/browse/GORA-546

-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: Student proposal for GSOC 2019

[Lahiru Jayasekera]

Hi all,
I have made the changes per the comments on proposal. And I also did a POC
and have mailed it to the dev mailing list. Appreciate your kind feedback.

Thanks
Lahiru

On Mon, Apr 8, 2019 at 12:57 PM Lahiru Jayasekera 
wrote:

> Hi Kevin,
> I have added those to proposal.
> Sorry I have directly emailed you. I will respond to mailing list.
>
> Thanks
>
> On Mon, Apr 8, 2019 at 11:53 AM Kevin Ratnasekera 
> wrote:
>
>> Hi Lahiru,
>>
>> Please add all the contributions, POC etc to Proposal. I ll have a look.
>> Also please respond to mailing list, above email is directly sent to me. (
>> Carlos is not copied ) Good luck with your proposal.
>>
>> Regards
>> Kevin
>>
>> On Mon, Apr 8, 2019 at 11:26 AM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com> wrote:
>>
>>> Hi Kevin and Carlos,
>>> I have addressed the comments in draft proposal. Appreciate if you can
>>> please have a look before I submit it to GSOC.
>>>
>>> Thanks
>>>
>>> On Mon, Apr 8, 2019 at 11:11 AM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi all,
>>>> I have created a POC for the project and I have sent a mail to the
>>>> mailing list too. Your kind feedback is appreciated.
>>>>
>>>> On Wed, Apr 3, 2019 at 3:58 PM Kevin Ratnasekera <
>>>> djkevincr1...@gmail.com> wrote:
>>>>
>>>>> Hi Lahiru,
>>>>>
>>>>> Sure, thanks for the update.
>>>>>
>>>>> Regards
>>>>> Kevin
>>>>>
>>>>> On Wed, Apr 3, 2019 at 7:03 AM Lahiru Jayasekera <
>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>
>>>>>> Hi Kevin,
>>>>>> Working on them. Thanks for the feedback.
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>> On Tue, Apr 2, 2019 at 2:24 PM Kevin Ratnasekera <
>>>>>> djkevincr1...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Lahiru,
>>>>>>>
>>>>>>> Overall proposal looks good :) I have added some comments where you
>>>>>>> can improve.
>>>>>>>
>>>>>>> Regards
>>>>>>> Kevin
>>>>>>>
>>>>>>> On Tue, Apr 2, 2019 at 9:53 AM Lahiru Jayasekera <
>>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Thanks Carlos
>>>>>>>>
>>>>>>>> On Tue, Apr 2, 2019 at 9:26 AM carlos muñoz 
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>> > Thanks Lahiru.
>>>>>>>> >
>>>>>>>> > Nice work, I have left a few comments.
>>>>>>>> >
>>>>>>>> > Regards,
>>>>>>>> > Carlos.
>>>>>>>> >
>>>>>>>> > El lun., 1 abr. 2019 a las 22:22, Lahiru Jayasekera (<
>>>>>>>> > mlpjayasek...@gmail.com>) escribió:
>>>>>>>> >
>>>>>>>> > > Hi Carols,
>>>>>>>> > > Enabled the comments. Please add your comments.
>>>>>>>> > >
>>>>>>>> > >
>>>>>>>> > >
>>>>>>>> >
>>>>>>>> https://docs.google.com/document/d/1jt1bVlcVyDk1cytS8g-oNJoqZ9hminHWUsY5vBAmvQc/edit?usp=drivesdkr
>>>>>>>> > >
>>>>>>>> > > Thanks and regards
>>>>>>>> > >
>>>>>>>> > > On Tue, Apr 2, 2019, 08:38 carlos muñoz >>>>>>> wrote:
>>>>>>>> > >
>>>>>>>> > > > Hi Lahiru,
>>>>>>>> > > >
>>>>>>>> > > > Thanks for your interest in Apache Gora.
>>>>>>>> > > > The proposal looks interesting, could you please enable the
>>>>>>>> suggestions
>>>>>>>> > > > mode on the document?.
>>>>>>>> > > > I would like to leave a couple of comments.
>>>>>>>> > > >
>>>>>>>> > > > Cheers,
>>>>>>>> > > > Carlos
>>>&

POC for hazelcast jet integration

[Lahiru Jayasekera]

Hi all,
I have come up with a poc for hazelcast jet execution engine support for
gora.
https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java

Here I have wrote a custom source for jet. What this does is read the
AccessLog table created via LogManager example, and feed the PageView
objects to jet.

I have also looked into using hdfs connectors of jet. But I encountered a
problem with conflicting hadoop versions. InputFormat class used in gora is
from pacjage 'org.apache.hadoop.mapreduce', but in jet it is '
org.apache.hadoop.mapred.InputFormat'.

Anyway the proposed poc works as expected. Please add your suggestions here.

Thanks and regards

-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: Student proposal for GSOC 2019

[Lahiru Jayasekera]

Hi Kevin,
Thanks for the feedback. I'll work on the POC further.

Thanks

On Mon, Apr 8, 2019 at 1:12 PM Kevin Ratnasekera 
wrote:

> Hi Lahiru,
>
> There is nothing to apologize for. What I mentioned was, even though you
> addressed Carlos in the email, he was not CC ed to the email sent to me. I
> know that you have mistakenly sent that email CC ing only me.
> Regarding the POC, I don't see you you have created the Input Format or
> Connection Interface that is needed for Jet jobs. On the other hand, also
> you have created on top tutorial module. These are just my feedback, have
> feedback on other people in the dev list. And try to improve your proposal.
> My feedback is just one factor. You know how opensource work since you
> worked for WSO2.
>
> Regards
> Kevin
>
> On Mon, Apr 8, 2019 at 12:57 PM Lahiru Jayasekera 
> wrote:
>
>> Hi Kevin,
>> I have added those to proposal.
>> Sorry I have directly emailed you. I will respond to mailing list.
>>
>> Thanks
>>
>> On Mon, Apr 8, 2019 at 11:53 AM Kevin Ratnasekera <
>> djkevincr1...@gmail.com> wrote:
>>
>>> Hi Lahiru,
>>>
>>> Please add all the contributions, POC etc to Proposal. I ll have a look.
>>> Also please respond to mailing list, above email is directly sent to me. (
>>> Carlos is not copied ) Good luck with your proposal.
>>>
>>> Regards
>>> Kevin
>>>
>>> On Mon, Apr 8, 2019 at 11:26 AM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi Kevin and Carlos,
>>>> I have addressed the comments in draft proposal. Appreciate if you can
>>>> please have a look before I submit it to GSOC.
>>>>
>>>> Thanks
>>>>
>>>> On Mon, Apr 8, 2019 at 11:11 AM Lahiru Jayasekera <
>>>> mlpjayasek...@gmail.com> wrote:
>>>>
>>>>> Hi all,
>>>>> I have created a POC for the project and I have sent a mail to the
>>>>> mailing list too. Your kind feedback is appreciated.
>>>>>
>>>>> On Wed, Apr 3, 2019 at 3:58 PM Kevin Ratnasekera <
>>>>> djkevincr1...@gmail.com> wrote:
>>>>>
>>>>>> Hi Lahiru,
>>>>>>
>>>>>> Sure, thanks for the update.
>>>>>>
>>>>>> Regards
>>>>>> Kevin
>>>>>>
>>>>>> On Wed, Apr 3, 2019 at 7:03 AM Lahiru Jayasekera <
>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Kevin,
>>>>>>> Working on them. Thanks for the feedback.
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>> On Tue, Apr 2, 2019 at 2:24 PM Kevin Ratnasekera <
>>>>>>> djkevincr1...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Lahiru,
>>>>>>>>
>>>>>>>> Overall proposal looks good :) I have added some comments where you
>>>>>>>> can improve.
>>>>>>>>
>>>>>>>> Regards
>>>>>>>> Kevin
>>>>>>>>
>>>>>>>> On Tue, Apr 2, 2019 at 9:53 AM Lahiru Jayasekera <
>>>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Thanks Carlos
>>>>>>>>>
>>>>>>>>> On Tue, Apr 2, 2019 at 9:26 AM carlos muñoz 
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> > Thanks Lahiru.
>>>>>>>>> >
>>>>>>>>> > Nice work, I have left a few comments.
>>>>>>>>> >
>>>>>>>>> > Regards,
>>>>>>>>> > Carlos.
>>>>>>>>> >
>>>>>>>>> > El lun., 1 abr. 2019 a las 22:22, Lahiru Jayasekera (<
>>>>>>>>> > mlpjayasek...@gmail.com>) escribió:
>>>>>>>>> >
>>>>>>>>> > > Hi Carols,
>>>>>>>>> > > Enabled the comments. Please add your comments.
>>>>>>>>> > >
>>>>>>>>> > >
>>>>>>>>> > >
>>>>>>>>> >
>>>>>&g

Test case failure when building the project

[Lahiru Jayasekera]

Hi all,
I'm new to the gora project. But I hope to contribute to the project. In
the process, I got a test case failure in gora core module. Following is
the log,

[ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
65.234 s <<< FAILURE! - in
org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce
[ERROR]
testCountQuery(org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce)
Time elapsed: 64.953 s  <<< FAILURE!
java.lang.AssertionError: expected:<10> but was:<0>

Can someone please help me on this issue.

Thanks and regards
Lahiru
-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: Test case failure when building the project

[Lahiru Jayasekera]

Hi all,
Sorry for the noise. Got this fixed. Problem was with my Java installation.

Thanks and regards
Lahiru

On Fri, Mar 1, 2019 at 6:48 PM Lahiru Jayasekera 
wrote:

> Hi all,
> I'm new to the gora project. But I hope to contribute to the project. In
> the process, I got a test case failure in gora core module. Following is
> the log,
>
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> 65.234 s <<< FAILURE! - in
> org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce
> [ERROR]
> testCountQuery(org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce)
> Time elapsed: 64.953 s  <<< FAILURE!
> java.lang.AssertionError: expected:<10> but was:<0>
>
> Can someone please help me on this issue.
>
> Thanks and regards
> Lahiru
> --
> Lahiru Jayasekara
> Batch 15
> Faculty of Information Technology
> University of Moratuwa
> 0716492170
>


-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I'm doing this project for GSOC 2019. This email is to update the
initiative progress of the project and this thread will be used in future
for updating the progress too.

First of all here [0] is a basic POC I did.
After that I found out that there is already a HDFS connector for hazelcast
jet[1]. Then I looked into using this. But encountered with some package
conflicts('org.apache.hadoop.mapreduce', and 'org.apache.hadoop.mapred').

Therefore finally after further discussions with mentors, it was decided to
implement custom source and sink as of this documentation[2].
Now i'm in the process of implementing this. Your ideas and feedback are
appreciated.

[0]
https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java

[1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs

[2]
https://docs.hazelcast.org/docs/jet/3.0/manual/#custom-source-sink-vertex

Thanks and Regards
-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: POC for hazelcast jet integration

[Lahiru Jayasekera]

Sure, will do that.

Thanks

On Mon, May 27, 2019 at 2:41 PM Kevin Ratnasekera 
wrote:

> Hi Lahiru,
>
> As per the offline chat we had, please start a new mail thread on adding
> design details, related to approach ( writing custom source and sink
> connectors [3] ) you have taken on implementation of Jet execution engine
> support. That way community can comment on your project work.
>
> [1] https://jet.hazelcast.org/connectors/batch-connectors/
>
> Regards
> Kevin
>
> On Sun, May 19, 2019 at 1:15 PM Lahiru Jayasekera 
> wrote:
>
>> Hi all,
>> This is the[1] hdfs connector for hazelcast jet.
>>
>> Here the problem is hazelcast jet is using `org.apache.hadoop.mapred`
>> package and gora is using `org.apache.hadoop.mapreduce` package.
>>
>> These are two APIs exposed by hadoop to create hadoop jobs and etc.
>> Eventhough these two are similar in functionality, both the packages are
>> shiped with hadoop. See this answer[2],
>>
>> So I thought of writing an InputFormat for gora with the support of older
>> package(`org.apache.hadoop.mapred`).
>>
>> Please correct me if I'm going in the wrong direction. Your Feedback is
>> appreciated.
>>
>> [1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs
>> [2] https://stackoverflow.com/a/7600339
>>
>> Thanks and regards
>> Lahiru
>>
>> On Fri, Apr 26, 2019 at 6:32 PM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com>
>> wrote:
>>
>> > Hi Madhawa,
>> > Sorry for the late reply. Sure I'll try that and let you know.
>> >
>> > Thanks
>> >
>> > On Tue, Apr 23, 2019 at 2:24 PM Madhawa Kasun Gunasekara <
>> > madhaw...@gmail.com> wrote:
>> >
>> >> Hi Lahiru,
>> >>
>> >> Good initiative.
>> >> It seems like we need to use hadoop-hdfs and hadoop common with version
>> >> 2.8.3. Try adding these dependencies, and exclude the old dependency
>> from
>> >> the gora, or otherwise, we can do a version upgrade in gora for
>> Hadoop. at
>> >> the moment we use Hadoop version 2.5.2 in gora but I prefer to upgrade
>> the
>> >> Hadoop versions in the gora to 2.8.3.
>> >>
>> >> Recently hazelcast developers released 3.0 version, We can try that
>> also.
>> >>
>> >> Thanks,
>> >> Madhawa
>> >>
>> >>
>> >> On Sat, Apr 6, 2019 at 9:53 PM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com
>> >> >
>> >> wrote:
>> >>
>> >> > Hi all,
>> >> > I have come up with a poc for hazelcast jet execution engine support
>> for
>> >> > gora.
>> >> >
>> >> >
>> >>
>> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
>> >> >
>> >> > Here I have wrote a custom source for jet. What this does is read the
>> >> > AccessLog table created via LogManager example, and feed the PageView
>> >> > objects to jet.
>> >> >
>> >> > I have also looked into using hdfs connectors of jet. But I
>> encountered
>> >> a
>> >> > problem with conflicting hadoop versions. InputFormat class used in
>> >> gora is
>> >> > from pacjage 'org.apache.hadoop.mapreduce', but in jet it is '
>> >> > org.apache.hadoop.mapred.InputFormat'.
>> >> >
>> >> > Anyway the proposed poc works as expected. Please add your
>> suggestions
>> >> > here.
>> >> >
>> >> > Thanks and regards
>> >> >
>> >> > --
>> >> > Lahiru Jayasekara
>> >> > Batch 15
>> >> > Faculty of Information Technology
>> >> > University of Moratuwa
>> >> > 0716492170
>> >> >
>> >>
>> >
>> >
>> > --
>> > Lahiru Jayasekara
>> > Batch 15
>> > Faculty of Information Technology
>> > University of Moratuwa
>> > 0716492170
>> >
>>
>>
>> --
>> Lahiru Jayasekara
>> Batch 15
>> Faculty of Information Technology
>> University of Moratuwa
>> 0716492170
>>
>

-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 01 report and have asked several questions there.
Please have a look  nad give your feed back.

https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports

Thanks and Regards

On Mon, May 27, 2019 at 9:33 PM Lahiru Jayasekera 
wrote:

> Hi all,
> I'm doing this project for GSOC 2019. This email is to update the
> initiative progress of the project and this thread will be used in future
> for updating the progress too.
>
> First of all here [0] is a basic POC I did.
> After that I found out that there is already a HDFS connector for
> hazelcast jet[1]. Then I looked into using this. But encountered with some
> package conflicts('org.apache.hadoop.mapreduce', and
> 'org.apache.hadoop.mapred').
>
> Therefore finally after further discussions with mentors, it was decided
> to implement custom source and sink as of this documentation[2].
> Now i'm in the process of implementing this. Your ideas and feedback are
> appreciated.
>
> [0]
> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
>
> [1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs
>
> [2]
> https://docs.hazelcast.org/docs/jet/3.0/manual/#custom-source-sink-vertex
>
>
> Thanks and Regards
> --
> Lahiru Jayasekara
> Batch 15
> Faculty of Information Technology
> University of Moratuwa
> 0716492170
>


-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all
I have updated my week 02 report and have asked several questions there.
Please have a look. Your feedback is much appreciated.

https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports

Thanks and Regards

On Mon, Jun 3, 2019 at 8:00 PM Lahiru Jayasekera 
wrote:

> Hi all,
> I have updated my week 01 report and have asked several questions there.
> Please have a look  nad give your feed back.
>
>
> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>
> Thanks and Regards
>
> On Mon, May 27, 2019 at 9:33 PM Lahiru Jayasekera 
> wrote:
>
>> Hi all,
>> I'm doing this project for GSOC 2019. This email is to update the
>> initiative progress of the project and this thread will be used in future
>> for updating the progress too.
>>
>> First of all here [0] is a basic POC I did.
>> After that I found out that there is already a HDFS connector for
>> hazelcast jet[1]. Then I looked into using this. But encountered with some
>> package conflicts('org.apache.hadoop.mapreduce', and
>> 'org.apache.hadoop.mapred').
>>
>> Therefore finally after further discussions with mentors, it was decided
>> to implement custom source and sink as of this documentation[2].
>> Now i'm in the process of implementing this. Your ideas and feedback are
>> appreciated.
>>
>> [0]
>> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
>>
>> [1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs
>>
>> [2]
>> https://docs.hazelcast.org/docs/jet/3.0/manual/#custom-source-sink-vertex
>>
>>
>> Thanks and Regards
>> --
>> Lahiru Jayasekara
>> Batch 15
>> Faculty of Information Technology
>> University of Moratuwa
>> 0716492170
>>
>
>
> --
> Lahiru Jayasekara
> Batch 15
> Faculty of Information Technology
> University of Moratuwa
> 0716492170
>


-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 04 report and have asked  questions there. Please
have a look. Your feedback is much appreciated.

https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports


Thanks and regards


On Sun, Jun 16, 2019 at 5:38 PM Lahiru Jayasekera 
wrote:

> Hi all,
> I have updated my week 03 report and have asked  questions there. Please
> have a look. Your feedback is much appreciated.
>
>
> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>
> Thanks and regards
>
> On Mon, Jun 10, 2019 at 12:33 AM Lahiru Jayasekera <
> mlpjayasek...@gmail.com> wrote:
>
>> Hi all
>> I have updated my week 02 report and have asked several questions there.
>> Please have a look. Your feedback is much appreciated.
>>
>>
>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>
>> Thanks and Regards
>>
>> On Mon, Jun 3, 2019 at 8:00 PM Lahiru Jayasekera 
>> wrote:
>>
>>> Hi all,
>>> I have updated my week 01 report and have asked several questions there.
>>> Please have a look  nad give your feed back.
>>>
>>>
>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>
>>> Thanks and Regards
>>>
>>> On Mon, May 27, 2019 at 9:33 PM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi all,
>>>> I'm doing this project for GSOC 2019. This email is to update the
>>>> initiative progress of the project and this thread will be used in future
>>>> for updating the progress too.
>>>>
>>>> First of all here [0] is a basic POC I did.
>>>> After that I found out that there is already a HDFS connector for
>>>> hazelcast jet[1]. Then I looked into using this. But encountered with some
>>>> package conflicts('org.apache.hadoop.mapreduce', and
>>>> 'org.apache.hadoop.mapred').
>>>>
>>>> Therefore finally after further discussions with mentors, it was
>>>> decided to implement custom source and sink as of this documentation[2].
>>>> Now i'm in the process of implementing this. Your ideas and feedback
>>>> are appreciated.
>>>>
>>>> [0]
>>>> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
>>>>
>>>> [1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs
>>>>
>>>> [2]
>>>> https://docs.hazelcast.org/docs/jet/3.0/manual/#custom-source-sink-vertex
>>>>
>>>>
>>>> Thanks and Regards
>>>> --
>>>> Lahiru Jayasekara
>>>> Batch 15
>>>> Faculty of Information Technology
>>>> University of Moratuwa
>>>> 0716492170
>>>>
>>>
>>>
>>> --
>>> Lahiru Jayasekara
>>> Batch 15
>>> Faculty of Information Technology
>>> University of Moratuwa
>>> 0716492170
>>>
>>
>>
>> --
>> Lahiru Jayasekara
>> Batch 15
>> Faculty of Information Technology
>> University of Moratuwa
>> 0716492170
>>
>
>
> --
> Lahiru Jayasekara
>
> President | Information Technology Society (INTECS)
>
> Faculty of Information Technology
> University of Moratuwa
> 0716492170
>


-- 
Lahiru Jayasekara

President | Information Technology Society (INTECS)

Faculty of Information Technology
University of Moratuwa
0716492170

Fix GORA-538 Make consistent across datastores the way of getting the mapping filename

[Lahiru Jayasekera]

Hi all,
I have done a small fix to above jira issue. Can you please review the PR.
Your feedback is appreciated.

PR for the fix -
https://github.com/apache/gora/pull/170

Thanks and Regards
Lahiru

-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: POC for hazelcast jet integration

[Lahiru Jayasekera]

Hi all,
This is the[1] hdfs connector for hazelcast jet.

Here the problem is hazelcast jet is using `org.apache.hadoop.mapred`
package and gora is using `org.apache.hadoop.mapreduce` package.

These are two APIs exposed by hadoop to create hadoop jobs and etc.
Eventhough these two are similar in functionality, both the packages are
shiped with hadoop. See this answer[2],

So I thought of writing an InputFormat for gora with the support of older
package(`org.apache.hadoop.mapred`).

Please correct me if I'm going in the wrong direction. Your Feedback is
appreciated.

[1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs
[2] https://stackoverflow.com/a/7600339

Thanks and regards
Lahiru

On Fri, Apr 26, 2019 at 6:32 PM Lahiru Jayasekera 
wrote:

> Hi Madhawa,
> Sorry for the late reply. Sure I'll try that and let you know.
>
> Thanks
>
> On Tue, Apr 23, 2019 at 2:24 PM Madhawa Kasun Gunasekara <
> madhaw...@gmail.com> wrote:
>
>> Hi Lahiru,
>>
>> Good initiative.
>> It seems like we need to use hadoop-hdfs and hadoop common with version
>> 2.8.3. Try adding these dependencies, and exclude the old dependency from
>> the gora, or otherwise, we can do a version upgrade in gora for Hadoop. at
>> the moment we use Hadoop version 2.5.2 in gora but I prefer to upgrade the
>> Hadoop versions in the gora to 2.8.3.
>>
>> Recently hazelcast developers released 3.0 version, We can try that also.
>>
>> Thanks,
>> Madhawa
>>
>>
>> On Sat, Apr 6, 2019 at 9:53 PM Lahiru Jayasekera > >
>> wrote:
>>
>> > Hi all,
>> > I have come up with a poc for hazelcast jet execution engine support for
>> > gora.
>> >
>> >
>> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
>> >
>> > Here I have wrote a custom source for jet. What this does is read the
>> > AccessLog table created via LogManager example, and feed the PageView
>> > objects to jet.
>> >
>> > I have also looked into using hdfs connectors of jet. But I encountered
>> a
>> > problem with conflicting hadoop versions. InputFormat class used in
>> gora is
>> > from pacjage 'org.apache.hadoop.mapreduce', but in jet it is '
>> > org.apache.hadoop.mapred.InputFormat'.
>> >
>> > Anyway the proposed poc works as expected. Please add your suggestions
>> > here.
>> >
>> > Thanks and regards
>> >
>> > --
>> > Lahiru Jayasekara
>> > Batch 15
>> > Faculty of Information Technology
>> > University of Moratuwa
>> > 0716492170
>> >
>>
>
>
> --
> Lahiru Jayasekara
> Batch 15
> Faculty of Information Technology
> University of Moratuwa
> 0716492170
>


-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Fwd: GSoC 2019: Congratulations, your proposal with The Apache Software Foundation has been accepted!

[Lahiru Jayasekera]

Hi all,
I have received the acceptance letter for GSOC 2019 for the project
"Hazelcast Jet execution engine support for Apache Gora". I am really
delightful of this huge opportunity. Thank you very much for accepting my
proposal. I hope to give my full capacity to finish this project. Please
let me know of any other things that I need to do to start my GSOC journey.

Thanks and Regards
Lahiru

-- Forwarded message -
From: Google Summer of Code 
Date: Tue, May 7, 2019 at 2:21 AM
Subject: GSoC 2019: Congratulations, your proposal with The Apache Software
Foundation has been accepted!
To: 


[image: Google Summer of Code]

Hi Lahiru Jayasekara,

Your proposal Hazelcast Jet execution engine support for Apache Gora

has been accepted!

Welcome to GSoC 2019!

We look forward to seeing the great things you will accomplish this summer
with The Apache Software Foundation.

The next thing you need to do is read the Information for Accepted Students
. It
contains important information you need to know about your participation in
GSoC 2019.

You will receive another email in the next few days with information about
your stipend.

If you have any questions, please email the Google Summer of Code support
team at gsoc-supp...@google.com.

Have a great summer!

-*Google Summer of Code team*

This email was sent to mlpjayasek...@gmail.com.

You are receiving this email because of your participation in Google Summer
of Code 2019.
https://summerofcode.withgoogle.com

To leave the program and stop receiving all emails, you can go to your
profile  and
request deletion of your program profile.

For any questions, please contact gsoc-supp...@google.com. Replies to this
message go to an unmonitored mailbox.

© 2019 Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA 94043, USA


-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: POC for hazelcast jet integration

[Lahiru Jayasekera]

Hi Madhawa,
Sorry for the late reply. Sure I'll try that and let you know.

Thanks

On Tue, Apr 23, 2019 at 2:24 PM Madhawa Kasun Gunasekara <
madhaw...@gmail.com> wrote:

> Hi Lahiru,
>
> Good initiative.
> It seems like we need to use hadoop-hdfs and hadoop common with version
> 2.8.3. Try adding these dependencies, and exclude the old dependency from
> the gora, or otherwise, we can do a version upgrade in gora for Hadoop. at
> the moment we use Hadoop version 2.5.2 in gora but I prefer to upgrade the
> Hadoop versions in the gora to 2.8.3.
>
> Recently hazelcast developers released 3.0 version, We can try that also.
>
> Thanks,
> Madhawa
>
>
> On Sat, Apr 6, 2019 at 9:53 PM Lahiru Jayasekera 
> wrote:
>
> > Hi all,
> > I have come up with a poc for hazelcast jet execution engine support for
> > gora.
> >
> >
> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
> >
> > Here I have wrote a custom source for jet. What this does is read the
> > AccessLog table created via LogManager example, and feed the PageView
> > objects to jet.
> >
> > I have also looked into using hdfs connectors of jet. But I encountered a
> > problem with conflicting hadoop versions. InputFormat class used in gora
> is
> > from pacjage 'org.apache.hadoop.mapreduce', but in jet it is '
> > org.apache.hadoop.mapred.InputFormat'.
> >
> > Anyway the proposed poc works as expected. Please add your suggestions
> > here.
> >
> > Thanks and regards
> >
> > --
> > Lahiru Jayasekara
> > Batch 15
> > Faculty of Information Technology
> > University of Moratuwa
> > 0716492170
> >
>


-- 
Lahiru Jayasekara
Batch 15
Faculty of Information Technology
University of Moratuwa
0716492170

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 06 report and have asked  questions there as usual.
Please have a look. Your feedback is much appreciated.

Thanks and regards

On Wed, Jul 3, 2019 at 10:57 PM Lahiru Jayasekera 
wrote:

> Hi all,
> I have updated my week 05 report and have asked  questions there. Please
> have a look. Your feedback is much appreciated.
>
> On Sun, Jun 23, 2019 at 10:34 PM Lahiru Jayasekera <
> mlpjayasek...@gmail.com> wrote:
>
>> Hi all,
>> I have updated my week 04 report and have asked  questions there. Please
>> have a look. Your feedback is much appreciated.
>>
>>
>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>
>>
>> Thanks and regards
>>
>>
>> On Sun, Jun 16, 2019 at 5:38 PM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com> wrote:
>>
>>> Hi all,
>>> I have updated my week 03 report and have asked  questions there. Please
>>> have a look. Your feedback is much appreciated.
>>>
>>>
>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>
>>> Thanks and regards
>>>
>>> On Mon, Jun 10, 2019 at 12:33 AM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi all
>>>> I have updated my week 02 report and have asked several questions
>>>> there. Please have a look. Your feedback is much appreciated.
>>>>
>>>>
>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>
>>>> Thanks and Regards
>>>>
>>>> On Mon, Jun 3, 2019 at 8:00 PM Lahiru Jayasekera <
>>>> mlpjayasek...@gmail.com> wrote:
>>>>
>>>>> Hi all,
>>>>> I have updated my week 01 report and have asked several questions
>>>>> there. Please have a look  nad give your feed back.
>>>>>
>>>>>
>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>
>>>>> Thanks and Regards
>>>>>
>>>>> On Mon, May 27, 2019 at 9:33 PM Lahiru Jayasekera <
>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>
>>>>>> Hi all,
>>>>>> I'm doing this project for GSOC 2019. This email is to update the
>>>>>> initiative progress of the project and this thread will be used in future
>>>>>> for updating the progress too.
>>>>>>
>>>>>> First of all here [0] is a basic POC I did.
>>>>>> After that I found out that there is already a HDFS connector for
>>>>>> hazelcast jet[1]. Then I looked into using this. But encountered with 
>>>>>> some
>>>>>> package conflicts('org.apache.hadoop.mapreduce', and
>>>>>> 'org.apache.hadoop.mapred').
>>>>>>
>>>>>> Therefore finally after further discussions with mentors, it was
>>>>>> decided to implement custom source and sink as of this documentation[2].
>>>>>> Now i'm in the process of implementing this. Your ideas and feedback
>>>>>> are appreciated.
>>>>>>
>>>>>> [0]
>>>>>> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
>>>>>>
>>>>>> [1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs
>>>>>>
>>>>>> [2]
>>>>>> https://docs.hazelcast.org/docs/jet/3.0/manual/#custom-source-sink-vertex
>>>>>>
>>>>>>
>>>>>> Thanks and Regards
>>>>>> --
>>>>>> Lahiru Jayasekara
>>>>>> Batch 15
>>>>>> Faculty of Information Technology
>>>>>> University of Moratuwa
>>>>>> 0716492170
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Lahiru Jayasekara
>>>>> Batch 15
>>>>> Faculty of Information Technology
>>>>> University of Moratuwa
>>>>> 0716492170
>>>>>
>>>>
>>>>
>>>> --
>>>> Lahiru Jayasekara
>>>> Batch 15
>>>> Faculty of Information Technology
>>>> University of Moratuwa
>>>> 0716492170
>>>>
>>>
>>>
>>> --
>>> Lahiru Jayasekara
>>>
>>> President | Information Technology Society (INTECS)
>>>
>>> Faculty of Information Technology
>>> University of Moratuwa
>>> 0716492170
>>>
>>
>>
>> --
>> Lahiru Jayasekara
>>
>> President | Information Technology Society (INTECS)
>>
>> Faculty of Information Technology
>> University of Moratuwa
>> 0716492170
>>
>
>
> --
> Lahiru Jayasekara
>
> President | Information Technology Society (INTECS)
>
> Faculty of Information Technology
> University of Moratuwa
> 0716492170
>


-- 
Lahiru Jayasekara

President | Information Technology Society (INTECS)

Faculty of Information Technology
University of Moratuwa
0716492170

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 05 report and have asked  questions there. Please
have a look. Your feedback is much appreciated.

On Sun, Jun 23, 2019 at 10:34 PM Lahiru Jayasekera 
wrote:

> Hi all,
> I have updated my week 04 report and have asked  questions there. Please
> have a look. Your feedback is much appreciated.
>
>
> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>
>
> Thanks and regards
>
>
> On Sun, Jun 16, 2019 at 5:38 PM Lahiru Jayasekera 
> wrote:
>
>> Hi all,
>> I have updated my week 03 report and have asked  questions there. Please
>> have a look. Your feedback is much appreciated.
>>
>>
>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>
>> Thanks and regards
>>
>> On Mon, Jun 10, 2019 at 12:33 AM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com> wrote:
>>
>>> Hi all
>>> I have updated my week 02 report and have asked several questions there.
>>> Please have a look. Your feedback is much appreciated.
>>>
>>>
>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>
>>> Thanks and Regards
>>>
>>> On Mon, Jun 3, 2019 at 8:00 PM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi all,
>>>> I have updated my week 01 report and have asked several questions
>>>> there. Please have a look  nad give your feed back.
>>>>
>>>>
>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>
>>>> Thanks and Regards
>>>>
>>>> On Mon, May 27, 2019 at 9:33 PM Lahiru Jayasekera <
>>>> mlpjayasek...@gmail.com> wrote:
>>>>
>>>>> Hi all,
>>>>> I'm doing this project for GSOC 2019. This email is to update the
>>>>> initiative progress of the project and this thread will be used in future
>>>>> for updating the progress too.
>>>>>
>>>>> First of all here [0] is a basic POC I did.
>>>>> After that I found out that there is already a HDFS connector for
>>>>> hazelcast jet[1]. Then I looked into using this. But encountered with some
>>>>> package conflicts('org.apache.hadoop.mapreduce', and
>>>>> 'org.apache.hadoop.mapred').
>>>>>
>>>>> Therefore finally after further discussions with mentors, it was
>>>>> decided to implement custom source and sink as of this documentation[2].
>>>>> Now i'm in the process of implementing this. Your ideas and feedback
>>>>> are appreciated.
>>>>>
>>>>> [0]
>>>>> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
>>>>>
>>>>> [1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs
>>>>>
>>>>> [2]
>>>>> https://docs.hazelcast.org/docs/jet/3.0/manual/#custom-source-sink-vertex
>>>>>
>>>>>
>>>>> Thanks and Regards
>>>>> --
>>>>> Lahiru Jayasekara
>>>>> Batch 15
>>>>> Faculty of Information Technology
>>>>> University of Moratuwa
>>>>> 0716492170
>>>>>
>>>>
>>>>
>>>> --
>>>> Lahiru Jayasekara
>>>> Batch 15
>>>> Faculty of Information Technology
>>>> University of Moratuwa
>>>> 0716492170
>>>>
>>>
>>>
>>> --
>>> Lahiru Jayasekara
>>> Batch 15
>>> Faculty of Information Technology
>>> University of Moratuwa
>>> 0716492170
>>>
>>
>>
>> --
>> Lahiru Jayasekara
>>
>> President | Information Technology Society (INTECS)
>>
>> Faculty of Information Technology
>> University of Moratuwa
>> 0716492170
>>
>
>
> --
> Lahiru Jayasekara
>
> President | Information Technology Society (INTECS)
>
> Faculty of Information Technology
> University of Moratuwa
> 0716492170
>


-- 
Lahiru Jayasekara

President | Information Technology Society (INTECS)

Faculty of Information Technology
University of Moratuwa
0716492170

Re: Student proposal for GSOC 2019

[Lahiru Jayasekera]

Hi Kevin,

Addressed the comment. I added a simple class diagram. Thank you very much
for the support.

Thanks

On Mon, Apr 8, 2019 at 9:27 PM Kevin Ratnasekera 
wrote:

> Hi Lahiru,
>
> Added a comment on the proposal. Please address before the final
> submission. Good luck with your proposal.
>
> Regards
> Kevin
>
> On Mon, Apr 8, 2019 at 9:13 PM Madhawa Kasun Gunasekara <
> madhaw...@gmail.com>
> wrote:
>
> > Hi Lahiru,
> >
> > Overall, the proposal looks good, you can address the points mentioned by
> > Kevin. Try to make your proposal very attractive way. Add more technical
> > stuff.
> >
> > Thanks,
> > Madhawa
> >
> >
> > On Mon, Apr 8, 2019 at 4:58 PM Lahiru Jayasekera <
> mlpjayasek...@gmail.com>
> > wrote:
> >
> >> Hi Kevin,
> >> Thanks for the feedback. I'll work on the POC further.
> >>
> >> Thanks
> >>
> >> On Mon, Apr 8, 2019 at 1:12 PM Kevin Ratnasekera <
> djkevincr1...@gmail.com
> >> >
> >> wrote:
> >>
> >> > Hi Lahiru,
> >> >
> >> > There is nothing to apologize for. What I mentioned was, even though
> you
> >> > addressed Carlos in the email, he was not CC ed to the email sent to
> >> me. I
> >> > know that you have mistakenly sent that email CC ing only me.
> >> > Regarding the POC, I don't see you you have created the Input Format
> or
> >> > Connection Interface that is needed for Jet jobs. On the other hand,
> >> also
> >> > you have created on top tutorial module. These are just my feedback,
> >> have
> >> > feedback on other people in the dev list. And try to improve your
> >> proposal.
> >> > My feedback is just one factor. You know how opensource work since you
> >> > worked for WSO2.
> >> >
> >> > Regards
> >> > Kevin
> >> >
> >> > On Mon, Apr 8, 2019 at 12:57 PM Lahiru Jayasekera <
> >> mlpjayasek...@gmail.com>
> >> > wrote:
> >> >
> >> >> Hi Kevin,
> >> >> I have added those to proposal.
> >> >> Sorry I have directly emailed you. I will respond to mailing list.
> >> >>
> >> >> Thanks
> >> >>
> >> >> On Mon, Apr 8, 2019 at 11:53 AM Kevin Ratnasekera <
> >> >> djkevincr1...@gmail.com> wrote:
> >> >>
> >> >>> Hi Lahiru,
> >> >>>
> >> >>> Please add all the contributions, POC etc to Proposal. I ll have a
> >> look.
> >> >>> Also please respond to mailing list, above email is directly sent to
> >> me. (
> >> >>> Carlos is not copied ) Good luck with your proposal.
> >> >>>
> >> >>> Regards
> >> >>> Kevin
> >> >>>
> >> >>> On Mon, Apr 8, 2019 at 11:26 AM Lahiru Jayasekera <
> >> >>> mlpjayasek...@gmail.com> wrote:
> >> >>>
> >> >>>> Hi Kevin and Carlos,
> >> >>>> I have addressed the comments in draft proposal. Appreciate if you
> >> can
> >> >>>> please have a look before I submit it to GSOC.
> >> >>>>
> >> >>>> Thanks
> >> >>>>
> >> >>>> On Mon, Apr 8, 2019 at 11:11 AM Lahiru Jayasekera <
> >> >>>> mlpjayasek...@gmail.com> wrote:
> >> >>>>
> >> >>>>> Hi all,
> >> >>>>> I have created a POC for the project and I have sent a mail to the
> >> >>>>> mailing list too. Your kind feedback is appreciated.
> >> >>>>>
> >> >>>>> On Wed, Apr 3, 2019 at 3:58 PM Kevin Ratnasekera <
> >> >>>>> djkevincr1...@gmail.com> wrote:
> >> >>>>>
> >> >>>>>> Hi Lahiru,
> >> >>>>>>
> >> >>>>>> Sure, thanks for the update.
> >> >>>>>>
> >> >>>>>> Regards
> >> >>>>>> Kevin
> >> >>>>>>
> >> >>>>>> On Wed, Apr 3, 2019 at 7:03 AM Lahiru Jayasekera <
> >> >>>>>> mlpjayasek...@gmail.com> wrote:
> >> >>>>>>
> >> >>>>>>> Hi Kevin,
> >> >>>>>>>

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 07 report and have asked  questions there as usual.
I have made a PR too, so that I can get reviews easily. Please have a look
and your reviews are mostly welcome.
https://github.com/apache/gora/pull/175

Thanks and regards

On Tue, Jul 9, 2019 at 7:53 AM Lahiru Jayasekera 
wrote:

> Hi all,
> I have updated my week 06 report and have asked  questions there as usual.
> Please have a look. Your feedback is much appreciated.
>
> Thanks and regards
>
> On Wed, Jul 3, 2019 at 10:57 PM Lahiru Jayasekera 
> wrote:
>
>> Hi all,
>> I have updated my week 05 report and have asked  questions there. Please
>> have a look. Your feedback is much appreciated.
>>
>> On Sun, Jun 23, 2019 at 10:34 PM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com> wrote:
>>
>>> Hi all,
>>> I have updated my week 04 report and have asked  questions there. Please
>>> have a look. Your feedback is much appreciated.
>>>
>>>
>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>
>>>
>>> Thanks and regards
>>>
>>>
>>> On Sun, Jun 16, 2019 at 5:38 PM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi all,
>>>> I have updated my week 03 report and have asked  questions there.
>>>> Please have a look. Your feedback is much appreciated.
>>>>
>>>>
>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>
>>>> Thanks and regards
>>>>
>>>> On Mon, Jun 10, 2019 at 12:33 AM Lahiru Jayasekera <
>>>> mlpjayasek...@gmail.com> wrote:
>>>>
>>>>> Hi all
>>>>> I have updated my week 02 report and have asked several questions
>>>>> there. Please have a look. Your feedback is much appreciated.
>>>>>
>>>>>
>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>
>>>>> Thanks and Regards
>>>>>
>>>>> On Mon, Jun 3, 2019 at 8:00 PM Lahiru Jayasekera <
>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>
>>>>>> Hi all,
>>>>>> I have updated my week 01 report and have asked several questions
>>>>>> there. Please have a look  nad give your feed back.
>>>>>>
>>>>>>
>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>
>>>>>> Thanks and Regards
>>>>>>
>>>>>> On Mon, May 27, 2019 at 9:33 PM Lahiru Jayasekera <
>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi all,
>>>>>>> I'm doing this project for GSOC 2019. This email is to update the
>>>>>>> initiative progress of the project and this thread will be used in 
>>>>>>> future
>>>>>>> for updating the progress too.
>>>>>>>
>>>>>>> First of all here [0] is a basic POC I did.
>>>>>>> After that I found out that there is already a HDFS connector for
>>>>>>> hazelcast jet[1]. Then I looked into using this. But encountered with 
>>>>>>> some
>>>>>>> package conflicts('org.apache.hadoop.mapreduce', and
>>>>>>> 'org.apache.hadoop.mapred').
>>>>>>>
>>>>>>> Therefore finally after further discussions with mentors, it was
>>>>>>> decided to implement custom source and sink as of this documentation[2].
>>>>>>> Now i'm in the process of implementing this. Your ideas and feedback
>>>>>>> are appreciated.
>>>>>>>
>>>>>>> [0]
>>>>>>> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
>>>>>>>
>>>>>>> [1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs
>>>>>>>
>>>>>>> [2]
>>>>>>> https://docs.hazelcast.org/docs/jet/3.0/manual/#custom-source-sink-vertex
>>>>>>>
>>>>>>>
>>>&g

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 09 report and have asked  questions there as usual.
Please have a look. Your feedback is much appreciated.
Please have a look into the PR too, and your reviews are mostly welcome.
https://github.com/apache/gora/pull/175

Regards

On Wed, Jul 31, 2019 at 1:04 AM Lahiru Jayasekera 
wrote:

> Hi all,
> I have updated my week 09 report and have asked  questions there as usual.
> Please have a look. Your feedback is much appreciated.
>
> Please have a look into the PR too, and your reviews are mostly welcome.
> https://github.com/apache/gora/pull/175
>
>
> Thanks and regards
>
> On Sun, Jul 21, 2019 at 10:34 PM Lahiru Jayasekera <
> mlpjayasek...@gmail.com> wrote:
>
>> Hi all,
>> I have updated my week 08 report and have asked  questions there as
>> usual. Please have a look. Your feedback is much appreciated.
>>
>> Please have a look into the PR too, and your reviews are mostly welcome.
>> https://github.com/apache/gora/pull/175
>>
>>
>> Thanks and regards
>>
>> On Tue, Jul 16, 2019 at 9:13 PM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com> wrote:
>>
>>> Hi all,
>>> I have updated my week 07 report and have asked  questions there as
>>> usual.
>>> I have made a PR too, so that I can get reviews easily. Please have a
>>> look and your reviews are mostly welcome.
>>> https://github.com/apache/gora/pull/175
>>>
>>> Thanks and regards
>>>
>>> On Tue, Jul 9, 2019 at 7:53 AM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi all,
>>>> I have updated my week 06 report and have asked  questions there as
>>>> usual. Please have a look. Your feedback is much appreciated.
>>>>
>>>> Thanks and regards
>>>>
>>>> On Wed, Jul 3, 2019 at 10:57 PM Lahiru Jayasekera <
>>>> mlpjayasek...@gmail.com> wrote:
>>>>
>>>>> Hi all,
>>>>> I have updated my week 05 report and have asked  questions there.
>>>>> Please have a look. Your feedback is much appreciated.
>>>>>
>>>>> On Sun, Jun 23, 2019 at 10:34 PM Lahiru Jayasekera <
>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>
>>>>>> Hi all,
>>>>>> I have updated my week 04 report and have asked  questions there.
>>>>>> Please have a look. Your feedback is much appreciated.
>>>>>>
>>>>>>
>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>
>>>>>>
>>>>>> Thanks and regards
>>>>>>
>>>>>>
>>>>>> On Sun, Jun 16, 2019 at 5:38 PM Lahiru Jayasekera <
>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi all,
>>>>>>> I have updated my week 03 report and have asked  questions there.
>>>>>>> Please have a look. Your feedback is much appreciated.
>>>>>>>
>>>>>>>
>>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>>
>>>>>>> Thanks and regards
>>>>>>>
>>>>>>> On Mon, Jun 10, 2019 at 12:33 AM Lahiru Jayasekera <
>>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi all
>>>>>>>> I have updated my week 02 report and have asked several questions
>>>>>>>> there. Please have a look. Your feedback is much appreciated.
>>>>>>>>
>>>>>>>>
>>>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>>>
>>>>>>>> Thanks and Regards
>>>>>>>>
>>>>>>>> On Mon, Jun 3, 2019 at 8:00 PM Lahiru Jayasekera <
>>>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi all,
>>>>>>>>> I have updated my week 01 report and have asked several questions
>>>>>>>>> there. Please have a look  nad give your feed back.
>>>>>>>>>
>>>>>>>>>
>>>

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 10 report and have asked  questions there as usual.
I have made a PR too, so that I can get reviews easily. Please have a look
and your reviews are mostly welcome.
https://github.com/apache/gora/pull/175

On Mon, Aug 5, 2019 at 1:49 AM Lahiru Jayasekera 
wrote:

> Hi all,
> I have updated my week 09 report and have asked  questions there as usual.
> Please have a look. Your feedback is much appreciated.
> Please have a look into the PR too, and your reviews are mostly welcome.
> https://github.com/apache/gora/pull/175
>
> Regards
>
> On Wed, Jul 31, 2019 at 1:04 AM Lahiru Jayasekera 
> wrote:
>
>> Hi all,
>> I have updated my week 09 report and have asked  questions there as
>> usual. Please have a look. Your feedback is much appreciated.
>>
>> Please have a look into the PR too, and your reviews are mostly welcome.
>> https://github.com/apache/gora/pull/175
>>
>>
>> Thanks and regards
>>
>> On Sun, Jul 21, 2019 at 10:34 PM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com> wrote:
>>
>>> Hi all,
>>> I have updated my week 08 report and have asked  questions there as
>>> usual. Please have a look. Your feedback is much appreciated.
>>>
>>> Please have a look into the PR too, and your reviews are mostly welcome.
>>> https://github.com/apache/gora/pull/175
>>>
>>>
>>> Thanks and regards
>>>
>>> On Tue, Jul 16, 2019 at 9:13 PM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi all,
>>>> I have updated my week 07 report and have asked  questions there as
>>>> usual.
>>>> I have made a PR too, so that I can get reviews easily. Please have a
>>>> look and your reviews are mostly welcome.
>>>> https://github.com/apache/gora/pull/175
>>>>
>>>> Thanks and regards
>>>>
>>>> On Tue, Jul 9, 2019 at 7:53 AM Lahiru Jayasekera <
>>>> mlpjayasek...@gmail.com> wrote:
>>>>
>>>>> Hi all,
>>>>> I have updated my week 06 report and have asked  questions there as
>>>>> usual. Please have a look. Your feedback is much appreciated.
>>>>>
>>>>> Thanks and regards
>>>>>
>>>>> On Wed, Jul 3, 2019 at 10:57 PM Lahiru Jayasekera <
>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>
>>>>>> Hi all,
>>>>>> I have updated my week 05 report and have asked  questions there.
>>>>>> Please have a look. Your feedback is much appreciated.
>>>>>>
>>>>>> On Sun, Jun 23, 2019 at 10:34 PM Lahiru Jayasekera <
>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi all,
>>>>>>> I have updated my week 04 report and have asked  questions there.
>>>>>>> Please have a look. Your feedback is much appreciated.
>>>>>>>
>>>>>>>
>>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>>
>>>>>>>
>>>>>>> Thanks and regards
>>>>>>>
>>>>>>>
>>>>>>> On Sun, Jun 16, 2019 at 5:38 PM Lahiru Jayasekera <
>>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi all,
>>>>>>>> I have updated my week 03 report and have asked  questions there.
>>>>>>>> Please have a look. Your feedback is much appreciated.
>>>>>>>>
>>>>>>>>
>>>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>>>
>>>>>>>> Thanks and regards
>>>>>>>>
>>>>>>>> On Mon, Jun 10, 2019 at 12:33 AM Lahiru Jayasekera <
>>>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi all
>>>>>>>>> I have updated my week 02 report and have asked several questions
>>>>>>>>> there. Please have a look. Your feedback is much appreciated.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> https://cwiki.apache.org/confluence/display/GORA/GOR

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,

I have updated the reports. Please check and give me feedback.
This week I have implemented the LogAnalyticsJet tutorial class.

Please review my code on github PR - https://github.com/apache/gora/pull/175
Thanks and regards

On Thu, Aug 8, 2019 at 3:08 PM Lahiru Jayasekera 
wrote:

> Hi Furkan,
> Thanks very much for your review. I'll fix those by the end of the week.
>
> Thanks and regards
>
> On Mon, Aug 5, 2019 at 2:08 AM Furkan KAMACI 
> wrote:
>
>> Hi Lahiru,
>>
>> Thanks for the PR! I've made my comments.
>>
>> Kind Regards,
>> Furkan KAMACI
>>
>> On Sun, Aug 4, 2019 at 11:20 PM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com>
>> wrote:
>>
>> > Hi all,
>> > I have updated my week 10 report and have asked  questions there as
>> usual.
>> > I have made a PR too, so that I can get reviews easily. Please have a
>> look
>> > and your reviews are mostly welcome.
>> > https://github.com/apache/gora/pull/175
>> >
>> > On Mon, Aug 5, 2019 at 1:49 AM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com>
>> > wrote:
>> >
>> > > Hi all,
>> > > I have updated my week 09 report and have asked  questions there as
>> > usual.
>> > > Please have a look. Your feedback is much appreciated.
>> > > Please have a look into the PR too, and your reviews are mostly
>> welcome.
>> > > https://github.com/apache/gora/pull/175
>> > >
>> > > Regards
>> > >
>> > > On Wed, Jul 31, 2019 at 1:04 AM Lahiru Jayasekera <
>> > mlpjayasek...@gmail.com>
>> > > wrote:
>> > >
>> > >> Hi all,
>> > >> I have updated my week 09 report and have asked  questions there as
>> > >> usual. Please have a look. Your feedback is much appreciated.
>> > >>
>> > >> Please have a look into the PR too, and your reviews are mostly
>> welcome.
>> > >> https://github.com/apache/gora/pull/175
>> > >>
>> > >>
>> > >> Thanks and regards
>> > >>
>> > >> On Sun, Jul 21, 2019 at 10:34 PM Lahiru Jayasekera <
>> > >> mlpjayasek...@gmail.com> wrote:
>> > >>
>> > >>> Hi all,
>> > >>> I have updated my week 08 report and have asked  questions there as
>> > >>> usual. Please have a look. Your feedback is much appreciated.
>> > >>>
>> > >>> Please have a look into the PR too, and your reviews are mostly
>> > welcome.
>> > >>> https://github.com/apache/gora/pull/175
>> > >>>
>> > >>>
>> > >>> Thanks and regards
>> > >>>
>> > >>> On Tue, Jul 16, 2019 at 9:13 PM Lahiru Jayasekera <
>> > >>> mlpjayasek...@gmail.com> wrote:
>> > >>>
>> > >>>> Hi all,
>> > >>>> I have updated my week 07 report and have asked  questions there as
>> > >>>> usual.
>> > >>>> I have made a PR too, so that I can get reviews easily. Please
>> have a
>> > >>>> look and your reviews are mostly welcome.
>> > >>>> https://github.com/apache/gora/pull/175
>> > >>>>
>> > >>>> Thanks and regards
>> > >>>>
>> > >>>> On Tue, Jul 9, 2019 at 7:53 AM Lahiru Jayasekera <
>> > >>>> mlpjayasek...@gmail.com> wrote:
>> > >>>>
>> > >>>>> Hi all,
>> > >>>>> I have updated my week 06 report and have asked  questions there
>> as
>> > >>>>> usual. Please have a look. Your feedback is much appreciated.
>> > >>>>>
>> > >>>>> Thanks and regards
>> > >>>>>
>> > >>>>> On Wed, Jul 3, 2019 at 10:57 PM Lahiru Jayasekera <
>> > >>>>> mlpjayasek...@gmail.com> wrote:
>> > >>>>>
>> > >>>>>> Hi all,
>> > >>>>>> I have updated my week 05 report and have asked  questions there.
>> > >>>>>> Please have a look. Your feedback is much appreciated.
>> > >>>>>>
>> > >>>>>> On Sun, Jun 23, 2019 at 10:34 PM Lahiru Jayasekera <
>> > >>>>>> mlpjayasek...@gmail.com> wrote:
>> > 

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi Furkan,
I have resolved the issues you showed me on github, please let me know if
there is any other thing to do.
Thanks for pointing out those.

Thanks and Regards

On Fri, Aug 16, 2019 at 7:05 PM Lahiru Jayasekera 
wrote:

> Hi all,
>
> I have updated the reports. Please check and give me feedback.
> This week I have implemented the LogAnalyticsJet tutorial class.
>
> Please review my code on github PR -
> https://github.com/apache/gora/pull/175
> Thanks and regards
>
> On Thu, Aug 8, 2019 at 3:08 PM Lahiru Jayasekera 
> wrote:
>
>> Hi Furkan,
>> Thanks very much for your review. I'll fix those by the end of the week.
>>
>> Thanks and regards
>>
>> On Mon, Aug 5, 2019 at 2:08 AM Furkan KAMACI 
>> wrote:
>>
>>> Hi Lahiru,
>>>
>>> Thanks for the PR! I've made my comments.
>>>
>>> Kind Regards,
>>> Furkan KAMACI
>>>
>>> On Sun, Aug 4, 2019 at 11:20 PM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com>
>>> wrote:
>>>
>>> > Hi all,
>>> > I have updated my week 10 report and have asked  questions there as
>>> usual.
>>> > I have made a PR too, so that I can get reviews easily. Please have a
>>> look
>>> > and your reviews are mostly welcome.
>>> > https://github.com/apache/gora/pull/175
>>> >
>>> > On Mon, Aug 5, 2019 at 1:49 AM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com>
>>> > wrote:
>>> >
>>> > > Hi all,
>>> > > I have updated my week 09 report and have asked  questions there as
>>> > usual.
>>> > > Please have a look. Your feedback is much appreciated.
>>> > > Please have a look into the PR too, and your reviews are mostly
>>> welcome.
>>> > > https://github.com/apache/gora/pull/175
>>> > >
>>> > > Regards
>>> > >
>>> > > On Wed, Jul 31, 2019 at 1:04 AM Lahiru Jayasekera <
>>> > mlpjayasek...@gmail.com>
>>> > > wrote:
>>> > >
>>> > >> Hi all,
>>> > >> I have updated my week 09 report and have asked  questions there as
>>> > >> usual. Please have a look. Your feedback is much appreciated.
>>> > >>
>>> > >> Please have a look into the PR too, and your reviews are mostly
>>> welcome.
>>> > >> https://github.com/apache/gora/pull/175
>>> > >>
>>> > >>
>>> > >> Thanks and regards
>>> > >>
>>> > >> On Sun, Jul 21, 2019 at 10:34 PM Lahiru Jayasekera <
>>> > >> mlpjayasek...@gmail.com> wrote:
>>> > >>
>>> > >>> Hi all,
>>> > >>> I have updated my week 08 report and have asked  questions there as
>>> > >>> usual. Please have a look. Your feedback is much appreciated.
>>> > >>>
>>> > >>> Please have a look into the PR too, and your reviews are mostly
>>> > welcome.
>>> > >>> https://github.com/apache/gora/pull/175
>>> > >>>
>>> > >>>
>>> > >>> Thanks and regards
>>> > >>>
>>> > >>> On Tue, Jul 16, 2019 at 9:13 PM Lahiru Jayasekera <
>>> > >>> mlpjayasek...@gmail.com> wrote:
>>> > >>>
>>> > >>>> Hi all,
>>> > >>>> I have updated my week 07 report and have asked  questions there
>>> as
>>> > >>>> usual.
>>> > >>>> I have made a PR too, so that I can get reviews easily. Please
>>> have a
>>> > >>>> look and your reviews are mostly welcome.
>>> > >>>> https://github.com/apache/gora/pull/175
>>> > >>>>
>>> > >>>> Thanks and regards
>>> > >>>>
>>> > >>>> On Tue, Jul 9, 2019 at 7:53 AM Lahiru Jayasekera <
>>> > >>>> mlpjayasek...@gmail.com> wrote:
>>> > >>>>
>>> > >>>>> Hi all,
>>> > >>>>> I have updated my week 06 report and have asked  questions there
>>> as
>>> > >>>>> usual. Please have a look. Your feedback is much appreciated.
>>> > >>>>>
>>> > >>>>> Thanks and regards
>>>

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 09 report and have asked  questions there as usual.
Please have a look. Your feedback is much appreciated.

Please have a look into the PR too, and your reviews are mostly welcome.
https://github.com/apache/gora/pull/175


Thanks and regards

On Sun, Jul 21, 2019 at 10:34 PM Lahiru Jayasekera 
wrote:

> Hi all,
> I have updated my week 08 report and have asked  questions there as usual.
> Please have a look. Your feedback is much appreciated.
>
> Please have a look into the PR too, and your reviews are mostly welcome.
> https://github.com/apache/gora/pull/175
>
>
> Thanks and regards
>
> On Tue, Jul 16, 2019 at 9:13 PM Lahiru Jayasekera 
> wrote:
>
>> Hi all,
>> I have updated my week 07 report and have asked  questions there as
>> usual.
>> I have made a PR too, so that I can get reviews easily. Please have a
>> look and your reviews are mostly welcome.
>> https://github.com/apache/gora/pull/175
>>
>> Thanks and regards
>>
>> On Tue, Jul 9, 2019 at 7:53 AM Lahiru Jayasekera 
>> wrote:
>>
>>> Hi all,
>>> I have updated my week 06 report and have asked  questions there as
>>> usual. Please have a look. Your feedback is much appreciated.
>>>
>>> Thanks and regards
>>>
>>> On Wed, Jul 3, 2019 at 10:57 PM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi all,
>>>> I have updated my week 05 report and have asked  questions there.
>>>> Please have a look. Your feedback is much appreciated.
>>>>
>>>> On Sun, Jun 23, 2019 at 10:34 PM Lahiru Jayasekera <
>>>> mlpjayasek...@gmail.com> wrote:
>>>>
>>>>> Hi all,
>>>>> I have updated my week 04 report and have asked  questions there.
>>>>> Please have a look. Your feedback is much appreciated.
>>>>>
>>>>>
>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>
>>>>>
>>>>> Thanks and regards
>>>>>
>>>>>
>>>>> On Sun, Jun 16, 2019 at 5:38 PM Lahiru Jayasekera <
>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>
>>>>>> Hi all,
>>>>>> I have updated my week 03 report and have asked  questions there.
>>>>>> Please have a look. Your feedback is much appreciated.
>>>>>>
>>>>>>
>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>
>>>>>> Thanks and regards
>>>>>>
>>>>>> On Mon, Jun 10, 2019 at 12:33 AM Lahiru Jayasekera <
>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi all
>>>>>>> I have updated my week 02 report and have asked several questions
>>>>>>> there. Please have a look. Your feedback is much appreciated.
>>>>>>>
>>>>>>>
>>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>>
>>>>>>> Thanks and Regards
>>>>>>>
>>>>>>> On Mon, Jun 3, 2019 at 8:00 PM Lahiru Jayasekera <
>>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi all,
>>>>>>>> I have updated my week 01 report and have asked several questions
>>>>>>>> there. Please have a look  nad give your feed back.
>>>>>>>>
>>>>>>>>
>>>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>>>
>>>>>>>> Thanks and Regards
>>>>>>>>
>>>>>>>> On Mon, May 27, 2019 at 9:33 PM Lahiru Jayasekera <
>>>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi all,
>>>>>>>>> I'm doing this project for GSOC 2019. This email is to update the
>>>>>>>>> initiative progress of the project and this thread will be used in 
>>>>>>>>> future
>>>>>>&

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi Furkan,
Thanks very much for your review. I'll fix those by the end of the week.

Thanks and regards

On Mon, Aug 5, 2019 at 2:08 AM Furkan KAMACI  wrote:

> Hi Lahiru,
>
> Thanks for the PR! I've made my comments.
>
> Kind Regards,
> Furkan KAMACI
>
> On Sun, Aug 4, 2019 at 11:20 PM Lahiru Jayasekera  >
> wrote:
>
> > Hi all,
> > I have updated my week 10 report and have asked  questions there as
> usual.
> > I have made a PR too, so that I can get reviews easily. Please have a
> look
> > and your reviews are mostly welcome.
> > https://github.com/apache/gora/pull/175
> >
> > On Mon, Aug 5, 2019 at 1:49 AM Lahiru Jayasekera <
> mlpjayasek...@gmail.com>
> > wrote:
> >
> > > Hi all,
> > > I have updated my week 09 report and have asked  questions there as
> > usual.
> > > Please have a look. Your feedback is much appreciated.
> > > Please have a look into the PR too, and your reviews are mostly
> welcome.
> > > https://github.com/apache/gora/pull/175
> > >
> > > Regards
> > >
> > > On Wed, Jul 31, 2019 at 1:04 AM Lahiru Jayasekera <
> > mlpjayasek...@gmail.com>
> > > wrote:
> > >
> > >> Hi all,
> > >> I have updated my week 09 report and have asked  questions there as
> > >> usual. Please have a look. Your feedback is much appreciated.
> > >>
> > >> Please have a look into the PR too, and your reviews are mostly
> welcome.
> > >> https://github.com/apache/gora/pull/175
> > >>
> > >>
> > >> Thanks and regards
> > >>
> > >> On Sun, Jul 21, 2019 at 10:34 PM Lahiru Jayasekera <
> > >> mlpjayasek...@gmail.com> wrote:
> > >>
> > >>> Hi all,
> > >>> I have updated my week 08 report and have asked  questions there as
> > >>> usual. Please have a look. Your feedback is much appreciated.
> > >>>
> > >>> Please have a look into the PR too, and your reviews are mostly
> > welcome.
> > >>> https://github.com/apache/gora/pull/175
> > >>>
> > >>>
> > >>> Thanks and regards
> > >>>
> > >>> On Tue, Jul 16, 2019 at 9:13 PM Lahiru Jayasekera <
> > >>> mlpjayasek...@gmail.com> wrote:
> > >>>
> > >>>> Hi all,
> > >>>> I have updated my week 07 report and have asked  questions there as
> > >>>> usual.
> > >>>> I have made a PR too, so that I can get reviews easily. Please have
> a
> > >>>> look and your reviews are mostly welcome.
> > >>>> https://github.com/apache/gora/pull/175
> > >>>>
> > >>>> Thanks and regards
> > >>>>
> > >>>> On Tue, Jul 9, 2019 at 7:53 AM Lahiru Jayasekera <
> > >>>> mlpjayasek...@gmail.com> wrote:
> > >>>>
> > >>>>> Hi all,
> > >>>>> I have updated my week 06 report and have asked  questions there as
> > >>>>> usual. Please have a look. Your feedback is much appreciated.
> > >>>>>
> > >>>>> Thanks and regards
> > >>>>>
> > >>>>> On Wed, Jul 3, 2019 at 10:57 PM Lahiru Jayasekera <
> > >>>>> mlpjayasek...@gmail.com> wrote:
> > >>>>>
> > >>>>>> Hi all,
> > >>>>>> I have updated my week 05 report and have asked  questions there.
> > >>>>>> Please have a look. Your feedback is much appreciated.
> > >>>>>>
> > >>>>>> On Sun, Jun 23, 2019 at 10:34 PM Lahiru Jayasekera <
> > >>>>>> mlpjayasek...@gmail.com> wrote:
> > >>>>>>
> > >>>>>>> Hi all,
> > >>>>>>> I have updated my week 04 report and have asked  questions there.
> > >>>>>>> Please have a look. Your feedback is much appreciated.
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> >
> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> Thanks and regards
> > >>>>>>>
> > >>>>>>>
> >

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 08 report and have asked  questions there as usual.
Please have a look. Your feedback is much appreciated.

Please have a look into the PR too, and your reviews are mostly welcome.
https://github.com/apache/gora/pull/175


Thanks and regards

On Tue, Jul 16, 2019 at 9:13 PM Lahiru Jayasekera 
wrote:

> Hi all,
> I have updated my week 07 report and have asked  questions there as usual.
> I have made a PR too, so that I can get reviews easily. Please have a look
> and your reviews are mostly welcome.
> https://github.com/apache/gora/pull/175
>
> Thanks and regards
>
> On Tue, Jul 9, 2019 at 7:53 AM Lahiru Jayasekera 
> wrote:
>
>> Hi all,
>> I have updated my week 06 report and have asked  questions there as
>> usual. Please have a look. Your feedback is much appreciated.
>>
>> Thanks and regards
>>
>> On Wed, Jul 3, 2019 at 10:57 PM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com> wrote:
>>
>>> Hi all,
>>> I have updated my week 05 report and have asked  questions there. Please
>>> have a look. Your feedback is much appreciated.
>>>
>>> On Sun, Jun 23, 2019 at 10:34 PM Lahiru Jayasekera <
>>> mlpjayasek...@gmail.com> wrote:
>>>
>>>> Hi all,
>>>> I have updated my week 04 report and have asked  questions there.
>>>> Please have a look. Your feedback is much appreciated.
>>>>
>>>>
>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>
>>>>
>>>> Thanks and regards
>>>>
>>>>
>>>> On Sun, Jun 16, 2019 at 5:38 PM Lahiru Jayasekera <
>>>> mlpjayasek...@gmail.com> wrote:
>>>>
>>>>> Hi all,
>>>>> I have updated my week 03 report and have asked  questions there.
>>>>> Please have a look. Your feedback is much appreciated.
>>>>>
>>>>>
>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>
>>>>> Thanks and regards
>>>>>
>>>>> On Mon, Jun 10, 2019 at 12:33 AM Lahiru Jayasekera <
>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>
>>>>>> Hi all
>>>>>> I have updated my week 02 report and have asked several questions
>>>>>> there. Please have a look. Your feedback is much appreciated.
>>>>>>
>>>>>>
>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>
>>>>>> Thanks and Regards
>>>>>>
>>>>>> On Mon, Jun 3, 2019 at 8:00 PM Lahiru Jayasekera <
>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi all,
>>>>>>> I have updated my week 01 report and have asked several questions
>>>>>>> there. Please have a look  nad give your feed back.
>>>>>>>
>>>>>>>
>>>>>>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>>>>>>
>>>>>>> Thanks and Regards
>>>>>>>
>>>>>>> On Mon, May 27, 2019 at 9:33 PM Lahiru Jayasekera <
>>>>>>> mlpjayasek...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi all,
>>>>>>>> I'm doing this project for GSOC 2019. This email is to update the
>>>>>>>> initiative progress of the project and this thread will be used in 
>>>>>>>> future
>>>>>>>> for updating the progress too.
>>>>>>>>
>>>>>>>> First of all here [0] is a basic POC I did.
>>>>>>>> After that I found out that there is already a HDFS connector for
>>>>>>>> hazelcast jet[1]. Then I looked into using this. But encountered with 
>>>>>>>> some
>>>>>>>> package conflicts('org.apache.hadoop.mapreduce', and
>>>>>>>> 'org.apache.hadoop.mapred').
>>>>>>>>
>>>>>>>> Therefore finally after further discussions with mentors, it was
>>>>>>>> decided to implement custom source and sink as of this 
&g

Re: Hazelcast jet engine support

[Lahiru Jayasekera]

Hi all,
I have updated my week 03 report and have asked  questions there. Please
have a look. Your feedback is much appreciated.

https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports

Thanks and regards

On Mon, Jun 10, 2019 at 12:33 AM Lahiru Jayasekera 
wrote:

> Hi all
> I have updated my week 02 report and have asked several questions there.
> Please have a look. Your feedback is much appreciated.
>
>
> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>
> Thanks and Regards
>
> On Mon, Jun 3, 2019 at 8:00 PM Lahiru Jayasekera 
> wrote:
>
>> Hi all,
>> I have updated my week 01 report and have asked several questions there.
>> Please have a look  nad give your feed back.
>>
>>
>> https://cwiki.apache.org/confluence/display/GORA/GORA-546%3A+Hazelcast+Jet+execution+engine+support+for+Apache+Gora+Reports
>>
>> Thanks and Regards
>>
>> On Mon, May 27, 2019 at 9:33 PM Lahiru Jayasekera <
>> mlpjayasek...@gmail.com> wrote:
>>
>>> Hi all,
>>> I'm doing this project for GSOC 2019. This email is to update the
>>> initiative progress of the project and this thread will be used in future
>>> for updating the progress too.
>>>
>>> First of all here [0] is a basic POC I did.
>>> After that I found out that there is already a HDFS connector for
>>> hazelcast jet[1]. Then I looked into using this. But encountered with some
>>> package conflicts('org.apache.hadoop.mapreduce', and
>>> 'org.apache.hadoop.mapred').
>>>
>>> Therefore finally after further discussions with mentors, it was decided
>>> to implement custom source and sink as of this documentation[2].
>>> Now i'm in the process of implementing this. Your ideas and feedback are
>>> appreciated.
>>>
>>> [0]
>>> https://github.com/LahiruJayasekara/gora/blob/poc-hazelcast-jet/gora-tutorial/src/main/java/org/apache/gora/tutorial/log/HazelcastJetPOC.java
>>>
>>> [1] https://docs.hazelcast.org/docs/jet/0.7/manual/#hdfs
>>>
>>> [2]
>>> https://docs.hazelcast.org/docs/jet/3.0/manual/#custom-source-sink-vertex
>>>
>>>
>>> Thanks and Regards
>>> --
>>> Lahiru Jayasekara
>>> Batch 15
>>> Faculty of Information Technology
>>> University of Moratuwa
>>> 0716492170
>>>
>>
>>
>> --
>> Lahiru Jayasekara
>> Batch 15
>> Faculty of Information Technology
>> University of Moratuwa
>> 0716492170
>>
>
>
> --
> Lahiru Jayasekara
> Batch 15
> Faculty of Information Technology
> University of Moratuwa
> 0716492170
>


-- 
Lahiru Jayasekara

President | Information Technology Society (INTECS)

Faculty of Information Technology
University of Moratuwa
0716492170