Hello, I have made changes in Ignite Extensions build configurations.
It is now running the tests as expected. https://ci.ignite.apache.org/viewLog.html?buildId=4804480&buildTypeId=IgniteExtensions_Build&tab=buildResultsDiv&branch_IgniteExtensions=pull%2F1%2Fhead Regards, Saikat On Thu, Nov 28, 2019 at 1:29 PM Saikat Maitra <saikat.mai...@gmail.com> wrote: > Hi, > > We do run build with -DskipTests and then configure selective test suites > to run. > > I will check why these test suites are not getting executed. > > Regards > Saikat > > On Wed, 27 Nov 2019 at 3:05 PM, Emmanouil Gkatziouras < > gkatzio...@gmail.com> wrote: > >> Hi all, >> >> I did add a test suite and run the build with the corresponding arguments, >> however the tests did not run [1]. >> I checked the Flink's build logs and the same message is displayed there >> too `No tests to run` [2]. >> >> [1] >> >> https://ci.ignite.apache.org/viewLog.html?buildId=4798203&buildTypeId=IgniteExtensions_Build&tab=buildLog&branch_IgniteExtensions=pull%2F2%2Fhead&_focus=248 >> [2] >> >> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4789199&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=1256 >> >> Kind regards >> *Emmanouil Gkatziouras* >> https://egkatzioura.com/ | >> https://www.linkedin.com/in/gkatziourasemmanouil/ >> https://github.com/gkatzioura >> >> >> On Wed, 27 Nov 2019 at 18:58, Saikat Maitra <saikat.mai...@gmail.com> >> wrote: >> >> > Hi, >> > >> > We will need to add test suites for tests to be executed in build. We >> pass >> > them as TestSuites param. I had added Flink sink and source testsuites. >> > >> > Can you please review and confirm. >> > >> > Regards >> > Saikat >> > >> > On Wed, 27 Nov 2019 at 6:00 AM, Emmanouil Gkatziouras < >> > gkatzio...@gmail.com> >> > wrote: >> > >> > > Hi all! >> > > >> > > I was successful building and running my pull requests. It seems that >> the >> > > tests do not run both for Flink and Pub/Sub [1] >> > > If there is something I cannot do to make them discoverable please >> let me >> > > know. >> > > >> > > [1] >> > > >> > > >> > >> https://ci.ignite.apache.org/viewLog.html?buildTypeId=IgniteExtensions_Build&buildId=4796722&tab=buildLog&logTab=tree&filter=debug&expand=all&_focus=283 >> > > >> > > *Emmanouil Gkatziouras* >> > > https://egkatzioura.com/ | >> > > https://www.linkedin.com/in/gkatziourasemmanouil/ >> > > https://github.com/gkatzioura >> > > >> > > >> > > On Wed, 27 Nov 2019 at 04:57, Saikat Maitra <saikat.mai...@gmail.com> >> > > wrote: >> > > >> > > > Hi Emmanouil, >> > > > >> > > > I have added you as contributor in Ignite Extensions project. Can >> you >> > > > please check and confirm if you are able to see the project and >> execute >> > > > build on your pull request. >> > > > >> > > > Regards, >> > > > Saikat >> > > > >> > > > On Tue, Nov 26, 2019 at 12:49 PM Emmanouil Gkatziouras < >> > > > gkatzio...@gmail.com> >> > > > wrote: >> > > > >> > > > > Hi all! >> > > > > >> > > > > If someone could give me read access to the Job of Ignite >> Extensions >> > on >> > > > > Team City will greatly help me (username gkatzioura). >> > > > > I suppose the builds get triggered automatically on a pull >> request. >> > > > > >> > > > > Kind regards, >> > > > > Emmanouil >> > > > > >> > > > > *Emmanouil Gkatziouras* >> > > > > https://egkatzioura.com/ | >> > > > > https://www.linkedin.com/in/gkatziourasemmanouil/ >> > > > > https://github.com/gkatzioura >> > > > > >> > > > > >> > > > > On Sun, 24 Nov 2019 at 21:11, Emmanouil Gkatziouras < >> > > > gkatzio...@gmail.com> >> > > > > wrote: >> > > > > >> > > > > > Hi Saikat! >> > > > > > >> > > > > > I just rebased with the flink branch. Unfortunately I do not >> have >> > > read >> > > > > > access to the team city link you provided and thus evaluate the >> > tests >> > > > for >> > > > > > my pull request. >> > > > > > I guess it has to do with ignite extensions being new. >> > > > > > My username is gkatzioura and email the one I am using on this >> > email >> > > > > > >> > > > > > Thank you for your time. >> > > > > > >> > > > > > >> > > > > > *Emmanouil Gkatziouras* >> > > > > > https://egkatzioura.com/ | >> > > > > > https://www.linkedin.com/in/gkatziourasemmanouil/ >> > > > > > https://github.com/gkatzioura >> > > > > > >> > > > > > >> > > > > > On Sun, 24 Nov 2019 at 18:03, Saikat Maitra < >> > saikat.mai...@gmail.com >> > > > >> > > > > > wrote: >> > > > > > >> > > > > >> Hi Emmanouil, >> > > > > >> >> > > > > >> The latest build on teamcity has passed on Flink pull request. >> > > > > >> >> > > > > >> >> > > > > >> >> > > > > >> > > > >> > > >> > >> https://ci.ignite.apache.org/viewLog.html?buildId=4788928&buildTypeId=IgniteExtensions_Build&tab=buildResultsDiv&branch_IgniteExtensions=pull%2F1%2Fhead >> > > > > >> >> > > > > >> you should be able to take the changes I made in my PR and run >> > build >> > > > on >> > > > > >> your pull request. >> > > > > >> >> > > > > >> Please let me know if you have any questions. >> > > > > >> >> > > > > >> Regards, >> > > > > >> Saikat >> > > > > >> >> > > > > >> On Sun, Nov 24, 2019 at 10:44 AM Saikat Maitra < >> > > > saikat.mai...@gmail.com >> > > > > > >> > > > > >> wrote: >> > > > > >> >> > > > > >> > Hi Emmanouil, >> > > > > >> > >> > > > > >> > I have fixed the Flink module testsuites and have setup new >> > > project >> > > > in >> > > > > >> > teamcity. >> > > > > >> > >> > > > > >> > >> > > > > >> > >> > > > > >> >> > > > > >> > > > >> > > >> > >> https://ci.ignite.apache.org/project.html?projectId=IgniteExtensions&tab=projectOverview >> > > > > >> > >> > > > > >> > I am looking into setting up the build. >> > > > > >> > >> > > > > >> > Regards, >> > > > > >> > Saikat >> > > > > >> > >> > > > > >> > On Sat, Nov 23, 2019 at 9:52 AM Saikat Maitra < >> > > > > saikat.mai...@gmail.com> >> > > > > >> > wrote: >> > > > > >> > >> > > > > >> >> Hi Emmanouil, >> > > > > >> >> >> > > > > >> >> Thank you for your email. Yes, the plan is once the Flink >> PR is >> > > > > merged >> > > > > >> it >> > > > > >> >> will provide the Licence, parent POMs etc and you can rebase >> > from >> > > > > >> master >> > > > > >> >> branch and apply the changes on top of it. >> > > > > >> >> >> > > > > >> >> I am getting some issues with test failures in local with >> > > > > >> >> GridTestProperties as the test.properties is not present in >> > this >> > > > new >> > > > > >> >> project but should be available from dependencies. >> > > > > >> >> >> > > > > >> >> Once I address this issue, I will go ahead and merge the >> > changes >> > > > and >> > > > > >> then >> > > > > >> >> we can take it from there. >> > > > > >> >> >> > > > > >> >> Regards, >> > > > > >> >> Saikat >> > > > > >> >> >> > > > > >> >> On Fri, Nov 22, 2019 at 5:23 PM Emmanouil Gkatziouras < >> > > > > >> >> gkatzio...@gmail.com> wrote: >> > > > > >> >> >> > > > > >> >>> Hi all, >> > > > > >> >>> >> > > > > >> >>> I made my first pull request [1]. Since this project is >> brand >> > > new >> > > > > (no >> > > > > >> >>> parent poms, licensing), I reckoned it was best to use >> > Saikat's >> > > > > >> branch on >> > > > > >> >>> Flink. >> > > > > >> >>> I suppose the Flink branch will be merged first. If not >> please >> > > > give >> > > > > me >> > > > > >> >>> guidelines on how I should proceed next. >> > > > > >> >>> >> > > > > >> >>> Kind regards >> > > > > >> >>> Emmanouil >> > > > > >> >>> >> > > > > >> >>> [1] https://github.com/apache/ignite-extensions/pull/2 >> > > > > >> >>> >> > > > > >> >>> *Emmanouil Gkatziouras* >> > > > > >> >>> https://egkatzioura.com/ | >> > > > > >> >>> https://www.linkedin.com/in/gkatziourasemmanouil/ >> > > > > >> >>> https://github.com/gkatzioura >> > > > > >> >>> >> > > > > >> >>> >> > > > > >> >>> On Fri, 22 Nov 2019 at 20:55, Denis Magda < >> dma...@apache.org> >> > > > > wrote: >> > > > > >> >>> >> > > > > >> >>> > Awesome, ping us whenever you're ready! >> > > > > >> >>> > >> > > > > >> >>> > - >> > > > > >> >>> > Denis >> > > > > >> >>> > >> > > > > >> >>> > >> > > > > >> >>> > On Fri, Nov 22, 2019 at 12:52 PM Emmanouil Gkatziouras < >> > > > > >> >>> > gkatzio...@gmail.com> >> > > > > >> >>> > wrote: >> > > > > >> >>> > >> > > > > >> >>> > > Hi all! >> > > > > >> >>> > > >> > > > > >> >>> > > I am sorry for being late on that. I was trying to >> > refactor >> > > > the >> > > > > >> test >> > > > > >> >>> in >> > > > > >> >>> > > order not to be in need of any external tools or >> spinning >> > > up a >> > > > > >> >>> server. >> > > > > >> >>> > > I did forked the new repo and indeed my changes there, >> so >> > a >> > > > pull >> > > > > >> >>> request >> > > > > >> >>> > is >> > > > > >> >>> > > a matter of time! >> > > > > >> >>> > > >> > > > > >> >>> > > Kind regards >> > > > > >> >>> > > >> > > > > >> >>> > > *Emmanouil Gkatziouras* >> > > > > >> >>> > > https://egkatzioura.com/ | >> > > > > >> >>> > > https://www.linkedin.com/in/gkatziourasemmanouil/ >> > > > > >> >>> > > https://github.com/gkatzioura >> > > > > >> >>> > > >> > > > > >> >>> > > >> > > > > >> >>> > > On Fri, 22 Nov 2019 at 20:45, Denis Magda < >> > > dma...@apache.org> >> > > > > >> wrote: >> > > > > >> >>> > > >> > > > > >> >>> > > > Hi Emmanouil, >> > > > > >> >>> > > > >> > > > > >> >>> > > > Do you have any questions or need any support from >> the >> > > > > >> community? >> > > > > >> >>> > > > >> > > > > >> >>> > > > - >> > > > > >> >>> > > > Denis >> > > > > >> >>> > > > >> > > > > >> >>> > > > >> > > > > >> >>> > > > On Sun, Nov 10, 2019 at 3:07 PM Saikat Maitra < >> > > > > >> >>> saikat.mai...@gmail.com >> > > > > >> >>> > > >> > > > > >> >>> > > > wrote: >> > > > > >> >>> > > > >> > > > > >> >>> > > >> Hi Emmanouil, >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> Can you please take a looks at dev utils, if this is >> > > > > something >> > > > > >> >>> you are >> > > > > >> >>> > > >> looking for >> > > > > >> >>> > > >> >> > > > > https://github.com/apache/ignite/tree/master/modules/dev-utils >> > > > > >> ? >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> IMO, if you can release Pub/Sub server in maven and >> > then >> > > > use >> > > > > >> it as >> > > > > >> >>> > > >> dependency, that would be great. >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> Regards, >> > > > > >> >>> > > >> Saikat >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> On Sun, Nov 10, 2019 at 5:00 PM Saikat Maitra < >> > > > > >> >>> > saikat.mai...@gmail.com> >> > > > > >> >>> > > >> wrote: >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> > Hi Emmanouil, >> > > > > >> >>> > > >> > >> > > > > >> >>> > > >> > The master branch has been initialized. I have >> > raised a >> > > > PR >> > > > > to >> > > > > >> >>> > migrate >> > > > > >> >>> > > >> > Flink module to ignite-extensions. >> > > > > >> >>> > > >> > >> > > > > >> >>> > > >> > PR >> > https://github.com/apache/ignite-extensions/pull/1 >> > > > > >> >>> > > >> > Jira : >> > > > https://issues.apache.org/jira/browse/IGNITE-12356 >> > > > > >> >>> > > >> > >> > > > > >> >>> > > >> > Regards, >> > > > > >> >>> > > >> > Saikat >> > > > > >> >>> > > >> > >> > > > > >> >>> > > >> > >> > > > > >> >>> > > >> > On Sun, Nov 10, 2019 at 3:39 PM Emmanouil >> > Gkatziouras < >> > > > > >> >>> > > >> > gkatzio...@gmail.com> wrote: >> > > > > >> >>> > > >> > >> > > > > >> >>> > > >> >> Hi all! >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> This is an update. The integration is tested with >> > > mocks >> > > > > >> based >> > > > > >> >>> on >> > > > > >> >>> > the >> > > > > >> >>> > > >> >> original Ignite repo [1]. >> > > > > >> >>> > > >> >> I am currently waiting for the first commits on >> the >> > > new >> > > > > >> >>> integration >> > > > > >> >>> > > >> >> project >> > > > > >> >>> > > >> >> to take place in order to create my pull request >> > > > > accordingly >> > > > > >> >>> to the >> > > > > >> >>> > > >> >> initial >> > > > > >> >>> > > >> >> commits. >> > > > > >> >>> > > >> >> In order to simulate the Pub/Sub server in a >> test I >> > > > used a >> > > > > >> test >> > > > > >> >>> > > server >> > > > > >> >>> > > >> >> implementation [2]. Unfortunately they don't have >> > this >> > > > > util >> > > > > >> >>> > uploaded >> > > > > >> >>> > > >> in a >> > > > > >> >>> > > >> >> maven repo, thus it needs to be hosted on a maven >> > repo >> > > > > >> (Apache >> > > > > >> >>> > > License >> > > > > >> >>> > > >> >> 2.0). Is there a repo for utilities that Ignite >> uses >> > > for >> > > > > the >> > > > > >> >>> > > >> test/build? >> > > > > >> >>> > > >> >> I have also created a ticket [3] >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> Kind regards >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> [1] >> > > > > >> >>> > >> > > https://github.com/gkatzioura/ignite/tree/pubsub/modules/pubsub >> > > > > >> >>> > > >> >> [2] >> > > > > >> >>> >> https://github.com/GoogleCloudPlatform/kafka-pubsub-emulator >> > > > > >> >>> > > >> >> [3] >> > > https://issues.apache.org/jira/browse/IGNITE-12262 >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> *Emmanouil Gkatziouras* >> > > > > >> >>> > > >> >> https://egkatzioura.com/ | >> > > > > >> >>> > > >> >> >> https://www.linkedin.com/in/gkatziourasemmanouil/ >> > > > > >> >>> > > >> >> https://github.com/gkatzioura >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> On Fri, 25 Oct 2019 at 03:35, Saikat Maitra < >> > > > > >> >>> > saikat.mai...@gmail.com >> > > > > >> >>> > > > >> > > > > >> >>> > > >> >> wrote: >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> > Hello Ilya, >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> > Thank you for your email. Yes, before we remove >> > any >> > > > > >> >>> integration >> > > > > >> >>> > we >> > > > > >> >>> > > >> will >> > > > > >> >>> > > >> >> > move them to another repository and release. >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> > We are thinking we will start with Pub/Sub >> > Streamer >> > > > > >> >>> > implementation >> > > > > >> >>> > > >> and >> > > > > >> >>> > > >> >> > continue to move other integration as >> mentioned in >> > > the >> > > > > >> >>> following >> > > > > >> >>> > > doc. >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> > > > > >> >>> > >> > > > > >> >>> >> > > > > >> >> > > > > >> > > > >> > > >> > >> https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> > Regards, >> > > > > >> >>> > > >> >> > Saikat >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> > On Thu, Oct 24, 2019 at 11:00 AM Ilya >> Kasnacheev < >> > > > > >> >>> > > >> >> > ilya.kasnach...@gmail.com> >> > > > > >> >>> > > >> >> > wrote: >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> > > Hello! >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > > My take on this: we want to offload some of >> > > > > >> integrations, >> > > > > >> >>> but >> > > > > >> >>> > > >> please >> > > > > >> >>> > > >> >> > commit >> > > > > >> >>> > > >> >> > > and release them to another project first, >> and >> > > only >> > > > > >> then we >> > > > > >> >>> > will >> > > > > >> >>> > > >> >> decide >> > > > > >> >>> > > >> >> > to >> > > > > >> >>> > > >> >> > > remove them from our repository. >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > > Please also make sure they are available with >> > same >> > > > > >> artifact >> > > > > >> >>> > name >> > > > > >> >>> > > >> and >> > > > > >> >>> > > >> >> API. >> > > > > >> >>> > > >> >> > > If this has to be changed, let's wait for AI >> 3.0 >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > > Regards, >> > > > > >> >>> > > >> >> > > -- >> > > > > >> >>> > > >> >> > > Ilya Kasnacheev >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > > ср, 23 окт. 2019 г. в 03:23, Saikat Maitra < >> > > > > >> >>> > > >> saikat.mai...@gmail.com>: >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > > > Hello Emmanouil, >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > As discussed earlier, I discussed with >> Apache >> > > > Bahir >> > > > > >> >>> community >> > > > > >> >>> > > and >> > > > > >> >>> > > >> >> they >> > > > > >> >>> > > >> >> > > are >> > > > > >> >>> > > >> >> > > > interested to have Apache Ignite >> extensions as >> > > > part >> > > > > of >> > > > > >> >>> Apache >> > > > > >> >>> > > >> Bahir >> > > > > >> >>> > > >> >> > > > project. >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > Can you please share Pub/Sub streamer >> > > > implementation >> > > > > >> >>> details >> > > > > >> >>> > > with >> > > > > >> >>> > > >> >> > Apache >> > > > > >> >>> > > >> >> > > > Bahir community and request for feedback. >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > https://bahir.apache.org/ >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > I have also requested for contributor >> access >> > in >> > > > Jira >> > > > > >> for >> > > > > >> >>> > Apache >> > > > > >> >>> > > >> >> Bahir >> > > > > >> >>> > > >> >> > > > project so that I can create issues and >> assign >> > > to >> > > > > >> myself. >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > I can help with code reviews as well. >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > Here is the email thread for reference >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> > > > https://www.mail-archive.com/dev@bahir.apache.org/msg02703.html >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > Regards, >> > > > > >> >>> > > >> >> > > > Saikat >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > On Mon, Oct 21, 2019 at 7:54 PM Saikat >> Maitra >> > < >> > > > > >> >>> > > >> >> saikat.mai...@gmail.com >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > > > wrote: >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > > Hello, >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > As discussed I have created following >> > > discussion >> > > > > >> >>> threads on >> > > > > >> >>> > > our >> > > > > >> >>> > > >> >> > > migration >> > > > > >> >>> > > >> >> > > > > proposals for Apache Ignite extensions: >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> > > > > >> >>> > >> > > > > >> >>> >> > > > > >> >> > > > > >> > > > >> > > >> > >> http://apache-ignite-users.70518.x6.nabble.com/DISCUSS-Proposal-for-Ignite-Extensions-as-a-separate-Bahir-module-or-Incubator-project-td29829.html >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > >> >> https://www.mail-archive.com/dev@bahir.apache.org/msg02703.html >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > I will share update as I hear more >> > > information. >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > Regards, >> > > > > >> >>> > > >> >> > > > > Saikat >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > > On Fri, Oct 18, 2019 at 9:03 PM Saikat >> > Maitra >> > > < >> > > > > >> >>> > > >> >> > saikat.mai...@gmail.com >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > > > wrote: >> > > > > >> >>> > > >> >> > > > > >> > > > > >> >>> > > >> >> > > > >> Hello Denis, >> > > > > >> >>> > > >> >> > > > >> >> > > > > >> >>> > > >> >> > > > >> Sure, sounds good. I will create a >> separate >> > > > > >> discussion >> > > > > >> >>> > > thread >> > > > > >> >>> > > >> to >> > > > > >> >>> > > >> >> get >> > > > > >> >>> > > >> >> > > > >> community feedback on whether we >> > > > > >> >>> > > >> >> > > > >> should join the Bahir or kick-off >> "Ignite >> > > > > >> Extensions" >> > > > > >> >>> > > project. >> > > > > >> >>> > > >> >> > > > >> >> > > > > >> >>> > > >> >> > > > >> Regards, >> > > > > >> >>> > > >> >> > > > >> Saikat >> > > > > >> >>> > > >> >> > > > >> >> > > > > >> >>> > > >> >> > > > >> On Thu, Oct 17, 2019 at 2:21 PM Denis >> > Magda < >> > > > > >> >>> > > >> dma...@apache.org> >> > > > > >> >>> > > >> >> > > wrote: >> > > > > >> >>> > > >> >> > > > >> >> > > > > >> >>> > > >> >> > > > >>> Folks, >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >>> The concept of Apache Bahir is >> precisely >> > > what >> > > > we >> > > > > >> >>> need! >> > > > > >> >>> > > >> Saikat, >> > > > > >> >>> > > >> >> > thanks >> > > > > >> >>> > > >> >> > > > for >> > > > > >> >>> > > >> >> > > > >>> doing the research. Why I believe the * >> > > idea* >> > > > > >> fits us >> > > > > >> >>> > well: >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >>> - All integrations can be stored in >> > > > separate >> > > > > >> >>> Github >> > > > > >> >>> > > >> >> repositories >> > > > > >> >>> > > >> >> > > and >> > > > > >> >>> > > >> >> > > > >>> have their dev lifecycles. We've not >> > > > obliged >> > > > > to >> > > > > >> >>> couple >> > > > > >> >>> > > all >> > > > > >> >>> > > >> >> the >> > > > > >> >>> > > >> >> > > > >>> integrations >> > > > > >> >>> > > >> >> > > > >>> in a single repo. For instance, >> Spark >> > can >> > > > be >> > > > > >> >>> located >> > > > > >> >>> > in >> > > > > >> >>> > > a >> > > > > >> >>> > > >> >> > > dedicated >> > > > > >> >>> > > >> >> > > > >>> repo >> > > > > >> >>> > > >> >> > > > >>> while streaming integrations might >> be >> > in >> > > a >> > > > > >> single >> > > > > >> >>> one. >> > > > > >> >>> > > >> It's >> > > > > >> >>> > > >> >> up >> > > > > >> >>> > > >> >> > to >> > > > > >> >>> > > >> >> > > > us. >> > > > > >> >>> > > >> >> > > > >>> - All the repositories and >> integrations >> > > > > belong >> > > > > >> to >> > > > > >> >>> ASF. >> > > > > >> >>> > > >> We're >> > > > > >> >>> > > >> >> not >> > > > > >> >>> > > >> >> > > > >>> dumping >> > > > > >> >>> > > >> >> > > > >>> them on Github but rather keep >> > supporting >> > > > and >> > > > > >> >>> > developing >> > > > > >> >>> > > >> in >> > > > > >> >>> > > >> >> > > > >>> accordance with >> > > > > >> >>> > > >> >> > > > >>> ASF vision and practices. >> > > > > >> >>> > > >> >> > > > >>> - There is a way to reward >> contributors >> > > via >> > > > > >> >>> > > committership >> > > > > >> >>> > > >> and >> > > > > >> >>> > > >> >> > PMC >> > > > > >> >>> > > >> >> > > > >>> membership. You won't get this if a >> > > project >> > > > > is >> > > > > >> >>> just >> > > > > >> >>> > one >> > > > > >> >>> > > of >> > > > > >> >>> > > >> >> the >> > > > > >> >>> > > >> >> > > > >>> millions of >> > > > > >> >>> > > >> >> > > > >>> Github projects. >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >>> Saikat, as Ignite PMC member, could you >> > > please >> > > > > >> >>> kick-off a >> > > > > >> >>> > > >> >> separate >> > > > > >> >>> > > >> >> > > > >>> dev-list >> > > > > >> >>> > > >> >> > > > >>> discussion to involve more community >> > members >> > > > and >> > > > > >> >>> > referring >> > > > > >> >>> > > to >> > > > > >> >>> > > >> >> this >> > > > > >> >>> > > >> >> > > > >>> thread? >> > > > > >> >>> > > >> >> > > > >>> I think the primary question the >> community >> > > > needs >> > > > > >> to >> > > > > >> >>> > answer >> > > > > >> >>> > > >> >> whether >> > > > > >> >>> > > >> >> > we >> > > > > >> >>> > > >> >> > > > >>> should join the Bahir or kick-off >> "Ignite >> > > > > >> Extensions" >> > > > > >> >>> > > >> project? >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >>> - >> > > > > >> >>> > > >> >> > > > >>> Denis >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >>> On Thu, Oct 17, 2019 at 2:54 AM Alexey >> > > > Zinoviev >> > > > > < >> > > > > >> >>> > > >> >> > > > zaleslaw....@gmail.com> >> > > > > >> >>> > > >> >> > > > >>> wrote: >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >>> > Maybe we could move all our Streaming >> > > > > >> Integrations >> > > > > >> >>> > there, >> > > > > >> >>> > > >> but >> > > > > >> >>> > > >> >> > what >> > > > > >> >>> > > >> >> > > is >> > > > > >> >>> > > >> >> > > > >>> about >> > > > > >> >>> > > >> >> > > > >>> > maintaining and committer >> permissions to >> > > the >> > > > > new >> > > > > >> >>> > > >> repositories? >> > > > > >> >>> > > >> >> > > > >>> > I see the list of the committers and >> PMC >> > > > > members >> > > > > >> >>> there >> > > > > >> >>> > > >> >> > > > >>> > >> > > https://bahir.apache.org/community-members/ >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> > Could somebody from Ignite community >> be >> > > > added >> > > > > to >> > > > > >> >>> this >> > > > > >> >>> > > list >> > > > > >> >>> > > >> as >> > > > > >> >>> > > >> >> a >> > > > > >> >>> > > >> >> > > > >>> > PMC/committer to maintain Ignite >> > > > integrations? >> > > > > >> >>> > > >> >> > > > >>> > If yes, I'd happy to join this >> project >> > and >> > > > > >> >>> collaborate >> > > > > >> >>> > > with >> > > > > >> >>> > > >> >> these >> > > > > >> >>> > > >> >> > > > guys >> > > > > >> >>> > > >> >> > > > >>> > together >> > > > > >> >>> > > >> >> > > > >>> > If no, and we should start from the >> zero >> > > > level >> > > > > >> with >> > > > > >> >>> > > >> external >> > > > > >> >>> > > >> >> PRs >> > > > > >> >>> > > >> >> > - >> > > > > >> >>> > > >> >> > > > >>> hmmm, >> > > > > >> >>> > > >> >> > > > >>> > it's better to have our own external >> > > > > repository >> > > > > >> >>> with >> > > > > >> >>> > > >> >> ApacheBahirr >> > > > > >> >>> > > >> >> > > > >>> ideology. >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> > Also, I agree, that all connectors >> could >> > > be >> > > > > >> moved >> > > > > >> >>> there >> > > > > >> >>> > > (in >> > > > > >> >>> > > >> >> > > > >>> ApacheBahirr >> > > > > >> >>> > > >> >> > > > >>> > like repository), but not all modules >> > from >> > > > the >> > > > > >> page >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> > > > > >> >>> > >> > > > > >> >>> >> > > > > >> >> > > > > >> > > > >> > > >> > >> https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations >> > > > > >> >>> > > >> >> > > > >>> > because >> > > > > >> >>> > > >> >> > > > >>> > they use different parts of core >> modules >> > > and >> > > > > >> could >> > > > > >> >>> be >> > > > > >> >>> > > >> >> developed >> > > > > >> >>> > > >> >> > > with >> > > > > >> >>> > > >> >> > > > >>> > different velocity. >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> > In reality, before creation of new >> > > > > repositories >> > > > > >> we >> > > > > >> >>> need >> > > > > >> >>> > > >> wide >> > > > > >> >>> > > >> >> > > > discussion >> > > > > >> >>> > > >> >> > > > >>> > based on the document mentioned >> above. >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> > P.S. Of course, we could experiment >> in >> > the >> > > > > next >> > > > > >> >>> release >> > > > > >> >>> > > 2.8 >> > > > > >> >>> > > >> >> with >> > > > > >> >>> > > >> >> > > one >> > > > > >> >>> > > >> >> > > > >>> or two >> > > > > >> >>> > > >> >> > > > >>> > integrations like twitter or ZeroMQ >> > > > > >> >>> > > >> >> > > > >>> > Also, I'd like Denis Magda idea for >> the >> > > > > separate >> > > > > >> >>> > > >> repositories >> > > > > >> >>> > > >> >> in >> > > > > >> >>> > > >> >> > > > Apache >> > > > > >> >>> > > >> >> > > > >>> > Github to maintain them by anybody. >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> > чт, 17 окт. 2019 г. в 05:02, Saikat >> > > Maitra < >> > > > > >> >>> > > >> >> > > saikat.mai...@gmail.com >> > > > > >> >>> > > >> >> > > > >: >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> > > Hi Denis, Emmanouil >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > > Thank you for your email. I think >> > > > creating a >> > > > > >> >>> separate >> > > > > >> >>> > > >> >> > integration >> > > > > >> >>> > > >> >> > > > >>> project >> > > > > >> >>> > > >> >> > > > >>> > > in github and also proposing it as >> an >> > > > apache >> > > > > >> >>> > incubator >> > > > > >> >>> > > >> >> project >> > > > > >> >>> > > >> >> > > will >> > > > > >> >>> > > >> >> > > > >>> be a >> > > > > >> >>> > > >> >> > > > >>> > > good move. The other separate >> > > integration >> > > > > >> modules >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> > > > > >> >>> > >> > > > > >> >>> >> > > > > >> >> > > > > >> > > > >> > > >> > >> https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations >> > > > > >> >>> > > >> >> > > > >>> > > can >> > > > > >> >>> > > >> >> > > > >>> > > be moved to this new apache >> incubator >> > > > > project. >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > > There are similar integration >> > available >> > > > for >> > > > > >> >>> Flink and >> > > > > >> >>> > > >> Spark >> > > > > >> >>> > > >> >> in >> > > > > >> >>> > > >> >> > > > Apache >> > > > > >> >>> > > >> >> > > > >>> > Bahir >> > > > > >> >>> > > >> >> > > > >>> > > https://bahir.apache.org/ >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > > Do you think we should reach out to >> > > Apache >> > > > > >> Bahir >> > > > > >> >>> > > >> community >> > > > > >> >>> > > >> >> > with a >> > > > > >> >>> > > >> >> > > > >>> > proposal >> > > > > >> >>> > > >> >> > > > >>> > > or we should plan to create a >> separate >> > > > > Apache >> > > > > >> >>> > Incubator >> > > > > >> >>> > > >> >> > project? >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > > Regards, >> > > > > >> >>> > > >> >> > > > >>> > > Saikat >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > > On Wed, Oct 16, 2019 at 6:21 AM >> > > Emmanouil >> > > > > >> >>> > Gkatziouras < >> > > > > >> >>> > > >> >> > > > >>> > > gkatzio...@gmail.com> >> > > > > >> >>> > > >> >> > > > >>> > > wrote: >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > > > Hi all! >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > Based on the discussions most >> > probably >> > > > > this >> > > > > >> is >> > > > > >> >>> > going >> > > > > >> >>> > > to >> > > > > >> >>> > > >> >> be on >> > > > > >> >>> > > >> >> > > > >>> another >> > > > > >> >>> > > >> >> > > > >>> > > > GitHub repo. Therefore I will >> > prepare >> > > a >> > > > > >> >>> standalone >> > > > > >> >>> > > >> project >> > > > > >> >>> > > >> >> > with >> > > > > >> >>> > > >> >> > > > the >> > > > > >> >>> > > >> >> > > > >>> > > Pub/Sub >> > > > > >> >>> > > >> >> > > > >>> > > > module and once the repository is >> > > > created >> > > > > a >> > > > > >> >>> pull >> > > > > >> >>> > > >> request >> > > > > >> >>> > > >> >> > shall >> > > > > >> >>> > > >> >> > > be >> > > > > >> >>> > > >> >> > > > >>> > issued. >> > > > > >> >>> > > >> >> > > > >>> > > > If there is anything else I can >> do >> > in >> > > > > order >> > > > > >> to >> > > > > >> >>> > > >> facilitate >> > > > > >> >>> > > >> >> > this >> > > > > >> >>> > > >> >> > > > >>> please >> > > > > >> >>> > > >> >> > > > >>> > let >> > > > > >> >>> > > >> >> > > > >>> > > > me know. >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > If a ticket is created for this >> > > issue, I >> > > > > >> shall >> > > > > >> >>> be >> > > > > >> >>> > > able >> > > > > >> >>> > > >> to >> > > > > >> >>> > > >> >> > > create >> > > > > >> >>> > > >> >> > > > a >> > > > > >> >>> > > >> >> > > > >>> pull >> > > > > >> >>> > > >> >> > > > >>> > > > request and thus a build will >> take >> > > place >> > > > > on >> > > > > >> >>> > ignite's >> > > > > >> >>> > > >> CI. >> > > > > >> >>> > > >> >> > > > >>> > > > If everyone is aligned with >> adding a >> > > > > Pub/Sub >> > > > > >> >>> > > >> >> implementation >> > > > > >> >>> > > >> >> > > may I >> > > > > >> >>> > > >> >> > > > >>> > create >> > > > > >> >>> > > >> >> > > > >>> > > a >> > > > > >> >>> > > >> >> > > > >>> > > > ticket on JIRA? >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > My next question has to do on how >> > > Ignite >> > > > > >> >>> configures >> > > > > >> >>> > > the >> > > > > >> >>> > > >> >> build >> > > > > >> >>> > > >> >> > > > jobs >> > > > > >> >>> > > >> >> > > > >>> in >> > > > > >> >>> > > >> >> > > > >>> > > Team >> > > > > >> >>> > > >> >> > > > >>> > > > City. The unit tests for my >> > > > implementation >> > > > > >> >>> need a >> > > > > >> >>> > > local >> > > > > >> >>> > > >> >> > Pub/Sub >> > > > > >> >>> > > >> >> > > > >>> server >> > > > > >> >>> > > >> >> > > > >>> > up >> > > > > >> >>> > > >> >> > > > >>> > > > and running (they provide one for >> > > > testing >> > > > > >> >>> > purposes). >> > > > > >> >>> > > >> Will >> > > > > >> >>> > > >> >> > this >> > > > > >> >>> > > >> >> > > > take >> > > > > >> >>> > > >> >> > > > >>> > > effect >> > > > > >> >>> > > >> >> > > > >>> > > > in a form of a build script >> inside >> > my >> > > > > >> >>> > implementation >> > > > > >> >>> > > or >> > > > > >> >>> > > >> >> is it >> > > > > >> >>> > > >> >> > > > >>> something >> > > > > >> >>> > > >> >> > > > >>> > > > that should be configured on Team >> > > City? >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > Kind regards, >> > > > > >> >>> > > >> >> > > > >>> > > > Emmanouil >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > *Emmanouil Gkatziouras* >> > > > > >> >>> > > >> >> > > > >>> > > > https://egkatzioura.com/ | >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> https://www.linkedin.com/in/gkatziourasemmanouil/ >> > > > > >> >>> > > >> >> > > > >>> > > > https://github.com/gkatzioura >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > On Tue, 15 Oct 2019 at 23:27, >> Denis >> > > > Magda >> > > > > < >> > > > > >> >>> > > >> >> dma...@apache.org >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > > > >>> wrote: >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > Emmanouil, Saikat, >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > After contemplating on this, >> let >> > me >> > > > > >> propose >> > > > > >> >>> > another >> > > > > >> >>> > > >> way >> > > > > >> >>> > > >> >> > with >> > > > > >> >>> > > >> >> > > > this >> > > > > >> >>> > > >> >> > > > >>> > > > > particular integration that is >> > > aligned >> > > > > >> with >> > > > > >> >>> our >> > > > > >> >>> > > >> >> > > modularization >> > > > > >> >>> > > >> >> > > > >>> > > endeavor. >> > > > > >> >>> > > >> >> > > > >>> > > > > The modularization [1] defines >> the >> > > > > Ignite >> > > > > >> >>> core, >> > > > > >> >>> > > >> Ignite >> > > > > >> >>> > > >> >> > > modules, >> > > > > >> >>> > > >> >> > > > >>> and >> > > > > >> >>> > > >> >> > > > >>> > > > > independent integrations. The >> > first >> > > > two >> > > > > >> are >> > > > > >> >>> to be >> > > > > >> >>> > > >> >> located >> > > > > >> >>> > > >> >> > in >> > > > > >> >>> > > >> >> > > > >>> Ignite >> > > > > >> >>> > > >> >> > > > >>> > > > > repositories and to be >> > > tested/updated >> > > > by >> > > > > >> the >> > > > > >> >>> > > >> community >> > > > > >> >>> > > >> >> for >> > > > > >> >>> > > >> >> > > > every >> > > > > >> >>> > > >> >> > > > >>> > > release. >> > > > > >> >>> > > >> >> > > > >>> > > > > The modules are a subset of >> > existing >> > > > > >> >>> integrations >> > > > > >> >>> > > >> that >> > > > > >> >>> > > >> >> are >> > > > > >> >>> > > >> >> > > > >>> adopted >> > > > > >> >>> > > >> >> > > > >>> > > widely >> > > > > >> >>> > > >> >> > > > >>> > > > > and require community >> attention. >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > As for the independent >> > integrations >> > > > [1], >> > > > > >> >>> those >> > > > > >> >>> > are >> > > > > >> >>> > > >> >> supposed >> > > > > >> >>> > > >> >> > > to >> > > > > >> >>> > > >> >> > > > be >> > > > > >> >>> > > >> >> > > > >>> > > located >> > > > > >> >>> > > >> >> > > > >>> > > > > in a separate GitHub repo. I >> would >> > > > > advise >> > > > > >> us >> > > > > >> >>> to >> > > > > >> >>> > > start >> > > > > >> >>> > > >> >> > > > >>> implementing >> > > > > >> >>> > > >> >> > > > >>> > this >> > > > > >> >>> > > >> >> > > > >>> > > > > concept with the Pub/Sub >> > > integration. >> > > > > Even >> > > > > >> >>> though >> > > > > >> >>> > > it >> > > > > >> >>> > > >> >> will >> > > > > >> >>> > > >> >> > be >> > > > > >> >>> > > >> >> > > > >>> located >> > > > > >> >>> > > >> >> > > > >>> > > in a >> > > > > >> >>> > > >> >> > > > >>> > > > > separate Github repo, it will >> be >> > > > listed >> > > > > >> among >> > > > > >> >>> > > >> officially >> > > > > >> >>> > > >> >> > > > >>> available >> > > > > >> >>> > > >> >> > > > >>> > > > > integrations on the Ignite >> website >> > > > > >> featuring >> > > > > >> >>> > > >> Emmanouil >> > > > > >> >>> > > >> >> as a >> > > > > >> >>> > > >> >> > > > >>> > > contributor. >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > What do you think? >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > [1] >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > >> > > > > >> >>> > > >> >> > > > >>> > >> > > > > >> >>> > > >> >> > > > >>> >> > > > > >> >>> > > >> >> > > > >> > > > > >> >>> > > >> >> > > >> > > > > >> >>> > > >> >> > >> > > > > >> >>> > > >> >> >> > > > > >> >>> > > >> >> > > > > >> >>> > > >> > > > > >> >>> > >> > > > > >> >>> >> > > > > >> >> > > > > >> > > > >> > > >> > >> https://cwiki.apache.org/confluence/display/IGNITE/IEP-36%3A+Modularization#IEP-36:Modularization-IndependentIntegrations >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > - >> > > > > >> >>> > > >> >> > > > >>> > > > > Denis >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > On Mon, Oct 14, 2019 at 9:47 PM >> > > Saikat >> > > > > >> >>> Maitra < >> > > > > >> >>> > > >> >> > > > >>> > saikat.mai...@gmail.com >> > > > > >> >>> > > >> >> > > > >>> > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > wrote: >> > > > > >> >>> > > >> >> > > > >>> > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > Hi Emmanouil, >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > The changes looks good to >> me. I >> > > > wanted >> > > > > >> to >> > > > > >> >>> check >> > > > > >> >>> > > if >> > > > > >> >>> > > >> you >> > > > > >> >>> > > >> >> > are >> > > > > >> >>> > > >> >> > > > also >> > > > > >> >>> > > >> >> > > > >>> > able >> > > > > >> >>> > > >> >> > > > >>> > > to >> > > > > >> >>> > > >> >> > > > >>> > > > > > validate that the once data >> is >> > > added >> > > > > to >> > > > > >> >>> Ignite >> > > > > >> >>> > > >> cluster >> > > > > >> >>> > > >> >> > you >> > > > > >> >>> > > >> >> > > > are >> > > > > >> >>> > > >> >> > > > >>> also >> > > > > >> >>> > > >> >> > > > >>> > > > able >> > > > > >> >>> > > >> >> > > > >>> > > > > to >> > > > > >> >>> > > >> >> > > > >>> > > > > > access it using another >> Ignite >> > > > client >> > > > > or >> > > > > >> >>> using >> > > > > >> >>> > > rest >> > > > > >> >>> > > >> >> > > > endpoints. >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > We use Teamcity for CI >> process, >> > > the >> > > > > >> >>> details are >> > > > > >> >>> > > as >> > > > > >> >>> > > >> >> > follows >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > Trigger validation of those >> test >> > > > > suites >> > > > > >> >>> that >> > > > > >> >>> > have >> > > > > >> >>> > > >> been >> > > > > >> >>> > > >> >> > > > >>> affected by >> > > > > >> >>> > > >> >> > > > >>> > > your >> > > > > >> >>> > > >> >> > > > >>> > > > > > changes on TeamCity < >> > > > > >> >>> > > http://ci.ignite.apache.org/>: >> > > > > >> >>> > > >> < >> > > > > >> >>> > > >> >> > > > >>> > > > > http://204.14.53.153/ >> > > > > >> >>> > > >> >> > > > >>> > > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > - Locate a test suite you >> > have >> > > to >> > > > > >> check, >> > > > > >> >>> > press >> > > > > >> >>> > > >> >> button >> > > > > >> >>> > > >> >> > > > named >> > > > > >> >>> > > >> >> > > > >>> > "..." >> > > > > >> >>> > > >> >> > > > >>> > > > that >> > > > > >> >>> > > >> >> > > > >>> > > > > > is located on the left of >> > "Run" >> > > > > >> button. >> > > > > >> >>> "Run >> > > > > >> >>> > > >> custom >> > > > > >> >>> > > >> >> > > build" >> > > > > >> >>> > > >> >> > > > >>> > dialog >> > > > > >> >>> > > >> >> > > > >>> > > > will >> > > > > >> >>> > > >> >> > > > >>> > > > > > appear; >> > > > > >> >>> > > >> >> > > > >>> > > > > > - Go to "Changes" tab and >> > > choose >> > > > > >> >>> > > >> >> > > > >>> > "pull/<pull-request-number>/head" >> > > > > >> >>> > > >> >> > > > >>> > > > in >> > > > > >> >>> > > >> >> > > > >>> > > > > > "Build branch" dropdown >> list; >> > > > > >> >>> > > >> >> > > > >>> > > > > > - Press "Run build" button >> > and >> > > > > >> monitor >> > > > > >> >>> tests >> > > > > >> >>> > > >> >> results. >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > @Roman rsht...@yahoo.com - >> can >> > > you >> > > > > also >> > > > > >> >>> please >> > > > > >> >>> > > >> take a >> > > > > >> >>> > > >> >> > > look? >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > Regards, >> > > > > >> >>> > > >> >> > > > >>> > > > > > Saikat >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > On Sun, Oct 13, 2019 at 6:20 >> PM >> > > > > >> Emmanouil >> > > > > >> >>> > > >> Gkatziouras >> > > > > >> >>> > > >> >> < >> > > > > >> >>> > > >> >> > > > >>> > > > > > gkatzio...@gmail.com> >> > > > > >> >>> > > >> >> > > > >>> > > > > > wrote: >> > > > > >> >>> > > >> >> > > > >>> > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > > Hi @Saikat Maitra >> > > > > >> >>> > > >> >> > > > >>> > > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > > I have my implementation >> on an >> > > > > Ignite >> > > > > >> >>> fork on >> > > > > >> >>> > > my >> > > > > >> >>> > > >> >> > personal >> > > > > >> >>> > > >> >> > > > >>> GitHub >> > > > > >> >>> > > >> >> > > > >>> > > > > account >> > > > > >> >>> > > >> >> > > > >>> > > > > > > [1] >> > > > > >> >>> > > >> >> > > > >>> > > > > > > It is based on the Kafka >> > > > > >> implementation >> > > > > >> >>> which >> > > > > >> >>> > > is >> > > > > >> >>> > > >> of >> > > > > >> >>> > > >> >> a >> > > > > >> >>> > > >> >> > > > polling >> > > > > >> >>> > > >> >> > > > >>> > > nature. >> > > > > >> >>> > > >> >> > > > >>> > > > > > > GCP does not provide a >> service >> > > > like >> > > > > >> >>> Kafka. >> > > > > >> >>> > > >> Instead >> > > > > >> >>> > > >> >> it >> > > > > >> >>> > > >> >> > > > >>> provides us >> > > > > >> >>> > > >> >> > > > >>> > > > with >> > > > > >> >>> > > >> >> > > > >>> > > > > > > Pub/Sub which is just like >> > > Kafka. >> > > > > >> >>> > > >> >> > > > >>> > > > > > > Therefore using the Kafka >> > > streamer >> > > > > as >> > > > > >> a >> > > > > >> >>> > > guideline >> > > > > >> >>> > > >> >> made >> > > > > >> >>> > > >> >> > > more >> > > > > >> >>> > > >> >> > > > >>> sense >> > > > > >> >>> > > >> >> > > > >>> > > to >> > > > > >> >>> > > >> >> > > > >>> > > > > me. >> > > > > >> >>> > > >> >> > > > >>> > > > > > > >> > > > > >> >>> > > >> >> > > > >>> > > > > > > Apart from the >> implementation >> > I >> > > > have >> > > > > >> also >> > > > > >> >>> > > added a >> > > > > >> >>> > > >> >> unit >> > > > > >> >>> > > >> >> > > > test. >> > > > > >> >>> > > >> >> > > > >>> > > > > > > It definitely needs some >> > > polishing >> > > > > >> and a >> > > > > >> >>> > double >> > > > > >> >>> > > >> >> check >> > > > > >> >>> > > >> >> > on >> > > > > >> >>> > > >> >> > > my >> > > > > >> >>> > > >> >> > > > >>> side >> > > > > >> >>> > > >> >> > > > >>> > to >> > > > > >> >>> > > >> >> > > > >>> > > > > make >> > > > > >> >>> > > >> >> > > > >>> > > > > > > the review smooth. >> > > > > >> >>> > > >> >> > > > >>> > > > > > > For the tests a local >> Pub/Sub >> > > [2] >> > > > > >> server >> > > > > >