Re: Back again with error with maven package in dev branch
forget it. I deleted my Maven folder and re-downloaded everything and the error was gone. So it was a short maven hickup. So the main message from this email: I have time to work on StreamPipes again :P Am Sonntag, dem 30.04.2023 um 22:41 +0200 schrieb Florian Micklich: > Hi all, > > after my relocation period I am back again :) > I pulled the latest dev commit and tried to start the debugger session in > IntelliJ. > I have rebuilt the project and loaded the maven packages again as usually and > still running with Java 17. > > But for some reason I get the error: > java: error reading > /home/micklich/.m2/repository/org/springframework/spring-core/6.0.7/spring-core-6.0.7.jar; > zip file is empty > > > and indeed. This file is empty. > Does anyone can tell me why? I think this is a maven / package problem? > > If I run my older branches, everything is fine. So it seems to be a newer > problem. > > Greetings > Florian
Back again with error with maven package in dev branch
Hi all, after my relocation period I am back again :) I pulled the latest dev commit and tried to start the debugger session in IntelliJ. I have rebuilt the project and loaded the maven packages again as usually and still running with Java 17. But for some reason I get the error: java: error reading /home/micklich/.m2/repository/org/springframework/spring-core/6.0.7/spring-core-6.0.7.jar; zip file is empty and indeed. This file is empty. Does anyone can tell me why? I think this is a maven / package problem? If I run my older branches, everything is fine. So it seems to be a newer problem. Greetings Florian
Re: AW: [DISCUSS] Next community meeting
What is the meeting link again? Am Dienstag, dem 04.04.2023 um 21:05 + schrieb Philipp Zehnder: > Hi all, > > the result of the poll is that the community meeting will take place on > Wednesday between 12 and 1 o'clock (UTC). > > @Tim, thanks for setting up the poll > > Cheers, > Philipp > > > Von: Tim Bossenmaier <[bosse...@apache.org](mailto:bosse...@apache.org)> > Datum: Dienstag, 4. April 2023 um 09:58 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Re: AW: [DISCUSS] Next community meeting > Hi all, > > here is a quick poll for tomorrow: > [https://terminplaner6.dfn.de/en/p/20e08293b025d7b4f2c0a4d8ad7671be-196145](https://terminplaner6.dfn.de/en/p/20e08293b025d7b4f2c0a4d8ad7671be-196145) > > Time slots are referring to UTC! > > Best > Tim
Re: [DISCUSS] Next community meeting
+1 what time? Am Mittwoch, dem 29.03.2023 um 11:20 + schrieb Dominik Riemer: > +1 Dominik > > > -Original Message- > From: Philipp Zehnder > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > Sent: Wednesday, March 29, 2023 8:21 AM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: AW: [DISCUSS] Next community meeting > > Ok, shall we move the community call to next week Wednesday? > > > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Datum: Dienstag, 28. März 2023 um 22:43 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Re: [DISCUSS] Next community meeting Unfortunately, a customer > appointment came in at short notice today. Mainly from from 10 till 12 am. > (09 - 11 UTC). > So I could only participate in the evening :( > > > Am Dienstag, dem 28.03.2023 um 08:57 + schrieb Dominik Riemer: > > +1 > > > > > > -Original Message- > > From: Philipp Zehnder > > <[[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)](mailto:[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai))> > > > > > > > Sent: Tuesday, March 28, 2023 10:17 AM > > To: > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > Subject: AW: [DISCUSS] Next community meeting > > > > Hi, > > > > unfortunately, I have an appointment at 5 pm. My suggestion is > > that we use the other time when everyone is available from 10 to > > 11. > > > > Is that ok? > > > > Cheers, > > Philipp > > > > > > Von: Dominik Riemer > > <[[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)](mailto:[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai))>< > > br> > > Datum: Dienstag, 28. März 2023 um 09:19 > > An: > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > > > <[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))> > > Betreff: RE: [DISCUSS] Next community meeting Hi, > > > > looking at the Doodle, it seems 5pm would be a good time for > > tomorrow's meeting. > > > > If that's fine for you, I'll send around a link. > > > > Cheers > > Dominik > > > > > > -Original Message- > > From: Florian Micklich > > <[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))> > > Sent: Monday, March 27, 2023 11:37 PM > > To: > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > Subject: Re: [DISCUSS] Next community meeting > > > > > > Hi, > > > > just saw this message. > > Who would attend? I can organise it due Tim has no time. The main > > topic is variables in StreamPipes by Dominik, as I can remember from > > last time. > > > > Is this still the case? > > The other topics will be discussed during the meeting. > > > > Florian > > > > > > > > > > Am Montag, dem 13.03.2023 um 11:36 + schrieb Tim:> > > > Hi all, > > > > > > it's time for our next community meeting! With respect to our > > > schedule, it will take place on the 29th of March. > > > Unfortunately, I won't be able to attend, so someone else needs to > > > take over of the remaining organization steps. Below > > > you can find a link to a new poll: > > > [[[https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7-16](https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7-16) > > > 593]([https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7](https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7) > > > -16593)https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e7](https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e7) > > > 27f5b7-16593%5d(https:/terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd > > > 49e727f5b7-16593)%3cbr>> > > > 3]([[https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7](https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7)- > > > 165]([https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7](https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7) > > > -165)https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727](https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727) > > > f5b7-165%5d(https:/terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e7 > > > 27f5b7-165)%3cbr>> > > > 933) > > > > > > Please be aware that you can scroll horizontally ;) > > > > > > Best > > > Tim
Re: [DISCUSS] Next community meeting
Unfortunately, a customer appointment came in at short notice today. Mainly from from 10 till 12 am. (09 - 11 UTC). So I could only participate in the evening :( Am Dienstag, dem 28.03.2023 um 08:57 + schrieb Dominik Riemer: > +1 > > > -Original Message- > From: Philipp Zehnder > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > Sent: Tuesday, March 28, 2023 10:17 AM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: AW: [DISCUSS] Next community meeting > > Hi, > > unfortunately, I have an appointment at 5 pm. > My suggestion is that we use the other time when everyone is available from > 10 to 11. > > Is that ok? > > Cheers, > Philipp > > > Von: Dominik Riemer > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > Datum: Dienstag, 28. März 2023 um 09:19 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: RE: [DISCUSS] Next community meeting Hi, > > looking at the Doodle, it seems 5pm would be a good time for tomorrow's > meeting. > > If that's fine for you, I'll send around a link. > > Cheers > Dominik > > > -Original Message- > From: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Sent: Monday, March 27, 2023 11:37 PM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: Re: [DISCUSS] Next community meeting > > > Hi, > > just saw this message. > Who would attend? I can organise it due Tim has no time. > The main topic is variables in StreamPipes by Dominik, as I can remember from > last time. > > Is this still the case? > The other topics will be discussed during the meeting. > > Florian > > > > > Am Montag, dem 13.03.2023 um 11:36 + schrieb Tim: > > Hi all, > > > > it's time for our next community meeting! With respect to our > > schedule, it will take place on the 29th of March. > > Unfortunately, I won't be able to attend, so someone else needs to > > take over of the remaining organization steps. Below you can > > find a link to a new poll: > > [[https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7-16593](https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7-16593) > > 3]([https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7-165](https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7-165) > > 933) > > > > Please be aware that you can scroll horizontally ;) > > > > Best > > Tim
Re: [DISCUSS] Next community meeting
Hi, just saw this message. Who would attend? I can organise it due Tim has no time. The main topic is variables in StreamPipes by Dominik, as I can remember from last time. Is this still the case? The other topics will be discussed during the meeting. Florian Am Montag, dem 13.03.2023 um 11:36 + schrieb Tim: > Hi all, > > it's time for our next community meeting! With respect to our schedule, > it will take place on the 29th of March. > Unfortunately, I won't be able to attend, so someone else needs to take > over of the remaining organization steps. > Below you can find a link to a new poll: > [https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7-165933](https://terminplaner6.dfn.de/p/816c4fa5501d88438a4ffd49e727f5b7-165933) > > Please be aware that you can scroll horizontally ;) > > Best > Tim
Re: [DISCUSS] StreamPipes Community Meeting
Hi, I just took a quick look at the poll and maybe someone else would like to participate on Wednesday? Otherwise there is a tie between morning and afternoon session :) Greetings Florian Am Montag, dem 06.02.2023 um 20:05 +0100 schrieb Tim Bossenmaier: > Hi all, > > thank you @Florian and @Philipp for initiating the discussion for our > second community meeting. > Below you can find a link to a new poll: > [https://terminplaner6.dfn.de/en/p/358aba8183d69a8fc4154ed0bab263bf-116952](https://terminplaner6.dfn.de/en/p/358aba8183d69a8fc4154ed0bab263bf-116952) > > Please be aware that you can scroll horizontally ;) > > Best > Tim
GSoC 2023
Hi last community meeting we talked about GSoC [1]. and that StreamPipes could be a project. Is there anything we should do? Is there a list of tasks and how to help out? :) Greetings [1] https://summerofcode.withgoogle.com/ [2] https://google.github.io/gsocguides/mentor/
FOSS4G calling for papers
Hi, like the fossgis conference there is a nother global version called foss4g [1] Is there anything against submitting the talk here as well? [2] I would prepair everything again. Greetings Florian [1] https://2023.foss4g.org/about/ [2] https://2023.foss4g.org/call-for-papers/
how to update dependencies?
Hi, I always see the emails from dependabot with updating dependencies. Is there a specific workflow behind it? What do I have to do, for updating packaged? Is that written down somewhere? Special Question for python: Is there already a plan how to check the pip python packaged for updates? Greetings Florian
Added chapter to wiki Good to Know
Hi i created a new section in the wiki called Good to Know (as a developer) https://cwiki.apache.org/confluence/x/RpVbDg and added a short description "Add dependency to POM Files" If anyone has something else to add, just do it :) Greetings Florian
Re: First StreamPipes Community Meeting
What about the second community meeting? :) Should we do a new poll again? The last Wednesday in February would be the 22.02.2023. Greetings Florian Am Freitag, dem 06.01.2023 um 13:21 + schrieb Tim: > Hi all, > > we are planning our first virtual StreamPipes Community meeting! > Many thanks again to Florian who brought about the initiative again (see > [1] for the intial discussion and some ideas for the agenda). > > Just to set a date, we agreed to conduct our first meeting at the > January 25! > The idea is to start a monthly schedule on the last wednesday for every > month but this is open to discuss. > Since we want to find the best time slot that fits as many of us as > possible, I created a quick poll: [2] > > The times given are referring to UTC time, please tick each option that > suits you (ideally not just one). > We will then select the slot that suits most of us. > > I'll leave this poll open until the January 18 and then share an > invitation link via thismailing list. > > I look forward to meeting you! > > Best > Tim > > > > [1] > [https://github.com/apache/streampipes/discussions/1033](https://github.com/apache/streampipes/discussions/1033) > [2] > [https://terminplaner6.dfn.de/de/p/b9587e9433cf6c03e71426914b90e397-79927](https://terminplaner6.dfn.de/de/p/b9587e9433cf6c03e71426914b90e397-79927)
Re: [DRAFT] February Board Report
Looks good +1 Am Montag, dem 06.02.2023 um 22:08 +0800 schrieb Xin Wang: > +1 LGTM Thanks Philipp. > > Dominik Riemer > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > 于2023年2月6日周一 20:48写道： > > > +1 > > Thanks for preparing the report, Philipp! > > > > Dominik > > > > > > -Original Message- > > From: Christofer Dutz > > <[christofer.d...@c-ware.de](mailto:christofer.d...@c-ware.de)> > > Sent: Monday, February 6, 2023 1:47 PM > > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > Subject: Re: [DRAFT] February Board Report > > > > +1 ... like it ;-) > > > > From: Philipp Zehnder > > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > > Date: Monday, 6. February 2023 at 13:38 > > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > Subject: AW: [DRAFT] February Board Report Hi all, > > > > here is the draft board report. Please let me know if you have any > > additional points. > > > > ## Description: > > The mission of Apache StreamPipes is the creation and maintenance of > > software related to a self-service Industrial IoT toolbox which enables > > non-technical users to connect, analyze and explore IoT data streams > > > > ## Issues: > > No Issues > > > > ## Membership Data: > > Apache StreamPipes was founded 2022-11-16 (3 months ago) There are > > currently 25 committers and 14 PMC members in this project. > > The Committer-to-PMC ratio is roughly 7:4. > > > > Community changes, past quarter: > > - Zike Yang was added to the PMC on 2022-11-26 > > - Cedric Kulbach was added as committer on 2022-12-15 > > - Sven Oehler was added as committer on 2022-12-15 > > - Samuel Abt was added as committer on 2023-01-17 > > - Xin Wang was added as committer on 2022-11-25 > > > > ## Project Activity: > > - Work on the Python Client continues to progress > > - Version 0.90.0 was released (January 17th 2023) [1] > > - The discussion for the next release has already started on the > > mailing list [2] > > - The project has updated its third-party service dependencies > > - The team is working to simplify the model used in the background to > > make it easier to use and understand, especially for new developers. > > > > ## Community Health: > > - The project recently held its first online community meeting, which > > was > > a success. The meeting details can be found here [3] and were also > > distributed to the dev list > > - The mailing list has seen a constant increase in traffic, with > > December's count at 468 and January's count at 734 > > - The switch to GitHub discussions has led to an increase in mailing > > list > > traffic, and we've tried several settings to make the list manageable > > again > > > > > > [1] > > [https://github.com/apache/streampipes/blob/release/0.90.0/RELEASE_NOTES.md](https://github.com/apache/streampipes/blob/release/0.90.0/RELEASE_NOTES.md) > > [2] > > [https://lists.apache.org/list?dev@streampipes.apache.org:lte=1M:Already%20time%20for%20preparing%20the%20next%20release](https://lists.apache.org/list?dev@streampipes.apache.org:lte=1M:Already%20time%20for%20preparing%20the%20next%20release) > > [3] > > [https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=240881564](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=240881564) > > > > Cheers, > > Philipp > > > > > > > > Von: Philipp Zehnder > > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > > Datum: Dienstag, 31. Januar 2023 um 18:29 > > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > Betreff: AW: [DRAFT] February Board Report Hi Chris, > > > > thanks a lot, I will add it. > > > > Cheers, > > Philipp > > > > Von: Christofer Dutz > > <[christofer.d...@c-ware.de](mailto:christofer.d...@c-ware.de)> > > Datum: Dienstag, 31. Januar 2023 um 18:27 > > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > Betreff: Re: [DRAFT] February Board Report Hi Philip, > > > > Well I would add in "community health" that after enabling github > > discussions a lot of discussions started but the emails completely > > swamped > > the mailinglists and we're trying to use different settings in order to > > make the list manageable again (This would be the sort of thing that I as > > a > > board-member would be looking for) > > > > Chris > > > > From: Philipp Zehnder > > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > > Date: Tuesday, 31. January 2023 at 17:49 > > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > Subject: [DRAFT] February Board Report > > Hi all, > > > > we have yet to
Re: Sunday coffee talk with ChatGPT about StreamPipes :)
If anyone has another conversation fell free to post here. I really enjoyed the answers. We can also train ChatGPT for correct answers :P Am Montag, dem 30.01.2023 um 20:04 +0800 schrieb Xin Wang: > Thank you Florian for sharing this. It is very interesting and arouses us > to think more :) > > Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > 于2023年1月29日周日 17:08写道： > > > Goog morning > > everyone is talking about ChatGPT so I talked with ChatGPT about > > StreamPipes... :) > > > > What is Apache StreamPipes > > Apache StreamPipes is an open-source software platform for developing > > and deploying real-time stream processing pipelines. It provides a web- > > based graphical user interface for designing and executing pipelines, > > as well as a set of pre-built components for integrating with various > > data sources and sinks. StreamPipes aims to make it easy for developers > > and data scientists to process large amounts of streaming data and > > build complex event processing applications. > > > > What are the benefits of Apache StreamPipes? > > The benefits of Apache StreamPipes are: > > 1. Ease of use: It provides a user-friendly graphical interface for > > designing and executing stream processing pipelines. > > 2. Open source: It is an open-source software, meaning it is free to > > use and has a large community of developers contributing to its > > development. > > 3. Integration: It supports a wide range of data sources and sinks, > > making it easy to integrate with existing systems. > > 4. Scalability: It can handle large amounts of data and can be > > easily scaled to meet increasing demand. > > 5. Flexibility: It provides a range of pre-built components and > > plugins, allowing users to build complex event processing > > applications. > > 6. Low latency: It processes data in real-time, making it suitable > > for use in latency-sensitive applications. > > 7. Robustness: It provides features such as fault tolerance and > > automatic recovery, ensuring that pipelines continue to run even > > in the event of failures. > > > > What about visualization? > > Yes, Apache StreamPipes also provides visualization capabilities for > > stream processing pipelines. It includes a variety of visualization > > tools and dashboards for monitoring the status of pipelines, analyzing > > data, and visualizing results. These tools can be used to get real-time > > insights into the data and make informed decisions based on the data. > > Additionally, the platform allows users to create custom visualizations > > and dashboards to meet specific requirements. The visualization > > capabilities of StreamPipes help to improve the understanding and > > interpretation of data, making it easier to use data for decision > > making. > > > > > > Who are the main contributors of StreamPipes? > > Apache StreamPipes is an open-source project developed and maintained > > by a global community of contributors. The main contributors to the > > project are universities, research institutions, and companies that are > > interested in stream processing and event-driven architecture. Some of > > the main contributors to Apache StreamPipes include: > > 1. University of Stuttgart: A leading research institution in > > Germany that specializes in computer science and engineering. > > 2. FZI Research Center for Information Technology: A research > > institution in Germany that focuses on information technology and > > engineering. > > 3. RWTH Aachen University: A research-oriented university in Germany > > that is known for its engineering and computer science programs > > 4. TU Wien: A technical university in Vienna, Austria that is > > focused on engineering, natural sciences, and technology. > > 5. Siemens AG: A multinational engineering and technology company > > with a strong presence in the stream processing and IoT fields. > > These organizations have been instrumental in developing and > > contributing to Apache StreamPipes, and the project continues to be > > driven by a growing community of developers and users from around the > > world. > > > > > > **What is the latest version of StreamPipes?** > > > > As of my knowledge cutoff (2021), the latest stable version of Apache > > StreamPipes is 0.61.0, released in 2021. The development of StreamPipes > > is ongoing and new versions are regularly released
Re: [ANNOUNCE] New PMC member & committer
Welcome from my side as well. What are your main "topics" :) Greetings Am Montag, dem 30.01.2023 um 20:11 +0800 schrieb Xin Wang: > Thanks everyone! It is really awesome to be working with you on > StreamPipes! > > Philipp Zehnder > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > 于2023年1月20日周五 00:58写道： > > > Congratulations to both of you! > > > > Cheers, > > Philipp > > > > Von: Grainier Perera <[grain...@apache.org](mailto:grain...@apache.org)> > > Datum: Donnerstag, 19. Januar 2023 um 03:18 > > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > Betreff: Re: [ANNOUNCE] New PMC member & committer > > Congratulations Zike and Xin! > > > > Best Regards, > > Grainier Perera. > > > > On Thu, 19 Jan 2023 at 02:48, Dominik Riemer > > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > > > > > wrote: > > > > > > Hi all, > > > > > > during all the graduation tasks, I totally forgot to announce on > > > behalf > > of> > > > the PMC that Zike Yang has accepted the offer to join the PMC and Xin > > Wang> > > > has joined as a new committer. > > > Although this has already happened by the end of last year, I'd like > > > to > > > warmly welcome you and thanks a lot for contributing to our community > > > project! > > > > > > Congratulations to both of you! > > > > > > Dominik > > > > > > > > > > > >
Re: [DRAFT] January Board Report
Thanks from me as well for the work. Nothing to add :) Am Dienstag, dem 10.01.2023 um 16:13 + schrieb Dominik Riemer: > Hi Philipp, > thanks for creating the report! I don't have any comments. > > Cheers > Dominik > > > -Original Message- > From: Philipp Zehnder > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > Sent: Tuesday, January 10, 2023 9:18 AM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: [DRAFT] January Board Report > > Hi all, > > I have created a draft of the board report. Please provide feedback if I > missed something or you have something to add: > > ## Description: > The mission of Apache StreamPipes is the creation and maintenance of software > related to a self-service Industrial IoT toolbox which enables non-technical > users to connect, analyze and explore IoT data streams > > ## Issues: > No Issues > > ## Membership Data: > Apache StreamPipes was founded 2022-11-16 (2 months ago) There are currently > 24 committers and 14 PMC members in this project. > The Committer-to-PMC ratio is roughly 3:2. > > Community changes, past quarter: > - Zike Yang was added to the PMC on 2022-11-26 > - Cedric Kulbach was added as committer on 2022-12-15 > - Sven Oehler was added as committer on 2022-12-15 > - Xin Wang was added as committer on 2022-11-25 > > ## Project Activity: > - Improve the setup of GitHub to make it more friendly for new developers > - e.g. mark more issues with the tag 'good first issue' > - The project is currently in the release process for version 0.90.0 > - Last release (0.70.0) October 13, 2022 > - Code improvement, dependency update and code base cleanup > > > ## Community Health: > - Constantly growing traffic on the mailing list (November: 399, December: > 468). > - Several PRs were submitted by new developers > - Organization of the first community call for the end of January > > > Cheers, > Philipp
Re: License Header in PR notifications
+1 from me as well. definitely an improvement for the eyes ;) Am Donnerstag, dem 12.01.2023 um 06:49 + schrieb Philipp Zehnder: > +1, yes I like the idea. > > Von: Dominik Riemer > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > Datum: Mittwoch, 11. Januar 2023 um 21:46 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: License Header in PR notifications > Hi, > > should we remove the license header from the PR template? As it is included > in every email in the body, it just makes reading PR info much more > difficult, and I don't think there is any requirement to include the license > header in PR notifications. > We could simply add the PR template file to the rat exclusions. > > Cheers > DOminik
Re: Update Java Version
Hi, great, I just switched to 17 and everything is working as expected. I think an important step to be up to date with the LTS. Florian Am Dienstag, dem 03.01.2023 um 09:44 + schrieb Philipp Zehnder: > Hi all, > > we updated the Java version from 11 to 17, see [1]. > > Cheers, > Philipp > > [1] > [https://github.com/apache/streampipes/issues/1013](https://github.com/apache/streampipes/issues/1013)
Re: [ANNOUNCE] New committer - Sven Oehler and Cedric Kulbach
Hi Sven and Cedric, also welcome and congratulations from my side :) Florian Am Freitag, dem 23.12.2022 um 07:36 + schrieb Philipp Zehnder: > Hi all, > > congratulations to both of you, we are glad to have you on the team! > I'm also very excited to see the progress on the Python integration. > I think this is a great way for data scientists to better interact with IIoT > data. > > Cheers, > Philipp > > Von: Tim Bossenmaier <[bosse...@apache.org](mailto:bosse...@apache.org)> > Datum: Donnerstag, 22. Dezember 2022 um 18:01 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: [ANNOUNCE] New committer - Sven Oehler and Cedric Kulbach > Hi all, > > on behalf of the StreamPipes PPMC, it is my pleasure to inform you > that we have two new committers.Sven Oehler and Cedric Kulbach have > accepted the offer to become committers of the StreamPipes project! > Both have already contributed significantly to our Python client. For > example, Sven has written a first implementation of StreamPipes > functions, and I am personally very interested in pushing this > further. Also, Cedric has contributed a lot to the first steps towards > the Python client, e.g. he created the basic project setup and > provided us with a great skeleton for the documentation. > > Congratulations, we are very happy to have you both on board. > > Best > Tim
loosing track of too many emails about github
Hi, after moving to GitHub with the discussion and issues, my email inbox is exploding and I am loosing track of important messages. For example I did not recognise that I was asked something by mentioning my name, just because there are too many emails. On the one hand it is a good sign of activity. On the other hand I have way to many emails. So how do you organise the emails yourself? I am subscribed to the commits and dev email list. The Email notification from my GitHub account are separated from this, but still to many as well. Greetings Florian
semantic and unit description for measurement values in streampipes?
Me again, do we have somewhere an up-to-date- examples on how to implement units in StreamPipes processor elements? I found an "old"? example in the speed calculator [1] but I guess only the ontology is added here and not the units? My goal would be to add automatically measurement ontology's with the specific units like * distance in meters, distance in km etc etc * meassurments of areas m², km² * speed in km/h and so on. What kind of methods are available to me in StreamPipes to accomplish this? Greetings Florian [1] https://github.com/apache/streampipes/blob/dev/streampipes-extensions/streampipes-processors-geo-jvm/src/main/java/org/apache/streampipes/processors/geo/jvm/processor/speed/SpeedCalculatorController.java#L69
unit tests in processor elements?
Hi all, just want to update myself about unit test in the processors elemets. Do we write them, in a specific way / structure and are the test implemented in the ci build later on? So a quick overview / best practise / workflow would be good. I can summarise it in the wiki later on. Thanks Florian
Re: Notification scheme for Github issues
Hi Dominik and Philipp, I would prefer option 3 as well. But if the emails are spitted into different mailing lists, is it guaranteed that I have following structure in my emails to track every related step? ``` New Issue |–– discussion |–– discussion | |–– discussion |... | |__closed issue ``` Greetings Florian Am Mittwoch, dem 30.11.2022 um 13:58 + schrieb Philipp Zehnder: > Hi Dominik, > > I think I would prefer option 3. > Because then we see on the developer list when there are new issues, and the > comments are tracked on the issue@ mailing list. > > Cheers, > Philipp > > Von: Dominik Riemer > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > Datum: Dienstag, 29. November 2022 um 21:31 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Notification scheme for Github issues > Hi, > > before migrating to Github, our notification scheme was configured to send > all newly created issues to the dev list and all other notifications to the > issues list. > This was a tradeoff between having not too many notification mails on the dev > list while still allowing everyone on the dev list to see where work is going > on. > > When we started the migration, we changed the asf.yaml settings to send all > Github issue notifications to the issues list to avoid an email flood on > dev. > > Which settings do we want to use now? > > As far as I can see, asf.yaml supports splitting of notifications between > comment/status, so there are three options: > > 1) send all notifications related to issues to the issues list (not my > favorite since only few people are subscribed to issues@) > 2) send all notifications including issue comments to the dev list > 3) send open/close notifications to dev@ and comments to issues@ > > What do you think? > > Cheers > Dominik > > > [1] > [https://cwiki.apache.org/confluence/display/INFRA/Git+-+.asf.yaml+features](https://cwiki.apache.org/confluence/display/INFRA/Git+-+.asf.yaml+features) >
Re: talk submission for FOSSGIS 2023 ?
Hi all, just wanted to let you know that the submission was accepted. So StreamPipes will be part of the fossgis 2023. More details coming soon. Florian Am Dienstag, dem 08.11.2022 um 10:19 +0100 schrieb Florian Micklich: > Hi Dominik, > > no worries. I created a text already. I just wanted to make sure it was okay > to submit it. > > Here is the link to the submission [1]. > > The First part is a summary for the committee. > The Second part is public and can be changed later on as well. > > Greetings > Florian > > [1] > [https://pretalx.com/fossgis2023/talk/review/9SWZKV7HUHFU9UCGDKRUVZTTDYS9AFVR](https://pretalx.com/fossgis2023/talk/review/9SWZKV7HUHFU9UCGDKRUVZTTDYS9AFVR) > > > > Am Montag, dem 07.11.2022 um 17:18 + schrieb Dominik Riemer: > > Hi Florian, > > sorry, I currently don't have time to contribute, but feel free to submit > > something! > > > > Cheers > > Dominik > > > > > > -Original Message- > > From: Florian Micklich > > <[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))> > > > > Sent: Monday, November 7, 2022 2:07 PM > > To: > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > Subject: Re: talk submission for FOSSGIS 2023 ? > > > > Hi all, > > > > any votes against a submission? > > End of "call for papers" is today. > > > > Greetings > > Florian > > > > > > > > Am Montag, dem 31.10.2022 um 22:20 +0100 schrieb Florian Micklich:> > > > Hi all, > > > > > > I am thinking about to prepare a 20 min talk at the FOSSGIS 2023 in > > > > > > Berlin [1]. Sorry, the description is only in German. FOSSGIS is > > > > > > the largest German-speaking conference for Open Source Software for > > > > > > geoinformation > > > > > > The main part would be about the geo processors due the missing key > > > > > > operator reprojection is almost done. But also a good opportunity > > > > > > to show the main concept of streampipes as well. > > > > > > > > > By next Monday we would have to submit a short description [2] > > > > > > Basically what we have to do: > > > ``` > > > You write your title and a short description of what it is about. In > > > > > > the Summary text box you describe what it is about in 5-x sentences. > > > > > > The program committee will read it and evaluate your > > > submission. > > > > > > The community gets to read the description during the community > > > voting. The summary will be published in the program when the > > > presentation is accepted. If you want, you can write a longer > > > contribution for the conference proceedings (up to 5 pages with > > > pictures and so on, depending on what you want to write). You will be > > > > > > informed about this by mail. The conference proceedings have an ISBN > > > > > > and can be cited. > > > > > > ``` > > > > > > The final paper submission would be on end of January 2023. What > > > > > > do you think about it. What base information about streampipes > > > > > > should be in the talk? > > > > > > I would prepare a short description and the summary if you want and > > > > > > discuss this later as well > > > > > > > > > Greetings > > > Florian > > > > > > [1] > > > [[[https://pretalx.com/fossgis2023/cfp](https://pretalx.com/fossgis2023/](https://pretalx.com/fossgis2023/cfp](https://pretalx.com/fossgis2023/)](https://pretalx.com/fossgis2023/cfp](https://pretalx.com/fossgis2023/](https://pretalx.com/fossgis2023/cfp](https://pretalx.com/fossgis2023/)) > > > cfp) > > > > > > [2] > > > [[[https://pretalx.com/fossgis2023/submit/8WBm1D/info/](https://pretalx](https://pretalx.com/fossgis2023/submit/8WBm1D/info/](https://pretalx)](https://pretalx.com/fossgis2023/submit/8WBm1D/info/](https://pretalx](https://pretalx.com/fossgis2023/submit/8WBm1D/info/](https://pretalx)). > > > com/fossgis2023/submit/8WBm1D/info/)
Re: [DISCUSS] Plan to release StreamPipes 1.0
I added two points for usability in the discussion. A friend of mine works as a UX designer. I can ask him to take a look and give us some tips. If he does, we can discuss this in a community session maybe. Florian Am Freitag, dem 02.12.2022 um 14:30 + schrieb Dominik Riemer: > Thanks for your feedback! > > I am especially interested in the opinion from those of you haven't followed > the project for years, as you have a "fresh" view on the system: > What do you think are the biggest pain points regarding usability or where do > you see improvement potential? > > I'll start a discussion on Github and we can collect any ideas there. > > Cheers > DOminik > > > -Original Message- > From: Xin Wang <[data.xinw...@gmail.com](mailto:data.xinw...@gmail.com)> > Sent: Thursday, December 1, 2022 4:02 PM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: Re: [DISCUSS] Plan to release StreamPipes 1.0 > > Hi, > > Agree with you. I think we should focus on usability improvements and mature > APIs for the 1.0 release. It is more important for users. > Other non-critical features can be released in a later version. > > Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > 于2022年11月27日周日 03:01写道： > > > Hi, > > > > I think it really depends on the timing of when 1.0 is released. > > > > In my point if view, the geo operators should be part of the 1.0 > > release as "new features". > > And also focus on the documentation and story line using them O:-) > > > > Florian > > > > > > > > > > > > > > Am Freitag, dem 25.11.2022 um 09:27 + schrieb Philipp Zehnder:> > > > Hi, > > > > > > I am also in favor of releasing a 1.0 version soon after the 0.90.0 > > version.> > > > > > > I think we do not need any new features for the 1.0 release. My > > > suggestion would be to focus on usability improvements and bug fixes > > for the 1.0 release.> > > > Especially that we have a backward compatible system and users can > > easily update to newer versions.> > > > Do you have any ideas how we can ensure this? We need a way to test > > > that > > updates work as expected and do not break anything.> > > > It would be cool to have an automated approach to validate this for > > > each > > release.> > > > > > > Cheers, > > > Philipp > > > > > > > > > Von: Dominik Riemer > > > <[[rie...@apache.org](mailto:rie...@apache.org)](mailto:[rie...@apache.org](mailto:rie...@apache.org))> > > > Datum: Freitag, 25. November 2022 um 07:08 > > > An: > > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > > > > > <[ > > [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))>> > > > > > Betreff: Re: [DISCUSS] Plan to release StreamPipes 1.0 Hi > > > Xin, > > > > > > thanks for bringing up this important question! The current plan > > > is to release a new version soon together with the TLP > > announcement, which is currently named "0.90.0".> > > > > > > I totally agree that a 1.0 version gives more trust to users. So > > > let's > > say we would go for a 1.0 release after 0.90.0, what do you all think > > should be part of this release and what improvements should be done? > > Are any mission-critical features missing?> > > > > > > E.g., an important item on my list for the 1.0 release is increased > > > test > > coverage.> > > > > > > Cheers > > > Dominik > > > > > > > > > On 2022/11/25 05:07:54 Xin Wang wrote:> > > > > > The current StreamPipes version is 0.70. Do we have a plan to > > > > release > > 1.0?> > > > > Because 1.x version may make users feel more mature and stable, > > > > what > > do you> > > > > think? > > > > > > > > > > > > -- > > > > Thanks, > > > > Xin > > > > > > > > > -- > Thanks, > Xin
[Diskussion] Keep reversegeocoder as it it or improve?
Hi during refactoring the geo processors to the 1 class method, I had a look at the reversegeocoder processor [1] Do we want to keep is this way as it is e.g. internal download from a zip file [2]? Should we adjust it in some way and do we want to keep it this way at all? This is not a really reverse geodocer ;) Greetings Florian [1] https://github.com/apache/streampipes/blob/dev/streampipes-extensions/streampipes-processors-geo-jvm/src/main/resources/org.apache.streampipes.processor.geo.jvm.reversegeocoding/documentation.md [2] https://github.com/apache/streampipes/blob/dev/streampipes-extensions/streampipes-processors-geo-jvm/src/main/java/org/apache/streampipes/processors/geo/jvm/processor/revgeocoder/ReverseGeocoding.java#L36
Re: Add functionality of host.docker.internal for linux users?
Hi Philipp, I guess we are talking at cross purposes :) Maybe for better understanding. How does auto discovery works with the CLI installer? I thought the auto discovery is done with the host.docker.internal flag? Everything is working after configure the SP_HOST in the environment list. But this leads to a changed file in git in the ../incubator-streampipes/.idea/runConfigurations folder e.g. all_pipeline_elements_jvm.xml due this folder / files are not in the gitignore list. So I have to handle this in git all the time and for better programmer experiences I though we can add this little feature for linux users as well, so that everything is working without extra editing. Greetings Florian Am Dienstag, dem 29.11.2022 um 10:15 + schrieb Philipp Zehnder: > Hi Florian, > > ah, sorry, I thought we don't have the IP problem anymore. > You can take a look at [1], the networking class implements auto-discovery of > the IP address. > Maybe we can find a solution that will reliably determine the IP address for > Linux as well. > > In the meantime, my tip would be to set the environment variable in the IDE > so you don't have any changes in the source files. > > Cheers! > Philipp > > > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Datum: Samstag, 26. November 2022 um 20:17 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Re: Add functionality of host.docker.internal for linux users? > Hi Philipp, > > are you using Linux with the CLI installation? How is here auto discovery > possible? > So I need to set the SP_HOST variable in my environment or env file. This > constantly results in a changed file in git that I have to pay attention > every time I commit, push, ... so I don't accidentally commit it or clash > into something else. > > > As it is written here [1] on Example walkthrough for > pipeline-elements-jvm-all in IntelliJ: > -> For Linux user: You must change the environment variables stating > host.docker.internal to you local machine's IP. > > So I think this will increase compatibility for Linux users to use the > default host.docker.internal. > > ``` > > extra_hosts: > > - "host.docker.internal:host-gateway" > ``` > > Greetings > Florian > > P.S. A short poll, who uses which operating system, would be interesting > :-) > > > > [1] > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions](https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions) > > > This is a service that wraps all pipeline elements written with the standard > Java wrapper, hence the the notion of "jvm-all". > > You should automatically have a run configuration > "all-pipeline-elements-jvm" as we ship in with the repository > (Optional) Modifiy environment variables depending on your OS (this is > due to the dev setup of partly IDE and partly Docker, we need the local > services to be reachable from within the Docker network) > For Windows/Mac user: you are good to go > For Linux user: You must change the environment variables stating > host.docker.internal to you local machine's IP > Run the service > Navigate to "[http://localhost:7023/](http://localhost:7023/)" to see if > the backend is running. You should see something similar to the following: > > Am Mittwoch, dem 23.11.2022 um 16:50 + schrieb Philipp Zehnder: > > Hi Florian, > > > > what do you need “host.docker.internal” for? > > > > I usually use the auto discovery of the IP address. > > Sometimes, when I change the network, I must restart the backend, but then > > it will automatically find the correct IP address again. > > > > Cheers, > > Philipp > > > > Von: Florian Micklich > > <[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))> > > Datum: Dienstag, 22. November 2022 um 18:03 > > An: StreanPipes Dev > > <[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))> > > Betreff: Add functionality of host.docker.internal for linux users? > > Hi, > > > > unlike Windows or Mac, the host.docker.internal command is not working by > > default in Linux. > > A solution would be to add following code snippet the the docker-compose > > files [1]. > > > > > > ``` > > extra_hosts: > > - "host.docker.internal:host-gateway"
Re: Issue migration completed
Hi Tim, thanks as well for the good documentation. But I have a short question. I want to create a subtask here [1] but the option convert to issue does not appear like as described here [2] Do I miss something? Is there also another option? Greetings Florian [1] https://github.com/apache/streampipes/issues/795 [2] https://cwiki.apache.org/confluence/display/STREAMPIPES/Work+with+GitHub+issues?preview=/235835711/235835721/add-subtask.gif Am Montag, dem 28.11.2022 um 19:55 + schrieb Tim: > Hi all, > > you can now find an initial version of the "how to GitHub issues page" > in confluence [1]. > In case you miss anything, feel free to adapt or ask for help if you not > directly find the corresponding feature in GitHub. > > Best > Tim > > > [1] > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Work+with+GitHub+issues](https://cwiki.apache.org/confluence/display/STREAMPIPES/Work+with+GitHub+issues) > > Am 28.11.2022 07:53 schrieb Xin Wang: > > Thanks for the great work! > > > > Dominik Riemer > > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > > 于2022年11月28日周一 06:08写道： > > > > > > Hi Tim, > > > > > > I had a look at the new templates and they are absolutely awesome! > > > Very > > > welcoming and convenient for new users and I also like the links to > > > the > > > discussion page... > > > > > > Cheers > > > Dominik > > > > > > > > > -Original Message- > > > From: Tim <[bosse...@posteo.de](mailto:bosse...@posteo.de)> > > > Sent: Sunday, November 27, 2022 9:22 PM > > > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > > Subject: Re: Issue migration completed > > > > > > Hi all, > > > > > > I have familiarized myself a bit with GitHub Issues and prepared some > > > aspects for our future work with it: > > > > > > 1) Labels > > > During the migration from Jira to Github, we already put some thought > > > into > > > the labels we want to use from now on. > > > A list of all labels and their description can be found here [1]. > > > What are your thoughts? Are you already missing any? If not, we can > > > just > > > start with the current selection and expand it step by step if needed. > > > > > > 2) Release planning/versions > > > From what I've seen so far, GitHub milestones are good for > > > managing/scheduling our releases, just like we did with JIRA. > > > So I mapped the upcoming releases that were already in JIRA to Github, > > > > > > see > > > [2]. > > > Can you link that? Do you think we can work this way? > > > > > > 3) Issue templates > > > Github offers to possibility to provide so called "issue template" > > > that > > > allows to provide custom forms that simplifies the process for > > > external > > > people to create issues about StreamPipes. Therefore, I've created a > > > pull > > > request [3]. > > > You can see how it would like when visiting my private fork of > > > StreamPipes > > > and click on "new issue" [4]. > > > How do you like it? Would you like to change anything? Is there > > > something > > > missing? > > > I'm happy to discuss changes within the PR. > > > > > > Do you miss anything for working with GitHub issues (besides the "how > > > to" > > > manual already mentioned before)? > > > > > > Best > > > Tim > > > > > > [1] > > > [https://github.com/apache/streampipes/labels](https://github.com/apache/streampipes/labels) > > > [2] > > > [https://github.com/apache/streampipes/milestones](https://github.com/apache/streampipes/milestones) > > > [3] > > > [https://github.com/apache/streampipes/pull/807](https://github.com/apache/streampipes/pull/807) > > > [4] > > > [https://github.com/bossenti/incubator-streampipes/issues/new/choose](https://github.com/bossenti/incubator-streampipes/issues/new/choose) > > > > > > Am 26.11.2022 19:45 schrieb Florian Micklich:> > > > > > Thank you all for the work. > > > > 1307 Emails in my github folder :-P > > > > > > > > Is there a howto "create a ticket" and some basic infos somewhere? > > > > e.g. how to create a subticket, version number, assign to, basic >
Re: Add functionality of host.docker.internal for linux users?
Hi Philipp, are you using Linux with the CLI installation? How is here auto discovery possible? So I need to set the SP_HOST variable in my environment or env file. This constantly results in a changed file in git that I have to pay attention every time I commit, push, ... so I don't accidentally commit it or clash into something else. As it is written here [1] on Example walkthrough for pipeline-elements-jvm-all in IntelliJ: -> For Linux user: You must change the environment variables stating host.docker.internal to you local machine's IP. So I think this will increase compatibility for Linux users to use the default host.docker.internal. ``` > extra_hosts: > - "host.docker.internal:host-gateway" ``` Greetings Florian P.S. A short poll, who uses which operating system, would be interesting :-) [1] https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions This is a service that wraps all pipeline elements written with the standard Java wrapper, hence the the notion of "jvm-all". You should automatically have a run configuration "all-pipeline-elements-jvm" as we ship in with the repository (Optional) Modifiy environment variables depending on your OS (this is due to the dev setup of partly IDE and partly Docker, we need the local services to be reachable from within the Docker network) For Windows/Mac user: you are good to go For Linux user: You must change the environment variables stating host.docker.internal to you local machine's IP Run the service Navigate to "http://localhost:7023/; to see if the backend is running. You should see something similar to the following: Am Mittwoch, dem 23.11.2022 um 16:50 + schrieb Philipp Zehnder: > Hi Florian, > > what do you need “host.docker.internal” for? > > I usually use the auto discovery of the IP address. > Sometimes, when I change the network, I must restart the backend, but then it > will automatically find the correct IP address again. > > Cheers, > Philipp > > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Datum: Dienstag, 22. November 2022 um 18:03 > An: StreanPipes Dev > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Add functionality of host.docker.internal for linux users? > Hi, > > unlike Windows or Mac, the host.docker.internal command is not working by > default in Linux. > A solution would be to add following code snippet the the docker-compose > files [1]. > > > ``` > extra_hosts: > - "host.docker.internal:host-gateway" > ``` > > But this requires at least docker version 20.10+. > I think on our website the required docker version is 1.17. > Should we take this step and increase the version requirements to add this > functionality? > > > Greetings > Florian > > [1] > [https://github.com/docker/for-linux/issues/264#issuecomment-784985736](https://github.com/docker/for-linux/issues/264#issuecomment-784985736)
Re: open GIT Question due rebase
Ok thanks, let me know if you found out why and if the "merge" on a file i did not touch was correct. Florian Am Donnerstag, dem 24.11.2022 um 22:18 + schrieb Dominik Riemer: > Hi Florian, > thanks for finding this! We need to investigate as the last commit message > deletes a test file which should not have been deleted. > > I can have a deeper look at the PR during the weekend, or maybe somebody else > has an idea what went wrong? > > Cheers > Dominik > > On 2022/11/24 09:48:41 Florian Micklich wrote: > > Hi Dominik, > > > > I have a short git result question on you. > > > > I am working in my branch STREAMPIPES-642 and before I pushed my commits, I > > did a rebase on dev. > > During this process an odd result came up. > > I had to merge a file that I did not touch at all. > > > > As you wrote the code, can you check if I didn't mess up anything? > > Still don't know why this message occurs because it has nothing to do with > > my code changes at all. > > > > Sorry for the inconvenience. > > > > > > [https://github.com/apache/streampipes/commits/STREAMPIPES-642/streampipes-data-explorer/src/test/java/org/apache/streampipesdataexplorer/v4/query/writer](https://github.com/apache/streampipes/commits/STREAMPIPES-642/streampipes-data-explorer/src/test/java/org/apache/streampipesdataexplorer/v4/query/writer) > > > > Florian > >
Re: [DISCUSS] Plan to release StreamPipes 1.0
Hi, I think it really depends on the timing of when 1.0 is released. In my point if view, the geo operators should be part of the 1.0 release as "new features". And also focus on the documentation and story line using them O:-) Florian Am Freitag, dem 25.11.2022 um 09:27 + schrieb Philipp Zehnder: > Hi, > > I am also in favor of releasing a 1.0 version soon after the 0.90.0 > version. > > I think we do not need any new features for the 1.0 release. > My suggestion would be to focus on usability improvements and bug fixes for > the 1.0 release. > Especially that we have a backward compatible system and users can easily > update to newer versions. > Do you have any ideas how we can ensure this? We need a way to test that > updates work as expected and do not break anything. > It would be cool to have an automated approach to validate this for each > release. > > Cheers, > Philipp > > > Von: Dominik Riemer <[rie...@apache.org](mailto:rie...@apache.org)> > Datum: Freitag, 25. November 2022 um 07:08 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Re: [DISCUSS] Plan to release StreamPipes 1.0 > Hi Xin, > > thanks for bringing up this important question! > The current plan is to release a new version soon together with the TLP > announcement, which is currently named "0.90.0". > > I totally agree that a 1.0 version gives more trust to users. So let's say we > would go for a 1.0 release after 0.90.0, what do you all think should be part > of this release and what improvements should be done? Are any > mission-critical features missing? > > E.g., an important item on my list for the 1.0 release is increased test > coverage. > > Cheers > Dominik > > > On 2022/11/25 05:07:54 Xin Wang wrote: > > The current StreamPipes version is 0.70. Do we have a plan to release > > 1.0? > > Because 1.x version may make users feel more mature and stable, what do > > you > > think? > > > > > > -- > > Thanks, > > Xin > >
Re: Issue migration completed
Thank you all for the work. 1307 Emails in my github folder :-P Is there a howto "create a ticket" and some basic infos somewhere? e.g. how to create a subticket, version number, assign to, basic community rules for creating an issue. I come totally from the jira world and this info would be for everyone good. Greetings Florian Am Samstag, dem 26.11.2022 um 18:01 + schrieb Dominik Riemer: > Hi all, > > the migration of our Jira issues to Github is completed. > > All issues should be available here: > [https://github.com/apache/streampipes/issues](https://github.com/apache/streampipes/issues) > > I hope that everything went well, in case there are any errors please feel > free to reassign or modify these issues! > > For the migration, we changed the notification settings to only send mails to > [iss...@streampipes.apache.org](mailto:iss...@streampipes.apache.org), sorry > for the email spam in case you are subscribed to this list > > Thanks @Tim and Philipp for helping with the migration! > > Cheers > Dominik
[jira] [Created] (STREAMPIPES-650) Extend geo jvm processing elements
Florian Micklich created STREAMPIPES-650: Summary: Extend geo jvm processing elements Key: STREAMPIPES-650 URL: https://issues.apache.org/jira/browse/STREAMPIPES-650 Project: StreamPipes Issue Type: Task Reporter: Florian Micklich Assignee: Florian Micklich Fix For: post-1.0 Extend / Write basic geo processor elements -- This message was sent by Atlassian Jira (v8.20.10#820010)
open GIT Question due rebase
Hi Dominik, I have a short git result question on you. I am working in my branch STREAMPIPES-642 and before I pushed my commits, I did a rebase on dev. During this process an odd result came up. I had to merge a file that I did not touch at all. As you wrote the code, can you check if I didn't mess up anything? Still don't know why this message occurs because it has nothing to do with my code changes at all. Sorry for the inconvenience. https://github.com/apache/streampipes/commits/STREAMPIPES-642/streampipes-data-explorer/src/test/java/org/apache/streampipesdataexplorer/v4/query/writer Florian
Re: Apache License Header Format
Hi Tim, ah ok good to know. I though RAT is something like that. This was the name in the STREAMPIPES-590 Ticket you were working on. Florian Am Dienstag, dem 22.11.2022 um 19:11 + schrieb Tim: > Hi Florian, > > no, there is yet no automation for Apache headers in resource files. > That yould be a future improvement. > > Best > Tim > > Am 22.11.2022 12:34 schrieb Florian Micklich: > > Hi, > > > > I can answer my question by myself. > > It is Option 1. > > > > Option 2 occurs on my side because of a "wrong" automatic Copyright > > text. > > IntelliJ is creating the commends syntax itself, that leads to option > > 2. If you add the text already with comment syntax, the double comment > > is the result. > > > > I added the info in conf [1] > > > > I think there is no option to make a different profile for markdown > > files. > > But this is done via STREAMPIPES-590 anyway automatically. Am I right? > > > > Greeting > > Florian > > > > [1] > > [https://cwiki.apache.org/confluence/display/STREAMPIPES/License+Requirements](https://cwiki.apache.org/confluence/display/STREAMPIPES/License+Requirements) > > > > Am Montag, dem 21.11.2022 um 19:53 +0100 schrieb Florian Micklich:> > > > > > > Hi all, > > > > > > I saw now two difference License headers in the code. What Option is > > > correct? ( I know it is only a minor issue because it is only the > > > format) > > > > > > Option 1 > > > ``` > > > /* > > > * Licensed to the Apache Software Foundation (ASF) under one or > > > more > > > * contributor license agreements. See the NOTICE file distributed > > > with > > > * this work for additional information regarding copyright > > > ownership. > > > * The ASF licenses this file to You under the Apache License, > > > Version 2.0 > > > * (the "License"); you may not use this file except in compliance > > > with > > > * the License. You may obtain a copy of the License at > > > * > > > * > > > [[http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0)](http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0)) > > > * > > > * Unless required by applicable law or agreed to in writing, > > > software > > > * distributed under the License is distributed on an "AS IS" > > > BASIS, > > > * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or > > > implied. > > > * See the License for the specific language governing permissions > > > and > > > * limitations under the License. > > > */ > > > ``` > > > > > > > > > Option 2 > > > ``` > > > /* > > > * > > > * * Licensed to the Apache Software Foundation (ASF) under one or > > > more > > > * * contributor license agreements. See the NOTICE file distributed > > > > > > with > > > * * this work for additional information regarding copyright > > > ownership. > > > * * The ASF licenses this file to You under the Apache License, > > > Version 2.0 > > > * * (the "License"); you may not use this file except in compliance > > > with > > > * * the License. You may obtain a copy of the License at > > > * * > > > * * > > > [[http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0)](http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0)) > > > * * > > > * * Unless required by applicable law or agreed to in writing, > > > software > > > * * distributed under the License is distributed on an "AS IS" > > > BASIS, > > > * * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or > > > implied. > > > * * See the License for the specific language governing permissions > > > and > > > * * limitations under the License. > > > * * > > > * > > > */ > > > ``` > > > > > > > > > In markdown this is used. I will add the description here [1] that for > > > > > > markdown another profile has to be used. > > > ``` > > > # > > > # Licensed to the Apache Software Foundation (ASF) under one or > > >
Re: How to add Logger output in processors
Hi Dominik,
I didn't change anything but now everything working as expected.
Never mind.
Florian
Am Dienstag, dem 22.11.2022 um 19:27 + schrieb Dominik Riemer:
> There shouldn't be anything different, make sure you are using the correct
> import (org.slf4j), and have a look at the other places where we use
> logging.
>
> Dominik
>
>
>
>
> -Original Message-
> From: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)>
>
> Sent: Tuesday, November 22, 2022 8:01 PM
> To: StreanPipes Dev
> <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)>
> Subject: How to add Logger output in processors
>
> Hi, me again O:-),
>
> I am wondering how to implement a logger output in the 1 class approach.
> Is there an example somewhere of how to achieve this?
>
> I tried following code but it is not working anymore.
>
>
> Define a logger in the Class
>
> ```
> private static final Logger LOG =
> LoggerFactory.getLogger(ReprojectionProcessor.class);
> ```
>
> and then use the logger syntax as always in onInvocation or onEvent
> method.
> ```
> LOG.warn("text text text.");
> ```
>
> But there is no output at all.
>
> Can some one help please?
>
> Greetings
> Florian
>
>
Re: [DISCUSS] Setup for Coordinate Reference System Reprojection Sources
Hi Dominik, I agree. The SIS/empty database approach is pushed and I removed the commend for fallback option. Florian Am Mittwoch, dem 23.11.2022 um 06:49 + schrieb Dominik Riemer: > Hi Florian, > thanks for asking! > Then I propose to stick with the Apache SIS/empty database approach and to > not include any ProJ4j dependencies in our source. > > Cheers > Dominik > > > -Original Message- > From: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > > Sent: Tuesday, November 22, 2022 10:56 PM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: Re: [DISCUSS] Setup for Coordinate Reference System Reprojection > Sources > > Hi Dominik, > > Am Dienstag, dem 22.11.2022 um 15:12 + schrieb Dominik Riemer: > > Hi Florian, > > > > just to make sure I understand correctly: > > > > * There is an "SIS approach" which doesn't have any licensing issues > > as users would need to fill their own database and only Apache SIS > > dependencies are used in this approach > > > Yes that is correct. > > > > * There could be a fallback option which wouldn't require users to > > have their own database, but that would require pulling in Proj4j, > > which itself relies on EPSG datasets. > > Yes, that was my idea. Also to use only some basic coordinates reference > systems. > But I had the same question like you in mind so I wrote Martin (maintainer of > SIS) exactly this kind of questions. > The answer is really worth reading! I am really surprised and amazed, > because most Geo Open Source programs are based on proj4. > > > > Hello Florian > > > > Le 22/11/2022 à 18:44, Florian Micklich a écrit : > > > > > > I didn't know that proj4j itself uses EPSG data. > > > > > The CSV files in [1] are derived from EPSG tables. The file structures > > are different than EPSG database schema, but the data that they contain > > are EPSG data. The same information is also provided in WKT format in > > [2] (this file somewhat duplicates the CSV tables). Some peoples on > > PROJ mailing list have argued that rewriting EPSG data in a different > > format free them from EPSG licensing terms, but this is not true. > > Translating a software in a different language is a derivative work and > > is still subject to the licensing terms of the copyright owner. In the > > same way that translating a book does not suppress the rights of the > > original author on the translated book. In the case of EPSG data, IOGP > > allows us to reformat the data in a different way, but under some > > conditions specified in their Terms of Use. And doing so does not give > > us the right to erase the EPSG terms of use from the derivative work. > > > > The value of EPSG geodetic dataset is not in the database schema > > (converting that to a different data structure is the easy part), but > > in the data themselves. Creating a new "EPSG-like" dataset from scratch > > would be a huge effort, well beyond our capability. We would have to > > visit all national mapping agencies in the world, ask them to provide > > documentation about the Coordinate Reference System they have defined > > (including historical ones), consolidate all those information in some > > tables, etc. So the CSV files [1] in PROJ4 contain an enormous amount > > of EPSG work, even if the data structures are different. > > > > [1][https://github.com/locationtech/proj4j/tree/master/src/main/resource](https://github.com/locationtech/proj4j/tree/master/src/main/resource) > > s/proj4 > > [2][https://raw.githubusercontent.com/locationtech/proj4j/master/src/mai](https://raw.githubusercontent.com/locationtech/proj4j/master/src/mai) > > n/resources/proj4/wkt/epsg.properties > > > > > > > > Until now I thought it would be a good alternative lib besides EPSG > > > approach. > > > > > When creating a Coordinate Reference System (CRS) from an EPSG code > > such as "EPSG:4326", we are using the EPSG geodetic dataset. I think > > that if a software contains e.g. 10 EPSG codes (compared to the ~6000 > > definitions in the full dataset), it could be considered Fair Use. But > > including the full dataset requires that we comply with EPSG Terms Of > > Use. > > > > However if CRS are created from user-supplied WKT strings (or PROJ4 > > parameter strings), then no EPSG code is involved. The WKT definition > > string may contain an AUTHORITY["EPSG", 4326] element, but it only
Re: [DISCUSS] Setup for Coordinate Reference System Reprojection Sources
Hi Dominik, Am Dienstag, dem 22.11.2022 um 15:12 + schrieb Dominik Riemer: > Hi Florian, > > just to make sure I understand correctly: > > * There is an "SIS approach" which doesn't have any licensing issues as users > would need to fill their own database and only Apache SIS dependencies are > used in this approach Yes that is correct. > * There could be a fallback option which wouldn't require users to have their > own database, but that would require pulling in Proj4j, which itself relies > on EPSG datasets. Yes, that was my idea. Also to use only some basic coordinates reference systems. But I had the same question like you in mind so I wrote Martin (maintainer of SIS) exactly this kind of questions. The answer is really worth reading! I am really surprised and amazed, because most Geo Open Source programs are based on proj4. >Hello Florian > >Le 22/11/2022 à 18:44, Florian Micklich a écrit : > >> I didn't know that proj4j itself uses EPSG data. >> >The CSV files in [1] are derived from EPSG tables. The file structures >are different than EPSG database schema, but the data that they contain >are EPSG data. The same information is also provided in WKT format in >[2] (this file somewhat duplicates the CSV tables). Some peoples on PROJ >mailing list have argued that rewriting EPSG data in a different format >free them from EPSG licensing terms, but this is not true. Translating a >software in a different language is a derivative work and is still >subject to the licensing terms of the copyright owner. In the same way >that translating a book does not suppress the rights of the original >author on the translated book. In the case of EPSG data, IOGP allows us >to reformat the data in a different way, but under some conditions >specified in their Terms of Use. And doing so does not give us the right >to erase the EPSG terms of use from the derivative work. > >The value of EPSG geodetic dataset is not in the database schema >(converting that to a different data structure is the easy part), but in >the data themselves. Creating a new "EPSG-like" dataset from scratch >would be a huge effort, well beyond our capability. We would have to >visit all national mapping agencies in the world, ask them to provide >documentation about the Coordinate Reference System they have defined >(including historical ones), consolidate all those information in some >tables, etc. So the CSV files [1] in PROJ4 contain an enormous amount of >EPSG work, even if the data structures are different. > >[1]https://github.com/locationtech/proj4j/tree/master/src/main/resources/proj4 >[2]https://raw.githubusercontent.com/locationtech/proj4j/master/src/main/resources/proj4/wkt/epsg.properties > > >> Until now I thought it would be a good alternative lib besides EPSG >> approach. >> >When creating a Coordinate Reference System (CRS) from an EPSG code such >as "EPSG:4326", we are using the EPSG geodetic dataset. I think that if >a software contains e.g. 10 EPSG codes (compared to the ~6000 >definitions in the full dataset), it could be considered Fair Use. But >including the full dataset requires that we comply with EPSG Terms Of Use. > >However if CRS are created from user-supplied WKT strings (or PROJ4 >parameter strings), then no EPSG code is involved. The WKT definition >string may contain an AUTHORITY["EPSG", 4326] element, but it only means >"see EPSG:4326 for more complete information". > > >> So what would be your advise with proj4(j) and how to handle that kind >> of implementation in an Apache project? >> >EPSG geodetic dataset is not needed when the CRS is built from WKT, GML >or some file formats like NetCDF and some (not all) GeoTIFF files. So >the approach taken in Apache SIS applications (JavaFX and console >application) is to start without EPSG data. Then the first time that an >EPSG code is really needed, the application popups a dialog box (in >JavaFX) or an interactive prompt (in console application) asking users >if they want to download the EPSG geodetic dataset. If users click >"yes", the EPSG Terms of Use is shown and the application asks users if >they accept. If they confirm, then the EPSG geodetic dataset is >downloaded and a database is created locally. > >Note that above procedure is needed only for software downloaded >directly from Apache servers. Anyone can bundle an application outside >Apache which contains the Apache software + EPSG data. The only >condition for being allowed to do that is to include the EPSG Terms of >Use (in addition of Apache license) in the application bundle. > > >> Officially it is running on MI
How to add Logger output in processors
Hi, me again O:-),
I am wondering how to implement a logger output in the 1 class approach.
Is there an example somewhere of how to achieve this?
I tried following code but it is not working anymore.
Define a logger in the Class
```
private static final Logger LOG =
LoggerFactory.getLogger(ReprojectionProcessor.class);
```
and then use the logger syntax as always in onInvocation or onEvent method.
```
LOG.warn("text text text.");
```
But there is no output at all.
Can some one help please?
Greetings
Florian
Add functionality of host.docker.internal for linux users?
Hi, unlike Windows or Mac, the host.docker.internal command is not working by default in Linux. A solution would be to add following code snippet the the docker-compose files [1]. ``` extra_hosts: - "host.docker.internal:host-gateway" ``` But this requires at least docker version 20.10+. I think on our website the required docker version is 1.17. Should we take this step and increase the version requirements to add this functionality? Greetings Florian [1] https://github.com/docker/for-linux/issues/264#issuecomment-784985736
Re: [DISCUSS] Setup for Coordinate Reference System Reprojection Sources
Hi, I found an interesting post regarding proj4j. That's why I prefer the SIS approach with external database. What do you think about the mentioned "copyright infringement" opinion? PROJ claims to be under MIT license, but in my understanding this is copyright infringement. PROJ license should be MIT + EPSG terms of use. The whole post is: > Proj4J (and its parent PROJ project) includes EPSG > data, so the use of Proj4J dependency implies accepting EPSG terms of > use [1]. PROJ claims to be under MIT license, but in my understanding > this is copyright infringement. PROJ license should be MIT + EPSG terms > of use. > > EPSG terms of use is a Category X license for Apache. The use of EPSG > data has been discussed in Apache Legal [2][3]. The conclusion was that > an Apache project can include EPSG data if they are optional (i.e. the > application can still do useful work without them), the main release > does not contain them, and the data are available in a separated > download prominently labelled as under a more restrictive license than > Apache. > > [1]https://epsg.org/terms-of-use.html > > [2]https://issues.apache.org/jira/browse/LEGAL-183 > > [3]https://issues.apache.org/jira/browse/LEGAL-347 > Am Freitag, dem 18.11.2022 um 22:27 +0100 schrieb Florian Micklich: > Hi, > > the basic sis implementation is done :) > I created a pull request [1] and happy about any feedback. > > > Form the fallback options I created this ticket [2] > > Florian > > [1] > [https://github.com/apache/streampipes/pull/146](https://github.com/apache/streampipes/pull/146) > [2] > [https://issues.apache.org/jira/browse/STREAMPIPES-638](https://issues.apache.org/jira/browse/STREAMPIPES-638) > > > Am Montag, dem 31.10.2022 um 13:23 +0100 schrieb Florian Micklich: > > Hi, > > > > I updated the Jira Ticket and described the setup little bit more. > > If my intellij is working I can run some last tests on the base > > implementation. > > > > My thoughts for the setup implementation: > > > > The setup could be visible in the Configuration -> Pipeline Element > > Configuration and if the service is available due correct setup and scripts > > import. > > (see picture in jira ticket > > > > > > To have still a plug and play system by default, we could implement a > > "fallback" projection system with a limited EPSG Codes. > > Therefore we could use proj4j [2]. > > So for example we allow the user to select just a bunch of valid codes from > > a list somewhere. > > > > > > [1] > > [[https://github.com/locationtech/proj4j](https://github.com/locationtech/proj4j)](https://github.com/locationtech/proj4j](https://github.com/locationtech/proj4j)) > > > > What do you think? > > Greetings > > Florian > > > > Am Montag, dem 19.09.2022 um 10:18 +0200 schrieb Florian Micklich:> > > > Hi Philipp, > > > > > > ok, maybe we can have a deeper discussion next week. > > > I am on vacation this week without computer :) > > > > > > With dataSource I mean the "Registration by Java code" as describet here > > > [1]. > > > I startet to write that code yesterday but was not able to check it due > > > another issue. > > > > > > Florian > > > > > > > > > [1] > > > [[[https://sis.apache.org/epsg.html](https://sis.apache.org/epsg.html)](https://sis.apache.org/epsg.html](https://sis.apache.org/epsg.html))](https://sis.apache.org/epsg.html](https://sis.apache.org/epsg.html)](https://sis.apache.org/epsg.html](https://sis.apache.org/epsg.html))) > > > > > > > > > BlueMail for Android herunterladen > > > > > > Am 19. Sept. 2022, 07:23, um 07:23, Philipp Zehnder > > > <[[[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)](mailto:[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai))](mailto:[[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)](mailto:[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)))> > > > schrieb:> > > > > > > Hi Florian, > > > > > > > > thanks for opening the issue. > > > > I really like the illustration, something like this would also be > > > > great > > > > for the documentation of the processing elements. > > > > > > > > As for the workflow, I'm not quite sure how we can handle that. > > > > Because > > > > so far, the idea is that the system is pl
Re: unclear/missleading example code writing own processor on website
Hi,
I found the error.
The two variables were not defined and the mapping method was also missing in
the final example.
I added the new class in the jira ticket [1]
Before I adjust the example on the website I would like to start a discussion
about the variable names in this example.
For better understanding we should change the variable names depending on the
usage.
In the geofence example there are this variables in my fixed version:
```
// VARIABLES FOR INTERNAL NAME USAGE
private static final String LATITUDE_INTERNAL_NAME = "latitude-key";
private static final String LONGITUDE_INTERNAL_NAME = "longitude-key";
private static final String LATITUDE_CENTER = "latitude-center";
private static final String LONGITUDE_CENTER = "longitude-center";
// VALUES FROM THE STREAM REQUIREMENTS (HAS TO BE STRING) TO MAP INTO
onInvocation
private String latitudeFieldMapper;
private String longitudeFieldMapper;
// VALUES FROM THE USER INPUT PARAMETERS
private float centerLatitude;
private float centerLongitude;
private int radius;
// THE VARIABLES FROM THE EVENT VALUES ITSELF ARE DEFINED IN THE onEvent
method
```
So we have 5 types of variables usage:
1) store the *internal name* usage -> String name_INTERNAL_NAME
2) store the *field mapper* usage -> String nameFieldMapper
3) store the *user field* parameter usage -> TYPE name
4) store the event stream variables in the onEvent method usage -> Type name
5) store *runtime names* to add to the stream description in the
outputStrategie (this example is missing in the example) -> String NAME_RUNTIME
What do you think?
Greetings
Florian
[1] https://issues.apache.org/jira/browse/STREAMPIPES-643
Am Montag, dem 21.11.2022 um 18:42 +0100 schrieb Florian Micklich:
> Hi all,
>
> I just wondering on the example with the 1 class processor here [1] [2].
> I think something is odd or I don't get it.
>
> In the description is mentioned that
>
> Next, we are interested in the fields of the input event stream that contains
> the latitude and longitude value we would like to compute against the
> geofence center location as follows:
>
> ```
> String latitudeFieldName =
> extractor.mappingPropertyValue("latitude-field");
> String longitudeFieldName =
> extractor.mappingPropertyValue("longitude-field");
> ```
>
> 1) Shouldn't it be:
> ```
> String latitudeFieldName =
> parameters.extractor().mappingPropertyValue("latitude-field");
> String longitudeFieldName =
> parameters.extractor().mappingPropertyValue("longitude-field");
>
> ```
> 2) But this code snippet is missing in "Your controller class should look as
> follows" example.
>
>
> 3)
> The latitudeFieldName is used in the onEvent Method as
>
> ```
> float latitude =
> event.getFieldBySelector(latitudeFieldName).getAsPrimitive().getAsFloat();
> float longitude =
> event.getFieldBySelector(longitudeFieldName).getAsPrimitive().getAsFloat();
> ```
> But the variables can not be resolved. So how to get the example work?
> Example Code in ticket [3]
>
> Greeting
> Florian
>
> [1]
> [https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html](https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html)
> [2]
> [https://github.com/apache/streampipes-website/blob/dev/documentation/docs/06_extend-tutorial-data-processors.md](https://github.com/apache/streampipes-website/blob/dev/documentation/docs/06_extend-tutorial-data-processors.md)
> [3]
> [https://issues.apache.org/jira/browse/STREAMPIPES-643](https://issues.apache.org/jira/browse/STREAMPIPES-643)
Re: Apache License Header Format
Hi, I can answer my question by myself. It is Option 1. Option 2 occurs on my side because of a "wrong" automatic Copyright text. IntelliJ is creating the commends syntax itself, that leads to option 2. If you add the text already with comment syntax, the double comment is the result. I added the info in conf [1] I think there is no option to make a different profile for markdown files. But this is done via STREAMPIPES-590 anyway automatically. Am I right? Greeting Florian [1] https://cwiki.apache.org/confluence/display/STREAMPIPES/License+Requirements Am Montag, dem 21.11.2022 um 19:53 +0100 schrieb Florian Micklich: > > Hi all, > > I saw now two difference License headers in the code. What Option is correct? > ( I know it is only a minor issue because it is only the format) > > Option 1 > ``` > /* > * Licensed to the Apache Software Foundation (ASF) under one or more > * contributor license agreements. See the NOTICE file distributed with > * this work for additional information regarding copyright ownership. > * The ASF licenses this file to You under the Apache License, Version > 2.0 > * (the "License"); you may not use this file except in compliance with > * the License. You may obtain a copy of the License at > * > * > [http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0) > * > * Unless required by applicable law or agreed to in writing, software > * distributed under the License is distributed on an "AS IS" BASIS, > * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or > implied. > * See the License for the specific language governing permissions and > * limitations under the License. > */ > ``` > > > Option 2 > ``` > /* > * > * * Licensed to the Apache Software Foundation (ASF) under one or more > * * contributor license agreements. See the NOTICE file distributed > with > * * this work for additional information regarding copyright ownership. > * * The ASF licenses this file to You under the Apache License, Version > 2.0 > * * (the "License"); you may not use this file except in compliance with > * * the License. You may obtain a copy of the License at > * * > * * > [http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0) > * * > * * Unless required by applicable law or agreed to in writing, software > * * distributed under the License is distributed on an "AS IS" BASIS, > * * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or > implied. > * * See the License for the specific language governing permissions and > * * limitations under the License. > * * > * > */ > ``` > > > In markdown this is used. I will add the description here [1] that for > markdown another profile has to be used. > ``` > # > # Licensed to the Apache Software Foundation (ASF) under one or more > # contributor license agreements. See the NOTICE file distributed with > # this work for additional information regarding copyright ownership. > # The ASF licenses this file to You under the Apache License, Version 2.0 > # (the "License"); you may not use this file except in compliance with > # the License. You may obtain a copy of the License at > # > # > [http://www.apache.org/licenses/LICENSE-2.0](http://www.apache.org/licenses/LICENSE-2.0) > # > # Unless required by applicable law or agreed to in writing, software > # distributed under the License is distributed on an "AS IS" BASIS, > # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > # See the License for the specific language governing permissions and > # limitations under the License. > # > ``` > > Greetings > Florian > > [1] > [https://cwiki.apache.org/confluence/display/STREAMPIPES/License+Requirements](https://cwiki.apache.org/confluence/display/STREAMPIPES/License+Requirements)
Apache License Header Format
Hi all, I saw now two difference License headers in the code. What Option is correct? ( I know it is only a minor issue because it is only the format) Option 1 ``` /* * Licensed to the Apache Software Foundation (ASF) under one or more * contributor license agreements. See the NOTICE file distributed with * this work for additional information regarding copyright ownership. * The ASF licenses this file to You under the Apache License, Version 2.0 * (the "License"); you may not use this file except in compliance with * the License. You may obtain a copy of the License at * * http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. * See the License for the specific language governing permissions and * limitations under the License. */ ``` Option 2 ``` /* * * * Licensed to the Apache Software Foundation (ASF) under one or more * * contributor license agreements. See the NOTICE file distributed with * * this work for additional information regarding copyright ownership. * * The ASF licenses this file to You under the Apache License, Version 2.0 * * (the "License"); you may not use this file except in compliance with * * the License. You may obtain a copy of the License at * * * *http://www.apache.org/licenses/LICENSE-2.0 * * * * Unless required by applicable law or agreed to in writing, software * * distributed under the License is distributed on an "AS IS" BASIS, * * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. * * See the License for the specific language governing permissions and * * limitations under the License. * * * */ ``` In markdown this is used. I will add the description here [1] that for markdown another profile has to be used. ``` # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. # The ASF licenses this file to You under the Apache License, Version 2.0 # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # #http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # ``` Greetings Florian [1] https://cwiki.apache.org/confluence/display/STREAMPIPES/License+Requirements
unclear/missleading example code writing own processor on website
Hi all,
I just wondering on the example with the 1 class processor here [1] [2].
I think something is odd or I don't get it.
In the description is mentioned that
Next, we are interested in the fields of the input event stream that contains
the latitude and longitude value we would like to compute against the geofence
center location as follows:
```
String latitudeFieldName = extractor.mappingPropertyValue("latitude-field");
String longitudeFieldName = extractor.mappingPropertyValue("longitude-field");
```
1) Shouldn't it be:
```
String latitudeFieldName =
parameters.extractor().mappingPropertyValue("latitude-field");
String longitudeFieldName =
parameters.extractor().mappingPropertyValue("longitude-field");
```
2) But this code snippet is missing in "Your controller class should look as
follows" example.
3)
The latitudeFieldName is used in the onEvent Method as
```
float latitude =
event.getFieldBySelector(latitudeFieldName).getAsPrimitive().getAsFloat();
float longitude =
event.getFieldBySelector(longitudeFieldName).getAsPrimitive().getAsFloat();
```
But the variables can not be resolved. So how to get the example work?
Example Code in ticket [3]
Greeting
Florian
[1]
https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html
[2]
https://github.com/apache/streampipes-website/blob/dev/documentation/docs/06_extend-tutorial-data-processors.md
[3] https://issues.apache.org/jira/browse/STREAMPIPES-643
[jira] [Created] (STREAMPIPES-643) unclear missleading example code writing own processor on website
Florian Micklich created STREAMPIPES-643:
Summary: unclear missleading example code writing own processor
on website
Key: STREAMPIPES-643
URL: https://issues.apache.org/jira/browse/STREAMPIPES-643
Project: StreamPipes
Issue Type: Task
Reporter: Florian Micklich
Attachments: GeofencingProcessor.java
I just wondering on the example with the 1 class processor here [1] [2].
In the description is mentioned that
Next, we are interested in the fields of the input event stream that contains
the latitude and longitude value we would like to compute against the geofence
center location as follows:
{code:java}
String latitudeFieldName = extractor.mappingPropertyValue("latitude-field");
String longitudeFieldName = extractor.mappingPropertyValue("longitude-field");
{code}
1) Shouldn't it be:
{code:java}
String latitudeFieldName =
parameters.extractor().mappingPropertyValue("latitude-field");
String longitudeFieldName =
parameters.extractor().mappingPropertyValue("longitude-field");
{code}
2) But this code snippet is is missing in "Your controller class should look
as follows" example.
3) The latitudeFieldName is used in the onEvent Method as
{code:java}
float latitude =
event.getFieldBySelector(latitudeFieldName).getAsPrimitive().getAsFloat();
float longitude =
event.getFieldBySelector(longitudeFieldName).getAsPrimitive().getAsFloat();
{code}
But the variables can not be resolved.
I but the example code into a file but better overview
[^GeofencingProcessor.java]
[1]
https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html
[2]
https://github.com/apache/streampipes-website/blob/dev/documentation/docs/06_extend-tutorial-data-processors.md
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
Re: new way to write processors?
Hi,
i started with the epsg processor to convert it to the 1-class processor model.
I really like the way to have everything in one class.
Two questions have arisen in the process.
1)
So if the 3 class are not required, what is the best practise for the folder
structure?
All in one folder or still one subfolder.
```
processor
|
|–– processor1.java
|__ processor2.java
processor
|
|__ awesomenamefolderforfirstsprocessor
| |___ processor1.java
|
|__ awesomenamefolderforsecondsprocessor
| processor2.java
```
If first option, how to handle the resources path. They would be all the same.
Also the description in the declare method?
Forget this question if it is option 2. ^^
2)
In the init file [1] I also get a deprecated message.
`org.apache.streampipes.container.standalone.init.StandaloneModelSubmitter is
deprecated`
What structural change has to be done here?
On the website in the declare method the "old" Labels.from is mentioned instead
of Labels.withId.
Should I change this on the website?
Greetings
Florian
[1]
https://github.com/apache/streampipes/blob/STREAMPIPES-642/streampipes-extensions/streampipes-processors-geo-jvm/src/main/java/org/apache/streampipes/processors/geo/jvm/GeoJvmInit.java
Am Samstag, dem 19.11.2022 um 15:47 +0100 schrieb Florian Micklich:
> Hi Tim,
>
> oh no, I didn't check that side before.
> I will have a look and "rewrite" the simple epsg geo-jvm processor, so I know
> what to do.
> I have some more geo processors up my sleeve after the reprojection is
> complete.
>
> So a good way to learn it :)
> If I have any questions I let you know ^^
>
> Greetings
> Florian
>
> Am Samstag, dem 19.11.2022 um 14:16 + schrieb Tim:
> > Hi Florian,
> >
> > indeed it is.
> > Processing elements can now be defined by only implementing one
> > class.
> > You find a detailed description for that here:
> > [[https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html](https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html)](https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html](https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html))
> >
> > We are also working on refactoring all processing elements to only use
> >
> > the approach
> > ([[https://issues.apache.org/jira/browse/STREAMPIPES-615](https://issues.apache.org/jira/browse/STREAMPIPES-615)](https://issues.apache.org/jira/browse/STREAMPIPES-615](https://issues.apache.org/jira/browse/STREAMPIPES-615))),
> > but that will probably take some time ;)
> > So there is no need to hurry with switching to the new approach.
> > Anyways, I will try to improve the deprecation warning so that it is
> >
> > more explanatory and directly guides to the tutorial.
> >
> > Best
> > Tim
> >
> > Am 19.11.2022 13:59 schrieb Florian Micklich:>
> > > Hi,
> > >
> > > i just wanted to refactor some "older" geo processors and got
> > > following messages about the 3 class structure:
> > >
> > >
> > > ```
> > > Processor:
> > > 'org.apache.streampipes.wrapper.runtime.EventProcessor' is
> > > deprecated
> > > and marked for removal
> > >
> > > Controller:
> > > public class X extends StandaloneEventProcessingDeclarer
> > > {
> > >
> > >
> > > Parameter:
> > > 'org.apache.streampipes.wrapper.params.binding.EventProcessorBindingParams'
> > > is deprecated and marked for removal.
> > > ```
> > >
> > >
> > > Is there a new way how to code processors?
> > >
> > >
> > > Greetings
> > > Florian
[jira] [Created] (STREAMPIPES-642) 1-class processor model and stylechecks on all processors.geo.jvm
Florian Micklich created STREAMPIPES-642: Summary: 1-class processor model and stylechecks on all processors.geo.jvm Key: STREAMPIPES-642 URL: https://issues.apache.org/jira/browse/STREAMPIPES-642 Project: StreamPipes Issue Type: Task Reporter: Florian Micklich Assignee: Florian Micklich Started with setEPSG Processor and validate result check GeoJvmInit -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (STREAMPIPES-641) Improve Distance Calculator with more accuracy
Florian Micklich created STREAMPIPES-641: Summary: Improve Distance Calculator with more accuracy Key: STREAMPIPES-641 URL: https://issues.apache.org/jira/browse/STREAMPIPES-641 Project: StreamPipes Issue Type: Improvement Reporter: Florian Micklich Assignee: Florian Micklich Attachments: City_Koords.csv at the moment the Haversine formula is used to calculate the distance between 2 lat/lng spherical points. Using the Vincenty solutions leads to a more accurate result https://github.com/apache/streampipes/tree/dev/streampipes-extensions/streampipes-processors-geo-jvm/src/main/java/org/apache/streampipes/processors/geo/jvm/processor/staticdistancecalculator The distance is calculated from a static point Berlin lat 52.520008 lng 13.404954 ||city|| distance_sp|| distance Vincenty || alpha || |Karlsruhe| 524.871 | 525.735 | -0.864 | | Sidney | 16094.221| 16088.138 | 6.083 | |Hamburg | 255.306 | 256.015 | -0.709 | | New York | 6384.996 | 6402.425 | -17.429 | Backgroundinfo https://www.neovasolutions.com/2019/10/04/haversine-vs-vincenty-which-is-the-best/ Testdata: [^City_Koords.csv] -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: new way to write processors?
Hi Tim,
oh no, I didn't check that side before.
I will have a look and "rewrite" the simple epsg geo-jvm processor, so I know
what to do.
I have some more geo processors up my sleeve after the reprojection is complete.
So a good way to learn it :)
If I have any questions I let you know ^^
Greetings
Florian
Am Samstag, dem 19.11.2022 um 14:16 + schrieb Tim:
> Hi Florian,
>
> indeed it is.
> Processing elements can now be defined by only implementing one class.
> You find a detailed description for that here:
> [https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html](https://streampipes.apache.org/docs/docs/extend-tutorial-data-processors.html)
>
> We are also working on refactoring all processing elements to only use
> the approach
> ([https://issues.apache.org/jira/browse/STREAMPIPES-615](https://issues.apache.org/jira/browse/STREAMPIPES-615)),
> but that will probably take some time ;)
> So there is no need to hurry with switching to the new approach.
> Anyways, I will try to improve the deprecation warning so that it is
> more explanatory and directly guides to the tutorial.
>
> Best
> Tim
>
> Am 19.11.2022 13:59 schrieb Florian Micklich:
> > Hi,
> >
> > i just wanted to refactor some "older" geo processors and got
> > following messages about the 3 class structure:
> >
> >
> > ```
> > Processor:
> > 'org.apache.streampipes.wrapper.runtime.EventProcessor' is deprecated
> > and marked for removal
> >
> > Controller:
> > public class X extends StandaloneEventProcessingDeclarer {
> >
> >
> > Parameter:
> > 'org.apache.streampipes.wrapper.params.binding.EventProcessorBindingParams'
> > is deprecated and marked for removal.
> > ```
> >
> >
> > Is there a new way how to code processors?
> >
> >
> > Greetings
> > Florian
new way to write processors?
Hi,
i just wanted to refactor some "older" geo processors and got following
messages about the 3 class structure:
```
Processor:
'org.apache.streampipes.wrapper.runtime.EventProcessor' is deprecated and
marked for removal
Controller:
public class X extends StandaloneEventProcessingDeclarer {
Parameter:
'org.apache.streampipes.wrapper.params.binding.EventProcessorBindingParams' is
deprecated and marked for removal.
```
Is there a new way how to code processors?
Greetings
Florian
Re: [DISCUSS] Setup for Coordinate Reference System Reprojection Sources
Hi, the basic sis implementation is done :) I created a pull request [1] and happy about any feedback. Form the fallback options I created this ticket [2] Florian [1] https://github.com/apache/streampipes/pull/146 [2] https://issues.apache.org/jira/browse/STREAMPIPES-638 Am Montag, dem 31.10.2022 um 13:23 +0100 schrieb Florian Micklich: > Hi, > > I updated the Jira Ticket and described the setup little bit more. > If my intellij is working I can run some last tests on the base > implementation. > > My thoughts for the setup implementation: > > The setup could be visible in the Configuration -> Pipeline Element > Configuration and if the service is available due correct setup and scripts > import. > (see picture in jira ticket > > > To have still a plug and play system by default, we could implement a > "fallback" projection system with a limited EPSG Codes. > Therefore we could use proj4j [2]. > So for example we allow the user to select just a bunch of valid codes from a > list somewhere. > > > [1] > [https://github.com/locationtech/proj4j](https://github.com/locationtech/proj4j) > > What do you think? > Greetings > Florian > > Am Montag, dem 19.09.2022 um 10:18 +0200 schrieb Florian Micklich: > > Hi Philipp, > > > > ok, maybe we can have a deeper discussion next week. > > I am on vacation this week without computer :) > > > > With dataSource I mean the "Registration by Java code" as describet here > > [1]. > > I startet to write that code yesterday but was not able to check it due > > another issue. > > > > Florian > > > > > > [1] > > [[https://sis.apache.org/epsg.html](https://sis.apache.org/epsg.html)](https://sis.apache.org/epsg.html](https://sis.apache.org/epsg.html)) > > > > > > BlueMail for Android herunterladen > > > > Am 19. Sept. 2022, 07:23, um 07:23, Philipp Zehnder > > <[[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)](mailto:[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai))> > > schrieb:> > > > Hi Florian, > > > > > > thanks for opening the issue. > > > I really like the illustration, something like this would also be > > > great > > > for the documentation of the processing elements. > > > > > > As for the workflow, I'm not quite sure how we can handle that. > > > Because > > > so far, the idea is that the system is plug and play. > > > The normal ‘user’ should not have to configure things on the > > > system > > > before it is used. > > > My suggestion would be to have a separate service that can > > > optionally > > > be integrated by manually adding it to the docker-compose. > > > In this docker service a volume mapping would be required. If the > > > files > > > are missing a message should be printed to the logs. > > > > > > What do you mean by connection source? > > > > > > Cheers, > > > Philipp > > > > > > > > > > > > Von: Florian Micklich > > > <[[florian.mickl...@mailbox.org.INVALID](mailto:florian.mickl...@mailbox.org.INVALID)](mailto:[florian.mickl...@mailbox.org.INVALID](mailto:florian.mickl...@mailbox.org.INVALID))> > > > Datum: Sonntag, 18. September 2022 um 12:44 > > > An: dev > > > <[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))> > > > Betreff: [DISCUSS] Setup for Coordinate Reference System > > > Reprojection > > > Sources > > > Hi everybody, > > > > > > I created a Ticket [1] to implement projection handling for geo > > > operations. > > > > > > User case.: > > > > > > Reproject betwwen WGS84 (with units Degree) to UTM (Unit meter). > > > With meter you can do calculations , which needs a metric Unit > > > system > > > e.g. area calculation, everything with distance and so on. > > > > > > I also added a short wortkflow picture for better understanding and > > > a > > > docker-compose file for SP Service. > > > > > > While I am working on the processor itself, I have a couple of > > > questions and would need support for implementing everything in the > > > the > > > SP UI and discuss best ways how to set up! > > > > > > Any ideas or questions? > > > > > > Greetings > > > Florian > > > > > > [1] > > > [[https://issues.apache.org/jira/browse/STREAMPIPES-584](https://issues.apache.org/jira/browse/STREAMPIPES-584)](https://issues.apache.org/jira/browse/STREAMPIPES-584](https://issues.apache.org/jira/browse/STREAMPIPES-584))
[jira] [Created] (STREAMPIPES-638) Add fallback options for georeferencing via proj4j
Florian Micklich created STREAMPIPES-638: Summary: Add fallback options for georeferencing via proj4j Key: STREAMPIPES-638 URL: https://issues.apache.org/jira/browse/STREAMPIPES-638 Project: StreamPipes Issue Type: Improvement Reporter: Florian Micklich Assignee: Florian Micklich If the SIS DB is not startet a fallback option for some basic mathematic reprojection options should be implemented therefore use https://github.com/locationtech/proj4j should be used but is not in standard OGC CRS WKT -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: Post-graduation tasks
Hi Dominik, I think you forgot Apache in the URL. Am i right? https://github.com/apache/streampipes aka https://github.com/apache/streampipes.git https://github.com/apache/streampipes-website aka https://github.com/apache/streampipes-website.git https://github.com/apache/streampipes-examples aka https://github.com/apache/streampipes-examples.git Greetings Florian Am Freitag, dem 18.11.2022 um 14:17 + schrieb Dominik Riemer: > Hi, > our repos have now been renamed: > github.com/streampipes > github.com/streampipes-website > github.com/streampipes-examples. > > Please make sure to update your remotes ;-) > > Cheers > Dominik > > On 2022/11/18 08:33:54 Dominik Riemer wrote: > > Hi all, > > > > it is my pleasure to inform you that the ASF board has decided to promote > > StreamPipes to a top-level project. Congratulations to everyone! > > > > From now on, our previous PPMC forms the new Apache StreamPipes PMC. > > > > We will prepare and publish an official announcement, but before a few > > steps are needed. the most significant change is that our git remotes will > > change from apache/incubator-streampipes to apache/streampipes (and all > > other repos as well). > > I’ll ask Infra to move the repos and will write to the list once this is > > done. Everyone will need to change the git remotes afterwards. > > > > For the remaining tasks, I created a checklist in confluence [1] and a task > > in Jira [2] where we can collect all subtasks related to transferring our > > resources out of the incubator. Please add or ask in case you have any > > additional items! > > > > For our plan to prepare a small release right after graduation and before > > the graduation announcement, I updated the Jira roadmap for the next > > version and closed outdated tickets. Feel free to change anything I might > > have closed for no reason > > > > So thank you again all for your great effort during the last years and a > > big thank you to our mentors and our champion Chris for helping us navigate > > through the incubation process!! Looking forward to the next phase. > > > > Cheers > > Dominik > > > > > > > > [1] > > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Graduate+to+a+TLP](https://cwiki.apache.org/confluence/display/STREAMPIPES/Graduate+to+a+TLP) > > [2] > > [https://issues.apache.org/jira/browse/STREAMPIPES-632](https://issues.apache.org/jira/browse/STREAMPIPES-632) > >
Re: Post-graduation tasks
Hi Dominik, this are really good news. Congratulations and a big thank you to Philipp and you. Without you the project would not be possible! I hope you celebrate and pop the champagne corks :-D Cheers Florian Am Freitag, dem 18.11.2022 um 08:33 + schrieb Dominik Riemer: > Hi all, > > it is my pleasure to inform you that the ASF board has decided to promote > StreamPipes to a top-level project. Congratulations to everyone! > > From now on, our previous PPMC forms the new Apache StreamPipes PMC. > > We will prepare and publish an official announcement, but before a few steps > are needed. the most significant change is that our git remotes will change > from apache/incubator-streampipes to apache/streampipes (and all other repos > as well). > I’ll ask Infra to move the repos and will write to the list once this is > done. Everyone will need to change the git remotes afterwards. > > For the remaining tasks, I created a checklist in confluence [1] and a task > in Jira [2] where we can collect all subtasks related to transferring our > resources out of the incubator. Please add or ask in case you have any > additional items! > > For our plan to prepare a small release right after graduation and before the > graduation announcement, I updated the Jira roadmap for the next version and > closed outdated tickets. Feel free to change anything I might have closed for > no reason > > So thank you again all for your great effort during the last years and a big > thank you to our mentors and our champion Chris for helping us navigate > through the incubation process!! Looking forward to the next phase. > > Cheers > Dominik > > > > [1] > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Graduate+to+a+TLP](https://cwiki.apache.org/confluence/display/STREAMPIPES/Graduate+to+a+TLP) > [2] > [https://issues.apache.org/jira/browse/STREAMPIPES-632](https://issues.apache.org/jira/browse/STREAMPIPES-632)
[DISCUSSION] Best practise Github
Hi all, we had a discussion moving everything to github and using also the github comment function. I don't no much about these functionality atm. I think we should write something like a best practise wiki, so that future developers and me :) knows what to do and how to behave O:-) We should also mentioned best tools to make these steps easier for everyone or do you use the web-gui only to keep track of all discussions? For example. I code on branch STREAMPIPES-584 and committed the basic implementation. I am not finished yet but still a good situations for discussion. How do we handle this. A pull request would be to early. Greeting Florian
Re: [DISCUSS] Migrate from Jira to Github Issues?
Hi all, is there a timeline for when we want to start moving? ALso what happens with the wiki. I write on the wiki atm and before butting it into conf maybe it is easier to start it on github? Greetings Florian Am Freitag, dem 11.11.2022 um 12:49 +0100 schrieb Florian Micklich: > Hi, > > definitely agree. > I think there are a lot of benefits. > Big + for moving the wiki into github and put it into git as well. > > I come from the gitlab and jira world. So I want to keep in mind that there > still could occur a "barrier" for new developer. > But I think, if we write down the git "rules" and what to do in what > situation, we are on the right side. > > I am happy to write the introduction after getting a short one :-) > > Greetings > Florian > > > > Am Donnerstag, dem 10.11.2022 um 16:51 + schrieb Tim: > > Hi all, > > > > I would also like to see us move our issues from JIRA to Github. > > Beyond that, I fully agree with Philipp and would also bring the > > "discussion" and "wiki" features. > > It's nice to have everything in one central place. This lowers the > > barrier to entry in my opinion. Github provides great interaction > > between these modules. > > Another advantage is that the wiki is then also versioned via Git and > > > > simply consists of Markdown files that you can edit with an editor of > > > > your choice. > > Last but not least, GitHub is the central entry point for open source > > > > projects, so we should make the best use of this entry point. > > > > Best > > Tim > > > > Am 10.11.2022 08:50 schrieb Philipp Zehnder:> > > > Hi Dominik, > > > > > > I am also in favor of migrating to GitHub issues. > > > I think it will ease the management of open issues and lower the > > > entry > > > barrier for new developers. > > > > > > Further, I am in favor of using GitHub discussions, this is a good > > > way > > > to answer to common questions. > > > I think we should also move the wiki to GitHub, because then we > > > have > > > all the information for developers in one location. > > > > > > Cheers, > > > Philipp > > > > > > > > > > > > Von: Dominik Riemer > > > <[[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)](mailto:[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai))> > > > Gesendet: Mittwoch, November 9, 2022 10:52 PM > > > An: > > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > > > > > <[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))> > > > Betreff: [DISCUSS] Migrate from Jira to Github Issues? > > > > > > Hi everyone, > > > > > > submitting bugs and feature requests are types of community > > > contributions with a very low entry barrier for first-time > > > contributors. To submit bug reports, users currently need to > > > register > > > in our Jira, which is not so straightforward for non-Apache-folks. > > > By using Github issues, I'd expect that users find a more > > > convenient > > > way to submit issues and we would foster community engagement. > > > > > > There are more and more ASF projects which are moving to Github > > > issues, e.g., our friends from PLC4X have just recently migrated > > > and > > > also Apache Airflow [1] and Apache Pulsar [2] are two great > > > examples. > > > I also like the Github discussion feature Airflow and Pulsar are > > > using. > > > > > > For some background information, people from Apache Beam have > > > written > > > a feature comparison [3], a migration guide [4] and even a > > > migration > > > tool [5] which we could also use to transfer our issues from Jira > > > to > > > Github. > > > > > > What do you think? > > > > > > Cheers > > > Dominik > > > > > > > > > [1] > > > [[https://github.com/apache/airflow/issues](https://github.com/apache/airflow/issues)](https://github.com/apache/airflow/issues](https://github.com/apache/airflow/issues)) > > > [2] > > > [[https://github.com/apache/pulsar/discussions](https://github.
Re: [DISCUSS] Basic Python Client
Hi Tim, is there a way to contribute? I don't know much about the backend atm. In the Readme you mentioned "Install pre-commit hook" What does it exactly mean? What is happening here in the backend and why? Also a comment in the GitHub pull request I don't understand: "We should also discuss how we can add the pre-commit hooks for java and typescript code" Greetings Florian Am Montag, dem 14.11.2022 um 10:44 +0530 schrieb Anush: > I think a python client would be ideal as it improves accessiblity and > provide an easier way to utilize the API. > As a Python developer, I usually look for a client library before I use an > API directly. > I would be happy to join in and contribute to this. I have previously > contributed to the python wrapper a year ago. > > On Sun, 13 Nov 2022 at 19:44, Tim > <[bosse...@posteo.de](mailto:bosse...@posteo.de)> wrote: > > > Hi everyone, > > > > I have been working on the general structure of a counterpart to our > > Java client for StreamPipes in Python. > > PR-140 [1] contains a basic framework for the client in general and a > > first reference implementation for an API endpoint. > > I'm curious to hear your feedback and discuss some aspects (I've already > > started some in the PR's comments). > > > > Best, > > Tim > > > > [1] > > [https://github.com/apache/incubator-streampipes/pull/140](https://github.com/apache/incubator-streampipes/pull/140) > >
Re: [DISCUSSION] "cooperate design"
Hi Dominik, thanks for the info. I created a Wiki Page with the information [1]. I also created a color pallet which can be used in Gimp or Inkscape. We should try to keep this up to date, if we use other colors for the documentation. Greetings Florian [1] https://cwiki.apache.org/confluence/x/MIsODg Am Montag, dem 14.11.2022 um 20:29 + schrieb Dominik Riemer: > Hi Florian, > > there's nothing documented, but we use: > > * Ubuntu as the logo font > * Roboto as the main font in the app > * The main colors are defined in > [https://github.com/apache/incubator-streampipes/blob/dev/ui/src/scss/_variables.scss](https://github.com/apache/incubator-streampipes/blob/dev/ui/src/scss/_variables.scss) > > A good place to provide this information would be the wiki, so we make sure > all resources are available within archived ASF infra. > > Cheers > Dominik > > > -Original Message- > From: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > > Sent: Monday, November 14, 2022 6:29 PM > To: StreanPipes Dev > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Subject: [DISCUSSION] "cooperate design" > > Me again, > > during drafting the info graph some questions came up for me. > > Do we have a "cooperate design" e.g. colors, fonts and size, base icons for > specific vocabulary we use in the app and later in the documentation? > > An internal download pool for icons, fonts e.g. would be cool as well. > So everyone has access to basics. Do we have something like this already? > Otherwise, I have my own Nextcloud instance running and could deploy to a > separate StreamPipes share folder. > > > Greetings > Florian >
Re: yet another IntelliJ problem
Hi Philipp, so I can run the all-pipeline-elements without errors. But I have problems to start the other environments. Therefore I had a look at the pre-configured variables [1] in the IntelliJ project. It seems to me, that some variables are missing or differs. Can we adjust the list, so everything runs correctly? Gretings Florian [1] https://cwiki.apache.org/confluence/display/STREAMPIPES/StreamPipes+Variables Am Samstag, dem 12.11.2022 um 20:55 +0100 schrieb Florian Micklich: > Heureca!! > setting the variable directly in IntelliJ was helpful. oh man, thanks a > lot. > A small little side effect is that all processors and sinks are represented > twice in the "install pipeline element" menu. > But they are acting like one. > > Oh dear that was a tough nut to crack. > > Florian > > Am Freitag, dem 11.11.2022 um 20:23 + schrieb Philipp Zehnder: > > Hi Florian, > > > > can you try to set the environment variables directly in the IDE? > > > > Philipp > > > > Von: Florian Micklich > > <[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))> > > Datum: Freitag, 11. November 2022 um 15:40 > > An: > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > > > <[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))> > > Betreff: Re: yet another IntelliJ problem > > Hi Philipp, > > > > yes I changed it in here [1]. > > I tried a couple of settings > > > > from > > * hostname like `SP_HOST=homebase` > > * IP like `SP_HOST=homebase` > > * Docker Host IP `SP_HOST=172.17.0.1` > > > > Here [2] I reverted it as you mentioned. > > > > > > > In streampipes-pipeline-elements-all-jvm/development [2] I removed the > > > > SP_HOST as you mentioned. > > > > > > > > ``` > > > > # Those parameters are used by IntelliJ to set the default consul > > > > parameters for development > > > > SP_PORT=7023 > > > > #SP_HOST=host.docker.internal > > > > #SP_HOST=192.168.178.100 > > > > SP_DEBUG=true > > > > SP_COUCHDB_HOST=localhost > > > > SP_JMS_HOST=localhost > > > > SP_JMS_PORT=61616 > > > > ``` > > > > > > > > Are there any other files or plugins I missed? > > > > Greetings > > Florian > > > > [1] > > [[https://github.com/apache/incubator-streampipes/blob/dev/development/.env](https://github.com/apache/incubator-streampipes/blob/dev/development/.env)](https://github.com/apache/incubator-streampipes/blob/dev/development/.env](https://github.com/apache/incubator-streampipes/blob/dev/development/.env)) > > [2] > > [[https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env](https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env)](https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env](https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env)) > > > > > > Am Freitag, dem 11.11.2022 um 13:26 + schrieb Philipp Zehnder:> > > > Hi Florian, > > > > > > can you check if the env variable SP_HOST is set correctly to the IP > > > address of you machine? > > > Because the logs say that auto discovery is used, usually with SP_HOST it > > > should state that the provided IP address is used instead. > > > > > > > > > > > > Cheers, > > > > > > Philipp > > > > > > > > > > > > > > > Von: Florian Micklich > > > <[[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))](mailto:[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org)))> > > > Datum: Freitag, 11. November 2022 um 13:31 > > > An: > > > [[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))](mailto:[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))) >
[DISCUSSION] "cooperate design"
Me again, during drafting the info graph some questions came up for me. Do we have a "cooperate design" e.g. colors, fonts and size, base icons for specific vocabulary we use in the app and later in the documentation? An internal download pool for icons, fonts e.g. would be cool as well. So everyone has access to basics. Do we have something like this already? Otherwise, I have my own Nextcloud instance running and could deploy to a separate StreamPipes share folder. Greetings Florian
[DISCUSSION] technical infrastructure documentation
Hi all, I created a new info graph. I call it "overview technical system infrastructure" [1]. My goal was to find out for myself what connections exist between the individual services and who communicates with whom. Especially after having some problems with environment variables in the past. I think it is also good for the documentation itself. Have a look at it and tell me if everything is clear for you ;-) The info of SP Backend and SP UI could be extended. I do not know much here what is going on. If we write some sentences about each container e.g. why it is there and what happens here, we will have a good overview for all users. Greetings Florian [1] https://cwiki.apache.org/confluence/display/STREAMPIPES/Tutorial+Doku+Crafts
Re: Icons for documentation and illustrations
Hi, I found a really good source [1] for SVG's and the license is always clear for each single file [2]. Much quicker so search as Google Font. Greeting Florian [1] https://www.svgrepo.com/ [2] https://www.svgrepo.com/page/licensing Am Samstag, dem 05.11.2022 um 08:37 + schrieb Dominik Riemer: > Hi Florian, > > sounds cool! > I'd like to avoid using images with proprietary licenses in the documentation > so that the documentation itself remains Apache licensed. You can have a look > at Google Font Icons, which include a large set of icons and are Apache > licensed (although not as extensive as other sources). Several creative > commons licenses are also fine (see [1], unmodified media section). > Many icons we use for pipeline elements are currently self-made. What kind of > illustrations do you need? > > Cheers > Dominik > > [1] > [https://www.apache.org/legal/resolved.html](https://www.apache.org/legal/resolved.html) > > > -Original Message- > From: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > > Sent: Friday, November 4, 2022 2:05 PM > To: dev <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Subject: Icons for documentation and illustrations > > Hi all, > > I am working on some documentation. Therefore I create some illustrations in > SVG format. > I think SVGs are much better for resolution scale and with inkscape exists > an open source tool to create them. The output still can be an image. > > Now my question. In my illustrations I prefer to use predesigned icons. > Therefore I use freepik [1] or flaticon [2] if free available. If I use them > I have to cite the source. > > How do you create illustrations e.g. for pipeline elements? > Is there another source for Apache projects? > On the other hand I am thinking about to get a premium access. > > Greetings > Florian > > [1] [https://www.freepik.com/](https://www.freepik.com/) > > [2] [https://www.flaticon.com](https://www.flaticon.com)
Re: yet another IntelliJ problem
Heureca!! setting the variable directly in IntelliJ was helpful. oh man, thanks a lot. A small little side effect is that all processors and sinks are represented twice in the "install pipeline element" menu. But they are acting like one. Oh dear that was a tough nut to crack. Florian Am Freitag, dem 11.11.2022 um 20:23 + schrieb Philipp Zehnder: > Hi Florian, > > can you try to set the environment variables directly in the IDE? > > Philipp > > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Datum: Freitag, 11. November 2022 um 15:40 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Re: yet another IntelliJ problem > Hi Philipp, > > yes I changed it in here [1]. > I tried a couple of settings > > from > * hostname like `SP_HOST=homebase` > * IP like `SP_HOST=homebase` > * Docker Host IP `SP_HOST=172.17.0.1` > > Here [2] I reverted it as you mentioned. > > > > In streampipes-pipeline-elements-all-jvm/development [2] I removed the > > > SP_HOST as you mentioned. > > > > > > ``` > > > # Those parameters are used by IntelliJ to set the default consul > > > parameters for development > > > SP_PORT=7023 > > > #SP_HOST=host.docker.internal > > > #SP_HOST=192.168.178.100 > > > SP_DEBUG=true > > > SP_COUCHDB_HOST=localhost > > > SP_JMS_HOST=localhost > > > SP_JMS_PORT=61616 > > > ``` > > > > > Are there any other files or plugins I missed? > > Greetings > Florian > > [1] > [https://github.com/apache/incubator-streampipes/blob/dev/development/.env](https://github.com/apache/incubator-streampipes/blob/dev/development/.env) > [2] > [https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env](https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env) > > > Am Freitag, dem 11.11.2022 um 13:26 + schrieb Philipp Zehnder: > > Hi Florian, > > > > can you check if the env variable SP_HOST is set correctly to the IP > > address of you machine? > > Because the logs say that auto discovery is used, usually with SP_HOST it > > should state that the provided IP address is used instead. > > > > > > > > Cheers, > > > > Philipp > > > > > > > > > > Von: Florian Micklich > > <[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))> > > Datum: Freitag, 11. November 2022 um 13:31 > > An: > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > > > <[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))> > > Betreff: Re: yet another IntelliJ problem > > Hi, > > > > is anyone using a Linux system as well and has working running setup to > > share? > > Still got the problem with CLI and IntelliJ. > > > > I think the main problem is the auto-discovered IP and (my guess) Linux > > can't use host.docker.internal compared to windows and mac by > > default. > > > > > > ``` > > [main] INFO org.apache.streampipes.commons.networking.Networking - Using > > auto-discovered IP: 127.0.1.1 > > That's why consul comes up with following error messages: > > > > org-apache-streampipes-pe-all-jvm-KV1H6F > > Get > > "[[http://127.0.1.1:7023/svchealth/KV1H6F](http://127.0.1.1:7023/svchealth/KV1H6F](http://127.0.1.1:7023/svchealth/KV1H6F](http://127.0.1.1:7023/svchealth/KV1H6F)<[http://127.0.1.1:7023/svchealth/KV1H6F%5d(http:/127.0.1.1:7023/svchealth/KV1H6F](http://127.0.1.1:7023/svchealth/KV1H6F%5d(http:/127.0.1.1:7023/svchealth/KV1H6F)>)": > > dial tcp 127.0.1.1:7023: connect: connection refused > > > > > > connect-adapter-r8Q91b > > Get > > "[[http://127.0.1.1:8001/svchealth/r8Q91b](http://127.0.1.1:8001/svchealth/r8Q91b](http://127.0.1.1:8001/svchealth/r8Q91b](http://127.0.1.1:8001/svchealth/r8Q91b)<[http://127.0.1.1:8001/svchealth/r8Q91b%5d(http:/127.0.1.1:8001/svchealth/r8Q91b](http://127.0.1.1:8001/svchealth/r8Q91b%5d(http:/127.0.1.1:8001/svchealth/r8Q91b)>)": > > dial tcp 127.0.1.1:8001: connect: connection refused > > > > > > connect-adapter-iiot-IJjKCP > > Get > &g
Re: yet another IntelliJ problem
Hi Philipp, yes I changed it in here [1]. I tried a couple of settings from * hostname like `SP_HOST=homebase` * IP like `SP_HOST=homebase` * Docker Host IP `SP_HOST=172.17.0.1` Here [2] I reverted it as you mentioned. > > In streampipes-pipeline-elements-all-jvm/development [2] I removed the > > SP_HOST as you mentioned. > > > > ``` > > # Those parameters are used by IntelliJ to set the default consul > > parameters for development > > SP_PORT=7023 > > #SP_HOST=host.docker.internal > > #SP_HOST=192.168.178.100 > > SP_DEBUG=true > > SP_COUCHDB_HOST=localhost > > SP_JMS_HOST=localhost > > SP_JMS_PORT=61616 > > ``` > > Are there any other files or plugins I missed? Greetings Florian [1] https://github.com/apache/incubator-streampipes/blob/dev/development/.env [2] https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env Am Freitag, dem 11.11.2022 um 13:26 + schrieb Philipp Zehnder: > Hi Florian, > > can you check if the env variable SP_HOST is set correctly to the IP address > of you machine? > Because the logs say that auto discovery is used, usually with SP_HOST it > should state that the provided IP address is used instead. > > > > Cheers, > > Philipp > > > > > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Datum: Freitag, 11. November 2022 um 13:31 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Re: yet another IntelliJ problem > Hi, > > is anyone using a Linux system as well and has working running setup to > share? > Still got the problem with CLI and IntelliJ. > > I think the main problem is the auto-discovered IP and (my guess) Linux can't > use host.docker.internal compared to windows and mac by default. > > > ``` > [main] INFO org.apache.streampipes.commons.networking.Networking - Using > auto-discovered IP: 127.0.1.1 > That's why consul comes up with following error messages: > > org-apache-streampipes-pe-all-jvm-KV1H6F > Get > "[http://127.0.1.1:7023/svchealth/KV1H6F](http://127.0.1.1:7023/svchealth/KV1H6F)": > dial tcp 127.0.1.1:7023: connect: connection refused > > > connect-adapter-r8Q91b > Get > "[http://127.0.1.1:8001/svchealth/r8Q91b](http://127.0.1.1:8001/svchealth/r8Q91b)": > dial tcp 127.0.1.1:8001: connect: connection refused > > > connect-adapter-iiot-IJjKCP > Get > "[http://127.0.1.1:8002/svchealth/IJjKCP](http://127.0.1.1:8002/svchealth/IJjKCP)": > dial tcp 127.0.1.1:8002: connect: connection refused > ``` > > Greetings > Florian > > > Am Montag, dem 31.10.2022 um 10:34 +0100 schrieb Florian Micklich: > > Hi Philipp, > > > > so to get clear. I have two .env variables. > > > > in development/.env [1] I have SP_HOST=host.docker.internal by default. Due > > Linux I have to change this to my local ip (?) > > > > ``` > > # Those parameters are used by IntelliJ to set the default consul > > parameters for development > > SP_PORT=6009 > > SP_HOST=192.168.178.100 > > SP_DEBUG=true > > ``` > > > > > > In streampipes-pipeline-elements-all-jvm/development [2] I removed the > > SP_HOST as you mentioned. > > > > ``` > > # Those parameters are used by IntelliJ to set the default consul > > parameters for development > > SP_PORT=7023 > > #SP_HOST=host.docker.internal > > #SP_HOST=192.168.178.100 > > SP_DEBUG=true > > SP_COUCHDB_HOST=localhost > > SP_JMS_HOST=localhost > > SP_JMS_PORT=61616 > > ``` > > > > > > Is this settings correct so far? > > But I have still the same behavior in consul. > > > > > > My logs looks like this after starting the debugger: > > > > ``` > > /home/micklich/.sdkman/candidates/java/11.0.17-zulu/bin/java > > -agentlib:jdwp=transport=dt_socket,address=127.0.0.1:50461,suspend=y,server=n > > > > -javaagent:/home/micklich/.local/share/JetBrains/Toolbox/apps/IDEA-U/ch-0/222.4345.14/plugins/java/lib/rt/debugger-agent.jar=file:/tmp/capture.props > > -Dfile.encoding=UTF-8 -classpath /tmp/classpath115376425.jar > > org.apache.streampipes.extensions.all.jvm.AllExtensionsInit > > Connected to the target VM, address: '127.0.0.1:50461', transport: > > 'socket' > > 10:29:46.290 [main] INFO > > org.apache.streampipes.commons.networking.Networking - Using > > auto-discovered IP: 127.0.1.1 > > 10:29:46.294
Re: yet another IntelliJ problem
Hi, is anyone using a Linux system as well and has working running setup to share? Still got the problem with CLI and IntelliJ. I think the main problem is the auto-discovered IP and (my guess) Linux can't use host.docker.internal compared to windows and mac by default. ``` [main] INFO org.apache.streampipes.commons.networking.Networking - Using auto-discovered IP: 127.0.1.1 That's why consul comes up with following error messages: org-apache-streampipes-pe-all-jvm-KV1H6F Get "http://127.0.1.1:7023/svchealth/KV1H6F": dial tcp 127.0.1.1:7023: connect: connection refused connect-adapter-r8Q91b Get "http://127.0.1.1:8001/svchealth/r8Q91b": dial tcp 127.0.1.1:8001: connect: connection refused connect-adapter-iiot-IJjKCP Get "http://127.0.1.1:8002/svchealth/IJjKCP": dial tcp 127.0.1.1:8002: connect: connection refused ``` Greetings Florian Am Montag, dem 31.10.2022 um 10:34 +0100 schrieb Florian Micklich: > Hi Philipp, > > so to get clear. I have two .env variables. > > in development/.env [1] I have SP_HOST=host.docker.internal by default. Due > Linux I have to change this to my local ip (?) > > ``` > # Those parameters are used by IntelliJ to set the default consul parameters > for development > SP_PORT=6009 > SP_HOST=192.168.178.100 > SP_DEBUG=true > ``` > > > In streampipes-pipeline-elements-all-jvm/development [2] I removed the > SP_HOST as you mentioned. > > ``` > # Those parameters are used by IntelliJ to set the default consul parameters > for development > SP_PORT=7023 > #SP_HOST=host.docker.internal > #SP_HOST=192.168.178.100 > SP_DEBUG=true > SP_COUCHDB_HOST=localhost > SP_JMS_HOST=localhost > SP_JMS_PORT=61616 > ``` > > > Is this settings correct so far? > But I have still the same behavior in consul. > > > My logs looks like this after starting the debugger: > > ``` > /home/micklich/.sdkman/candidates/java/11.0.17-zulu/bin/java > -agentlib:jdwp=transport=dt_socket,address=127.0.0.1:50461,suspend=y,server=n > -javaagent:/home/micklich/.local/share/JetBrains/Toolbox/apps/IDEA-U/ch-0/222.4345.14/plugins/java/lib/rt/debugger-agent.jar=file:/tmp/capture.props > -Dfile.encoding=UTF-8 -classpath /tmp/classpath115376425.jar > org.apache.streampipes.extensions.all.jvm.AllExtensionsInit > Connected to the target VM, address: '127.0.0.1:50461', transport: > 'socket' > 10:29:46.290 [main] INFO org.apache.streampipes.commons.networking.Networking > - Using auto-discovered IP: 127.0.1.1 > 10:29:46.294 [main] INFO org.apache.streampipes.commons.networking.Networking > - Using port from provided environment variable SP_PORT: 7023 > 10:29:46.313 [main] INFO > org.apache.streampipes.container.init.DeclarersSingleton - Registering 11 > configs in key/value store > 10:29:46.319 [main] INFO > org.apache.streampipes.svcdiscovery.consul.ConsulProvider - Checking if > consul is available... > 10:29:46.327 [main] INFO > org.apache.streampipes.svcdiscovery.consul.ConsulProvider - Successfully > connected to Consul > 10:29:47.283 [OkHttp [http://localhost:8500/](http://localhost:8500/)...] > DEBUG com.orbitz.consul.cache.ConsulCache - Consul cache updated for > health.service "core" (index=2994), request duration: 200 ms > 10:29:47.298 [OkHttp [http://localhost:8500/](http://localhost:8500/)...] > DEBUG com.orbitz.consul.cache.ConsulCache - Consul cache updated for > health.service "ext" (index=3009), request duration: 7 ms > 10:29:47.563 [main] INFO > org.apache.streampipes.svcdiscovery.consul.SpConsulServiceDiscovery - > Successfully registered service at Consul: > org.apache.streampipes.extensions.all.jvm-8jUycO > 10:29:47.580 [OkHttp [http://localhost:8500/](http://localhost:8500/)...] > DEBUG com.orbitz.consul.cache.ConsulCache - Consul cache updated for > health.service "ext" (index=3092), request duration: 280 ms > ___ __ __ __ > > __| |_..-.---.-..| __ \__|.-.-.-. > > __ | _| _| -__| _ | || __/ || _ | -__|__ --| > > ___||__| |_|___._|__|__|__||___| |__|| __|_|_| > |__| > ** StreamPipes Extensions Container ** > > 2022-10-31 10:29:48.215 INFO 23495 --- [ main] > o.a.s.e.all.jvm.AllExtensionsInit : Starting AllExtensionsInit using > Java 11.0.17 on homebase with PID 23495 > (/home/micklich/streampipes/incubator-streampipes/streampipes-extensions/streampipes-extensions-all-jvm/target/classes > started by micklich in /home/micklich/streampipes/incubator-streampipes) > 2022-10-31 10:29:48.217 INFO 23495 --- [ main] > o.a.s.e.all.jvm.All
Re: [DISCUSS] Migrate from Jira to Github Issues?
Hi, definitely agree. I think there are a lot of benefits. Big + for moving the wiki into github and put it into git as well. I come from the gitlab and jira world. So I want to keep in mind that there still could occur a "barrier" for new developer. But I think, if we write down the git "rules" and what to do in what situation, we are on the right side. I am happy to write the introduction after getting a short one :-) Greetings Florian Am Donnerstag, dem 10.11.2022 um 16:51 + schrieb Tim: > Hi all, > > I would also like to see us move our issues from JIRA to Github. > Beyond that, I fully agree with Philipp and would also bring the > "discussion" and "wiki" features. > It's nice to have everything in one central place. This lowers the > barrier to entry in my opinion. Github provides great interaction > between these modules. > Another advantage is that the wiki is then also versioned via Git and > simply consists of Markdown files that you can edit with an editor of > your choice. > Last but not least, GitHub is the central entry point for open source > projects, so we should make the best use of this entry point. > > Best > Tim > > Am 10.11.2022 08:50 schrieb Philipp Zehnder: > > Hi Dominik, > > > > I am also in favor of migrating to GitHub issues. > > I think it will ease the management of open issues and lower the entry > > barrier for new developers. > > > > Further, I am in favor of using GitHub discussions, this is a good way > > to answer to common questions. > > I think we should also move the wiki to GitHub, because then we have > > all the information for developers in one location. > > > > Cheers, > > Philipp > > > > > > > > Von: Dominik Riemer > > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > > Gesendet: Mittwoch, November 9, 2022 10:52 PM > > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > Betreff: [DISCUSS] Migrate from Jira to Github Issues? > > > > Hi everyone, > > > > submitting bugs and feature requests are types of community > > contributions with a very low entry barrier for first-time > > contributors. To submit bug reports, users currently need to register > > in our Jira, which is not so straightforward for non-Apache-folks. > > By using Github issues, I'd expect that users find a more convenient > > way to submit issues and we would foster community engagement. > > > > There are more and more ASF projects which are moving to Github > > issues, e.g., our friends from PLC4X have just recently migrated and > > also Apache Airflow [1] and Apache Pulsar [2] are two great examples. > > I also like the Github discussion feature Airflow and Pulsar are > > using. > > > > For some background information, people from Apache Beam have written > > a feature comparison [3], a migration guide [4] and even a migration > > tool [5] which we could also use to transfer our issues from Jira to > > Github. > > > > What do you think? > > > > Cheers > > Dominik > > > > > > [1] > > [https://github.com/apache/airflow/issues](https://github.com/apache/airflow/issues) > > [2] > > [https://github.com/apache/pulsar/discussions](https://github.com/apache/pulsar/discussions) > > [3] > > [https://docs.google.com/document/d/1_n7gboVbSKPs-CVcHzADgg8qpNL9igiHqUPCmiOslf0/edit#heading=h.r8qwrrbs8odn](https://docs.google.com/document/d/1_n7gboVbSKPs-CVcHzADgg8qpNL9igiHqUPCmiOslf0/edit#heading=h.r8qwrrbs8odn) > > [4] > > [https://docs.google.com/document/d/1powrXGbjMLMYl9ibRzMda5o5HM_p44XvBy5MZu75Q5E/edit#heading=h.wskna8eurvjv](https://docs.google.com/document/d/1powrXGbjMLMYl9ibRzMda5o5HM_p44XvBy5MZu75Q5E/edit#heading=h.wskna8eurvjv) > > > > [5] > > [https://github.com/google/jira-to-issues](https://github.com/google/jira-to-issues)
[INFO] OGC Mapping Code Sprint
Hi all, end of this month there is an OGC Mapping Code Sprint event [1]. Maybe a good opportunity to work on the maps in the dashboard. Also a good opportunity to get into contact with the OGC community and work/ learn about standards for a good interoperability. I don't no much about the code in StreamPipes itself atm nor where to find it and how to get started here. Can someone point me in the right direction? Greetings Florian [1] https://developer.ogc.org/sprints/19/#about
Re: run local documentation Pre-release versions not shown up anymore
Hi Tim, don't worry. Now everything works as expected. Thanks for the "fix" :-) Greetings Florian Am Donnerstag, dem 10.11.2022 um 16:37 + schrieb Tim: > Hi Florian, > > please apologize, my bad :/ > I forgot about to merge the corresponding PR [1]. > You can now access the documentation of the pre-release version by > clicking on "Documentation" within the "Pre-release versions" section. > We've reworked that part of the versions overview because it was somehow > outdated and misleading. > Sorry for the inconveniance. > > Pulling the current development branch should resolve your issue :) > > Best > Tim > > [1] > [https://github.com/apache/incubator-streampipes-website/pull/32](https://github.com/apache/incubator-streampipes-website/pull/32) > > Am 09.11.2022 18:37 schrieb Florian Micklich: > > Hi, > > > > I just tried to npm run start on documentation/website and if I click > > on the version options > > [http://localhost:3000/docs/versions.html](http://localhost:3000/docs/versions.html) > > the > > pre-release versions master is not shown up as an option to see my > > local changes. > > > > I tested it with the dev branch and moved downwards until commit > > 01b2478714f94b25340cbc1c73f1ded12e0153bd. > > Here I have the option again. > > > > Does anyone know why and whats going on? > > Do I miss something? > > > > Greetings > > Florian
Re: sources-vehicle-simulator:0.71.0-SNAPSHOT error
Hi Philipp, good point to change the beginenrs tutorial as well. What is *.ts for a format and how can I edit and check the changes? The UI is little bit a undiscovered country for me. Greetings Florian Am Mittwoch, dem 09.11.2022 um 16:46 + schrieb Philipp Zehnder: > Hi, > > it would be cool if we could also update the StreamPipes beginner tutorials > [1]. > As far as I know this is the last dependency to the service > “sources-watertank-simulator”. > Once we update those tutorials, we can also remove this service from the base > docker-compose.yml. > > My suggestion would be that we have one single welcome tour for new users > that gives them an overview over all features: > > * Add data machine data simulator adapter > * Create one pipeline for this adapter > * Create a live dashboard > * Create a first data view > I think an update of the tutorial would also be an improvement of the user > experience for first time users. > What are your thoughts? > > Cheers, > Philipp > > [1] > [https://github.com/apache/incubator-streampipes/tree/dev/ui/src/app/services/tour](https://github.com/apache/incubator-streampipes/tree/dev/ui/src/app/services/tour) > > > > Von: Obermeier. Stefan > <[st.oberme...@seeburger.de](mailto:st.oberme...@seeburger.de)> > Datum: Mittwoch, 9. November 2022 um 17:29 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: AW: sources-vehicle-simulator:0.71.0-SNAPSHOT error > Hi Dominik, > > I like this solution very much. This reduces the footprint and provides a > system with can be used easily. > From my point of view the current data simulator in Connect has all features > which are useful. > > Cheers, > Stefan > > -Ursprüngliche Nachricht- > Von: Dominik Riemer > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > Gesendet: Mittwoch, 9. November 2022 15:45 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Betreff: RE: sources-vehicle-simulator:0.71.0-SNAPSHOT error > > Hi Stefan, > > totally agree that some initial data source should be available to quickly > explore the system. We have integrated the machine data simulator into > Connect and could provide the vehicle simulator as well instead of running it > as a separate service. > So users can quickly start with simulated data, but can also easily delete it > by just removing the adapter instead of having a separate container which > only produces simulated data. > > Do you think we should have more "sophisticated" simulators in the Connect > library (the machine data simulator produces just some random values)? > > Cheers > Dominik > > -Original Message- > From: Obermeier. Stefan > <[st.oberme...@seeburger.de](mailto:st.oberme...@seeburger.de)> > Sent: Wednesday, November 9, 2022 1:37 PM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: AW: sources-vehicle-simulator:0.71.0-SNAPSHOT error > > Hi, > > I personally use some script which simulate data e.g. writing to a MQTT > topic. > > But I think a data source (Pipeline element) for nontechnical users are > useful especially at the beginning of a project. > E.g. to test connections to the field or to evaluate some pipeline ideas > without having external data sources. > Is there currently an alternative source for data? > > Greetings, > Stefan > > > > -Ursprüngliche Nachricht- > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Gesendet: Mittwoch, 9. November 2022 12:42 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Betreff: Re: sources-vehicle-simulator:0.71.0-SNAPSHOT error > > Hi Philipp, > > yes we can remove it. > I am looking anyway for some movement data, we could use via adapter. > > But it needs to be removed also in the docker-compose.full.yml here [1]. > and have to rebuild the download source here [2]. > > I can remove it and push it if you want (after I created a jira ticket) but > not sure how to replace the download source. > > Greetings > Florian > > > [1] > [https://github.com/apache/incubator-streampipes/blob/dev/installer/compose/docker-compose.full.yml](https://github.com/apache/incubator-streampipes/blob/dev/installer/compose/docker-compose.full.yml) > [2] > [https://streampipes.apache.org/download](https://streampipes.apache.org/download) > > > Am Mittwoch, dem 09.11.2022 um 08:14 + schrieb Philipp Zehnder: > > Hi Florian, > > >
Re: Updated README file
Hi Dominik, great work. Looks really nice. How did you create the gifs or where can I find Tim's manual? :-D What image at the top of the README do you mean exactly? Greetings Florian Am Donnerstag, dem 10.11.2022 um 08:32 + schrieb Philipp Zehnder: > Hi Dominik, > > I really like the new readme. I made some minor changes in the “Contribute”, > please check them. > > Regarding the current image at the top. I totally agree it gives a nice > overview. However, I also think it is a little bit outdated. > Maybe we can update it by removing point 2 at the top and point 3 at the > bottom and put more focus the data analytics part. > > Cheers, > Philipp > > Von: Dominik Riemer > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > Datum: Mittwoch, 9. November 2022 um 22:33 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Updated README file > Hi, > > I’ve updated the Github README file to better reflect our feature set and > make it more appealing. I also updated some texts and links and added > animated GIFs as screenshots thanks to Tim’s manual > > The updated page can be seen and compared to dev at [1], and the PR is > available at [2] – any feedback/comments in the PR or here are welcome! > > I’m unsure if we want to keep the current image at the top of the README – I > think it gives a good first glance at the project, but might let users think > StreamPipes only includes a pipeline editor…what do you think? > > Cheers > Dominik > > [1] > [https://github.com/apache/incubator-streampipes/tree/STREAMPIPES-622](https://github.com/apache/incubator-streampipes/tree/STREAMPIPES-622) > [2] > [https://github.com/apache/incubator-streampipes/pull/138](https://github.com/apache/incubator-streampipes/pull/138) > >
fosgis talk votes
Hi all, the public voting for the Fossgis talks has started. Unfortunately it is all in German but everyone can vote Our talk is "GIS & Datenströme; Stream Processing mit Apache (Incubator) StreamPipes" Feel free to share and vote for other interesting topics as well if you want ;-) Greetings Florian ``` Das Community-Voting (Öffentliche Abstimmung) ist ab heute bis 16.11.2022 geöffnet. Das Ergebnis wird vom Programm-Komitee als Meinungsbild aus der Community in die Bewertung einbezogen. Vorgehensweise: 1. Den Link zur Öffentlichen Abstimmung klicken, um sich dafür anzumelden: https://pretalx.com/fossgis2023/p/voting/signup/ 2. Sie erhalten eine E-Mail mit Ihrem persönlichen Link zur Öffentlichen Abstimmung 3. Einreichungen anschauen und bewerten. Dies kann in Etappen erfolgen und die Stimmabgabe ist vollständig anonym Community voting (public voting) is open from today until 16.11.2022. The result will be used by the program committee Opinion from the community into the evaluation. Procedure: 1. click on the link to the public voting to register for it. register: https://pretalx.com/fossgis2023/p/voting/signup/ 2. you will receive an e-mail with your personal link to the Public Vote 3. view and rate submissions. This can be done in stages and voting is completely anonymous ```
run local documentation Pre-release versions not shown up anymore
Hi, I just tried to npm run start on documentation/website and if I click on the version options http://localhost:3000/docs/versions.html the pre-release versions master is not shown up as an option to see my local changes. I tested it with the dev branch and moved downwards until commit 01b2478714f94b25340cbc1c73f1ded12e0153bd. Here I have the option again. Does anyone know why and whats going on? Do I miss something? Greetings Florian
Re: sources-vehicle-simulator:0.71.0-SNAPSHOT error
Hi, I created already a ticket for the simulators [1] So next to the sources-vehicle-simulator is also the sources-watertank-simulator. To be sure, this has nothing to do with the mentioned machine data simulator and could be removed as well? I think Dominik's idea to extend the machine data simulator or add similar adapters is a very good option. Similar to the vehicle simulator is the ISS-Adapter. Maybe we can move this adapter to the "light" installation to have an adequate replace. It is a simple source for lat lng coordinates with default ontology setup. Greetings Florian [1] https://issues.apache.org/jira/browse/STREAMPIPES-624 Am Mittwoch, dem 09.11.2022 um 14:45 + schrieb Dominik Riemer: > Hi Stefan, > > totally agree that some initial data source should be available to quickly > explore the system. We have integrated the machine data simulator into > Connect and could provide the vehicle simulator as well instead of running it > as a separate service. > So users can quickly start with simulated data, but can also easily delete it > by just removing the adapter instead of having a separate container which > only produces simulated data. > > Do you think we should have more "sophisticated" simulators in the Connect > library (the machine data simulator produces just some random values)? > > Cheers > Dominik > > -Original Message- > From: Obermeier. Stefan > <[st.oberme...@seeburger.de](mailto:st.oberme...@seeburger.de)> > Sent: Wednesday, November 9, 2022 1:37 PM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: AW: sources-vehicle-simulator:0.71.0-SNAPSHOT error > > Hi, > > I personally use some script which simulate data e.g. writing to a MQTT > topic. > > But I think a data source (Pipeline element) for nontechnical users are > useful especially at the beginning of a project. > E.g. to test connections to the field or to evaluate some pipeline ideas > without having external data sources. > Is there currently an alternative source for data? > > Greetings, > Stefan > > > > -Ursprüngliche Nachricht- > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Gesendet: Mittwoch, 9. November 2022 12:42 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Betreff: Re: sources-vehicle-simulator:0.71.0-SNAPSHOT error > > Hi Philipp, > > yes we can remove it. > I am looking anyway for some movement data, we could use via adapter. > > But it needs to be removed also in the docker-compose.full.yml here [1]. > and have to rebuild the download source here [2]. > > I can remove it and push it if you want (after I created a jira ticket) but > not sure how to replace the download source. > > Greetings > Florian > > > [1] > [https://github.com/apache/incubator-streampipes/blob/dev/installer/compose/docker-compose.full.yml](https://github.com/apache/incubator-streampipes/blob/dev/installer/compose/docker-compose.full.yml) > [2] > [https://streampipes.apache.org/download](https://streampipes.apache.org/download) > > > Am Mittwoch, dem 09.11.2022 um 08:14 + schrieb Philipp Zehnder: > > Hi Florian, > > > > that is a good point. We currently do not build this image > > anymore. The goal is to gradually remove the sources docker images > > and use adapters instead. > > > > Therefore, I suggest to remove the sources-vehicle-simulator from the > > CLI as well. What do you think? > > > > Cheers, > > Philipp > > > > Von: Florian Micklich > > <[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))> > > Datum: Montag, 7. November 2022 um 16:59 > > An: dev > > <[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))> > > Betreff: sources-vehicle-simulator:0.71.0-SNAPSHOT error Hi > > all, > > > > i tried to run the full installer via CLI and got following error > > message during image pull of the sources-vehicle-simulator. Is > > this known? > > > > > > > > ``` > > ⠿ sources-vehicle-simulator Error > > 2.2s Error response from daemon: manifest for > > apachestreampipes/sources-vehicle-simulator:0.71.0-SNAPSHOT not found: > > manifest unknown: manifest unknown ``` > > > > Greetings > > Florian > > > > > > > > > SEEBURGER AG Vorstand/SEEBURGER Executive Board: > Sitz der Gesellschaft/Registered Office: Axel Haas, Michael
[jira] [Created] (STREAMPIPES-624) remove data simulators from all installer sources
Florian Micklich created STREAMPIPES-624: Summary: remove data simulators from all installer sources Key: STREAMPIPES-624 URL: https://issues.apache.org/jira/browse/STREAMPIPES-624 Project: StreamPipes Issue Type: Task Reporter: Florian Micklich remove simulator from all installer sources due moving full to adapter in CLI in docker-compose-full.yml K8s * sources-vehicle-simulator * sources-watertank-simulator? replace download installer after rebuild (howto?) -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: sources-vehicle-simulator:0.71.0-SNAPSHOT error
Hi Philipp, yes we can remove it. I am looking anyway for some movement data, we could use via adapter. But it needs to be removed also in the docker-compose.full.yml here [1]. and have to rebuild the download source here [2]. I can remove it and push it if you want (after I created a jira ticket) but not sure how to replace the download source. Greetings Florian [1] https://github.com/apache/incubator-streampipes/blob/dev/installer/compose/docker-compose.full.yml [2] https://streampipes.apache.org/download Am Mittwoch, dem 09.11.2022 um 08:14 + schrieb Philipp Zehnder: > Hi Florian, > > that is a good point. We currently do not build this image anymore. > The goal is to gradually remove the sources docker images and use adapters > instead. > > Therefore, I suggest to remove the sources-vehicle-simulator from the CLI as > well. > What do you think? > > Cheers, > Philipp > > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Datum: Montag, 7. November 2022 um 16:59 > An: dev <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: sources-vehicle-simulator:0.71.0-SNAPSHOT error > Hi all, > > i tried to run the full installer via CLI and got following error message > during image pull of the sources-vehicle-simulator. > Is this known? > > > > ``` > ⠿ sources-vehicle-simulator Error > > 2.2s > Error response from daemon: manifest for > apachestreampipes/sources-vehicle-simulator:0.71.0-SNAPSHOT not found: > manifest unknown: manifest unknown > ``` > > Greetings > Florian
Re: talk submission for FOSSGIS 2023 ?
Hi Dominik, no worries. I created a text already. I just wanted to make sure it was okay to submit it. Here is the link to the submission [1]. The First part is a summary for the committee. The Second part is public and can be changed later on as well. Greetings Florian [1] https://pretalx.com/fossgis2023/talk/review/9SWZKV7HUHFU9UCGDKRUVZTTDYS9AFVR Am Montag, dem 07.11.2022 um 17:18 + schrieb Dominik Riemer: > Hi Florian, > sorry, I currently don't have time to contribute, but feel free to submit > something! > > Cheers > Dominik > > > -Original Message----- > From: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > > Sent: Monday, November 7, 2022 2:07 PM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: Re: talk submission for FOSSGIS 2023 ? > > Hi all, > > any votes against a submission? > End of "call for papers" is today. > > Greetings > Florian > > > > Am Montag, dem 31.10.2022 um 22:20 +0100 schrieb Florian Micklich: > > Hi all, > > > > I am thinking about to prepare a 20 min talk at the FOSSGIS 2023 in > > Berlin [1]. Sorry, the description is only in German. FOSSGIS is > > the largest German-speaking conference for Open Source Software for > > geoinformation > > > > The main part would be about the geo processors due the missing key > > operator reprojection is almost done. But also a good opportunity > > to show the main concept of streampipes as well. > > > > > > By next Monday we would have to submit a short description [2] > > > > Basically what we have to do: > > ``` > > You write your title and a short description of what it is about. In > > the Summary text box you describe what it is about in 5-x sentences. > > The program committee will read it and evaluate your > > submission. > > > > The community gets to read the description during the community > > voting. The summary will be published in the program when the > > presentation is accepted. If you want, you can write a longer > > contribution for the conference proceedings (up to 5 pages with > > pictures and so on, depending on what you want to write). You will be > > informed about this by mail. The conference proceedings have an ISBN > > and can be cited. > > > > ``` > > > > The final paper submission would be on end of January 2023. What > > do you think about it. What base information about streampipes > > should be in the talk? > > > > I would prepare a short description and the summary if you want and > > discuss this later as well > > > > > > Greetings > > Florian > > > > [1] > > [[https://pretalx.com/fossgis2023/cfp](https://pretalx.com/fossgis2023/](https://pretalx.com/fossgis2023/cfp](https://pretalx.com/fossgis2023/) > > cfp) > > > > [2] > > [[https://pretalx.com/fossgis2023/submit/8WBm1D/info/](https://pretalx](https://pretalx.com/fossgis2023/submit/8WBm1D/info/](https://pretalx). > > com/fossgis2023/submit/8WBm1D/info/)
sources-vehicle-simulator:0.71.0-SNAPSHOT error
Hi all, i tried to run the full installer via CLI and got following error message during image pull of the sources-vehicle-simulator. Is this known? ``` ⠿ sources-vehicle-simulator Error 2.2s Error response from daemon: manifest for apachestreampipes/sources-vehicle-simulator:0.71.0-SNAPSHOT not found: manifest unknown: manifest unknown ``` Greetings Florian
Re: talk submission for FOSSGIS 2023 ?
Hi all, any votes against a submission? End of "call for papers" is today. Greetings Florian Am Montag, dem 31.10.2022 um 22:20 +0100 schrieb Florian Micklich: > Hi all, > > I am thinking about to prepare a 20 min talk at the FOSSGIS 2023 in Berlin > [1]. Sorry, the description is only in German. > FOSSGIS is the largest German-speaking conference for Open Source Software > for geoinformation > > The main part would be about the geo processors due the missing key operator > reprojection is almost done. > But also a good opportunity to show the main concept of streampipes as > well. > > > By next Monday we would have to submit a short description [2] > > Basically what we have to do: > ``` > You write your title and a short description of what it is about. In the > Summary text box you describe what it is about in 5-x sentences. > The program committee will read it and evaluate your submission. > > The community gets to read the description during the community voting. The > summary will be published in the program when the presentation is > accepted. > If you want, you can write a longer contribution for the conference > proceedings (up to 5 pages with pictures and so on, depending on what you > want to write). You will be informed about this by mail. The conference > proceedings have an ISBN and can be cited. > > ``` > > The final paper submission would be on end of January 2023. > What do you think about it. > What base information about streampipes should be in the talk? > > I would prepare a short description and the summary if you want and discuss > this later as well > > > Greetings > Florian > > [1] > [https://pretalx.com/fossgis2023/cfp](https://pretalx.com/fossgis2023/cfp) > > [2] > [https://pretalx.com/fossgis2023/submit/8WBm1D/info/](https://pretalx.com/fossgis2023/submit/8WBm1D/info/)
Re: Icons for documentation and illustrations
Hi Dominik, I want to create user documentation like here [1] or here [2] or maybe you remember the visualization I did on my master thesis. So far, if you use freepic, you have to mention the author. If you get a premium account this is mention: Once you obtain any subscription plan, you will have access to download a PDF license document every time you download an icon or pack/collection. These licenses will allow you to use Flaticon resources without crediting the author and will remain active even when your premium membership expires. So far I don't see any other license requirements. Does that count for apache license requirements? I will have a look at google fonts but there are more icons available here. Greetings Florian [1] https://issues.apache.org/jira/browse/STREAMPIPES-584 [2] https://cwiki.apache.org/confluence/display/STREAMPIPES/JDBC+Database+Client Am Samstag, dem 05.11.2022 um 08:37 + schrieb Dominik Riemer: > Hi Florian, > > sounds cool! > I'd like to avoid using images with proprietary licenses in the documentation > so that the documentation itself remains Apache licensed. You can have a look > at Google Font Icons, which include a large set of icons and are Apache > licensed (although not as extensive as other sources). Several creative > commons licenses are also fine (see [1], unmodified media section). > Many icons we use for pipeline elements are currently self-made. What kind of > illustrations do you need? > > Cheers > Dominik > > [1] > [https://www.apache.org/legal/resolved.html](https://www.apache.org/legal/resolved.html) > > > -Original Message- > From: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > > Sent: Friday, November 4, 2022 2:05 PM > To: dev <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Subject: Icons for documentation and illustrations > > Hi all, > > I am working on some documentation. Therefore I create some illustrations in > SVG format. > I think SVGs are much better for resolution scale and with inkscape exists > an open source tool to create them. The output still can be an image. > > Now my question. In my illustrations I prefer to use predesigned icons. > Therefore I use freepik [1] or flaticon [2] if free available. If I use them > I have to cite the source. > > How do you create illustrations e.g. for pipeline elements? > Is there another source for Apache projects? > On the other hand I am thinking about to get a premium access. > > Greetings > Florian > > [1] [https://www.freepik.com/](https://www.freepik.com/) > > [2] [https://www.flaticon.com](https://www.flaticon.com)
Icons for documentation and illustrations
Hi all, I am working on some documentation. Therefore I create some illustrations in SVG format. I think SVGs are much better for resolution scale and with inkscape exists an open source tool to create them. The output still can be an image. Now my question. In my illustrations I prefer to use predesigned icons. Therefore I use freepik [1] or flaticon [2] if free available. If I use them I have to cite the source. How do you create illustrations e.g. for pipeline elements? Is there another source for Apache projects? On the other hand I am thinking about to get a premium access. Greetings Florian [1] https://www.freepik.com/ [2] https://www.flaticon.com
Re: [DISCUSS] What is the Master branch currently used for?
Hi, I also think that develop and release are perfect as branch names. Does it have any impact on a CI build that needs to be adjusted? I come from mainly from the gitlab world and have no clue about github actions. Greetings Florian Am Donnerstag, dem 03.11.2022 um 20:54 + schrieb Philipp Zehnder: > Hi, > > I am also in favor of renaming the branches. > > @Tim, the master branch is only used for the releases. So, I guess "release" > is a good name for it. Maybe we can create / rename it during the next > release so we can test the suggestion of Chris. > > Cheers, > Philipp > > > Von: Dominik Riemer <[rie...@fzi.de](mailto:rie...@fzi.de)> > Gesendet: Donnerstag, November 3, 2022 9:48 PM > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: RE: [DISCUSS] What is the Master branch currently used for? > > As our release guide has almost as many different instructions for avoiding > merge conflicts as the number of releases we've had, doing a force push > should be definitely worth a try for the next release > > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Post-release+steps](https://cwiki.apache.org/confluence/display/STREAMPIPES/Post-release+steps) > > > > > > -Original Message- > From: Christofer Dutz > <[christofer.d...@c-ware.de](mailto:christofer.d...@c-ware.de)> > Sent: Thursday, November 3, 2022 9:27 PM > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > Subject: Re: [DISCUSS] What is the Master branch currently used for? > > Shouldn’t a force push to main/master/release help with that? > That’s what we do in PLC4X. > > Chris > > > From: Tim <[bosse...@posteo.de](mailto:bosse...@posteo.de)> > Date: Thursday, 3. November 2022 at 21:15 > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Subject: Re: [DISCUSS] What is the Master branch currently used for? > We could also try to not only rename our master branch, but create a new > branch based on master. In order to then get rid of our lengthy merge > conflicts we have with each relase. > What do you think about this? Are there any downsides of this that aren't on > my radar now? > > Best > Tim > > Am 03.11.2022 21:12 schrieb Tim: > > I'm also in favour of this renaming. > > > > Best > > Tim > > > > Am 03.11.2022 21:01 schrieb Dominik Riemer:> > > > Hi, > > > > > > yes, our master branch currently points to the latest release version. > > > I like the idea to rename "master" to "release" and "dev" to > > > "develop", what do you think? > > > > > > Cheers > > > Dominik > > > > > > On 2022/11/03 14:39:54 Christofer Dutz wrote:> > > > > > Hi, > > > > > > > > good point … also it tends to upset some people. Most projects > > > > settled on “main” instead of “master”. > > > > In the PLC4X project however we decided to call the development > > > > branch “develop” and the banch where we merge releases “release”. > > > > This way the branches sort of explain what they are themselves ;-) > > > > > > > > Chris > > > > > > > > > > > > From: Zike Yang <[z...@apache.org](mailto:z...@apache.org)> > > > > Date: Thursday, 3. November 2022 at 15:29 > > > > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > > > Subject: [DISCUSS] What is the Master branch currently used for? > > > > Hi all, > > > > > > > > We use the `dev` branch as the default branch. But there still > > > > exists the master branch.[0] And it was still updated 21 days ago. > > > > I'm curious about what the master branch is currently used for. > > > > > > > > I think it's better to rename the master branch to another name if > > > > it has other usage because it will confuse developers if there is > > > > already a default branch. Sometimes I would accidentally checkout to > > > > master and then realize something was wrong. > > > > > > > > What's your thought? > > > > > > > > [0] > > > > [https://github.com/apache/incubator-streampipes/tree/master](https://github.com/apache/incubator-streampipes/tree/master) > > > > > > > > Best, > > > > Zike Yang > > > >
[jira] [Created] (STREAMPIPES-614) Run style check on geo processors and all related classes
Florian Micklich created STREAMPIPES-614: Summary: Run style check on geo processors and all related classes Key: STREAMPIPES-614 URL: https://issues.apache.org/jira/browse/STREAMPIPES-614 Project: StreamPipes Issue Type: Task Reporter: Florian Micklich Assignee: Florian Micklich Run https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java in alle classes related to geo-jvm processors created by [~micklich] -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: AW: [DISCUSS] Automatic Typescript model generation
Hi, so I updated the conf page now [1]. I believe a final decision has to be made :) What Scan Scope in Tools -> CheckStyle -> 3. Set Scan Cope should we use? * Only Java sources (no tests) or * Only Java sources (with tests) Greetings Florian [1] https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java Am Donnerstag, dem 03.11.2022 um 09:58 +0100 schrieb Florian Micklich: > Hi Philipp, > > perfect! That was the solution. Now it is working > I will adjust it on confluence. > > Greetings > Florian > > > > Am Mittwoch, dem 02.11.2022 um 18:06 + schrieb Philipp Zehnder: > > Hi Florian, > > > > I just found out that there are also checkstyle configurations in the tool > > settings, maybe you can try them. > > Therefore, navigate to settings -> Tools -> Checkstyle. > > > > Please let me know if this worked. > > > > Cheers, > > Philipp > > > > Von: Florian Micklich > > <[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))> > > Datum: Montag, 31. Oktober 2022 um 11:33 > > An: > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > > > <[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))> > > Betreff: Re: AW: [DISCUSS] Automatic Typescript model generation > > Hi Philipp, > > > > so far so good. > > I also select "rules" -> "active configuration" but after I open a file, > > the run button is still grayed out. > > But If I select the other options like "SUN CHECKS" or "Google Checks", the > > button is available. > > To be sure, I use the > > > > ``` > > ../incubator-streampipes/tools/maven/checkstyle.xml > > ``` > > in the git repository. > > Does anyone else have a similar behavior? I use 2022.2.3 UE. > > > > Unfortunately I don't have write access to the conf page atm, due "An > > internal error occurred when trying to change your password." > > > > Florian > > > > > > > > Am Montag, dem 31.10.2022 um 08:13 + schrieb Philipp Zehnder:> > > > Hi Florian, > > > > > > It could be that something is still missing in the > > > instructions. > > > After I added the checkstyle rules I navigate to the checkstyle > > > toolbar. > > > Then I can select "rules" -> "active configuration". > > > When I then open a file, I can click the run button in the checkstyle > > > toolbar. > > > > > > If something is missing in the manual, please add it or we can discuss it > > > here. > > > > > > Cheers, > > > Philipp > > > > > > Von: Florian Micklich > > > <[[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))](mailto:[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org)))> > > > Datum: Freitag, 28. Oktober 2022 um 21:45 > > > An: > > > [[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))](mailto:[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))) > > > > > > <[[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))](mailto:[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)))> > > > Betreff: Re: AW: [DISCUSS] Automatic Typescript model > > > generation > > > > > > Hi, > > > I added the checkstyle.xml as mentioned [1]. Is there anythink else I > > > have to do to start the check? > > > > > > If I do "check all modified files in the checkStyle toolbar, and set > > > Rules to I get "No Rules file has been > > > configured". > > > > > > Greetings > > > Florian > > > > > > [1] > > > [[[https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java)](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cw
Re: [DISCUSS] Automatic Typescript model generation
Hi all, is there a way to link check style and reformat code (CTRL + alt +L) to fix some errors automatically? I know from other programming languages that I can call an auto fix e.g. in rubocop. I get an check style error ModifierOrder [1] for example here [2] but don't really know what to change Modifier 'static' differs from the recommended modifier order of the Java Language Specification. (38:11) [ModifierOrder] final static double LONGITUDE_MIN = -180.00; final static double LONGITUDE_MAX = 180.00; final static double LATITUDE_MIN = -90; final static double LATITUDE_MAX = 90; [1] https://checkstyle.sourceforge.io/apidocs/com/puppycrawl/tools/checkstyle/checks/modifier/ModifierOrderCheck.html [2] https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-processors-geo-jvm/src/main/java/org/apache/streampipes/processors/geo/jvm/jts/helper/SpGeometryBuilder.java#L27 Greetings Florian Am Dienstag, dem 25.10.2022 um 19:40 + schrieb Philipp Zehnder: > Hi, > > here are also the links to our checkstyle [1], ESLint [2], and Prettier [3] > configuration files. > > @Tim, I hope they help for the git pre-commit hook. > @all, please have a look if you like the configurations. I think we can > customize the styles, but we should see that all developers use the same > configurations. > Also, if someone else has any other best practices, I am happy to discuss > them to improve our project. > > Philipp > > [1] > [https://github.com/apache/incubator-streampipes/blob/dev/tools/maven/checkstyle.xml](https://github.com/apache/incubator-streampipes/blob/dev/tools/maven/checkstyle.xml) > [2] > [https://github.com/apache/incubator-streampipes/blob/dev/ui/.eslintrc.json](https://github.com/apache/incubator-streampipes/blob/dev/ui/.eslintrc.json) > [3] > [https://github.com/apache/incubator-streampipes/blob/dev/ui/.prettierrc.json](https://github.com/apache/incubator-streampipes/blob/dev/ui/.prettierrc.json) > > > Von: Philipp Zehnder > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > Datum: Montag, 24. Oktober 2022 um 22:21 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: AW: [DISCUSS] Automatic Typescript model generation > Hi Tim, > > I really like the idea. > For this we need a uniform style guide, right? > For the UI we recently switched to ESLint with Prettier as a formatter and > for Java we use checkstyle. Are those configurations then used by the > pre-commit hook? > And what kind of formatting can be done with it? > > Where do we need to configure the pre-commit hooks, is that something each > developer needs to configure, or can we configure it in the repository? > > Cheers, > Philipp > > > Von: Tim <[bosse...@posteo.de](mailto:bosse...@posteo.de)> > Datum: Sonntag, 23. Oktober 2022 um 13:48 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Re: [DISCUSS] Automatic Typescript model generation > Hi Philipp, > > I don't know if this can be solved with the maven plugin used for the > TypeScript generation. > An alternative idea of mine would be to use a git-hook for this. > We could create a git-hook for StreamPipes that checks each committed > file for the presence of the Apache header and adds it if it is missing. > Pre-commit hooks could also be used for style checks and so on. I'm > already planning to have a discussion about that approach in general on > our mailing list, but apparently you have been faster ;) So this could > be a good first use case for it. > > What do you think about this idea? > > Best > Tim > > Am 19.10.2022 22:39 schrieb Philipp Zehnder: > > Hi all, > > > > the TypeScript model for our UI is automatically generated from the > > Java classes as described in [1]. > > So far this had to be done manually. I added a small script to > > automate the process [2]. > > > > This already eases to update process, however the license headers > > still must be inserted manually. > > Does anyone have an idea how we could automate this step as well? > > > > Here is the link to the corresponding issue [3]. > > > > Cheers, > > Philipp > > > > [1] > > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Core-UI+Serialization](https://cwiki.apache.org/confluence/display/STREAMPIPES/Core-UI+Serialization) > > [2] > > [https://github.com/apache/incubator-streampipes/blob/dev/create-client-model.sh](https://github.com/apache/incubator-streampipes/blob/dev/create-client-model.sh) > > [3] > > [https://issues.apache.org/jira/projects/STREAMPIPES/issues/STREAMPIPES-600](https://issues.apache.org/jira/projects/STREAMPIPES/issues/STREAMPIPES-600)
Re: AW: [DISCUSS] Automatic Typescript model generation
Hi Philipp, perfect! That was the solution. Now it is working I will adjust it on confluence. Greetings Florian Am Mittwoch, dem 02.11.2022 um 18:06 + schrieb Philipp Zehnder: > Hi Florian, > > I just found out that there are also checkstyle configurations in the tool > settings, maybe you can try them. > Therefore, navigate to settings -> Tools -> Checkstyle. > > Please let me know if this worked. > > Cheers, > Philipp > > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Datum: Montag, 31. Oktober 2022 um 11:33 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Re: AW: [DISCUSS] Automatic Typescript model generation > Hi Philipp, > > so far so good. > I also select "rules" -> "active configuration" but after I open a file, the > run button is still grayed out. > But If I select the other options like "SUN CHECKS" or "Google Checks", the > button is available. > To be sure, I use the > > ``` > ../incubator-streampipes/tools/maven/checkstyle.xml > ``` > in the git repository. > Does anyone else have a similar behavior? I use 2022.2.3 UE. > > Unfortunately I don't have write access to the conf page atm, due "An > internal error occurred when trying to change your password." > > Florian > > > > Am Montag, dem 31.10.2022 um 08:13 + schrieb Philipp Zehnder: > > Hi Florian, > > > > It could be that something is still missing in the instructions. > > After I added the checkstyle rules I navigate to the checkstyle > > toolbar. > > Then I can select "rules" -> "active configuration". > > When I then open a file, I can click the run button in the checkstyle > > toolbar. > > > > If something is missing in the manual, please add it or we can discuss it > > here. > > > > Cheers, > > Philipp > > > > Von: Florian Micklich > > <[[mickl...@apache.org](mailto:mickl...@apache.org)](mailto:[mickl...@apache.org](mailto:mickl...@apache.org))> > > Datum: Freitag, 28. Oktober 2022 um 21:45 > > An: > > [[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)) > > > > <[[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)](mailto:[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org))> > > Betreff: Re: AW: [DISCUSS] Automatic Typescript model generation > > > > Hi, > > I added the checkstyle.xml as mentioned [1]. Is there anythink else I have > > to do to start the check? > > > > If I do "check all modified files in the checkStyle toolbar, and set Rules > > to I get "No Rules file has been > > configured". > > > > Greetings > > Florian > > > > [1] > > [[https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java)](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java))https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java%5d(https:/cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java)%3cbr](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java%5d(https:/cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java)%3cbr)>> > > > > > > > > > > Am Mittwoch, dem 26.10.2022 um 09:52 + schrieb Philipp > > Zehnder:> > > > Hi Tim, > > > > > > thanks for providing the links. > > > I added a short description for Java in [1]. Maybe we can use this as the > > > central place for best practices. You are welcome to change and customize > > > anything. > > > > > > I will also add a similar description for Typescript & > > > Angular. > > > > > > > > > [1] > > > [[[https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java)](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java))](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java)](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.o
Re: AW: [DISCUSS] StreamPipes graduation: Draft Resolution
Hi, many thanks from my side as well :) I support Philipp for the PMC chair as well. If there is anything I can do, let me know. Greetings Florian Am Mittwoch, dem 02.11.2022 um 20:46 + schrieb Dominik Riemer: > Thanks for your feedback and thanks @Philipp for volunteering! > > We need a formal vote for the PMC chair which will happen on the private > list. In case you have any further feedback on the resolution text > (especially the mission statement), please provide your feedback until > tomorrow. > > Cheers, > Dominik > > On 2022/11/02 19:20:20 Tim wrote: > > Hi Dominik, > > > > thank you very much for pushing the graduation process. > > From my side, the charter is also fine. To put it another way, I have no > > > > desire to change anything. > > > > Philip is a great proposal for our first PMC Chair, I fully support it. > > > > Best > > Tim > > > > Am 02.11.2022 18:59 schrieb Philipp Zehnder:> > > > Hi Dominik, > > > > > > thank you for the preparation and organization of the graduation > > > process. > > > I think the charter is good and I didn't notice anything. > > > I still find the mission statement very fitting, and I really like it. > > > > > > Thank you also for your suggestion. I would be happy to take on the > > > role of the first PMC chair. > > > If there are other suggestions from the community, I am also happy to > > > discuss them. > > > > > > Cheers, > > > Philipp > > > > > > > > > > > > Von: Dominik Riemer > > > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > > > Datum: Montag, 31. Oktober 2022 um 21:06 > > > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > > Betreff: [DISCUSS] StreamPipes graduation: Draft Resolution > > > Hi all, > > > > > > now that our community graduation vote [1] has passed [2], there are a > > > few remaining steps before bringing the vote to the Apache Incubator: > > > > > > * Prepare a draft charter > > > * Decide on the initial Project Management Committee (PMC) > > > * Choose our first PMC Chair > > > > > > For the charter, I used the Whimsy tool [3] to generate a draft (see > > > below). Please read it (especially the mission statement) and respond > > > if you have any ideas for improvement. > > > In terms of the PMC, the draft resolution lists all current members of > > > the StreamPipes PPMC as the initial PMC. Please let me know in case > > > you feel there should be any changes. > > > Regarding the first PMC Chair, the responsibilities of the PMC chair > > > include reporting to the ASF board four times a year, needs to > > > subscribe to the board maliing list and to be aware of board concerns > > > [4]. I'd like to propose Philipp as the initial PMC chair in case he's > > > willing to do that and if there are no objections. > > > > > > So here's the draft resolution, any feedback is welcome! > > > > > > > > > --- > > > > > > Establish the Apache StreamPipes Project > > > > > > WHEREAS, the Board of Directors deems it to be in the best interests > > > of > > > the Foundation and consistent with the Foundation's purpose to > > > establish > > > a Project Management Committee charged with the creation and > > > maintenance > > > of open-source software, for distribution at no charge to the public, > > > related to a self-service Industrial IoT toolbox which enables > > > non-technical users to connect, analyze and explore IoT > > > data streams. > > > > > > NOW, THEREFORE, BE IT RESOLVED, that a Project Management Committee > > > (PMC), to be known as the "Apache StreamPipes Project", be and hereby > > > is > > > established pursuant to Bylaws of the Foundation; and be it further > > > > > > RESOLVED, that the Apache StreamPipes Project be and hereby is > > > responsible for the creation and maintenance of software related to a > > > self-service Industrial IoT toolbox which enables non-technical users > > > to > > > connect, analyze and explore IoT data streams; and be it > > > further > > > > > > RESOLVED, that the office of "Vice President, Apache StreamPipes" be > > > and > > > hereby is created, the person holding such office to serve at the > > > direction of the Board of Directors as the chair of the Apache > > > StreamPipes Project, and to have primary responsibility for management > > > of the projects within the scope of responsibility of the Apache > > > StreamPipes Project; and be it further > > > > > > RESOLVED, that the persons listed immediately below be and hereby are > > > appointed to serve as the initial members of the Apache StreamPipes > > > Project: > > > > > > * Christofer Dutz <[cd...@apache.org](mailto:cd...@apache.org)> > > > * Dominik Riemer > > > <[rie...@apache.org](mailto:rie...@apache.org)> > > > * Grainier Perera > > > <[grain...@apache.org](mailto:grain...@apache.org)> > > > * Jean-Baptiste Onofré > > >
talk submission for FOSSGIS 2023 ?
Hi all, I am thinking about to prepare a 20 min talk at the FOSSGIS 2023 in Berlin [1]. Sorry, the description is only in German. FOSSGIS is the largest German-speaking conference for Open Source Software for geoinformation The main part would be about the geo processors due the missing key operator reprojection is almost done. But also a good opportunity to show the main concept of streampipes as well. By next Monday we would have to submit a short description [2] Basically what we have to do: ``` You write your title and a short description of what it is about. In the Summary text box you describe what it is about in 5-x sentences. The program committee will read it and evaluate your submission. The community gets to read the description during the community voting. The summary will be published in the program when the presentation is accepted. If you want, you can write a longer contribution for the conference proceedings (up to 5 pages with pictures and so on, depending on what you want to write). You will be informed about this by mail. The conference proceedings have an ISBN and can be cited. ``` The final paper submission would be on end of January 2023. What do you think about it. What base information about streampipes should be in the talk? I would prepare a short description and the summary if you want and discuss this later as well Greetings Florian [1] https://pretalx.com/fossgis2023/cfp [2] https://pretalx.com/fossgis2023/submit/8WBm1D/info/
Re: [DISCUSS] Setup for Coordinate Reference System Reprojection Sources
Hi, I updated the Jira Ticket and described the setup little bit more. If my intellij is working I can run some last tests on the base implementation. My thoughts for the setup implementation: The setup could be visible in the Configuration -> Pipeline Element Configuration and if the service is available due correct setup and scripts import. (see picture in jira ticket To have still a plug and play system by default, we could implement a "fallback" projection system with a limited EPSG Codes. Therefore we could use proj4j [2]. So for example we allow the user to select just a bunch of valid codes from a list somewhere. [1] https://github.com/locationtech/proj4j What do you think? Greetings Florian Am Montag, dem 19.09.2022 um 10:18 +0200 schrieb Florian Micklich: > Hi Philipp, > > ok, maybe we can have a deeper discussion next week. > I am on vacation this week without computer :) > > With dataSource I mean the "Registration by Java code" as describet here > [1]. > I startet to write that code yesterday but was not able to check it due > another issue. > > Florian > > > [1] [https://sis.apache.org/epsg.html](https://sis.apache.org/epsg.html) > > > BlueMail for Android herunterladen > > Am 19. Sept. 2022, 07:23, um 07:23, Philipp Zehnder > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > schrieb: > > Hi Florian, > > > > thanks for opening the issue. > > I really like the illustration, something like this would also be great > > for the documentation of the processing elements. > > > > As for the workflow, I'm not quite sure how we can handle that. Because > > so far, the idea is that the system is plug and play. > > The normal ‘user’ should not have to configure things on the system > > before it is used. > > My suggestion would be to have a separate service that can optionally > > be integrated by manually adding it to the docker-compose. > > In this docker service a volume mapping would be required. If the files > > are missing a message should be printed to the logs. > > > > What do you mean by connection source? > > > > Cheers, > > Philipp > > > > > > > > Von: Florian Micklich > > <[florian.mickl...@mailbox.org.INVALID](mailto:florian.mickl...@mailbox.org.INVALID)> > > Datum: Sonntag, 18. September 2022 um 12:44 > > An: dev > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > Betreff: [DISCUSS] Setup for Coordinate Reference System Reprojection > > Sources > > Hi everybody, > > > > I created a Ticket [1] to implement projection handling for geo > > operations. > > > > User case.: > > > > Reproject betwwen WGS84 (with units Degree) to UTM (Unit meter). > > With meter you can do calculations , which needs a metric Unit system > > e.g. area calculation, everything with distance and so on. > > > > I also added a short wortkflow picture for better understanding and a > > docker-compose file for SP Service. > > > > While I am working on the processor itself, I have a couple of > > questions and would need support for implementing everything in the the > > SP UI and discuss best ways how to set up! > > > > Any ideas or questions? > > > > Greetings > > Florian > > > > [1] > > [https://issues.apache.org/jira/browse/STREAMPIPES-584](https://issues.apache.org/jira/browse/STREAMPIPES-584)
Re: AW: [DISCUSS] Automatic Typescript model generation
Hi Philipp, so far so good. I also select "rules" -> "active configuration" but after I open a file, the run button is still grayed out. But If I select the other options like "SUN CHECKS" or "Google Checks", the button is available. To be sure, I use the ``` ../incubator-streampipes/tools/maven/checkstyle.xml ``` in the git repository. Does anyone else have a similar behavior? I use 2022.2.3 UE. Unfortunately I don't have write access to the conf page atm, due "An internal error occurred when trying to change your password." Florian Am Montag, dem 31.10.2022 um 08:13 + schrieb Philipp Zehnder: > Hi Florian, > > It could be that something is still missing in the instructions. > After I added the checkstyle rules I navigate to the checkstyle toolbar. > Then I can select "rules" -> "active configuration". > When I then open a file, I can click the run button in the checkstyle > toolbar. > > If something is missing in the manual, please add it or we can discuss it > here. > > Cheers, > Philipp > > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Datum: Freitag, 28. Oktober 2022 um 21:45 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: Re: AW: [DISCUSS] Automatic Typescript model generation > > Hi, > I added the checkstyle.xml as mentioned [1]. Is there anythink else I have to > do to start the check? > > If I do "check all modified files in the checkStyle toolbar, and set Rules to > I get "No Rules file has been configured". > > Greetings > Florian > > [1] > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java) > > > > > Am Mittwoch, dem 26.10.2022 um 09:52 + schrieb Philipp Zehnder: > > Hi Tim, > > > > thanks for providing the links. > > I added a short description for Java in [1]. Maybe we can use this as the > > central place for best practices. You are welcome to change and customize > > anything. > > > > I will also add a similar description for Typescript & Angular. > > > > > > [1] > > [[https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java)](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java))https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java%5d(https:/cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java)%3cbr](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java%5d(https:/cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java)%3cbr)>> > > > > ……… > > Philipp Zehnder > > > > Bytefabrik.AI GmbH > > Haid-und-Neu-Str. 10–14 > > 76131 Karlsruhe > > Tel.: +49 721 9654-805 > > > > [[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)](mailto:[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)) > > [[www.bytefabrik.ai](http://www.bytefabrik.ai](http://www.bytefabrik.ai](http://www.bytefabrik.ai)<[http://www.bytefabrik.ai](http:/www.bytefabrik.ai](http://www.bytefabrik.ai](http:/www.bytefabrik.ai)>) > > > > <[[https://www.bytefabrik.ai/](https://www.bytefabrik.ai/](https://www.bytefabrik.ai/](https://www.bytefabrik.ai/)<[https://www.bytefabrik.ai/%5d(https:/www.bytefabrik.ai/](https://www.bytefabrik.ai/%5d(https:/www.bytefabrik.ai/)>)> > > | > > [[www.twitter.com/bytefabrik](http://www.twitter.com/bytefabrik)](http://www.twitter.com/bytefabrik](http://www.twitter.com/bytefabrik))<[[https://www.bytefabrik.ai/](https://www.bytefabrik.ai/)](https://www.bytefabrik.ai/](https://www.bytefabrik.ai/))>http://www.twitter.com/bytefabrik%5d(http:/www.twitter.com/bytefabrik)%3c%5bhttps:/www.bytefabrik.ai/%5d(https:/www.bytefabrik.ai/)%3e%3cbr](http://www.twitter.com/bytefabrik%5d(http:/www.twitter.com/bytefabrik)%3c%5bhttps:/www.bytefabrik.ai/%5d(https:/www.bytefabrik.ai/)%3e%3cbr)>> > > > > ……… > > Bytefabrik.AI GmbH > > Sitz der Gesellschaft: Karlsruhe > > Registergericht: Amtsgericht Mannheim, HRB 741226 > > Geschäftsführer: Dr.-Ing. Dominik Riemer, Dr.-Ing. Philipp Zehnder > > ……… > > > > > > Von: Tim > > <[[bosse...@posteo.de](mailto:bosse...@posteo.de)](mailto:[bosse...@posteo.de](mailto:bosse...@posteo.de))>
Re: yet another IntelliJ problem
ContextHolderAwareRequestFilter@7d66a126, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@375084c9, org.springframework.security.web.session.SessionManagementFilter@7f6b7426, org.springframework.security.web.access.ExceptionTranslationFilter@57a667c8, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@6bb4cc0e] 2022-10-31 10:29:49.698 INFO 23495 --- [ main] io.undertow : starting server: Undertow - 2.2.17.Final 2022-10-31 10:29:49.709 INFO 23495 --- [ main] org.xnio : XNIO version 3.8.6.Final 2022-10-31 10:29:49.722 INFO 23495 --- [ main] org.xnio.nio : XNIO NIO Implementation Version 3.8.6.Final 2022-10-31 10:29:49.809 INFO 23495 --- [ main] org.jboss.threads : JBoss Threads version 3.1.0.Final 2022-10-31 10:29:49.856 INFO 23495 --- [ main] o.s.b.w.e.undertow.UndertowWebServer : Undertow started on port(s) 7023 (http) 2022-10-31 10:29:49.868 INFO 23495 --- [ main] o.a.s.e.all.jvm.AllExtensionsInit: Started AllExtensionsInit in 2.154 seconds (JVM running for 4.293) 2022-10-31 10:29:49.935 INFO 23495 --- [ main] o.a.s.commons.networking.Networking : Using auto-discovered IP: 127.0.1.1 2022-10-31 10:29:50.304 INFO 23495 --- [ main] c.c.w.i.ConnectWorkerRegistrationService : Successfully connected to master. Worker is now running. ``` Greetings [1] https://github.com/apache/incubator-streampipes/blob/dev/development/.env [2] https://github.com/apache/incubator-streampipes/tree/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development Am Montag, dem 31.10.2022 um 08:21 + schrieb Philipp Zehnder: > Hi Florian, > > can you try to remove the SP_HOST from the environment variables. > We now use auto discovery to get the IP address. Auto discovery is used when > no SP_HOST variable is set. > > To see if it is working you can check the logs. A message should appear > stating that auto discovery is being used. E.g.: > [main] INFO org.apache.streampipes.commons.networking.Networking - Using > auto-discovered IP: 192.168.0.56 > > If this does not work, please send the logs so we can check what is going > wrong. > > Cheers, > Philipp > > > > Von: Florian Micklich <[mickl...@apache.org](mailto:mickl...@apache.org)> > Datum: Samstag, 29. Oktober 2022 um 18:47 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Betreff: yet another IntelliJ problem > Hi all, > > I have again a small develop problem due moving setup to a new computer. > Breakpoints and log output do not create any actions in intelij (I set them > in the processor in the onEvent method) > > The CLI is running and is also representative in consul > (org.apache.streampipes.extensions.all.jvm-zeOgsy) > > If I start the debugger in IntelliJ, the service is shown up in consul > (org.apache.streampipes.extensions.all.jvm-Fj76Sh) but get an "All service > checks failing" with the output: > > > ``` > Get > "[http://127.0.1.1:7023/svchealth/Fj76Sh](http://127.0.1.1:7023/svchealth/Fj76Sh)": > dial tcp 127.0.1.1:7023: connect: connection refused > `` > > My env looks like this and I set SP_HOST to my local IP address as mentioned > here [1] due I use Linux. > > ``` > # Those parameters are used by IntelliJ to set the default consul parameters > for development > SP_PORT=7023 > SP_HOST=192.168.178.100 > SP_DEBUG=true > SP_COUCHDB_HOST=localhost > SP_JMS_HOST=localhost > SP_JMS_PORT=61616 > SP_DATA_LAKE_HOST=localhost > SP_DATA_LAKE_PORT=8086 > SP_BACKEND_HOST=localhost > SP_BACKEND_PORT=8030 > `` > > If I call [http://localhost:7023/](http://localhost:7023/) I guess that I see > the elements from the CLI but why is it refused? > > Any suggestion what to do? > > Greetings > Florian > > [1] > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions](https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions)
yet another IntelliJ problem
Hi all, I have again a small develop problem due moving setup to a new computer. Breakpoints and log output do not create any actions in intelij (I set them in the processor in the onEvent method) The CLI is running and is also representative in consul (org.apache.streampipes.extensions.all.jvm-zeOgsy) If I start the debugger in IntelliJ, the service is shown up in consul (org.apache.streampipes.extensions.all.jvm-Fj76Sh) but get an "All service checks failing" with the output: ``` Get "http://127.0.1.1:7023/svchealth/Fj76Sh": dial tcp 127.0.1.1:7023: connect: connection refused `` My env looks like this and I set SP_HOST to my local IP address as mentioned here [1] due I use Linux. ``` # Those parameters are used by IntelliJ to set the default consul parameters for development SP_PORT=7023 SP_HOST=192.168.178.100 SP_DEBUG=true SP_COUCHDB_HOST=localhost SP_JMS_HOST=localhost SP_JMS_PORT=61616 SP_DATA_LAKE_HOST=localhost SP_DATA_LAKE_PORT=8086 SP_BACKEND_HOST=localhost SP_BACKEND_PORT=8030 `` If I call http://localhost:7023/ I guess that I see the elements from the CLI but why is it refused? Any suggestion what to do? Greetings Florian [1] https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions
Re: AW: [DISCUSS] Automatic Typescript model generation
Hi, I added the checkstyle.xml as mentioned [1]. Is there anythink else I have to do to start the check? If I do "check all modified files in the checkStyle toolbar, and set Rules to I get "No Rules file has been configured". Greetings Florian [1] https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java Am Mittwoch, dem 26.10.2022 um 09:52 + schrieb Philipp Zehnder: > Hi Tim, > > thanks for providing the links. > I added a short description for Java in [1]. Maybe we can use this as the > central place for best practices. You are welcome to change and customize > anything. > > I will also add a similar description for Typescript & Angular. > > > [1] > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java) > > ……… > Philipp Zehnder > > Bytefabrik.AI GmbH > Haid-und-Neu-Str. 10–14 > 76131 Karlsruhe > Tel.: +49 721 9654-805 > > [philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai) > [www.bytefabrik.ai](http://www.bytefabrik.ai) > <[https://www.bytefabrik.ai/](https://www.bytefabrik.ai/)> | > [www.twitter.com/bytefabrik](http://www.twitter.com/bytefabrik)<[https://www.bytefabrik.ai/](https://www.bytefabrik.ai/)> > > ……… > Bytefabrik.AI GmbH > Sitz der Gesellschaft: Karlsruhe > Registergericht: Amtsgericht Mannheim, HRB 741226 > Geschäftsführer: Dr.-Ing. Dominik Riemer, Dr.-Ing. Philipp Zehnder > ……… > > > Von: Tim <[bosse...@posteo.de](mailto:bosse...@posteo.de)> > Datum: Dienstag, 25. Oktober 2022 um 21:47 > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > Cc: Philipp Zehnder > <[philipp.zehn...@bytefabrik.ai](mailto:philipp.zehn...@bytefabrik.ai)> > Betreff: Re: AW: [DISCUSS] Automatic Typescript model generation > Hi, > > yes that would be benefial. > I've notices that we already have confluence pages for that: [1] [2] > it's just up to us to fill them with live ;) > > Let's see whether we can use these tools in a pre-commit hook, but that > shouldn't be an issue since any executable can be defined as git hook. > Usually, you add a pre-commit hook file to the repository. > This file then needs to be configured by each developer as pre-commit > hook but this really simple and can be done with one git command. > When describing it properly in the development guide and/or README, this > shouldn't be a high bar for any developer. > > I would be happy to move this topic forward with you. > > Best > Tim > > [1] > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Java) > [2] > [https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Typescript](https://cwiki.apache.org/confluence/display/STREAMPIPES/Code+Style+-+Typescript) > > Am 24.10.2022 22:21 schrieb Philipp Zehnder: > > Hi Tim, > > > > I really like the idea. > > For this we need a uniform style guide, right? > > For the UI we recently switched to ESLint with Prettier as a formatter > > and for Java we use checkstyle. Are those configurations then used by > > the pre-commit hook? > > And what kind of formatting can be done with it? > > > > Where do we need to configure the pre-commit hooks, is that something > > each developer needs to configure, or can we configure it in the > > repository? > > > > Cheers, > > Philipp > > > > > > Von: Tim <[bosse...@posteo.de](mailto:bosse...@posteo.de)> > > Datum: Sonntag, 23. Oktober 2022 um 13:48 > > An: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > Betreff: Re: [DISCUSS] Automatic Typescript model generation > > Hi Philipp, > > > > I don't know if this can be solved with the maven plugin used for the > > TypeScript generation. > > An alternative idea of mine would be to use a git-hook for this. > > We could create a git-hook for StreamPipes that checks each committed > > file for the presence of the Apache header and adds it if it is > > missing. > > Pre-commit hooks could also be used for style checks and so on. I'm > > already planning to have a discussion about that approach in general on > > our mailing list, but apparently you have been faster ;) So this could > > be a good first use case for it. > > > > What do you think about this idea? > > > > Best > > Tim > > > > Am 19.10.2022 22:39 schrieb Philipp Zehnder:> > > > Hi all, > > > > > > the TypeScript model for our UI is automatically generated from the > > > Java classes as described in [1]. > > > So far this had to be done manually. I added a small script to > > > automate the process [2]. > > > > > > This already eases to update process, however the license headers > > > still must be inserted manually. > > > Does anyone have an idea how we could
Re: [ANNOUNCE] New Committer: Zike Yang
Hi Zike, also from me congrats and welcome to the team :) What is your plan to work on mainly? Greetings Florian Am Freitag, dem 21.10.2022 um 15:10 + schrieb Dominik Riemer: > Hi all, > > on behalf of the StreamPipes PPMC, it is my pleasure to inform you that Zike > Yang has accepted the offer to become committer of the StreamPipes > project! > > Zike has already worked on some important improvements such as the Pulsar > connector and sink and the establishment of an integration test framework. > > Please join me in congratulating Zike! > > Cheers > Dominik
Re: [DISCUSS] Graduate StreamPipes as TLP?
Hi Dominik, the voting already started but neverless I would like to note once again the very good development that StreamPipes has made. I also like the discussions in the mailing list. I don't know exactly how the process will work now. What are the next steps? Greetings Florian Am Dienstag, dem 25.10.2022 um 19:04 + schrieb Dominik Riemer: > Hi Chris, > > thanks for bringing this up! > > I think all PPMC members have also subscribed to the list - what about an > opt-out approach where PPMC members who don't want to be part of the PMC can > express that before preparing the board resolution? > > Personally, I think it would be great to have at least all PPMC members in > the initial PMC. > > Also, in this thread any opinion regarding graduation is highly welcome > independent from being active or less-active PPMC member, committer or > contributor ;-) > > Cheers > Dominik > > On 2022/10/25 08:18:54 Christofer Dutz wrote: > > With my mentor hat on: I think you are ready, so I support this. > > > > Also think about discussing things like: Who will be part of the initial > > PMC? I remember in PLC4X we had loads of totally inactive PPMC members, > > some never even bothered signing up for the private project list or the > > project list. So We used that to shed ourselves of dead-skin ;-) > > > > Chris > > > > > > From: Dominik Riemer > > <[dominik.rie...@bytefabrik.ai](mailto:dominik.rie...@bytefabrik.ai)> > > Date: Monday, 24. October 2022 at 18:18 > > To: [dev@streampipes.apache.org](mailto:dev@streampipes.apache.org) > > <[dev@streampipes.apache.org](mailto:dev@streampipes.apache.org)> > > Subject: [DISCUSS] Graduate StreamPipes as TLP? > > Hi, > > > > since StreamPipes joined the Apache Incubator in November 2019, a lot has > > happened: > > > > * We’ve had five releases in the incubator so far, with three different > > release managers > > * We’ve had steady community growth with many new committers & PPMC > > members > > * We have constant traffic on the mailing lists and I think we have > > really adopted the Apache way for development > > * StreamPipes has now over 9.000 commits, has evolved in terms of > > quality and feature-richness and we had many talks at ApacheCons and many > > other events to increase attention for our tool > > * Our self-assessment of the maturity model [1] looks good and all > > boxes are ticked > > > > So from my personal view, we are quite ready for graduation to a TLP! > > > > The graduation process foresees that we as a community discuss graduation > > readiness and have a community vote. Afterwards, we bring this to the > > Incubator list where another vote happens. Finally, the ASF board makes the > > final decision on graduation to a top-level project. The whole process will > > probably take several weeks. > > > > But first – what do you think? Should we go for graduation? > > > > Cheers > > Dominik > > > > [1] > > [https://cwiki.apache.org/confluence/display/STREAMPIPES/StreamPipes+Maturity+Checklist](https://cwiki.apache.org/confluence/display/STREAMPIPES/StreamPipes+Maturity+Checklist) > >
Re: [DISCUSS] Setup for Coordinate Reference System Reprojection Sources
Hi Philipp, ok, maybe we can have a deeper discussion next week. I am on vacation this week without computer :) With dataSource I mean the "Registration by Java code" as describet here [1]. I startet to write that code yesterday but was not able to check it due another issue. Florian [1] https://sis.apache.org/epsg.html BlueMail for Android herunterladen Am 19. Sept. 2022, 07:23, um 07:23, Philipp Zehnder schrieb: >Hi Florian, > >thanks for opening the issue. >I really like the illustration, something like this would also be great >for the documentation of the processing elements. > >As for the workflow, I'm not quite sure how we can handle that. Because >so far, the idea is that the system is plug and play. >The normal ‘user’ should not have to configure things on the system >before it is used. >My suggestion would be to have a separate service that can optionally >be integrated by manually adding it to the docker-compose. >In this docker service a volume mapping would be required. If the files >are missing a message should be printed to the logs. > >What do you mean by connection source? > >Cheers, >Philipp > > > >Von: Florian Micklich >Datum: Sonntag, 18. September 2022 um 12:44 >An: dev >Betreff: [DISCUSS] Setup for Coordinate Reference System Reprojection >Sources >Hi everybody, > >I created a Ticket [1] to implement projection handling for geo >operations. > >User case.: > >Reproject betwwen WGS84 (with units Degree) to UTM (Unit meter). >With meter you can do calculations , which needs a metric Unit system >e.g. area calculation, everything with distance and so on. > >I also added a short wortkflow picture for better understanding and a >docker-compose file for SP Service. > >While I am working on the processor itself, I have a couple of >questions and would need support for implementing everything in the the >SP UI and discuss best ways how to set up! > >Any ideas or questions? > >Greetings >Florian > >[1] https://issues.apache.org/jira/browse/STREAMPIPES-584
Re: CLI Installer does not start anymore
Hi Philipp, no, that was a really odd behaviour. I was able to "fix" it but still donˋt know why this was happening. To fix this situatuation I made a new git pull into a seperate folder, set the environment to pipeline elemnts and started the container. This was working like expected. Then I checked the difference between the old and new cli folder and the only difference was the spenv file. This was not existing in the new folder. Do double check I coppied the spenv file into the new folder and started the containers and it was still working. And now comes the fun part. Then I gave the old cli another try (without doing anything) and it was starting again as well! oO So I donˋt really now why and what. Can you explain how the spenv file is created and what it is for. I missed that bit. Florian BlueMail for Android herunterladen Am 19. Sept. 2022, 06:58, um 06:58, Philipp Zehnder schrieb: >Hi Florian, > >did you pull the git repository into a new directory? >If that is the case, you must run ‘streampipes env --set #ENVIRONMENT’. >For #ENVIRONMENT you can select one of the predefined environments in >the directory /cli/environments/. > >Please let me know if that solves the problem. > >Cheers, >Philipp > >Von: Florian Micklich >Datum: Sonntag, 18. September 2022 um 00:51 >An: dev >Betreff: CLI Installer does not start anymore >Hi, > >I just pulled to the latest dev commit >(4c039efb804dccc1262b9e9bbbcd2797801fa24e) >I don't know if this action is related, but since then I can't launch >the CLI installer. > >No Docker containers are started and only the following message >appears: > >streampipes up -d ___ __ __ >__ | __| |_..-.---.-..| __ \__|.-.-.-- >---. |__ | _| _| -__| _ |||__/ || _ | -__|__ >--| |___||__| >|_|___._|__|__|__||___| |__|| __|_|_| > |__| >Welcome to Apache StreamPipes - wait for installation to be finished... >[INFO] Version: 0.71.0-SNAPSHOT[INFO] Environment: 'pipeline- >element'[INFO] Mode: Development mode, all ports mapped > >I also did a "streampipes clean" to get sure that nothing previous is >dangling but still same result. > > streampipes clean > >[WARN] This will remove:- StreamPipes docker network- all >dangling StreamPipes images >Are you sure you want to continue? [y/N]: y[INFO] No dangling >StreamPipes images found[INFO] No StreamPipes docker network found > >Can someone check if this is a generell problem or only on my side >(again)? > >Greetings >Florian
[DISCUSS] Setup for Coordinate Reference System Reprojection Sources
Hi everybody, I created a Ticket [1] to implement projection handling for geo operations. User case.: Reproject betwwen WGS84 (with units Degree) to UTM (Unit meter). With meter you can do calculations , which needs a metric Unit system e.g. area calculation, everything with distance and so on. I also added a short wortkflow picture for better understanding and a docker-compose file for SP Service. While I am working on the processor itself, I have a couple of questions and would need support for implementing everything in the the SP UI and discuss best ways how to set up! Any ideas or questions? Greetings Florian [1] https://issues.apache.org/jira/browse/STREAMPIPES-584
[jira] [Created] (STREAMPIPES-584) Implementing possibility fpr reprojection Coordinates
Florian Micklich created STREAMPIPES-584: Summary: Implementing possibility fpr reprojection Coordinates Key: STREAMPIPES-584 URL: https://issues.apache.org/jira/browse/STREAMPIPES-584 Project: StreamPipes Issue Type: New Feature Components: Backend, Pipeline Elements Reporter: Florian Micklich Fix For: 0.70.0 Essential Task in Geo is to reproject between different Coordinate Reference Systems (CRS) e.g for special calculations which needs meter as CRS Unit instead of degree (as it it in WGS84) Lib for reprojection would be https://sis.apache.org/ Necessary extra package is the EPSG Library Source, which needs a special license agreement (not apache license) Following Workflow (to be discussed) -- This message was sent by Atlassian Jira (v8.20.10#820010)
CLI Installer does not start anymore
Hi, I just pulled to the latest dev commit (4c039efb804dccc1262b9e9bbbcd2797801fa24e) I don't know if this action is related, but since then I can't launch the CLI installer. No Docker containers are started and only the following message appears: streampipes up -d ___ __ __ __ | __| |_..-.---.-..| __ \__|.-.-.-- ---. |__ | _| _| -__| _ |||__/ || _ | -__|__ --| |___||__| |_|___._|__|__|__||___| |__|| __|_|_| |__| Welcome to Apache StreamPipes - wait for installation to be finished... [INFO] Version: 0.71.0-SNAPSHOT[INFO] Environment: 'pipeline- element'[INFO] Mode: Development mode, all ports mapped I also did a "streampipes clean" to get sure that nothing previous is dangling but still same result. streampipes clean [WARN] This will remove:- StreamPipes docker network- all dangling StreamPipes images Are you sure you want to continue? [y/N]: y[INFO] No dangling StreamPipes images found[INFO] No StreamPipes docker network found Can someone check if this is a generell problem or only on my side (again)? Greetings Florian
