I successfully started StreamPipes via CLI. I used instructions provided on StreamPipes Wiki<https://cwiki.apache.org/confluence/display/STREAMPIPES/Test+StreamPipes>. The problem was in the fact that I did not use 'set-template' command before 'start' command, so i got following error which is accounted for in said instructions:
[INFO] Starting StreamPipes [INFO] StreamPipes network already exists. Continuing .OSError: [Errno 22] Invalid argument: 'C:/StreamPipes/incubator-streampipes-installer/cli/services/activemq\r/docker-compose.yml' [ERROR] Error occured while executing the StreamPipes command. Everything works well, as it seems. Thank you for your support. Best regards, Branislav ________________________________ From: Branislav Jovicic <[email protected]> Sent: Monday, August 3, 2020 9:35 AM To: [email protected] <[email protected]> Subject: Re: Creating custom pipeline element Yes, I used installer with the lite/full version. Could you provide a step-by-step explanation of how to start StreamPipes using CLI? I found README file a bit confusing, sorry. Branislav ________________________________ From: Dominik Riemer <[email protected]> Sent: Thursday, July 30, 2020 3:25 PM To: [email protected] <[email protected]> Subject: Re: Creating custom pipeline element Hi Branislav, I assume you used the installer with the lite or full version? In this case, the only ports that are exposed by the docker-based installer are the ports that are the ports that are needed by the UI. We closed all other external ports to avoid port conflicts. For development purposes, we recommend using the CLI tool (which can be found in the cli folder of the installation zip file). In this version, all ports necessary for development are open by default. Alternatively, you can also uncomment closed ports in the generated docker-compose.yml file (e.g., have a look at the consul service), but we recommend using the CLI for development. Hope this helps, if you have any other questions, feel free to ask! Dominik On 2020/07/29 11:17:35, Branislav Jovicic <[email protected]> wrote: > Greetings, > > I was able to successfully install and run StreamPipes. I created a simple > pipeline following provided tutorial in the Pipeline Editor. > > Afterwards i tried to follow > this<https://streampipes.apache.org/docs/docs/dev-guide-archetype/> tutorial > and create a custom pipeline element: > > * I am using IntelliJ IDE > * I created the project using following command: mvn archetype:generate > -DarchetypeGroupId=org.apache.streampipes > -DarchetypeArtifactId=streampipes-archetype-pe-processors-jvm > -DarchetypeVersion=0.66.0 -DgroupId=org.apache.streampipes.test > -DartifactId=TestProcessor -DclassNamePrefix=TestProcessor -DpackageName=test > * I edited processor's onEvent method according to instructions. > > However, when i tried running the project i got following error regarding > Consul: > > """ > 09:59:25,289 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could > NOT find resource [logback-test.xml] > 09:59:25,289 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could > NOT find resource [logback.groovy] > 09:59:25,290 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found > resource [logback.xml] at > [jar:file:/home/nissa/.m2/repository/org/apache/streampipes/streampipes-commons/0.66.0/streampipes-commons-0.66.0.jar!/logback.xml] > 09:59:25,298 |-INFO in > ch.qos.logback.core.joran.spi.ConfigurationWatchList@281e3708 - URL > [jar:file:/home/nissa/.m2/repository/org/apache/streampipes/streampipes-commons/0.66.0/streampipes-commons-0.66.0.jar!/logback.xml] > is not of type file > 09:59:25,337 |-INFO in > ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not > set > 09:59:25,337 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - > About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] > 09:59:25,342 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - > Naming appender as [STDOUT] > 09:59:25,383 |-WARN in ch.qos.logback.core.ConsoleAppender[STDOUT] - This > appender no longer admits a layout as a sub-component, set an encoder instead. > 09:59:25,383 |-WARN in ch.qos.logback.core.ConsoleAppender[STDOUT] - To > ensure compatibility, wrapping your layout in LayoutWrappingEncoder. > 09:59:25,383 |-WARN in ch.qos.logback.core.ConsoleAppender[STDOUT] - See also > http://logback.qos.ch/codes.html#layoutInsteadOfEncoder for details > 09:59:25,383 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - > Setting level of logger [org.apache.streampipes] to INFO > 09:59:25,383 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - > Setting level of logger [org.lightcouch] to ERROR > 09:59:25,383 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - > Setting level of ROOT logger to INFO > 09:59:25,383 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - > Attaching appender named [STDOUT] to Logger[ROOT] > 09:59:25,384 |-INFO in > ch.qos.logback.classic.joran.action.ConfigurationAction - End of > configuration. > 09:59:25,384 |-INFO in > ch.qos.logback.classic.joran.JoranConfigurator@35a50a4c - Registering current > configuration as safe fallback point > > Exception in thread "main" java.lang.ExceptionInInitializerError > at > org.apache.streampipes.test.main.Init.main(<DeclarersSingleton.getInstance().setPort(Config.INSTANCE.getPort());>) > Caused by: com.orbitz.consul.ConsulException: Error connecting to Consul > at com.orbitz.consul.AgentClient.ping(AgentClient.java:69) > at com.orbitz.consul.Consul$Builder.build(Consul.java:731) > at > org.apache.streampipes.config.consul.ConsulSpConfig.<init>(ConsulSpConfig.java:62) > at org.apache.streampipes.config.SpConfig.getSpConfig(SpConfig.java:38) > at org.apache.streampipes.test.config.Config.<init>(<config = > SpConfig.getSpConfig("pe/org.apache.streampipes.test");>) > at org.apache.streampipes.test.config.Config.<clinit>(<INSTANCE;>) > ... 1 more > Caused by: java.net.ConnectException: Failed to connect to > localhost/127.0.0.1:8500 > at > okhttp3.internal.connection.RealConnection.connectSocket(RealConnection.java:249) > at okhttp3.internal.connection.RealConnection.connect(RealConnection.java:167) > at > okhttp3.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:257) > at > okhttp3.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:135) > at > okhttp3.internal.connection.StreamAllocation.newStream(StreamAllocation.java:114) > at > okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42) > at > okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) > at > okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121) > at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:93) > at > okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) > at > okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121) > at > okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93) > at > okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) > at > okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:126) > at > okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) > at > okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121) > at > com.orbitz.consul.cache.TimeoutInterceptor.intercept(TimeoutInterceptor.java:53) > at > okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:147) > at > okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:121) > at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:250) > at okhttp3.RealCall.execute(RealCall.java:93) > at retrofit2.OkHttpCall.execute(OkHttpCall.java:186) > at com.orbitz.consul.AgentClient.ping(AgentClient.java:62) > ... 6 more > Caused by: java.net.ConnectException: Connection refused > at java.base/sun.nio.ch.Net.pollConnect(Native Method) > at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:589) > at > java.base/sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:542) > at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597) > at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:333) > at java.base/java.net.Socket.connect(Socket.java:648) > at okhttp3.internal.platform.Platform.connectSocket(Platform.java:129) > at > okhttp3.internal.connection.RealConnection.connectSocket(RealConnection.java:247) > ... 28 more > > Process finished with exit code 1 > """ > > I checked, port 8500 was not registered to any program (including Consul) > and is not blocked by Firewall. > Unfortunately, I am not familiar with Consul and my attempts at solving this > problem were not successful. > I am running Linux Mint 19.3 Tricia base: Ubuntu 18.04 bionic. > > I would be very grateful for your help in solving this issue. > > Kindest regards, > Branislav Jovicic >
