[onap-discuss] How to check file delivery to DMaaP Data Router?
Hello,
We can see in logs that file has been delivered to DMaaP-DR by
data-file-collector:
2018-11-07 13:41:41.753 TRACE 1 --- [-client-epoll-8]
.c.d.s.p.DmaapProducerReactiveHttpClient : Starting to publish to DR
2018-11-07 13:41:41.789 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : ===request
begin
2018-11-07 13:41:41.789 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : URI :
https://10.42.111.6:9443/publish/1/file.txt
2018-11-07 13:41:41.789 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : Method : PUT
2018-11-07 13:41:41.796 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : Headers : {Accept=[text/plain,
application/json, application/*+json, */*],
Content-Type=[application/octet-stream],
X-ATT-DR-META=[{"compression":"txt","fileFormatType":"org.3GPP.32.435#measCollec","fileFormatVersion":"V10"}],
Authorization=[Basic ZHJhZG1pbjpkcmFkbWlu], Content-Length=[17]}
2018-11-07 13:41:41.797 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : Request body: sample message v2
2018-11-07 13:41:41.797 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : ==request
end
2018-11-07 13:41:41.910 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : response
begin==
2018-11-07 13:41:41.910 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : Status code : 204 NO_CONTENT
2018-11-07 13:41:41.913 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : Status text : No Content
2018-11-07 13:41:41.914 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : Headers : {Date=[Wed, 07 Nov
2018 13:41:41 GMT], Strict-Transport-Security=[max-age=2000;
includeSubDomains], X-ATT-DR-PUBLISH-ID=[1541598101903.dmaap-dr-node],
Server=[Jetty(9.3.8.RC0)]}
2018-11-07 13:41:41.914 DEBUG 1 --- [-client-epoll-8]
.c.d.w.RequestResponseLoggingInterceptor : ===response
end=
2018-11-07 13:41:41.924 INFO 1 --- [-client-epoll-8]
o.o.d.c.datafile.tasks.ScheduledTasks: Datafile consumed tasks. HTTP
Response code 204 NO_CONTENT
How to check in DMaaP-DR that file or it's content has been delivered to DMaaP
Data Router?
Br,
Marcin Migal
Nokia
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#13582): https://lists.onap.org/g/onap-discuss/message/13582
Mute This Topic: https://lists.onap.org/mt/28023588/21656
Group Owner: onap-discuss+ow...@lists.onap.org
Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
[onap-discuss] DMaaP - local run via docker compose
Hello, I try to run locally newest DMaaP Message Router via docker-compose located here: dmaap/messagerouter/messageservice/src/main/resources/docker-compose Zookeeeper and Kafka are up and running but DMaaP MR is failing: /appl/dmaapMR1/lib/ajsc-runner-3.0.7-oss.jar ""2018-10-01 15:18:05,291 [ApplicationShutdownThread-1] INFO ajsc.RouteMgmtService - ->Current System Loader ClassPath<-* /appl/dmaapMR1/lib/ajsc-runner-3.0.7-oss.jar Exception in thread "ApplicationShutdownThread-1" java.lang.NoClassDefFoundError: ajsc/util/AJSCShutdownBean$_shutdownAJSC_closure1 at ajsc.util.AJSCShutdownBean.shutdownAJSC(AJSCShutdownBean.groovy:65) at ajsc.util.AJSCShutdownBean.this$2$shutdownAJSC(AJSCShutdownBean.groovy) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:210) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.call(PogoMetaMethodSite.java:71) at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113) at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117) at ajsc.util.AJSCShutdownBean$1.run(AJSCShutdownBean.groovy:48) Caused by: java.lang.ClassNotFoundException: ajsc.util.AJSCShutdownBean$_shutdownAJSC_closure1 at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:487) at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:428) ... 12 more Dose it mean that nexus3.onap.org:10001/onap/dmaap/dmaap-mr:1.1.6 is missing something at classpath? Br Marcin -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12767): https://lists.onap.org/g/onap-discuss/message/12767 Mute This Topic: https://lists.onap.org/mt/26442490/21656 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
[onap-discuss] Kibana administrator contact
Hello, Could anyone please point me to Kibana administartor? https://onap.biterg.io/app/kibana I cannot see myself attached to my company in commits' statistics. Also new projects are not attached to Kibana automatically. Regards Marcin ___ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss
Re: [onap-discuss] Testing Dmaap locally - problems with reading messages
Hello,
I managed to read messages from topic ??. So I have progress.
Still open issues are:
1) How may I stub
com.att.nsa.security.NsaAclUtils.updateAcl(NsaAclUtils.java:74) for local
DMaap development/testing?
2) Are there any Integration or e2e tests agsinst Dmaap in master branch?
We could have discussion on Wednesday during DMaap meeting. I think it would be
the most convenient way.
According to point 2, link would be very useful so that we could focus on point
1 during meeting.
Br,
Marcin
From: UNNAVA, SUNIL <su6...@att.com>
Sent: Monday, April 9, 2018 3:35:54 PM
To: Migdal, Marcin (Nokia - PL/Wroclaw); MUNNELLI, BHAVANI;
onap-discuss@lists.onap.org
Cc: KOYA, RAMPRASAD; LUNANUOVA, DOMINIC; KOPP, ANNE E
Subject: RE: Testing Dmaap locally - problems with reading messages
Marcin,
Let me know your convenient time to connect and discuss.
Thanks,
Sunil
From: Migdal, Marcin (Nokia - PL/Wroclaw) [mailto:marcin.mig...@nokia.com]
Sent: Monday, April 09, 2018 4:01 AM
To: UNNAVA, SUNIL <su6...@att.com>; MUNNELLI, BHAVANI <bm8...@att.com>;
onap-discuss@lists.onap.org
Cc: KOYA, RAMPRASAD <rk5...@att.com>; LUNANUOVA, DOMINIC
<d...@research.att.com>; KOPP, ANNE E <ak1...@att.com>
Subject: Re: Testing Dmaap locally - problems with reading messages
Hi Sunil,
How may I stub com.att.nsa.security.NsaAclUtils.updateAcl(NsaAclUtils.java:74)
for local development?
Link provided by you is against service from master code or branch code?
Are there any Integration or e2e tests agsinst Dmaap in master branch?
Br
Marcin
From: UNNAVA, SUNIL <su6...@att.com<mailto:su6...@att.com>>
Sent: Friday, April 6, 2018 4:52:55 PM
To: Migdal, Marcin (Nokia - PL/Wroclaw); MUNNELLI, BHAVANI;
onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>
Cc: KOYA, RAMPRASAD; LUNANUOVA, DOMINIC; KOPP, ANNE E
Subject: RE: Testing Dmaap locally - problems with reading messages
Its depend on the consumer. You can define consumer group and consumer id based
on your needs. For example using the following URL, I am subscribing to a topic
testtopic with consumer group as CG1 and consumer as c1.
http://10.12.5.163:30227/events/testtopic/CG1/C1?timeout=1000<https://urldefense.proofpoint.com/v2/url?u=http-3A__10.12.5.163-3A30227_events_testtopic_CG1_C1-3Ftimeout-3D1000=DwMF-g=LFYZ-o9_HUMeMTSQicvjIg=t27CRRmn7U12dnOvcSPfcQ=_lmEqJjajqHj77M6Z1GIJJy3A6oDsz2E8ExAlrozIps=ZXpPN1_O1neH86s3yieg_Thbvs-MlUvcaJc6Rf9vyD4=>
Thanks,
Sunil
From: Migdal, Marcin (Nokia - PL/Wroclaw) [mailto:marcin.mig...@nokia.com]
Sent: Friday, April 06, 2018 10:12 AM
To: UNNAVA, SUNIL <su6...@att.com<mailto:su6...@att.com>>; MUNNELLI, BHAVANI
<bm8...@att.com<mailto:bm8...@att.com>>;
onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>
Cc: KOYA, RAMPRASAD <rk5...@att.com<mailto:rk5...@att.com>>; LUNANUOVA, DOMINIC
<d...@research.att.com<mailto:d...@research.att.com>>
Subject: Re: Testing Dmaap locally - problems with reading messages
Hello Sunil,
How to determine consumerGroup and consumerId?
May they have any values?
I have found that there is exposed REST API that enables registering consumer
to topic:
curl --request PUT localhost:3904/topics/testTopic/consumers/consumerId
But when I call it, then there is thrown NullPointerException:
Caused by: java.lang.NullPointerException
at com.att.nsa.security.NsaAclUtils.updateAcl(NsaAclUtils.java:74)
at
com.att.nsa.cambria.beans.DMaaPKafkaMetaBroker$KafkaTopic.updateAcl(DMaaPKafkaMetaBroker.java:412)
at
com.att.nsa.cambria.beans.DMaaPKafkaMetaBroker$KafkaTopic.permitReadsByUser(DMaaPKafkaMetaBroker.java:399)
at
com.att.nsa.cambria.service.impl.TopicServiceImpl.permitConsumerForTopic(TopicServiceImpl.java:595)
at
com.att.nsa.dmaap.service.TopicRestService.permitConsumerForTopic(TopicRestService.java:582)
How to stub
com.att.nsa.security.NsaAclUtils.updateAcl(NsaAclUtils.java:74)
for local run of DMaap so that I could register consumer to topic?
Regards,
Marcin
________
From: UNNAVA, SUNIL <su6...@att.com<mailto:su6...@att.com>>
Sent: Friday, April 6, 2018 3:39:44 PM
To: Migdal, Marcin (Nokia - PL/Wroclaw); MUNNELLI, BHAVANI;
onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>
Cc: KOYA, RAMPRASAD; LUNANUOVA, DOMINIC
Subject: RE: Testing Dmaap locally - problems with reading messages
Marcin,
Consumers has to subscribe to a topic to receive the events. Consumer will
receive the messages published after subscribed to a topic. Subscriber URL
({host}:3904/events/testTopic/{consumerGroup}/{consumerId}) is used to both
subscribe to a topic and receive messages from the topic. ConsumerGroup and
ConsumerId are used to uniquely identify a subscriber. You will not receive 400
Re: [onap-discuss] Testing Dmaap locally - problems with reading messages
Hi Sunil,
How may I stub com.att.nsa.security.NsaAclUtils.updateAcl(NsaAclUtils.java:74)
for local development?
Link provided by you is against service from master code or branch code?
Are there any Integration or e2e tests agsinst Dmaap in master branch?
Br
Marcin
From: UNNAVA, SUNIL <su6...@att.com>
Sent: Friday, April 6, 2018 4:52:55 PM
To: Migdal, Marcin (Nokia - PL/Wroclaw); MUNNELLI, BHAVANI;
onap-discuss@lists.onap.org
Cc: KOYA, RAMPRASAD; LUNANUOVA, DOMINIC; KOPP, ANNE E
Subject: RE: Testing Dmaap locally - problems with reading messages
Its depend on the consumer. You can define consumer group and consumer id based
on your needs. For example using the following URL, I am subscribing to a topic
testtopic with consumer group as CG1 and consumer as c1.
http://10.12.5.163:30227/events/testtopic/CG1/C1?timeout=1000
Thanks,
Sunil
From: Migdal, Marcin (Nokia - PL/Wroclaw) [mailto:marcin.mig...@nokia.com]
Sent: Friday, April 06, 2018 10:12 AM
To: UNNAVA, SUNIL <su6...@att.com>; MUNNELLI, BHAVANI <bm8...@att.com>;
onap-discuss@lists.onap.org
Cc: KOYA, RAMPRASAD <rk5...@att.com>; LUNANUOVA, DOMINIC <d...@research.att.com>
Subject: Re: Testing Dmaap locally - problems with reading messages
Hello Sunil,
How to determine consumerGroup and consumerId?
May they have any values?
I have found that there is exposed REST API that enables registering consumer
to topic:
curl --request PUT localhost:3904/topics/testTopic/consumers/consumerId
But when I call it, then there is thrown NullPointerException:
Caused by: java.lang.NullPointerException
at com.att.nsa.security.NsaAclUtils.updateAcl(NsaAclUtils.java:74)
at
com.att.nsa.cambria.beans.DMaaPKafkaMetaBroker$KafkaTopic.updateAcl(DMaaPKafkaMetaBroker.java:412)
at
com.att.nsa.cambria.beans.DMaaPKafkaMetaBroker$KafkaTopic.permitReadsByUser(DMaaPKafkaMetaBroker.java:399)
at
com.att.nsa.cambria.service.impl.TopicServiceImpl.permitConsumerForTopic(TopicServiceImpl.java:595)
at
com.att.nsa.dmaap.service.TopicRestService.permitConsumerForTopic(TopicRestService.java:582)
How to stub
com.att.nsa.security.NsaAclUtils.updateAcl(NsaAclUtils.java:74)
for local run of DMaap so that I could register consumer to topic?
Regards,
Marcin
From: UNNAVA, SUNIL <su6...@att.com<mailto:su6...@att.com>>
Sent: Friday, April 6, 2018 3:39:44 PM
To: Migdal, Marcin (Nokia - PL/Wroclaw); MUNNELLI, BHAVANI;
onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>
Cc: KOYA, RAMPRASAD; LUNANUOVA, DOMINIC
Subject: RE: Testing Dmaap locally - problems with reading messages
Marcin,
Consumers has to subscribe to a topic to receive the events. Consumer will
receive the messages published after subscribed to a topic. Subscriber URL
({host}:3904/events/testTopic/{consumerGroup}/{consumerId}) is used to both
subscribe to a topic and receive messages from the topic. ConsumerGroup and
ConsumerId are used to uniquely identify a subscriber. You will not receive 400
as response code even when you are trying to subscribe to a consumer.
Thanks,
Sunil
From: Migdal, Marcin (Nokia - PL/Wroclaw) [mailto:marcin.mig...@nokia.com]
Sent: Friday, April 06, 2018 9:09 AM
To: UNNAVA, SUNIL <su6...@att.com<mailto:su6...@att.com>>; MUNNELLI, BHAVANI
<bm8...@att.com<mailto:bm8...@att.com>>;
onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>
Cc: KOYA, RAMPRASAD <rk5...@att.com<mailto:rk5...@att.com>>; LUNANUOVA, DOMINIC
<d...@research.att.com<mailto:d...@research.att.com>>
Subject: Testing Dmaap locally - problems with reading messages
Hello
I managed to run Dmaap locally with code from master branch.
I am able to list existing queues:
Request:
curl --request GET localhost:3904/topics/listAll
Response:
{"topics": [
{
"owner": "",
"txenabled": false,
"topicName": "msgrtr.apinode.metrics.dmaap"
},
{
"owner": "",
"txenabled": false,
"topicName": "testTopic"
}
]}
Also sending messages to quese seems to work fine:
Request:
curl --header "Content-type: application/json" --request POST --data
'{"message":"messageContent"}' http://localhost:3904/events/testTopic
Response:
{
"serverTimeMs": 2,
"count": 1
}
Also in logs there are entries that message has been published:
""2018-04-06 12:59:09,875 [qtp1555093762-2808] INFO
com.att.nsa.dmaap.service.EventsRestService - Publishing message to topic
testTopic
""2018-04-06 12:59:09,879 [qtp1555093762-2808] INFO
com.att.nsa.cambria.service.impl.EventsServiceImpl - Published 1 msgs
[onap-discuss] Testing Dmaap locally - problems with reading messages
Hello
I managed to run Dmaap locally with code from master branch.
I am able to list existing queues:
Request:
curl --request GET localhost:3904/topics/listAll
Response:
{"topics": [
{
"owner": "",
"txenabled": false,
"topicName": "msgrtr.apinode.metrics.dmaap"
},
{
"owner": "",
"txenabled": false,
"topicName": "testTopic"
}
]}
Also sending messages to quese seems to work fine:
Request:
curl --header "Content-type: application/json" --request POST --data
'{"message":"messageContent"}' http://localhost:3904/events/testTopic
Response:
{
"serverTimeMs": 2,
"count": 1
}
Also in logs there are entries that message has been published:
""2018-04-06 12:59:09,875 [qtp1555093762-2808] INFO
com.att.nsa.dmaap.service.EventsRestService - Publishing message to topic
testTopic
""2018-04-06 12:59:09,879 [qtp1555093762-2808] INFO
com.att.nsa.cambria.service.impl.EventsServiceImpl - Published 1 msgs in 2ms
for topic testTopic
Now target is to read messages from topic named testTopic
According to:
http://onap.readthedocs.io/en/amsterdam/submodules/dmaap/messagerouter/messageservice.git/docs/Installation/Installation.html
below request should work fine:
curl -H “Content-Type:text/plain” -GET
http://localhost:3904/events/testTopic/CG1/C1?timeout=1000
But it does not work. Also logs confirm that:
2018-04-06 13:03:25.608:WARN:oejh.HttpParser:qtp1555093762-2885: badMessage:
400 for HttpChannelOverHttp@7a1b89e8{r=0,c=false,a=IDLE,uri=-}
>From EventsRestService implementation I can see that request should look like
>as below one:
curl --request GET localhost:3904/events/testTopic/{consumerGroup}/{consumerId}
But I do not know consumerGroup and ConsumerID.
So question how to read messages from DMaap using DMaap REST API?
Best regards,
Marcin Migdal
___
onap-discuss mailing list
onap-discuss@lists.onap.org
https://lists.onap.org/mailman/listinfo/onap-discuss
Re: [onap-discuss] DMaap problems - looking for Project Technical Leadrer
Hello Bhavani, Thank you for response. During yesterday's DMaap meeting Sunil mentioned that there will be pushed changes to DMaap. Supposed timeline is on Friday. @Sunil Unnava Could you please share Gerrit ticket with changes that are going to be pushed to master? Br Marcin From: MUNNELLI, BHAVANI <bm8...@att.com> Sent: Thursday, March 22, 2018 11:59 AM To: Migdal, Marcin (Nokia - PL/Wroclaw); onap-discuss@lists.onap.org Cc: KOYA, RAMPRASAD; UNNAVA, SUNIL; LUNANUOVA, DOMINIC Subject: RE: [onap-discuss] DMaap problems - looking for Project Technical Leadrer Hi Marcin, You can reach out Sunil /Dominic for DMaaP related issues/queries. Ramprasad Koya is PTL for DMAAP. Thanks, Bhavani From: onap-discuss-boun...@lists.onap.org [mailto:onap-discuss-boun...@lists.onap.org] On Behalf Of Migdal, Marcin (Nokia - PL/Wroclaw) Sent: Thursday, March 22, 2018 6:29 AM To: onap-discuss@lists.onap.org Subject: [onap-discuss] DMaap problems - looking for Project Technical Leadrer Hello, Could you please write me who is Project Technical Leader of DMaap? Br Marcin ___ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss
[onap-discuss] DMaap problems - looking for Project Technical Leadrer
Hello, Could you please write me who is Project Technical Leader of DMaap? Br Marcin ___ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss
Re: [onap-discuss] Dmaap - how to run locally
Hello Provided instruction: http://onap.readthedocs.io/en/amsterdam/submodules/dmaap/messagerouter/messageservice.git/docs/Installation/Installation.html assumes static IP addresses which do not point to localhost. I managed to build and run Docker images, but despite this fact services are not available via REST interface, so I am still looking for root cause. Marcin From: DRAGOSH, PAMELA L (PAM) <pdrag...@research.att.com> Sent: Thursday, March 15, 2018 1:30:51 PM To: fu.guangr...@zte.com.cn; Migdal, Marcin (Nokia - PL/Wroclaw) Cc: onap-discuss@lists.onap.org Subject: Re: [onap-discuss] Dmaap - how to run locally Actually, Liam Fallon put together a nice little how-to: https://wiki.onap.org/display/DW/How+to+set+up+a+local+DMaaP+installation+in+Docker+for+testing Hope that helps. Pam From: <onap-discuss-boun...@lists.onap.org> on behalf of "fu.guangr...@zte.com.cn" <fu.guangr...@zte.com.cn> Date: Thursday, March 15, 2018 at 6:10 AM To: "marcin.mig...@nokia.com" <marcin.mig...@nokia.com> Cc: "onap-discuss@lists.onap.org" <onap-discuss@lists.onap.org> Subject: Re: [onap-discuss] Dmaap - how to run locally Hi Marcin, I'm not from the DMaaP team but I set up DMaaP a couple of days ago following the instructions on http://onap.readthedocs.io/en/amsterdam/submodules/dmaap/messagerouter/messageservice.git/docs/Installation/Installation.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__onap.readthedocs.io_en_amsterdam_submodules_dmaap_messagerouter_messageservice.git_docs_Installation_Installation.html=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=jwTiArcEj6aUX0HjV0M3dT12gUtk7rC07xpgpVZkS_4=V3CI0sAbo74-h8PfBaveaEbwvP2hS_xOPieiciM7ugc=Vu1XXerf7uCB3xGkEU4pj2wolsgXKTNg2AbSD1wQTwI=>. I hope it is helpful for you as well. Regards, Guangrong Original Mail Sender: Migdal,Marcin(Nokia-PL/Wroclaw) <marcin.mig...@nokia.com> To: onap-discuss@lists.onap.org <onap-discuss@lists.onap.org> Date: 2018/03/15 17:50 Subject: [onap-discuss] Dmaap - how to run locally ___ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss<https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.onap.org_mailman_listinfo_onap-2Ddiscuss=DwQGaQ=LFYZ-o9_HUMeMTSQicvjIg=jwTiArcEj6aUX0HjV0M3dT12gUtk7rC07xpgpVZkS_4=V3CI0sAbo74-h8PfBaveaEbwvP2hS_xOPieiciM7ugc=8qjSmkWOZM27I4QagIwktrbcKsz7-mZrpiQqvy66p5M=> Hello, Is there any instruction describing how to run Dmaap locally for development? Which elements have to be run to test basic functionality of Dmaap? I tried to build locally docker images, but it looks like that there are needed additional steps such as coping configuration files. Another question is why dmaap maven modules are separated from each other? I have noticed there is no one single parent pom that could accumulate all modules, define dependencies in one place and also drive one generic build. Regards Marcin ___ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss
[onap-discuss] Dmaap - how to run locally
Hello, Is there any instruction describing how to run Dmaap locally for development? Which elements have to be run to test basic functionality of Dmaap? I tried to build locally docker images, but it looks like that there are needed additional steps such as coping configuration files. Another question is why dmaap maven modules are separated from each other? I have noticed there is no one single parent pom that could accumulate all modules, define dependencies in one place and also drive one generic build. Regards Marcin ___ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss
Re: [onap-discuss] SDC- local development - how to?
Hi, My understanding is that due to project complexity (indeed it' huge), Vagrant has been introduced because it provides portable virtual software development environments. I have seen similar situation earlier in another project I was involved into. My understanding is that simplification of project focusing on Maven modules, dependencies and Docker images may lead to such situation that Vagrant is not needed. Of course it's ideal situation and I was asking only if such option has been taken into consideration ?? Referring to pom files I was thinking of simplifying dependency management in SDC project. For example scope compile is default in Maven and does not have to be added to dependency declaration - Maven resolves it with no problem. It means that lines compile in pom files may be removed. Marcin From: Morales, Victor <victor.mora...@intel.com> Sent: Wednesday, March 7, 2018 3:13:40 PM To: Migdal, Marcin (Nokia - PL/Wroclaw); Lando,Michael Cc: onap-discuss@lists.onap.org Subject: Re: [onap-discuss] SDC- local development - how to? Can you elaborate more your approach to stop using vagrant? we used vagrant as supporting tool for ensuring that the scripts work in a base distro (or minimal dependencies) besides its capability to recreate everything automatically. Regarding the attempt to optimize Maven files, AFAIK that is done by OParent project [1] Victor Morales [1] https://git.onap.org/oparent/ From: "Migdal, Marcin (Nokia - PL/Wroclaw)" <marcin.mig...@nokia.com> Date: Wednesday, March 7, 2018 at 5:39 AM To: Victor Morales <victor.mora...@intel.com>, "Lando,Michael" <ml6...@intl.att.com> Cc: "onap-discuss@lists.onap.org" <onap-discuss@lists.onap.org> Subject: Re: [onap-discuss] SDC- local development - how to? Hello, Have you thought about stop using Vagrant and focus only on pure Docker images? I think such approach could simplify few things - no setting env variables, coping configuration files. Has there also been an attempt to optimize Maven files? I can see that optimization of content can be easily achieved with no big effort. Expected outcome would be: - thin pom files - better readability - easier dependency management Marcin From: Morales, Victor <victor.mora...@intel.com> Sent: Tuesday, March 6, 2018 5:46:56 PM To: Migdal, Marcin (Nokia - PL/Wroclaw); Lando,Michael Cc: onap-discuss@lists.onap.org; Wejs, Maciej (Nokia - PL/Wroclaw) Subject: Re: [onap-discuss] SDC- local development - how to? Hi Marcin, Just one additional think about the vagrant provider, even when VirtualBox is the default one you can use Libvirt. There is a script that installs it https://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/tools/setup.sh [https://avatars2.githubusercontent.com/u/25933741?s=400=4]<https://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/tools/setup.sh> onap/integration<https://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/tools/setup.sh> github.com Mirror of https://gerrit.onap.org/r/#/admin/projects/integration The other alternative is to use the scripts in your own environment without having to install a Virtual Machine, I tried to explain that here http://onap.readthedocs.io/en/amsterdam/submodules/integration.git/bootstrap/vagrant-onap/doc/source/features/consuming_scripts.html I don’t recommend it because the dependencies will be installed in your host machine and eventually those can be omitted or assumed, resulting in heterogonous development environments. Regards, Victor Morales From: "Migdal, Marcin (Nokia - PL/Wroclaw)" <marcin.mig...@nokia.com> Date: Tuesday, March 6, 2018 at 5:31 AM To: "Lando,Michael" <ml6...@intl.att.com> Cc: "onap-discuss@lists.onap.org" <onap-discuss@lists.onap.org>, Victor Morales <victor.mora...@intel.com>, "Wejs, Maciej (Nokia - PL/Wroclaw)" <maciej.w...@nokia.com> Subject: Re: [onap-discuss] SDC- local development - how to? Hello, Thank you for suggestions. Especially link: ttps://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/lib/sdc<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_onap_integration_blob_master_bootstrap_vagrant-2Donap_lib_sdc=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=FYvXSElfSmWIXOeZxWIxQysejuz9-TXmaL6uftBh8MY=VAPoDqmxmOmnw1EkqbL2uctNhbGRdcJbyV9vf0nhXio=Cvh3_5oZToIdIor5o5At6iFiQSVfzGqg_eSLq1jEKpA=> is very useful. I can see that Vagrant is being used for local development with Virtual Box. Unfortunately, VirtaulBox is not a good option for running at machine hosting as OS Linux. What I am still thinking of is something simpler. I have JDK and Maven available at my machine (having Windows, Linux, Solaris, zOS, whatever) so that I am able to execute Maven's go
Re: [onap-discuss] SDC- local development - how to?
Hello, Have you thought about stop using Vagrant and focus only on pure Docker images? I think such approach could simplify few things - no setting env variables, coping configuration files. Has there also been an attempt to optimize Maven files? I can see that optimization of content can be easily achieved with no big effort. Expected outcome would be: - thin pom files - better readability - easier dependency management Marcin From: Morales, Victor <victor.mora...@intel.com> Sent: Tuesday, March 6, 2018 5:46:56 PM To: Migdal, Marcin (Nokia - PL/Wroclaw); Lando,Michael Cc: onap-discuss@lists.onap.org; Wejs, Maciej (Nokia - PL/Wroclaw) Subject: Re: [onap-discuss] SDC- local development - how to? Hi Marcin, Just one additional think about the vagrant provider, even when VirtualBox is the default one you can use Libvirt. There is a script that installs it https://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/tools/setup.sh [https://avatars2.githubusercontent.com/u/25933741?s=400=4]<https://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/tools/setup.sh> onap/integration<https://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/tools/setup.sh> github.com Mirror of https://gerrit.onap.org/r/#/admin/projects/integration The other alternative is to use the scripts in your own environment without having to install a Virtual Machine, I tried to explain that here http://onap.readthedocs.io/en/amsterdam/submodules/integration.git/bootstrap/vagrant-onap/doc/source/features/consuming_scripts.html I don’t recommend it because the dependencies will be installed in your host machine and eventually those can be omitted or assumed, resulting in heterogonous development environments. Regards, Victor Morales From: "Migdal, Marcin (Nokia - PL/Wroclaw)" <marcin.mig...@nokia.com> Date: Tuesday, March 6, 2018 at 5:31 AM To: "Lando,Michael" <ml6...@intl.att.com> Cc: "onap-discuss@lists.onap.org" <onap-discuss@lists.onap.org>, Victor Morales <victor.mora...@intel.com>, "Wejs, Maciej (Nokia - PL/Wroclaw)" <maciej.w...@nokia.com> Subject: Re: [onap-discuss] SDC- local development - how to? Hello, Thank you for suggestions. Especially link: ttps://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/lib/sdc<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_onap_integration_blob_master_bootstrap_vagrant-2Donap_lib_sdc=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=FYvXSElfSmWIXOeZxWIxQysejuz9-TXmaL6uftBh8MY=VAPoDqmxmOmnw1EkqbL2uctNhbGRdcJbyV9vf0nhXio=Cvh3_5oZToIdIor5o5At6iFiQSVfzGqg_eSLq1jEKpA=> is very useful. I can see that Vagrant is being used for local development with Virtual Box. Unfortunately, VirtaulBox is not a good option for running at machine hosting as OS Linux. What I am still thinking of is something simpler. I have JDK and Maven available at my machine (having Windows, Linux, Solaris, zOS, whatever) so that I am able to execute Maven's goals responsible for compilation, testing and packaging of SDC Maven modules. Now I would like to run SDC locally in order to define PNF of VFN within SDC locally. Lets assume I have Apache Tomcat/Jetty available. I can see that modules: a) sdc/catalog-be b) sdc/catalog-fe generate war modules that can be run on any Java web container, so I think they could be good starting points. So would it be a good idea to focus on mentioned artifacts? Also from Vagrant file I can see that elasticsearch & cassandra are also needed. Marcin ________ From: Lando,Michael <ml6...@intl.att.com> Sent: Monday, March 5, 2018 8:59 AM To: Migdal, Marcin (Nokia - PL/Wroclaw) Cc: onap-discuss@lists.onap.org; Morales, Victor Subject: RE: [onap-discuss] SDC- local development - how to? Hi, You can find instructions here: https://wiki.onap.org/pages/viewpage.action?pageId=15999821 you can find all the info on SDC here: https://wiki.onap.org/display/DW/Service+Design+and+Creation+%28SDC%29+Portal BR, Michael Lando Opensource TL , SDC AT Network Application Development · NetCom Tel Aviv | Tampa | Atlanta | New Jersey |Chicago ··· Office: +972 (3) 5451487 Mobile: +972 (54) 7833603 e-mail: ml6...@intl.att.com<mailto:ml6...@intl.att.com> From: onap-discuss-boun...@lists.onap.org [mailto:onap-discuss-boun...@lists.onap.org] On Behalf Of Morales, Victor Sent: Friday, March 02, 2018 16:16 To: Migdal, Marcin (Nokia - PL/Wroclaw) <marcin.mig...@nokia.com>; onap-discuss@lists.onap.org Subject: Re: [onap-discuss] SDC- local development - how to? Hey Marcin, We tried to collect most of the instructions (clone and compile, install dependencies, build docker images, etc.) into the vagrant-onap script [1]. This is its docum
Re: [onap-discuss] SDC- local development - how to?
Hello, Thank you for suggestions. Especially link: ttps://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/lib/sdc<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_onap_integration_blob_master_bootstrap_vagrant-2Donap_lib_sdc=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=FYvXSElfSmWIXOeZxWIxQysejuz9-TXmaL6uftBh8MY=VAPoDqmxmOmnw1EkqbL2uctNhbGRdcJbyV9vf0nhXio=Cvh3_5oZToIdIor5o5At6iFiQSVfzGqg_eSLq1jEKpA=> is very useful. I can see that Vagrant is being used for local development with Virtual Box. Unfortunately, VirtaulBox is not a good option for running at machine hosting as OS Linux. What I am still thinking of is something simpler. I have JDK and Maven available at my machine (having Windows, Linux, Solaris, zOS, whatever) so that I am able to execute Maven's goals responsible for compilation, testing and packaging of SDC Maven modules. Now I would like to run SDC locally in order to define PNF of VFN within SDC locally. Lets assume I have Apache Tomcat/Jetty available. I can see that modules: a) sdc/catalog-be b) sdc/catalog-fe generate war modules that can be run on any Java web container, so I think they could be good starting points. So would it be a good idea to focus on mentioned artifacts? Also from Vagrant file I can see that elasticsearch & cassandra are also needed. Marcin From: Lando,Michael <ml6...@intl.att.com> Sent: Monday, March 5, 2018 8:59 AM To: Migdal, Marcin (Nokia - PL/Wroclaw) Cc: onap-discuss@lists.onap.org; Morales, Victor Subject: RE: [onap-discuss] SDC- local development - how to? Hi, You can find instructions here: https://wiki.onap.org/pages/viewpage.action?pageId=15999821 you can find all the info on SDC here: https://wiki.onap.org/display/DW/Service+Design+and+Creation+%28SDC%29+Portal BR, Michael Lando Opensource TL , SDC AT Network Application Development · NetCom Tel Aviv | Tampa | Atlanta | New Jersey |Chicago ··· Office: +972 (3) 5451487 Mobile: +972 (54) 7833603 e-mail: ml6...@intl.att.com<mailto:ml6...@intl.att.com> From: onap-discuss-boun...@lists.onap.org [mailto:onap-discuss-boun...@lists.onap.org] On Behalf Of Morales, Victor Sent: Friday, March 02, 2018 16:16 To: Migdal, Marcin (Nokia - PL/Wroclaw) <marcin.mig...@nokia.com>; onap-discuss@lists.onap.org Subject: Re: [onap-discuss] SDC- local development - how to? Hey Marcin, We tried to collect most of the instructions (clone and compile, install dependencies, build docker images, etc.) into the vagrant-onap script [1]. This is its documentation [2], but it’s not covering the configuration and installation of the IDE, I suggest to install it manually and use the opt folder given that it’s sharing the source code between host and guest computers. Regards/Saludos Victor Morales [1] https://github.com/onap/integration/blob/master/bootstrap/vagrant-onap/lib/sdc<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_onap_integration_blob_master_bootstrap_vagrant-2Donap_lib_sdc=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=FYvXSElfSmWIXOeZxWIxQysejuz9-TXmaL6uftBh8MY=VAPoDqmxmOmnw1EkqbL2uctNhbGRdcJbyV9vf0nhXio=Cvh3_5oZToIdIor5o5At6iFiQSVfzGqg_eSLq1jEKpA=> [2] http://onap.readthedocs.io/en/amsterdam/submodules/integration.git/bootstrap/vagrant-onap/doc/source/index.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__onap.readthedocs.io_en_amsterdam_submodules_integration.git_bootstrap_vagrant-2Donap_doc_source_index.html=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=FYvXSElfSmWIXOeZxWIxQysejuz9-TXmaL6uftBh8MY=VAPoDqmxmOmnw1EkqbL2uctNhbGRdcJbyV9vf0nhXio=Ku_y0G9kSLVLI7HMnxd5yxifm4OBOv_oI3aW1LKdcd4=> From: <onap-discuss-boun...@lists.onap.org<mailto:onap-discuss-boun...@lists.onap.org>> on behalf of "Migdal, Marcin (Nokia - PL/Wroclaw)" <marcin.mig...@nokia.com<mailto:marcin.mig...@nokia.com>> Date: Thursday, March 1, 2018 at 12:37 AM To: "onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>" <onap-discuss@lists.onap.org<mailto:onap-discuss@lists.onap.org>> Subject: [onap-discuss] SDC- local development - how to? Hello, Is there any instruction how to setup SDC for development in any IDE? Marcin ___ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss
[onap-discuss] SDC- local development - how to?
Hello, Is there any instruction how to setup SDC for development in any IDE? Marcin ___ onap-discuss mailing list onap-discuss@lists.onap.org https://lists.onap.org/mailman/listinfo/onap-discuss
