[Dev] WSO2 Committers += Thisaru Guruge
Hi All, It's my pleasure to announce Thisaru Guruge as a WSO2 committer. He has been a valuable contributor to WSO2. Congratulations Thisarau and keep up the good work ...! Regards, Gihan -- *W.G. Gihan Anuruddha* | Technical Lead | WSO2 Inc. (E) gi...@wso2.com GET INTEGRATION AGILE Integration Agility for Digitally Driven Business ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] OUT_ONLY - Response with no callback
No. ESB will discard the response. So there shouldn't be any memory issues. On Tue, Jun 5, 2018 at 8:46 PM Júnior wrote: > Thanks Milinda, > > In case of that, this error could cause any memory issue? > > I mean, respond with no callback associated? > > Thanks, > > 2018-06-04 23:25 GMT-05:00 Milinda Perera : > >> Hi, >> >> If you set OUT_ONLY property to true, ESB will not register callback >> expecting a response message from the backend. >> If your backend responds with a response message, avoid setting the >> OUT_ONLY property. >> >> Thanks, >> Milinda >> >> On Tue, Jun 5, 2018 at 9:46 AM, Júnior wrote: >> >>> Hi, >>> >>> I have an Inbound Endpoint which sequence just sends the payload to one >>> Proxy Service in WSO2. >>> >>> The sequence set the OUT_ONLY property to true and uses the send >>> mediator to send the request to the Proxy. >>> >>> The Proxy receives the request, performs its logic and then respond back. >>> >>> But, when it responds, I am seeing an error like below: >>> >>> Synapse received a response for the request with message Id : >>> urn:uuid:f1d3d901-322e-4ac2-ad28-5c4fd3c97aa5 But a callback is not >>> registered (anymore) to process this response >>> >>> In this case, the proxy service should not respond at all? >>> >>> Do you have any suggestions on recommendations for this case? >>> >>> Thanks, >>> >>> >>> -- >>> Francisco Ribeiro >>> *SCEA|SCJP|SCWCD|IBM Certified SOA Associate* >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> Milinda Perera >> Senior Software Engineer; >> WSO2 Inc. http://wso2.com , >> Mobile: (+94) 714 115 032 >> >> > > > -- > Francisco Ribeiro > *SCEA|SCJP|SCWCD|IBM Certified SOA Associate* > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] SMB on WSO2 EI 6.2.0 VFS
This will be available in the next week EI 6.3.0-m7 release if you don't have a valid WUM subscription. On Sat, May 5, 2018 at 2:56 PM, Nirothipan Mehalingam <nirothi...@wso2.com> wrote: > Hi Norberto, > > Th issue [1] you identified is the related one.We will release a WUM > update for EI 6.2.0 with this fix. Then you can update EI 6.2.0 and get > this issue sorted. > But please note that Updates published through WSO2 Update are NOT open > source – they are released under the WSO2 Update EULA 2.0 > <https://wso2.com/licenses/wso2-update/2.0>. Updates can be used in > PRODUCTION only under a paid WSO2 Subscription [2]. > > > [1] - https://github.com/wso2/product-ei/issues/2150 > [2] - https://wso2.com/updates/wum > > Thanks > Nirothipan > > On Sat, May 5, 2018 at 2:28 PM, Fernandes, Norberto < > nfern...@jaguarlandrover.com> wrote: > >> Hi Devs, >> >> https://github.com/wso2/product-ei/issues/2150 >> >> Found this issue that I think is related to this. The issue is closed and >> there a new jar added to the orbit project. >> How can I get this jar into my installation? >> >> Thanks in advance. >> Norberto >> >> On 4 May 2018 at 17:49, Fernandes, Norberto <nfern...@jaguarlandrover.com >> > wrote: >> >>> Hi Devs, >>> >>> I am trying to use VFS to read and write files to a SMB location. I try >>> to configure a proxy to access SMB share but I always get an error >>> reporting unknown protocol smb. >>> >>> ... >>> >>> Caused by: java.net.MalformedURLException: unknown protocol: smb >>> >>> at java.net.URL.(URL.java:600) >>> >>> at java.net.URL.(URL.java:490) >>> >>> at java.net.URL.(URL.java:439) >>> >>> at org.apache.commons.vfs2.provider.url.UrlFileProvider.findFil >>> e(UrlFileProvider.java:60) >>> .. >>> >>> I had a look into the vfs-providers.xml file >>> at commons-vfs2_2.2.0.wso2v1.jar and it refers to >>> org.apache.commons.vfs2.provider.smb.SmbFileProvider class. >>> >>> I tried to find this class in all jars in the 6.2.0 distribution and >>> could not find it. >>> >>> Could you please indicate if this class should be present or if smb >>> should work without it? >>> >>> Norberto >>> JLR >>> >> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > > > *M.Nirothipan* > *Software Engineer | WSO2* > *Mobile : +94 77 2172692* > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Problems with multiple RDBMS hits within the stream
osed
> Connection Ignored FQCN: org.apache.commons.logging.
> impl.SLF4JLocationAwareLog
> 2018-04-04 17:23:43,039 INFO
> [org.wso2.siddhi.core.stream.output.sink.LogSink]
> - mond : *AlarmsToCreate* : Event{timestamp=1522851823026, data=[-1, 1,
> 2, thresholdEvent, region1.router1.cpu_utilization, 1, 1522851823026],
> isExpired=false}
> 2018-04-04 17:23:43,040 INFO
> [org.wso2.siddhi.core.stream.output.sink.LogSink]
> - mond : EventStream : Event{timestamp=1522851823026, data=[null,
> thresholdEvent, threshold_rearmed, region1.router1.cpu_utilization, TODO,
> {path=region1.router1.cpu_utilization, aggr_context={average=12584.705,
> current=12584.705, percentile_50=12584.705, percentile_95=12669.98,
> percentile_100=12669.98, percentile_99=12669.98}, level_changed=true,
> metric_context={node_profile=null, node=null, metric_name=null,
> city=null, description=description, location=null, region=null},
> threshold_context={selectivity=1, metric_name=cpu_utilization,
> critical=11000.0, warning_action=MAIL_DEVOPS, warning=8000.0,
> aggr_field=rate, id=1, aggr_function=average, critical_action=MAIL_MANAGER,
> path_regex=.*cpu_utilization}, old_level=1, rate=12584.705, level=2,
> delta=-7550823.0, value=4.21999414061E11, tenant=null,
> timestamp=1521697200}], isExpired=false}
> [org.wso2.extension.siddhi.io.http.source.HttpWorkerThread] : Submitted
> Event {"event": {"path": "region1.router1.cpu_utilization",
> "description": "description", "value": 421999414061.0, "timestamp":
> 1521697200}} Stream
> [org.wso2.transport.http.netty.listener.HTTPServerChannelInitializer] :
> Initializing source channel pipeline
>
>
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
--
W.G. Gihan Anuruddha
Associate Technical Lead | WSO2, Inc.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] WSO2 EI - ESB statistics and/vs tracing
On Sun, Apr 1, 2018 at 9:46 PM, Lahiru Sandaruwan <lahi...@wso2.com> wrote: > Hi all, > > While I was looking at $subject, noticed that we can only enable > statistics in production environment, not tracing. > As Gihan mentioned at another place, tracing will generate a huge volume > of data since it publishes payload for each mediator and performance will > be affected as well. > > Couple of questions, > > Is it recommended to use tracing in trouble-shooting scenarios only? > > Yes. Normally we encourage tracing for trouble shooting only scenarios. But if you have lower TPS and an adequate storage then there is no harm to use tracing in the production. This decision has to take by the end user after doing a proper load testing with expected TPS in the production environment. > > > > Do we have a place listing the capabilities(what we can achieve) by > enabling statistics and tracing separately? > > Thanks. > > -- > -- > > Lahiru Sandaruwan > WSO2 Inc., http://wso2.com > > lean.enterprise.middleware > > m: +1 901 530 2379 <+1%20901-530-2379> > e: lahi...@wso2.com b: https://medium.com/@lahirugmg > in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146 > > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] WSO2 DAS Analytics
EI analytics do not support any customization. You need to use DAS for all the customization use cases. On Mon, Mar 5, 2018 at 2:47 PM, Yohanna Fernando <yoha...@wso2.com> wrote: > Hi Sanketh, > > I have forwarded your query to dev@wso2.org. > > Thanks, > > Yohanna > > > > On Thu, Mar 1, 2018 at 11:10 PM, Pendekal Sanketh < > pendekal.sank...@bridgesgi.com> wrote: > >> Hey, >> >> I have been going through WSO2 das analytics session. I found an tab >> for 'mutlitenancy' in DAS console. Under this section I found Usage Plan >> Information which had only DEMO option, are there any other plans >> available? If so, please notify me about it. >> >> And in EI analytics console, I found it's not possible to simulate events >> outside EI,i.e, I was unable to send the payload info to my custom created >> datasource and I was unable to generate my custom widget in EI analytics >> console dashboard. I would like to know why is that and what would be >> possible solution? >> >> >> Thank you, >> >> Regards >> >> Sanketh >> -- >> This email and any files transmitted with it are confidential and >> intended solely for the use of the individual or entity to whom they are >> addressed. It may also be privileged or otherwise protected by work product >> immunity or other legal rules. If you have received it by mistake, please >> let us know by e-mail reply and delete it from your system; you may not >> copy this message or disclose its contents to anyone. >> > > > > -- > Yohanna Fernando > Training & Certification > WSO2 Inc. > http://wso2.com > > E-mail: yoha...@wso2.com > Cell: +94779021159 <077%20902%201159> > <http://wso2con.com/> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [EI Analytic] Clarification about analytic tables
Hi Godwin, On Wed, Jan 24, 2018 at 9:50 AM, Godwin Shrimal <god...@wso2.com> wrote: > Hi Devs, > > I have a few clarification about analytics table. As per the discussion > had with Gihan, I understand there are tables to store stats per seconds, > stats per minutes etc... as described in [1]. > > *Questions* > > 1. Say we are creating a purging car to delete records from stats per > second table with 2 days retention period. So as I understand this will > only impact the data of one minute time period since after one minute those > per second data (something cumulative value) stores in per minute table. Is > this understanding correct? And Don't we need those per second data > (deleted) to represent on the dashboard if those cumulative value already > added to stats per minute table? > Both perSecond tables and perMinute tables are populating from an execution plan. We are not doing any cumulative addition top of perSecond to perMinute. PerHour table will depend on perMinute, perDay will depend on perHour etc. But if you delete data from perSecond and perMinute tables then that will affect the final value that display in the dashboard depend on the time range you are using. We are using perSecond, perMinute values to calculate ending edge of the time range. All 5 tables will be used to calculate total when you request a value for a time range. > > 2. We have configured a global purging for 14 days retention to delete all > tables and deployed a purging car file to delete stat per seconds table for > 2 days retention. I want to know these both execute as it is? > Our recommendation is to use same purging policy to all tables to maintain the consistency. Deleting only perSecond table will give slightly incorrect result (up to 59 second worth data can be missed from final result) and effect the drill down capability. > > [1] https://docs.wso2.com/display/EI620/Purging+Analytics+Data > > Thanks > Godwin > > -- > *Godwin Amila Shrimal* > Associate Technical Lead > WSO2 Inc.; http://wso2.com > lean.enterprise.middleware > > mobile: *+94772264165* > linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ > <https://www.linkedin.com/in/godwin-amila-2ba26844/>* > twitter: https://twitter.com/godwinamila > <http://wso2.com/signature> > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Removing root element above an array in wso2. Please guide
Have you tried something like this [1]? You need to add another XSLT
processing after you get the original output.
[1] -
https://stackoverflow.com/questions/1571083/how-to-remove-root-element-from-xml-file
Regards,
Gihan
On Mon, Jan 22, 2018 at 8:12 AM, Vinod Kavinda <vi...@wso2.com> wrote:
> Hi Vikram,
> This is happening because your XPath generates multiple elements with
> below structure, which not your desired output.
> **
> * 26*
> * box*
> * 2019-01-17T00:00:00*
> * *
>
> In an XML point of view, you are expecting an xml content like below,
> which is not a valid XML content since it does not have a root element. You
> can test this with an online XPath evaluator and verify.
>
> * *
> * 40*
> * car*
> * 2019-01-17T00:00:00*
> * *
> * *
> * 37*
> * table*
> * 2019-01-17T00:00:00*
> * *
>
>
> I don't think you can achieve your requirement with the enrich mediator
> since it only supports Xpaths. Please try using the Payload Factory
> mediator[1] with Jsonpath. Then you can extract the "Detail" element from
> the converted JSON and set it to the body.
>
> [1] - https://docs.wso2.com/display/EI611/PayloadFactory+Mediator
>
> On Sun, Jan 21, 2018 at 8:37 PM, vikram nayak <nayak.vikr...@yahoo.in>
> wrote:
>
>>
>>
>> On Sunday, 21 January 2018 8:14 PM, vikram nayak <nayak.vikr...@yahoo.in>
>> wrote:
>>
>>
>> Hi All,,
>>
>> I have output like below from my xslt :
>>
>>
>> http://schemas.
>> xmlsoap.org/soap/envelope/">
>>
>>
>>
>> 40
>> car
>> 2019-01-17T00:00:00
>>
>>
>> 37
>> table
>> 2019-01-17T00:00:00
>>
>>
>> 35
>> book
>> 2019-01-17T00:00:00
>>
>>
>> 26
>> box
>> 2019-01-17T00:00:00
>>
>>
>>
>>
>>
>> which gets converted into below json in postman :
>>
>> {
>> "Result": {
>> "Detail": [
>> {
>> "a": "40",
>> "b": "car",
>> "c": "2019-01-17T00:00:00"
>> },
>> {
>> "a": "37",
>> "b": "table",
>> "c": "2019-01-17T00:00:00"
>> },
>> {
>> "a": "35",
>> "b": "book",
>> "c": "2019-01-17T00:00:00"
>> },
>> {
>> "a": "26",
>> "b": "box",
>> "c": "2019-01-17T00:00:00"
>> }
>> ]
>> }
>> }
>>
>> but in my desired output response . I do not want root element "Result".
>>
>> Desired output :
>>
>> {
>> "Detail": [
>> {
>> "a": "40",
>> "b": "car",
>> "c": "2019-01-17T00:00:00"
>> },
>> {
>> "a": "37",
>> "b": "table",
>> "c": "2019-01-17T00:00:00"
>> },
>> {
>> "a": "35",
>> "b": "book",
>> "c": "2019-01-17T00:00:00"
>> },
>> {
>> "a": "26",
>> "b": "box",
>> "c": "2019-01-17T00:00:00"
>> }
>> ]
>> }
>> }
>>
>> Going through some online documents I tried below enrich after xslt.
>>
>>
>>
>>
>>
>>
>> But it gives only one element from my output like below :
>>
>> {
>> "Detail": {
>> "insuranceNumber": "40",
>> "policyName": "Laptop insurance - 4 star",
>> "agreementValidTill": "2019-01-17T00:00:00"
>> }
>> }
>>
>> Please guide.
>>
>> Thanks,
>> Vikram
>>
>>
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> Vinod Kavinda
> Senior Software Engineer
> *WSO2 Inc. - lean . enterprise . middleware <http://www.wso2.com>.*
> Mobile : +94 (0) 712 415544
> Blog : http://soatechflicks.blogspot.com/
> [image: http://wso2.com/signature]
> <http://wso2.com/signature>
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
--
W.G. Gihan Anuruddha
Associate Technical Lead | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [EI-Analytics] Having two different Keystores for analytic nodes
Hi Godwin, AFAIK, we can share the same Keystrore with two nodes. We are not storing analytics data by encrypting using the keystore. So this won't be any issue. Regards, GIhan On Fri, Jan 12, 2018 at 8:12 AM, Godwin Shrimal <god...@wso2.com> wrote: > Hi Devs, > > Think we have two analytics nodes and EI connects to them via IP address > for data publishing. I hope theoretically we need to configure two > Keystores for each nodes correct CommonName (correct me if I am wrong). > Both these nodes connect to shared UM, registry and other analytics DB (as > recommended). > Don't we have any registry data which has encrypted using Keystore in > analytics? If exist we'll have a problem since we are using two keystores > here. > > Any thoughts? > > Thanks > Godwin > -- > *Godwin Amila Shrimal* > Associate Technical Lead > WSO2 Inc.; http://wso2.com > lean.enterprise.middleware > > mobile: *+94772264165* > linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ > <https://www.linkedin.com/in/godwin-amila-2ba26844/>* > twitter: https://twitter.com/godwinamila > <http://wso2.com/signature> > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [EI-Enalytics] Search messages by status
Hi Godwin, We display the fail message count in the summary page as overall one and the proxy, API specific. Once you select that, it will redirect to fail message list. Is that you looking? Regards, Gihan On Wed, Jan 10, 2018 at 2:50 PM, Godwin Shrimal <god...@wso2.com> wrote: > Hi Gihan, > > I sent my previous email without seeing your mail. IMO this will be a very > useful feature. Let me explain using an example. Think we have a lot of > messages in the message flow and few messages have failed. So we need to > find what are the failed message and trace them. Without having this > feature it'll be so hard to find them. > > Shall we add this to EI-analytics future roadmap? WDYT? > > Thanks > Godwin > > On Wed, Jan 10, 2018 at 4:14 PM, Gihan Anuruddha <gi...@wso2.com> wrote: > >> Hi Godwin, >> >> Are you looking search based on status code? That's not available. >> >> Regards, >> Gihan >> >> On Wed, Jan 10, 2018 at 2:42 PM, Godwin Shrimal <god...@wso2.com> wrote: >> >>> If it's not available I think that will be a useful feature to add. >>> >>> Thanks >>> Godwin >>> >>> On Tue, Jan 9, 2018 at 11:12 AM, Pubudu Gunatilaka <pubu...@wso2.com> >>> wrote: >>> >>>> Hi Godwin, >>>> >>>> Based on [1], looks like there is no way to give the status when >>>> searching. >>>> >>>> [1] - https://docs.wso2.com/display/EI610/Searching+for+Messages >>>> >>>> Thank you! >>>> >>>> On Tue, Jan 9, 2018 at 7:49 AM, Godwin Shrimal <god...@wso2.com> wrote: >>>> >>>>> Reminder on this. >>>>> >>>>> >>>>> Thanks >>>>> Godwin >>>>> >>>>> On Mon, Jan 8, 2018 at 4:57 PM, Godwin Shrimal <god...@wso2.com> >>>>> wrote: >>>>> >>>>>> Hi Devs, >>>>>> >>>>>> How can we search messages in the EI Analytics dashboard with Status? >>>>>> >>>>>> Thanks >>>>>> Godwin >>>>>> >>>>>> -- >>>>>> *Godwin Amila Shrimal* >>>>>> Associate Technical Lead >>>>>> WSO2 Inc.; http://wso2.com >>>>>> lean.enterprise.middleware >>>>>> >>>>>> mobile: *+94772264165* >>>>>> linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ >>>>>> <https://www.linkedin.com/in/godwin-amila-2ba26844/>* >>>>>> twitter: https://twitter.com/godwinamila >>>>>> <http://wso2.com/signature> >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> *Godwin Amila Shrimal* >>>>> Associate Technical Lead >>>>> WSO2 Inc.; http://wso2.com >>>>> lean.enterprise.middleware >>>>> >>>>> mobile: *+94772264165* >>>>> linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ >>>>> <https://www.linkedin.com/in/godwin-amila-2ba26844/>* >>>>> twitter: https://twitter.com/godwinamila >>>>> <http://wso2.com/signature> >>>>> >>>>> ___ >>>>> Dev mailing list >>>>> Dev@wso2.org >>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>> >>>>> >>>> >>>> >>>> -- >>>> *Pubudu Gunatilaka* >>>> Committer and PMC Member - Apache Stratos >>>> Senior Software Engineer >>>> WSO2, Inc.: http://wso2.com >>>> mobile : +94774078049 <%2B94772207163> >>>> >>>> >>> >>> >>> -- >>> *Godwin Amila Shrimal* >>> Associate Technical Lead >>> WSO2 Inc.; http://wso2.com >>> lean.enterprise.middleware >>> >>> mobile: *+94772264165* >>> linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ >>> <https://www.linkedin.com/in/godwin-amila-2ba26844/>* >>> twitter: https://twitter.com/godwinamila >>> <http://wso2.com/signature> >>> >> >> >> >> -- >> W.G. Gihan Anuruddha >> Associate Technical Lead | WSO2, Inc. >> M: +94772272595 >> > > > > -- > *Godwin Amila Shrimal* > Associate Technical Lead > WSO2 Inc.; http://wso2.com > lean.enterprise.middleware > > mobile: *+94772264165* > linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ > <https://www.linkedin.com/in/godwin-amila-2ba26844/>* > twitter: https://twitter.com/godwinamila > <http://wso2.com/signature> > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [EI-Enalytics] Search messages by status
Hi Godwin, Are you looking search based on status code? That's not available. Regards, Gihan On Wed, Jan 10, 2018 at 2:42 PM, Godwin Shrimal <god...@wso2.com> wrote: > If it's not available I think that will be a useful feature to add. > > Thanks > Godwin > > On Tue, Jan 9, 2018 at 11:12 AM, Pubudu Gunatilaka <pubu...@wso2.com> > wrote: > >> Hi Godwin, >> >> Based on [1], looks like there is no way to give the status when >> searching. >> >> [1] - https://docs.wso2.com/display/EI610/Searching+for+Messages >> >> Thank you! >> >> On Tue, Jan 9, 2018 at 7:49 AM, Godwin Shrimal <god...@wso2.com> wrote: >> >>> Reminder on this. >>> >>> >>> Thanks >>> Godwin >>> >>> On Mon, Jan 8, 2018 at 4:57 PM, Godwin Shrimal <god...@wso2.com> wrote: >>> >>>> Hi Devs, >>>> >>>> How can we search messages in the EI Analytics dashboard with Status? >>>> >>>> Thanks >>>> Godwin >>>> >>>> -- >>>> *Godwin Amila Shrimal* >>>> Associate Technical Lead >>>> WSO2 Inc.; http://wso2.com >>>> lean.enterprise.middleware >>>> >>>> mobile: *+94772264165* >>>> linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ >>>> <https://www.linkedin.com/in/godwin-amila-2ba26844/>* >>>> twitter: https://twitter.com/godwinamila >>>> <http://wso2.com/signature> >>>> >>> >>> >>> >>> -- >>> *Godwin Amila Shrimal* >>> Associate Technical Lead >>> WSO2 Inc.; http://wso2.com >>> lean.enterprise.middleware >>> >>> mobile: *+94772264165* >>> linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ >>> <https://www.linkedin.com/in/godwin-amila-2ba26844/>* >>> twitter: https://twitter.com/godwinamila >>> <http://wso2.com/signature> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> *Pubudu Gunatilaka* >> Committer and PMC Member - Apache Stratos >> Senior Software Engineer >> WSO2, Inc.: http://wso2.com >> mobile : +94774078049 <%2B94772207163> >> >> > > > -- > *Godwin Amila Shrimal* > Associate Technical Lead > WSO2 Inc.; http://wso2.com > lean.enterprise.middleware > > mobile: *+94772264165* > linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ > <https://www.linkedin.com/in/godwin-amila-2ba26844/>* > twitter: https://twitter.com/godwinamila > <http://wso2.com/signature> > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [EI] Data services are not hot deploying
Ideally, we should have a consistent behavior in EI for both proxies and data services. But since this is not a recommended way can leave it this way for now. On Thu, Jan 4, 2018 at 10:43 AM, Rajith Vitharana <raji...@wso2.com> wrote: > Hi Godwin, > > AFAIR deployment flows are different for ESB artifacts and DSS artifacts, > DSS artifacts are getting deployed via axis2 deployer(that is it will pick > up changes from file system and get deployed, so with car files, this won't > happen as the actual file does not get changed) whereas when we change ESB > artifacts, it will directly invoke the deployment flow. This was the > behavior we had and since it is not recommended to update artifacts within > a car file, we haven't done any changes to DSS behavior, hence the > difference. > > Thanks, > > On 4 January 2018 at 05:41, Godwin Shrimal <god...@wso2.com> wrote: > >> Hi Pubudu, >> >> Yeah, I know it's not recommending, But when we are doing testing, think >> you want to add a small log to the proxy, you simply can add it via UI and >> test it. >> >> My Question is not about the recommendation, it's about why DSS behaving >> differently than the proxy services. >> >> Thanks >> Godwin >> >> On Thu, Jan 4, 2018 at 12:46 AM, Pubudu Gunatilaka <pubu...@wso2.com> >> wrote: >> >>> Hi Godwin, >>> >>> AFAIK, we should not change any artifact which is deployed using a CAR >>> file. This is not recommended. I am not sure about the reasons for this >>> behavior. >>> >>> Thank you! >>> >>> On Tue, Jan 2, 2018 at 12:45 PM, Godwin Shrimal <god...@wso2.com> wrote: >>> >>>> Hi Devs, >>>> >>>> We can change proxy services (Deployed using CAR) from UI and its >>>> getting hot deploy after changes. But we can't observe same with Data >>>> Services. Any reason for this ? Is it the expected behaviour ? >>>> >>>> Thanks >>>> Godwin >>>> >>>> -- >>>> *Godwin Amila Shrimal* >>>> Associate Technical Lead >>>> WSO2 Inc.; http://wso2.com >>>> lean.enterprise.middleware >>>> >>>> mobile: *+94772264165* >>>> linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ >>>> <https://www.linkedin.com/in/godwin-amila-2ba26844/>* >>>> twitter: https://twitter.com/godwinamila >>>> <http://wso2.com/signature> >>>> >>> >>> >>> >>> -- >>> *Pubudu Gunatilaka* >>> Committer and PMC Member - Apache Stratos >>> Senior Software Engineer >>> WSO2, Inc.: http://wso2.com >>> mobile : +94774078049 <%2B94772207163> >>> >>> >> >> >> -- >> *Godwin Amila Shrimal* >> Associate Technical Lead >> WSO2 Inc.; http://wso2.com >> lean.enterprise.middleware >> >> mobile: *+94772264165* >> linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/ >> <https://www.linkedin.com/in/godwin-amila-2ba26844/>* >> twitter: https://twitter.com/godwinamila >> <http://wso2.com/signature> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Rajith Vitharana > > Associate Technical Lead, > WSO2 Inc. : wso2.com > Mobile : +94715883223 > Blog : http://lankavitharana.blogspot.com/ > <http://wso2.com/signature> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS][Spark] Is it valid to use INSERT OVERWRITE with incremental processing?
That's also possible. But when data grows, eventually where clause might add some overhead. Keeping only unprocessed data separately might speed up the process. On Mon, Nov 13, 2017 at 6:27 PM, Sajith Ravindra <saji...@wso2.com> wrote: > > <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> > > On Mon, Nov 13, 2017 at 5:43 PM, Gihan Anuruddha <gi...@wso2.com> wrote: > >> Keeping a last processed data set in a separate table might be a valid >> use case for some scenario. Users can run an one job per day and gather >> last process data and could do some operations. This avoids the overhead to >> go through the entire data set. >> > > @Gihan, Gimanatha: But, is this a direct or intended use case of using > these two construts together. Isn't it more of a by product? > > If some user wants to process only subset of data wouldn't the user use a > "WHERE" clause? > >> >> On Mon, Nov 13, 2017 at 4:57 PM, Gimantha Bandara <giman...@wso2.com> >> wrote: >> >>> Hi, >>> >>> I don't think we have a valid use case of using OVERWRITE with >>> incremental processing unless we want to keep the last processed data set >>> in a separate table. >>> >>> On Mon, Nov 13, 2017 at 4:30 PM, Sajith Ravindra <saji...@wso2.com> >>> wrote: >>> >>>> Hi all, >>>> >>>> Can there be a valid use case where we do an INSERT OVERWRITE to a >>>> table and then do incremental table commit? >>>> >>>> AFAIU, it leads to loss of data as incremental processing processes >>>> only unprocessed data and OVERWRITE statement drops previously processed >>>> data. >>>> >>>> Please advice. >>>> >>>> Thanks >>>> *,Sajith Ravindra* >>>> Associate Technical Lead >>>> WSO2 Inc.; http://wso2.com >>>> lean.enterprise.middleware >>>> >>>> mobile: +94 77 2273550 >>>> blog: http://sajithr.blogspot.com/ >>>> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> >>>> >>> >>> >>> >>> -- >>> Gimantha Bandara >>> Software Engineer >>> WSO2. Inc : http://wso2.com >>> Mobile : +94714961919 <071%20496%201919> >>> >> >> >> >> -- >> W.G. Gihan Anuruddha >> Associate Technical Lead | WSO2, Inc. >> M: +94772272595 >> > > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS][Spark] Is it valid to use INSERT OVERWRITE with incremental processing?
Yes. That can lead to data loss. I think It's up to the user to decide to use which method. Regards, Gihan On Mon, Nov 13, 2017 at 5:01 PM, Fazlan Nazeem <fazl...@wso2.com> wrote: > Hi Gimantha, > > To add to this question, if we have enabled data purging, does it mean we > shouldn't use INSERT OVERWRITE? Doing INSERT OVEWRITES to a table which > has scheduled data purging will also result in data loss right? > > On Mon, Nov 13, 2017 at 4:57 PM, Gimantha Bandara <giman...@wso2.com> > wrote: > >> Hi, >> >> I don't think we have a valid use case of using OVERWRITE with >> incremental processing unless we want to keep the last processed data set >> in a separate table. >> >> On Mon, Nov 13, 2017 at 4:30 PM, Sajith Ravindra <saji...@wso2.com> >> wrote: >> >>> Hi all, >>> >>> Can there be a valid use case where we do an INSERT OVERWRITE to a table >>> and then do incremental table commit? >>> >>> AFAIU, it leads to loss of data as incremental processing processes only >>> unprocessed data and OVERWRITE statement drops previously processed data. >>> >>> Please advice. >>> >>> Thanks >>> *,Sajith Ravindra* >>> Associate Technical Lead >>> WSO2 Inc.; http://wso2.com >>> lean.enterprise.middleware >>> >>> mobile: +94 77 2273550 >>> blog: http://sajithr.blogspot.com/ >>> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> >>> >> >> >> >> -- >> Gimantha Bandara >> Software Engineer >> WSO2. Inc : http://wso2.com >> Mobile : +94714961919 <+94%2071%20496%201919> >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Thanks & Regards, > > *Fazlan Nazeem* > Senior Software Engineer > WSO2 Inc > Mobile : +94772338839 > <%2B94%20%280%29%20773%20451194> > fazl...@wso2.com > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS][Spark] Is it valid to use INSERT OVERWRITE with incremental processing?
Keeping a last processed data set in a separate table might be a valid use case for some scenario. Users can run an one job per day and gather last process data and could do some operations. This avoids the overhead to go through the entire data set. On Mon, Nov 13, 2017 at 4:57 PM, Gimantha Bandara <giman...@wso2.com> wrote: > Hi, > > I don't think we have a valid use case of using OVERWRITE with incremental > processing unless we want to keep the last processed data set in a separate > table. > > On Mon, Nov 13, 2017 at 4:30 PM, Sajith Ravindra <saji...@wso2.com> wrote: > >> Hi all, >> >> Can there be a valid use case where we do an INSERT OVERWRITE to a table >> and then do incremental table commit? >> >> AFAIU, it leads to loss of data as incremental processing processes only >> unprocessed data and OVERWRITE statement drops previously processed data. >> >> Please advice. >> >> Thanks >> *,Sajith Ravindra* >> Associate Technical Lead >> WSO2 Inc.; http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 77 2273550 >> blog: http://sajithr.blogspot.com/ >> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> >> > > > > -- > Gimantha Bandara > Software Engineer > WSO2. Inc : http://wso2.com > Mobile : +94714961919 <071%20496%201919> > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] WSO2 Committers += Rukshani Athapathu
Hi Devs, It is my pleasure to welcome Rukshani Athapathu as a WSO2 Committer. Rukshani has made some great contributions to product-EI and Ballerina during the last few months and in recognition of her commitment and contributions, she has been voted as a Committer for WSO2. @Rukshani, welcome aboard and keep up the good work. Regards, Gihan -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] WSO2 Enterprise Integrator 6.1.1-update8 Released!
Hi All, The WSO2 Integration team is pleased to announce the release of Enterprise Integrator 6.1.1-update8. It is available for download from here <https://github.com/wso2/product-ei/releases/tag/v6.1.1-update8>. *Tasks/Bug Fixes and Improvements* https://github.com/wso2/product-ei/issues?utf8=%E2%9C%93=is%3Aissue%20milestone%3A6.1.1-update8%20is%3Aclosed%20 ***Documentation* https://docs.wso2.com/display/EI611/ <https://mail.google.com/mail/u/1/%E2%80%8Bhttps://docs.wso2.com/display/EI611/%E2%80%8B> *List of Open Issues* https://github.com/wso2/product-ei/labels/Type%2FBug *Mailing Lists* Join our mailing lists and correspond with the developers directly. Developer List : dev@wso2.org | Subscribe <dev-requ...@wso2.org> | Mail Archive <http://mail.wso2.org/mailarchive/dev/> WSO2 Architecture List: architect...@wso2.org User Forum : StackOverflow <https://stackoverflow.com/questions/tagged/wso2ei> *Reporting Issues* We encourage you to report issues, improvements and feature requests regarding WSO2 Integrator through WSO2 EI GIT <https://github.com/wso2/product-ei/> Issues. ~ The WSO2 Integration Team ~ -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] wso2ei-7.0.0-SNAPSHOT doesn't contain analytics runtime
Hi Youcef, EI-7.0.0 still in a working progress. We haven't added the analytics profile yet. Most of the functionalities are still in the discussion phase. For the immediate usage, please use EI-6.x.x branch/product. Regards, Gihan On Sun, Sep 3, 2017 at 10:27 PM, Youcef HILEM <youcef.hi...@laposte.fr> wrote: > Hi, > I have successfully build wso2ei-7.0.0-SNAPSHOT but it doesn't contain the > nalaytics runtime. > > [INFO] Installing > C:\OpenSource\wso2-ei\product-ei_7.0.x\integration\test-mb\ > test-amqp\pom.xml > to > C:\Users\yhilem\.m2\repository\org\wso2\ei\org.wso2.ei.mb.amqp.test\7.0.0- > SNAPSHOT\org.wso2.ei.mb.amqp.test-7.0.0-SNAPSHOT.pom > [INFO] > > [INFO] Reactor Summary: > [INFO] > [INFO] WSO2 Enterprise Integrator . SUCCESS [ > 3.031 > s] > [INFO] WSO2 Enterprise Integrator - Component Parent .. SUCCESS [ > 0.297 > s] > [INFO] WSO2 Enterprise Integrator - Artifact Deployer . SUCCESS [ > 2.187 > s] > [INFO] tools .. SUCCESS [ > 0.250 > s] > [INFO] converter .. SUCCESS [ > 0.297 > s] > [INFO] common . SUCCESS [ > 5.110 > s] > [INFO] mule2ballerina . SUCCESS [ > 2.656 > s] > [INFO] ds2ballerina ... SUCCESS [ > 2.316 > s] > [INFO] synapse2ballerina .. SUCCESS [ > 5.000 > s] > [INFO] WSO2 Enterprise Integrator - Feature Aggregator Module SUCCESS [ > 0.187 s] > [INFO] org.wso2.ei.converter.tools.mule2ballerina.feature . SUCCESS [ > 4.032 > s] > [INFO] org.wso2.ei.converter.tools.ds2ballerina.feature ... SUCCESS [ > 2.076 > s] > [INFO] org.wso2.ei.converter.tools.synapse2ballerina.feature SUCCESS [ > 2.687 s] > [INFO] WSO2 Enterprise Integrator - Distribution .. SUCCESS [01:00 > min] > [INFO] WSO2 Enterprise Integrator - Integration Tests . SUCCESS [ > 0.203 > s] > [INFO] MB Test Module . SUCCESS [ > 0.282 > s] > [INFO] MB AMQP based Test Module .. SUCCESS [ > 5.447 > s] > [INFO] > > [INFO] BUILD SUCCESS > [INFO] > > [INFO] Total time: 01:39 min > [INFO] Finished at: 2017-09-03T11:08:07+02:00 > [INFO] Final Memory: 117M/946M > [INFO] > > > > > C:\Platform\POC\WSO2\EI-7.0.0\wso2ei-7.0.0-SNAPSHOT\wso2>dir > Le volume dans le lecteur C s’appelle Windows > Le numéro de série du volume est B8E5-2E6D > > Répertoire de C:\Platform\POC\WSO2\EI-7.0.0\wso2ei-7.0.0-SNAPSHOT\wso2 > > 03/09/2017 11:07 . > 03/09/2017 11:07 .. > 03/09/2017 11:28 ballerina > 03/09/2017 11:28 broker > 03/09/2017 11:28 lib > 03/09/2017 11:28 msf4j >0 fichier(s)0 octets >6 Rép(s) 93 357 318 144 octets libres > > C:\Platform\POC\WSO2\EI-7.0.0\wso2ei-7.0.0-SNAPSHOT\wso2> > > > What to do to include this profile. > I need to test the analytics part. > > Thanks, > Youcef HILEM > > > > -- > Sent from: http://wso2-oxygen-tank.10903.n7.nabble.com/WSO2- > Development-f3.html > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > -- W.G. Gihan Anuruddha Associate Technical Lead | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Error when running the newest build of MB-4
Hi,
This is a know issue. Can you please create an issue in here[1].
[1] - https://github.com/wso2/carbon-deployment
Regards,
Gihan
On Wed, May 31, 2017 at 9:32 AM, Pamod Sylvester <pa...@wso2.com> wrote:
> (+) KasunG
>
> On Wed, May 31, 2017 at 9:27 AM, Riyafa Abdul Hameed <riy...@wso2.com>
> wrote:
>
>> Hi,
>>
>> I built MB-4 from the 4.x.x branch of product-mb[1] and ran it by
>> extracting 'wso2mb-4.0.0-SNAPSHOT.zip' from ''/product-mb/product/target'.
>> I get the following error during execution of carbon.sh from the bin folder:
>>
>>> ERROR
>>> {org.wso2.carbon.deployment.engine.internal.DeploymentEngineListenerComponent}
>>> - Could not initialize carbon deployment engine
>>> org.wso2.carbon.deployment.engine.exception.DeploymentEngineException:
>>> Cannot find repository : /home/riyafa/Documents/Workspa
>>> ce/product-mb/product/target/wso2mb-4.0.0-SNAPSHOT/deployment
>>> at org.wso2.carbon.deployment.engine.internal.DeploymentEngine.
>>> start(DeploymentEngine.java:103)
>>> at org.wso2.carbon.deployment.engine.internal.DeploymentEngineL
>>> istenerComponent.onAllRequiredCapabilitiesAvailable(Deployme
>>> ntEngineListenerComponent.java:212)
>>> at org.wso2.carbon.kernel.internal.startupresolver.StartupCompo
>>> nentManager.lambda$notifySatisfiableComponents$51(
>>> StartupComponentManager.java:238)
>>> at java.util.ArrayList.forEach(ArrayList.java:1249)
>>> at org.wso2.carbon.kernel.internal.startupresolver.StartupCompo
>>> nentManager.notifySatisfiableComponents(StartupComponentMana
>>> ger.java:224)
>>> at org.wso2.carbon.kernel.internal.startupresolver.StartupOrder
>>> Resolver$1.run(StartupOrderResolver.java:204)
>>> at java.util.TimerThread.mainLoop(Timer.java:555)
>>> at java.util.TimerThread.run(Timer.java:505)
>>>
>>
>> The current product-mb is written over C5 and I am not sure if it's an
>> issue with C5. When I create a deployment folder in the
>> wso2mb-4.0.0-SNAPSHOT folder and rerun product-mb the error goes away. Any
>> highlight on the above issue would be of help.
>>
>> Thank you.
>> Riyafa
>>
>>
>> [1] https://github.com/wso2/product-mb/tree/4.x.x/product
>>
>> --
>> Riyafa Abdul Hameed
>> Software Engineer, WSO2 Lanka (Pvt) Ltd <http://wso2.com/>
>>
>> Email: riy...@wso2.com <riyafa...@cse.mrt.ac.lk>
>> Website: https://riyafa.wordpress.com/ <http://riyafa.wordpress.com/>
>> <http://facebook.com/riyafa.ahf> <http://lk.linkedin.com/in/riyafa>
>> <http://twitter.com/Riyafa1>
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> *Pamod Sylvester *
>
> *WSO2 Inc.; http://wso2.com <http://wso2.com>*
> cell: +94 77 7779495 <077%20777%209495>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
--
W.G. Gihan Anuruddha
Associate Technical Lead | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Using dep sync for artifact synchronization of Analytics Cluster
In a normal scenario, users will do their implementation and test on dev/staging environments. So simply they just upload their final CApp to production environment. We can avoid SVN depsync in a minimum HA cluster for the simplicity. User needs to upload CApp to the both nodes. Another option is using rsync kind of an option to sync artifacts within the nodes. The same thing can be applied to the fully distributed cluster as well. Regards, Gihan On Fri, Sep 23, 2016 at 12:35 PM, Sashika Wijesinghe <sash...@wso2.com> wrote: > Hi All, > > When deploying an Analytics cluster relevant cApp is bundled with the > Analytics pack, therefore even without configuring SVN based deployment > synchronizer, Analytics cluster can be configured successfully. But if any > changes required (may be a bug fix etc) to the cApp later on, users have to > manually replace the cApp for each node. > > May I know what is the recommended way to configure analytics cluster in > terms of artifacts deployment? > > Thanks > Sashika > > -- > > *Sashika WijesingheSoftware Engineer - QA Team* > Mobile : +94 (0) 774537487 > sash...@wso2.com > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Vote] Release WSO2 Data Analytics Server (DAS) 3.1.0-RC3
I have tested the following and found no issues. - Data explorer with facet search and primary key search. - DAS 3.0.1 to 3.1.0 migration. - ESB Anaytics feature top of on DAS 3.1.0 [+] Stable - Go ahead and release. On Tue, Sep 13, 2016 at 1:47 PM, Gokul Balakrishnan <go...@wso2.com> wrote: > I have tested the following through the EC2 performance test round: > > - Clustered DAS deployment > - Analyzer, Indexer and Receiver profiles > - Data persistence with HBase > - Spark script execution in clustered mode (CarbonAnalytics) > - Clustered indexing operation > - Data explorer > - Basic data publishing > - Smart Home and Wikipedia samples > > [+] Stable - Go ahead and release. > > > On 12 September 2016 at 16:21, Niranda Perera <nira...@wso2.com> wrote: > >> Hi all, >> >> I have tested the following and found no issues >> - DAS usual flow: Data publishing, script execution and dashboards in the >> local mode using the smart home example >> - DAS HA and failover scenarios, 3 node cluster test >> - Spark on YARN in DAS clustering >> >> Hence, >> +1 Stable - Go ahead and release >> >> Best >> >> On Fri, Sep 9, 2016 at 4:54 PM, Niranda Perera <nira...@wso2.com> wrote: >> >>> Hi Devs, >>> >>> This is the third release candidate (RC) of WSO2 Data Analytics Server >>> 3.1.0 release. >>> >>> New / Improvements In This Release after RC2 >>> >>>- Bug fixes in ML integration >>>- Spark configuration parameters for long running jobs >>> >>> Issues Fixed in This Release >>> >>>- WSO2 DAS 3.1.0 Fixed Issues >>><https://wso2.org/jira/issues/?filter=13152> >>> >>> Known Issues >>> >>>- WSO2 DAS 3.1.0 Known Issues >>><https://wso2.org/jira/issues/?filter=13154> >>> >>> Source and distribution packages: >>> >>>- https://github.com/wso2/product-das/releases/tag/v3.1.0-RC3 >>> >>> Please download, test, and vote. The README file under the distribution >>> contains guide and instructions on how to try it out locally. >>> >>> [+] Stable - Go ahead and release >>> [-] Broken - Do not release (explain why) >>> >>> This vote will be open for 72 hours or as needed. >>> >>> Regards, >>> WSO2 DAS Team >>> >>> -- >>> *Niranda Perera* >>> Software Engineer, WSO2 Inc. >>> Mobile: +94-71-554-8430 >>> Twitter: @n1r44 <https://twitter.com/N1R44> >>> https://pythagoreanscript.wordpress.com/ >>> >> >> >> >> -- >> *Niranda Perera* >> Software Engineer, WSO2 Inc. >> Mobile: +94-71-554-8430 >> Twitter: @n1r44 <https://twitter.com/N1R44> >> https://pythagoreanscript.wordpress.com/ >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Gokul Balakrishnan > Senior Software Engineer, > WSO2, Inc. http://wso2.com > M +94 77 5935 789 | +44 7563 570502 > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS 310] ML Siddhi Extension doc update
Yes. We have added ML Siddhi extension to the DAS 3.1.0. On Thu, Aug 18, 2016 at 8:04 AM, Rukshani Weerasinha <ruksh...@wso2.com> wrote: > Hi Sachith, > > Thank you for mentioning this. I will check with someone in the team to > confirm, and update accordingly. > > Best Regards, > Rukshani. > > On Wed, Aug 17, 2016 at 12:23 AM, Sachith Withana <sach...@wso2.com> > wrote: > >> Hi all, >> >> I can see in the doc[1] for the ML siddhi extension, we need to install >> the features (ML Siddhi extension ...etc). This was true for previous >> releases. >> >> But I can see these features are already installed in the latest DAS >> pack. >> >> If that's so, we need to update the docs accordingly. >> >> Can someone please confirm this? >> >> [1] https://docs.wso2.com/display/ML111/WSO2+CEP+Extension+for+M >> L+Predictions >> >> Thanks, >> Sachith >> -- >> Sachith Withana >> Software Engineer; WSO2 Inc.; http://wso2.com >> E-mail: sachith AT wso2.com >> M: +94715518127 >> Linked-In: <http://goog_416592669>https://lk.linkedin.com/in/sac >> hithwithana >> > > > > -- > Rukshani Weerasinha > > WSO2 Inc. > Web:http://wso2.com > Mobile: 0777 683 738 > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV] [DAS] Packaging a JMX Profile in a Carbon App
Hi Chamila, Immediate 3.1.0 doesn't contain this. Still, we haven't decided the features for next DAS release. Regards, Gihan On Fri, Aug 12, 2016 at 10:13 PM, Chamila De Alwis <chami...@wso2.com> wrote: > Hi Gihan, > > Thanks for the reply! Is the improvement targetted for the upcoming > release? > > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Senior Software Engineer | WSO2 > Blog: https://medium.com/@chamilad > > > > On Fri, Aug 12, 2016 at 5:01 AM, Gihan Anuruddha <gi...@wso2.com> wrote: > >> Hi Chamila, >> >> In the current implementation, all the JMX profile information is stored >> in the registry. There is no way to bundle those into the CAPP since there >> is no JMX related deployer. Anyway, we have a plan to redesign this JMX >> agent and we can consider that, to moving to file based artifact solution >> like in other areas. >> >> Regards, >> Gihan >> >> On Fri, Aug 12, 2016 at 10:01 AM, Chamila De Alwis <chami...@wso2.com> >> wrote: >> >>> Hi, >>> >>> I couldn't find any file based artifact matching the JMX Profile that is >>> added from the JMX Agent configuration [1]. Is it possible to pack the JMX >>> profile, event stream, and the event sink into a CAR file so that it can be >>> deployed instead of configured? >>> >>> [1] - https://docs.wso2.com/display/DAS300/Setting+up+the+JMX+Agent >>> >>> Regards, >>> Chamila de Alwis >>> Committer and PMC Member - Apache Stratos >>> Senior Software Engineer | WSO2 >>> Blog: https://medium.com/@chamilad >>> >>> >>> >> >> >> -- >> W.G. Gihan Anuruddha >> Senior Software Engineer | WSO2, Inc. >> M: +94772272595 >> > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV] [DAS] Packaging a JMX Profile in a Carbon App
Hi Chamila, In the current implementation, all the JMX profile information is stored in the registry. There is no way to bundle those into the CAPP since there is no JMX related deployer. Anyway, we have a plan to redesign this JMX agent and we can consider that, to moving to file based artifact solution like in other areas. Regards, Gihan On Fri, Aug 12, 2016 at 10:01 AM, Chamila De Alwis <chami...@wso2.com> wrote: > Hi, > > I couldn't find any file based artifact matching the JMX Profile that is > added from the JMX Agent configuration [1]. Is it possible to pack the JMX > profile, event stream, and the event sink into a CAR file so that it can be > deployed instead of configured? > > [1] - https://docs.wso2.com/display/DAS300/Setting+up+the+JMX+Agent > > Regards, > Chamila de Alwis > Committer and PMC Member - Apache Stratos > Senior Software Engineer | WSO2 > Blog: https://medium.com/@chamilad > > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Deleting events from DAS
+1. AnalyticsDataService is an internal representation and can be changed with subsequent DAS versions. All the external parties must use public representation like AnalyticsDataAPI. On Thu, Jun 30, 2016 at 12:28 PM, Inosh Goonewardena <in...@wso2.com> wrote: > Hi, > > On Thu, Jun 30, 2016 at 12:15 PM, Gihan Anuruddha <gi...@wso2.com> wrote: > >> We don't have a direct method to do this. But we can achieve this if you >> have access to AnalyticsDataService instance. First, you need to call the >> *search* method which will return list of SearchResultEntry list. >> Each SearchResultEntry will contain the id that satisfied the given search >> query, Then you can use the *delete* method by providing a list of ids. >> > > Yes, but instead of > AnalyticsDataService(org.wso2.carbon.analytics.dataservice.core.AnalyticsDataService) > better to use "org.wso2.carbon.analytics.api.AnalyticsDataAPI" instead, it > also implements the same interface but works in a higher layer than that. > > >> >> On Thu, Jun 30, 2016 at 12:06 PM, Chathura Ekanayake <chath...@wso2.com> >> wrote: >> >>> Yes, requirement is to delete events using a filtering criteria (e.g. >>> delete all events with processId=p1). One usecase is for testing. >>> >>> On Thu, Jun 30, 2016 at 11:30 AM, Inosh Goonewardena <in...@wso2.com> >>> wrote: >>> >>>> Hi, >>>> >>>> On Thu, Jun 30, 2016 at 11:22 AM, Nirmal Fernando <nir...@wso2.com> >>>> wrote: >>>> >>>>> You can schedule data purging >>>>> https://docs.wso2.com/display/DAS301/Purging+Data >>>>> >>>> >>>> Yes, we have per table and global data purging support in DAS. However, >>>> you cannot delete events by using filtering criteria OOTB. Is that your >>>> requirement? >>>> >>>> >>>>> >>>>> On Thu, Jun 30, 2016 at 11:18 AM, Chathura Ekanayake < >>>>> chath...@wso2.com> wrote: >>>>> >>>>>> Can we delete events from DAS event store? >>>>>> >>>>>> - Chathura >>>>>> >>>>>> ___ >>>>>> Dev mailing list >>>>>> Dev@wso2.org >>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> Thanks & regards, >>>>> Nirmal >>>>> >>>>> Team Lead - WSO2 Machine Learner >>>>> Associate Technical Lead - Data Technologies Team, WSO2 Inc. >>>>> Mobile: +94715779733 >>>>> Blog: http://nirmalfdo.blogspot.com/ >>>>> >>>>> >>>>> >>>>> ___ >>>>> Dev mailing list >>>>> Dev@wso2.org >>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>> >>>>> >>>> >>>> >>>> -- >>>> Thanks & Regards, >>>> >>>> Inosh Goonewardena >>>> Associate Technical Lead- WSO2 Inc. >>>> Mobile: +94779966317 >>>> >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> W.G. Gihan Anuruddha >> Senior Software Engineer | WSO2, Inc. >> M: +94772272595 >> > > > > -- > Thanks & Regards, > > Inosh Goonewardena > Associate Technical Lead- WSO2 Inc. > Mobile: +94779966317 > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Deleting events from DAS
We don't have a direct method to do this. But we can achieve this if you have access to AnalyticsDataService instance. First, you need to call the *search* method which will return list of SearchResultEntry list. Each SearchResultEntry will contain the id that satisfied the given search query, Then you can use the *delete* method by providing a list of ids. On Thu, Jun 30, 2016 at 12:06 PM, Chathura Ekanayake <chath...@wso2.com> wrote: > Yes, requirement is to delete events using a filtering criteria (e.g. > delete all events with processId=p1). One usecase is for testing. > > On Thu, Jun 30, 2016 at 11:30 AM, Inosh Goonewardena <in...@wso2.com> > wrote: > >> Hi, >> >> On Thu, Jun 30, 2016 at 11:22 AM, Nirmal Fernando <nir...@wso2.com> >> wrote: >> >>> You can schedule data purging >>> https://docs.wso2.com/display/DAS301/Purging+Data >>> >> >> Yes, we have per table and global data purging support in DAS. However, >> you cannot delete events by using filtering criteria OOTB. Is that your >> requirement? >> >> >>> >>> On Thu, Jun 30, 2016 at 11:18 AM, Chathura Ekanayake <chath...@wso2.com> >>> wrote: >>> >>>> Can we delete events from DAS event store? >>>> >>>> - Chathura >>>> >>>> ___ >>>> Dev mailing list >>>> Dev@wso2.org >>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>> >>>> >>> >>> >>> -- >>> >>> Thanks & regards, >>> Nirmal >>> >>> Team Lead - WSO2 Machine Learner >>> Associate Technical Lead - Data Technologies Team, WSO2 Inc. >>> Mobile: +94715779733 >>> Blog: http://nirmalfdo.blogspot.com/ >>> >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> Thanks & Regards, >> >> Inosh Goonewardena >> Associate Technical Lead- WSO2 Inc. >> Mobile: +94779966317 >> > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS][IS-ANALYTICS]May threads are blocked on Event Sink Queue
The same code snippet points out during the ESB-Analytics performance test as well. Queue not releasing fast enough due to database slowness. So introducing new queues will not solve the problem, but may introduce OOM situations. On Thu, Jun 16, 2016 at 4:16 PM, Sajith Ravindra <saji...@wso2.com> wrote: > Gihan, it's true that IO for database operations is also a bottleneck. But > if you take a look at the thread dump many data receiving threads(to > persist events of incoming streams) and processing threads (to persist > events of output streams) are just blocked on this lock trying to insert > events to the queue. From what I see it's not that threads are blocked > because queue is full. > > Apparently at this point, blocking of these receiving and processing > threads seems to degrade the performance. > > > On Jun 16, 2016, at 3:48 PM, Gihan Anuruddha <gi...@wso2.com> wrote: > > Actually bottleneck is coming from the database. Data insertion > back-pressure shows at this level. What is the exact data insertion rate > for database(not the server TPS). Btw Innodb give poor performance than > MyISAM. Also, in MySQL TPS gets degraded with the data growth. > > On Thu, Jun 16, 2016 at 2:23 PM, Sajith Ravindra <saji...@wso2.com> wrote: > >> Thread dump for reference >> >> >> https://drive.google.com/a/wso2.com/file/d/0B92QGepCpPD9SFdjQi1OeV9DUUk/view?usp=sharing >> >> Thanks >> *,Sajith Ravindra* >> Senior Software Engineer >> WSO2 Inc.; http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 77 2273550 >> blog: http://sajithr.blogspot.com/ >> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> >> >> On Thu, Jun 16, 2016 at 2:18 PM, Sajith Ravindra <saji...@wso2.com> >> wrote: >> >>> Hi all, >>> >>> We are doing a performance test on IS analytics server. While we keep >>> pumping data to the server we can see that throughput gradually decreases >>> to a very low (< 1K) TPS. We used MySQL with InnoDB with tuned parameters. >>> And set Xms2g and Xmx4g in DAS. >>> >>> When looked at the thread dumps we can see that more than 100 threads >>> BLOCKED/TIMED_WATING at AnalyticsEventQueueManager.put() on a single lock >>> object(i.e. on the same reference). Many threads are just waiting to get >>> the lock without processing events which seem to be the reason for degraded >>> performance. >>> >>> Are there any parameters that we can tune to gain better performance to >>> overcome this bottleneck ? >>> >>> I had a look at the code and AFAIU all events of a particular tenant are >>> persisted through a single synchronized queue. According to my >>> understanding, this synchronized queue is a performance bottleneck since >>> all threads pertaining to a persisted event stream will need to block on >>> this queue. >>> >>> IMO if we can have a queue per event-sink(i.e per persisted stream) it >>> should give a better performance than this. Any implications if we do that >>> or is there a better option? >>> >>> >>> Thanks >>> *,Sajith Ravindra* >>> Senior Software Engineer >>> WSO2 Inc.; http://wso2.com >>> lean.enterprise.middleware >>> >>> mobile: +94 77 2273550 >>> blog: http://sajithr.blogspot.com/ >>> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> >>> >> >> > > > -- > W.G. Gihan Anuruddha > Senior Software Engineer | WSO2, Inc. > M: +94772272595 > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS][IS-ANALYTICS]May threads are blocked on Event Sink Queue
Actually bottleneck is coming from the database. Data insertion back-pressure shows at this level. What is the exact data insertion rate for database(not the server TPS). Btw Innodb give poor performance than MyISAM. Also, in MySQL TPS gets degraded with the data growth. On Thu, Jun 16, 2016 at 2:23 PM, Sajith Ravindra <saji...@wso2.com> wrote: > Thread dump for reference > > > https://drive.google.com/a/wso2.com/file/d/0B92QGepCpPD9SFdjQi1OeV9DUUk/view?usp=sharing > > Thanks > *,Sajith Ravindra* > Senior Software Engineer > WSO2 Inc.; http://wso2.com > lean.enterprise.middleware > > mobile: +94 77 2273550 > blog: http://sajithr.blogspot.com/ > <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> > > On Thu, Jun 16, 2016 at 2:18 PM, Sajith Ravindra <saji...@wso2.com> wrote: > >> Hi all, >> >> We are doing a performance test on IS analytics server. While we keep >> pumping data to the server we can see that throughput gradually decreases >> to a very low (< 1K) TPS. We used MySQL with InnoDB with tuned parameters. >> And set Xms2g and Xmx4g in DAS. >> >> When looked at the thread dumps we can see that more than 100 threads >> BLOCKED/TIMED_WATING at AnalyticsEventQueueManager.put() on a single lock >> object(i.e. on the same reference). Many threads are just waiting to get >> the lock without processing events which seem to be the reason for degraded >> performance. >> >> Are there any parameters that we can tune to gain better performance to >> overcome this bottleneck ? >> >> I had a look at the code and AFAIU all events of a particular tenant are >> persisted through a single synchronized queue. According to my >> understanding, this synchronized queue is a performance bottleneck since >> all threads pertaining to a persisted event stream will need to block on >> this queue. >> >> IMO if we can have a queue per event-sink(i.e per persisted stream) it >> should give a better performance than this. Any implications if we do that >> or is there a better option? >> >> >> Thanks >> *,Sajith Ravindra* >> Senior Software Engineer >> WSO2 Inc.; http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 77 2273550 >> blog: http://sajithr.blogspot.com/ >> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab> >> > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Architecture] WSO2 ESB 5.0.0-BETA Released!
executions. >>>>>- [ESBJAVA-4591 <https://wso2.org/jira/browse/ESBJAVA-4591>] - >>>>>[WSO2 ESB Mediation Debugger][Clear Property] Clearing value of >>>>> property >>>>>give an error >>>>>- [ESBJAVA-4599 <https://wso2.org/jira/browse/ESBJAVA-4599>] - >>>>>[Data Mapper]Cannot map attributes with namespaces >>>>>- [ESBJAVA-4600 <https://wso2.org/jira/browse/ESBJAVA-4600>] - >>>>>[Data Mapper]Cannot map Array elements >>>>>- [ESBJAVA-4601 <https://wso2.org/jira/browse/ESBJAVA-4601>] - >>>>>When creating an endpoint template and defining template endpoint with >>>>>dynamic duration it fails >>>>>- [ESBJAVA-4609 <https://wso2.org/jira/browse/ESBJAVA-4609>] - Can >>>>>not deployed more than one mqtt transport enabled proxy services >>>>>- [ESBJAVA-4610 <https://wso2.org/jira/browse/ESBJAVA-4610>] - >>>>>MQTT proxy service can not send messages to another MQTT topic >>>>> concurrently >>>>>- [ESBJAVA-4611 <https://wso2.org/jira/browse/ESBJAVA-4611>] - >>>>>Cannot change the mediation flow and proceed by resending mediation >>>>> flow >>>>>break points >>>>>- [ESBJAVA-4613 <https://wso2.org/jira/browse/ESBJAVA-4613>] - JMS >>>>>Proxy retrying fails in multiple proxies deployed setup when MQ >>>>> restarted. >>>>>- [ESBJAVA-4617 <https://wso2.org/jira/browse/ESBJAVA-4617>] - >>>>>Proxy source view shows as empty sometimes >>>>>- [ESBJAVA-4625 <https://wso2.org/jira/browse/ESBJAVA-4625>] - >>>>>[ESB500][JMS] Logs show incorrect value >>>>> >>>>> Improvement >>>>> >>>>> - [ESBJAVA-4060 <https://wso2.org/jira/browse/ESBJAVA-4060>] - >>>>>server_name support in client hello of TLS connection >>>>>- [ESBJAVA-4328 <https://wso2.org/jira/browse/ESBJAVA-4328>] - >>>>>Encode REST_URL_POSTFIX >>>>>- [ESBJAVA-4380 <https://wso2.org/jira/browse/ESBJAVA-4380>] - >>>>>Improve the script mediator allow set properties with a scope >>>>>- [ESBJAVA-4404 <https://wso2.org/jira/browse/ESBJAVA-4404>] - >>>>>Consolidate log entries of HTTP access logs >>>>>- [ESBJAVA-4411 <https://wso2.org/jira/browse/ESBJAVA-4411>] - >>>>>Upgrade Commons-net to 3.4 >>>>>- [ESBJAVA-4520 <https://wso2.org/jira/browse/ESBJAVA-4520>] - >>>>>Improve the Kafka Inbound performance >>>>>- [ESBJAVA-4530 <https://wso2.org/jira/browse/ESBJAVA-4530>] - >>>>>Support to map primitive array types in Datamaper >>>>>- [ESBJAVA-4569 <https://wso2.org/jira/browse/ESBJAVA-4569>] - >>>>>RabbitMQ message store and message processor not support SSL >>>>>- [ESBJAVA-4580 <https://wso2.org/jira/browse/ESBJAVA-4580>] - >>>>>xsi:type support in datamapper engine side >>>>> >>>>> Patch >>>>> >>>>>- [ESBJAVA-4572 <https://wso2.org/jira/browse/ESBJAVA-4572>] - >>>>>"false" or "true" String values send as JSON, autoprimtives and >>>>>autoprimtive disable regex has lower precedance >>>>>- [ESBJAVA-4578 <https://wso2.org/jira/browse/ESBJAVA-4578>] - >>>>>enableMTOM property does not check in SynapseCallBackReceiver when >>>>> Enabling >>>>>MTOM >>>>> >>>>> Task >>>>> >>>>>- [ESBJAVA-4382 <https://wso2.org/jira/browse/ESBJAVA-4382>] - >>>>>Update MQTT Client library version >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> - WSO2 Team - >>>>> >>>>> -- >>>>> Buddhima Wijeweera >>>>> Software Engineer; WSO2 Inc.; http://wso2.com , >>>>> >>>>> Mobile: +94 71 427 9966 >>>>> Email: buddh...@wso2.com >>>>> Blog: https://buddhimawijeweera.wordpress.com >>>>> GitHub Profile: https://github.com/Buddhima >>>>> >>>>> ___ >>>>> Architecture mailing list >>>>> architect...@wso2.org >>>>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture >>>>> >>>>> >>>> >>>> >>>> -- >>>> Thanks & Regards >>>> >>>> Iranga Muthuthanthri >>>> (M) -0777-255773 >>>> Team Product Management >>>> >>>> >>>> ___ >>>> Dev mailing list >>>> Dev@wso2.org >>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>> >>>> >>> >>> >>> -- >>> *Isuru Udana* >>> Associate Technical Lead >>> WSO2 Inc.; http://wso2.com >>> email: isu...@wso2.com cell: +94 77 3791887 >>> blog: http://mytecheye.blogspot.com/ >>> >> >> >> >> -- >> Thanks & Regards >> >> Iranga Muthuthanthri >> (M) -0777-255773 >> Team Product Management >> >> > > > -- > *Isuru Udana* > Associate Technical Lead > WSO2 Inc.; http://wso2.com > email: isu...@wso2.com cell: +94 77 3791887 > blog: http://mytecheye.blogspot.com/ > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] DAS 3.0.1 - Empty Dashboard for Smart Home Sample
;> home application sample as expected in QuickStartGuide >>>>>>> <https://docs.wso2.com/display/DAS301/Quick+Start+Guide#QuickStartGuide-DeployingthesampleC-App> >>>>>>> (Screenshot >>>>>>> is attached). However, the "Data Explorer" shows the data as expected. I >>>>>>> face the same problem in both Chrome and Firefox. >>>>>>> >>>>>>> Could anyone suggest a solution for this? >>>>>>> >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>>> -- >>>>>>> *Gobinath **Loganathan* >>>>>>> Software Engineer, WSO2 Inc. http://wso2.com >>>>>>> >>>>>>> Email : gobin...@wso2.com >>>>>>> Mobile : (+94) 770 780 210 >>>>>>> Blog: javahelps.com <http://www.javahelps.com/> >>>>>>> >>>>>>> >>>>>>> >>>>>>> ___ >>>>>>> Dev mailing list >>>>>>> Dev@wso2.org >>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Thanuja Uruththirakodeeswaran >>>>>> Software Engineer >>>>>> WSO2 Inc.;http://wso2.com >>>>>> lean.enterprise.middleware >>>>>> >>>>>> mobile: +94 774363167 >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Thanuja Uruththirakodeeswaran >>>>> Software Engineer >>>>> WSO2 Inc.;http://wso2.com >>>>> lean.enterprise.middleware >>>>> >>>>> mobile: +94 774363167 >>>>> >>>> >>>> >>>> >>>> -- >>>> *Gobinath **Loganathan* >>>> Software Engineer, WSO2 Inc. http://wso2.com >>>> >>>> Email : gobin...@wso2.com >>>> Mobile : (+94) 770 780 210 >>>> Blog: javahelps.com <http://www.javahelps.com/> >>>> >>>> >>>> >>>> ___ >>>> Dev mailing list >>>> Dev@wso2.org >>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>> >>>> >>> >>> >>> -- >>> Nipuna Marcus >>> *Software Engineer* >>> WSO2 Inc. >>> http://wso2.com/ - "lean . enterprise . middleware" >>> Mobile : +94 (0) 713 667906 >>> nipu...@wso2.com >>> >> >> >> >> -- >> *Gobinath **Loganathan* >> Software Engineer, WSO2 Inc. http://wso2.com >> >> Email : gobin...@wso2.com >> Mobile : (+94) 770 780 210 >> Blog: javahelps.com <http://www.javahelps.com/> >> >> >> > > > > -- > Nipuna Marcus > *Software Engineer* > WSO2 Inc. > http://wso2.com/ - "lean . enterprise . middleware" > Mobile : +94 (0) 713 667906 > nipu...@wso2.com > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [CEP][Siddhi QL] Flushing external time batch after some time
Hi All, We are using external time windows in second based and minute based to do some aggregate operations as below. from tempDecompressedEventStream#window.externalTimeBatch(startTime, 1 sec, 0) As we observed, this will not flush the current values after some time. As an example, if I send 50 events to second based external time batch stream only 49 events I'm getting. We want to flush that last remaining event after some time in order to execute other analytics correctly. Is there anyway to achieve this? Regards, Gihan W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] DAS minimum HA deployment in one node?
Normally what we are doing is stating one node path in both configuration files. Basically, this symbolic link is used to load some classes to runtime. Since both node are identical this won't be an issue IMO. Regards, Gihan On Tue, Apr 12, 2016 at 10:30 AM, Nirmal Fernando <nir...@wso2.com> wrote: > Hi All, > > Is it possible to setup DAS minimum HA deployment in one node? AFAIS the > requirement to create a symbolic link makes it impossible? > > -- > > Thanks & regards, > Nirmal > > Team Lead - WSO2 Machine Learner > Associate Technical Lead - Data Technologies Team, WSO2 Inc. > Mobile: +94715779733 > Blog: http://nirmalfdo.blogspot.com/ > > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] WSO2 ESB Analytics v1.0.0-ALPHA Released !
*WSO2 ESB Analytics v1.0.0-ALPHA Released* We are pleased to announce the alpha release of WSO2 ESB Analytics v1.0.0 [1 <https://wso2.org/jira/browse/ESBJAVA>] which is powered by WSO2 Data Analytics Server. ESB Analytics can be used to collect statistics, debug, and profile your mediation sequences. Your feedback is highly appreciated, any bugs or issues can be reported here [2 <https://wso2.org/jira/browse/ESBJAVA>]. This release contains the following capabilities:- - Mediation Tracing - Tracking of all actions in ESB, drilling down into mediator - Analyzing message flows, comparing mediator before/after versions of payloads - Mediator flow visualization - Mediation Statistics - Proxy/API/Inbound Endpoint/Mediator level statistics (TPS/Latency/Message Counts) - Statistics drill-down support (timestamp ranges / proxy-> sequence -> mediator) [1] https://svn.wso2.org/repos/wso2/scratch/ESB/packs/5.0.0-Releases/5.0.0-ALPHA/wso2analytics-esb-1.0.0-ALPHA.zip [2] https://wso2.org/jira/browse/ESBJAVA Thanks. -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Arbitrary data is not visible in data explorer
Hi Kalpa, Yes. There is a bug in DAS 3.0.1 pack where arbitrary data not persisting. This bug already fixed after the release. So fixed will be available in the next DAS release. Regards, Gihan On Sun, Apr 3, 2016 at 9:46 AM, Kalpa Welivitigoda <kal...@wso2.com> wrote: > Hi all, > > I have added an arbitrary values Map <String, String> when constructing > the Event to be published to DAS 3.0.1. But when I publish and search the > table in Data Explorer in DAS, I don't see the arbitrary data in "Arbitrary > Fields / Extended fields" section of any record. > > Would this be related to [1] or am I missing something here? > > [1] https://wso2.org/jira/browse/DAS-255 > > -- > Best Regards, > > Kalpa Welivitigoda > Software Engineer, WSO2 Inc. http://wso2.com > Email: kal...@wso2.com > Mobile: +94776509215 > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Is there a way to retrieve selected fields from a given table
Hi Sumedha, Gimantha will implement same for the REST API as well. This will be available in the DAS-3.0.2-SNAPSHOT pack. Regards, Gihan On Wed, Mar 23, 2016 at 1:48 PM, Sumedha Rubasinghe <sume...@wso2.com> wrote: > Gihan, > Can't we implement the same functionality for REST API? > > This will help to prevent maintaining two client logics for REST API & > Admin API. > > On Wed, Mar 23, 2016 at 1:27 PM, Gihan Anuruddha <gi...@wso2.com> wrote: > >> There is a parameter that you can specify which column you need for >> response. >> >> On Wed, Mar 23, 2016 at 11:36 AM, Geesara Prathap <gees...@wso2.com> >> wrote: >> >>> Thanks for the information. In admin service how to do $subject. Just to >>> know >>> >>> On Wed, Mar 23, 2016 at 11:28 AM, Gihan Anuruddha <gi...@wso2.com> >>> wrote: >>> >>>> AFAIK, you can't do this when you use the REST API. But if you use the >>>> admin service you should able to do this. >>>> >>>> On Wed, Mar 23, 2016 at 10:39 AM, Geesara Prathap <gees...@wso2.com> >>>> wrote: >>>> >>>>> Hi All, >>>>> >>>>> As an example, *ORG_WSO2_IOT_DEVICES_TEMPERATURE *table consists of >>>>> five fields: META_OWNER, META_DEVICETYPE, META_DEVICEID, META_TIME, >>>>> TEMPERATURE and _TIMESTAMP. But interested only less number of fields. >>>>> When >>>>> querying this >>>>> >>>>> *meta_owner:admin AND meta_deviceId:1iexrfgp2jwa8 AND >>>>> meta_time:[1456467843079 TO 1456468494817]* which retrieved all >>>>> fields it contains. So how to get selected some of the fields only which >>>>> are required? >>>>> >>>>> Thanks, >>>>> Geesara >>>>> -- >>>>> Geesara Prathap Kulathunga >>>>> Software Engineer >>>>> WSO2 Inc; http://wso2.com >>>>> Mobile : +940772684174 >>>>> >>>>> >>>>> ___ >>>>> Dev mailing list >>>>> Dev@wso2.org >>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>> >>>>> >>>> >>>> >>>> -- >>>> W.G. Gihan Anuruddha >>>> Senior Software Engineer | WSO2, Inc. >>>> M: +94772272595 >>>> >>> >>> >>> >>> -- >>> Geesara Prathap Kulathunga >>> Software Engineer >>> WSO2 Inc; http://wso2.com >>> Mobile : +940772684174 >>> >>> >> >> >> -- >> W.G. Gihan Anuruddha >> Senior Software Engineer | WSO2, Inc. >> M: +94772272595 >> >> ___ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > /sumedha > m: +94 773017743 > b : bit.ly/sumedha > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Is there a way to retrieve selected fields from a given table
There is a parameter that you can specify which column you need for response. On Wed, Mar 23, 2016 at 11:36 AM, Geesara Prathap <gees...@wso2.com> wrote: > Thanks for the information. In admin service how to do $subject. Just to > know > > On Wed, Mar 23, 2016 at 11:28 AM, Gihan Anuruddha <gi...@wso2.com> wrote: > >> AFAIK, you can't do this when you use the REST API. But if you use the >> admin service you should able to do this. >> >> On Wed, Mar 23, 2016 at 10:39 AM, Geesara Prathap <gees...@wso2.com> >> wrote: >> >>> Hi All, >>> >>> As an example, *ORG_WSO2_IOT_DEVICES_TEMPERATURE *table consists of >>> five fields: META_OWNER, META_DEVICETYPE, META_DEVICEID, META_TIME, >>> TEMPERATURE and _TIMESTAMP. But interested only less number of fields. When >>> querying this >>> >>> *meta_owner:admin AND meta_deviceId:1iexrfgp2jwa8 AND >>> meta_time:[1456467843079 TO 1456468494817]* which retrieved all fields >>> it contains. So how to get selected some of the fields only which are >>> required? >>> >>> Thanks, >>> Geesara >>> -- >>> Geesara Prathap Kulathunga >>> Software Engineer >>> WSO2 Inc; http://wso2.com >>> Mobile : +940772684174 >>> >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> W.G. Gihan Anuruddha >> Senior Software Engineer | WSO2, Inc. >> M: +94772272595 >> > > > > -- > Geesara Prathap Kulathunga > Software Engineer > WSO2 Inc; http://wso2.com > Mobile : +940772684174 > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] Is there a way to retrieve selected fields from a given table
AFAIK, you can't do this when you use the REST API. But if you use the admin service you should able to do this. On Wed, Mar 23, 2016 at 10:39 AM, Geesara Prathap <gees...@wso2.com> wrote: > Hi All, > > As an example, *ORG_WSO2_IOT_DEVICES_TEMPERATURE *table consists of five > fields: META_OWNER, META_DEVICETYPE, META_DEVICEID, META_TIME, TEMPERATURE > and _TIMESTAMP. But interested only less number of fields. When querying > this > > *meta_owner:admin AND meta_deviceId:1iexrfgp2jwa8 AND > meta_time:[1456467843079 TO 1456468494817]* which retrieved all fields it > contains. So how to get selected some of the fields only which are required? > > Thanks, > Geesara > -- > Geesara Prathap Kulathunga > Software Engineer > WSO2 Inc; http://wso2.com > Mobile : +940772684174 > > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Publishing data to CSV file in DAS
We don't have data export functionality at the moment. But I believe you
can use the RDBMS adaptor to publish data to external RDBMS like MySQL and
use tool like phpMyAdmin to export that data to CSV.
On Tue, Feb 23, 2016 at 1:29 PM, Sashika Wijesinghe <sash...@wso2.com>
wrote:
> Hi Gihan,
>
> In data explorer there is a set of tables
> ('ORG_WSO2_APIMGT_STATISTICS_FAULT', ORG_WSO2_APIMGT_STATISTICS_REQUEST)
> which contains the event information. My requirement is to export these
> data in to a csv file. I checked in the event publisher, but I coudn't find
> 'csv' format there.
>
> Regards,
>
> On Tue, Feb 23, 2016 at 12:28 PM, Gihan Anuruddha <gi...@wso2.com> wrote:
>
>> You can use the event simulator for this AFAIU [1].
>>
>> [1] -
>> https://docs.wso2.com/display/CEP400/Publishing+Data+Using+Event+Simulation
>>
>> On Tue, Feb 23, 2016 at 12:20 PM, Sashika Wijesinghe <sash...@wso2.com>
>> wrote:
>>
>>> Hi All,
>>>
>>> I have configured to publish APIM statistics to DAS. Invoked the API and
>>> the request/response counts were recorded in DAS data exploere.
>>>
>>> May I know whether there is any way of publishing this raw data to a csv
>>> file through DAS?
>>>
>>> Any suggestion is highly appreciated.
>>>
>>> Thanks and Regards,
>>> Sashika
>>>
>>>
>>> --
>>>
>>> *Sashika WijesingheSoftware Engineer - QA Team*
>>> Mobile : +94 (0) 774537487
>>> sash...@wso2.com
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>> W.G. Gihan Anuruddha
>> Senior Software Engineer | WSO2, Inc.
>> M: +94772272595
>>
>
>
>
> --
>
> *Sashika WijesingheSoftware Engineer - QA Team*
> Mobile : +94 (0) 774537487
> sash...@wso2.com
>
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Publishing data to CSV file in DAS
You can use the event simulator for this AFAIU [1]. [1] - https://docs.wso2.com/display/CEP400/Publishing+Data+Using+Event+Simulation On Tue, Feb 23, 2016 at 12:20 PM, Sashika Wijesinghe <sash...@wso2.com> wrote: > Hi All, > > I have configured to publish APIM statistics to DAS. Invoked the API and > the request/response counts were recorded in DAS data exploere. > > May I know whether there is any way of publishing this raw data to a csv > file through DAS? > > Any suggestion is highly appreciated. > > Thanks and Regards, > Sashika > > > -- > > *Sashika WijesingheSoftware Engineer - QA Team* > Mobile : +94 (0) 774537487 > sash...@wso2.com > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DEV][VOTE] Release WSO2 Data Analytics Server 3.0.1 RC1
Tested below functionalities in a standalone pack. - Data Explorer - Index search - Primary key search - Facet search - Date range search - Spark notification sending My vote is [x] Stable - Go ahead and release Regards, Gihan On Thu, Jan 14, 2016 at 5:53 PM, Dunith Dhanushka <dun...@wso2.com> wrote: > Tested below areas in a standalone pack. > > - Samples > - Smart home > - HTTPD Logs > > - CApp deployment > - Stream persistence > - Analytic Dashboard > - Gadget generation > > So my vote is [x] Stable - Go ahead and release > > > Thanks, > Dunith > > On Thu, Jan 14, 2016 at 5:46 PM, Seshika Fernando <sesh...@wso2.com> > wrote: > >> Hi, >> >> I've tested DAS 3.0.1 RC1 with complex execution plans that test event >> tables, indexing, patterns, windows, joins etc; I've also tested data >> persistence, event tracing, data explorer, event publisher, stream >> simulation. >> >> All works well. >> >> My vote - [x] Stable - Go ahead and release. >> >> seshi >> >> On Thu, Jan 14, 2016 at 4:15 PM, Sachith Withana <sach...@wso2.com> >> wrote: >> >>> Hi all, >>> >>> This is the first release candidate of WSO2 DAS 3.0.1. Please download, >>> test and vote. >>> >>> The vote will be open for 72 hours or as needed. >>> >>> This release fixes the following issues: >>> https://wso2.org/jira/issues/?filter=12622 >>> >>> Binary distribution file: >>> https://svn.wso2.org/repos/wso2/people/sachith/rc1/ >>> >>> [ ] Broken - Do not release (explain why) >>> [ ] Stable - Go ahead and release >>> >>> >>> Thanks, >>> WSO2 DAS Team. >>> >>> -- >>> Sachith Withana >>> Software Engineer; WSO2 Inc.; http://wso2.com >>> E-mail: sachith AT wso2.com >>> M: +94715518127 >>> Linked-In: <http://goog_416592669> >>> https://lk.linkedin.com/in/sachithwithana >>> >>> ___ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> _______ >> Dev mailing list >> Dev@wso2.org >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Regards, > > Dunith Dhanushka, > Senior Software Engineer > WSO2 Inc, > > Mobile - +94 71 8615744 > Blog - dunithd.wordpress.com <http://blog.dunith.com> > Twitter - @dunithd <http://twitter.com/dunithd> > > ___ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Data Publishing Client API
Hi Nathasha, Did you refer this document[1]? [1] - https://docs.wso2.com/pages/viewpage.action?pageId=45952633 Regards, Gihan On Tue, Jan 5, 2016 at 5:36 PM, Nathasha Naranpanawa <natha...@wso2.com> wrote: > > Hi, > > I'm working on publishing data to the DAS using Thrift/Binary directly. Is > there an existing client API for DAS that I could use to publish data > asynchronously instead? > > Thanks. > > > -- > Nathasha Naranpanawa > Software Engineering Intern > WSO2 Inc. > > Email: natha...@wso2.com > Mobile: +94775496142 > LinkedIn: https://lk.linkedin.com/in/nathashanaranpanawa > > > -- > You received this message because you are subscribed to the Google Groups > "WSO2 Engineering Group" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to engineering-group+unsubscr...@wso2.com. > For more options, visit https://groups.google.com/a/wso2.com/d/optout. > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] DAS going OOM frequently
ure_Sensor_Script for tenant id: -1234
>>>>>> [2015-12-16 15:11:00,006] INFO
>>>>>> {org.wso2.carbon.analytics.spark.core.AnalyticsTask} - Executing the
>>>>>> schedule task for: Proximity_Sensor_Script for tenant id: -1234
>>>>>> [2015-12-16 15:11:00,006] INFO
>>>>>> {org.wso2.carbon.analytics.spark.core.AnalyticsTask} - Executing the
>>>>>> schedule task for: Rotation_Sensor_Script for tenant id: -1234
>>>>>> [2015-12-16 15:11:00,007] INFO
>>>>>> {org.wso2.carbon.analytics.spark.core.AnalyticsTask} - Executing the
>>>>>> schedule task for: Temperature_Sensor_Script for tenant id: -1234
>>>>>> [2015-12-16 15:11:01,132] ERROR
>>>>>> {org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter} - Error in
>>>>>> executing task: null
>>>>>> java.util.ConcurrentModificationException
>>>>>> at java.util.HashMap$HashIterator.nextEntry(HashMap.java:922)
>>>>>> at java.util.HashMap$KeyIterator.next(HashMap.java:956)
>>>>>> at java.util.AbstractCollection.toArray(AbstractCollection.java:195)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.dataservice.core.indexing.AnalyticsIndexedTableStore.refreshIndexedTableArray(AnalyticsIndexedTableStore.java:46)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.dataservice.core.indexing.AnalyticsIndexedTableStore.addIndexedTable(AnalyticsIndexedTableStore.java:37)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.dataservice.core.AnalyticsDataServiceImpl.refreshIndexedTableStoreEntry(AnalyticsDataServiceImpl.java:512)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.dataservice.core.AnalyticsDataServiceImpl.invalidateAnalyticsTableInfo(AnalyticsDataServiceImpl.java:525)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.dataservice.core.AnalyticsDataServiceImpl.checkAndInvalidateTableInfo(AnalyticsDataServiceImpl.java:504)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.dataservice.core.AnalyticsDataServiceImpl.setTableSchema(AnalyticsDataServiceImpl.java:495)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.spark.core.sources.AnalyticsRelation.insert(AnalyticsRelation.java:162)
>>>>>> at
>>>>>> org.apache.spark.sql.sources.InsertIntoDataSource.run(commands.scala:53)
>>>>>> at
>>>>>> org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult$lzycompute(commands.scala:57)
>>>>>> at
>>>>>> org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult(commands.scala:57)
>>>>>> at
>>>>>> org.apache.spark.sql.execution.ExecutedCommand.doExecute(commands.scala:68)
>>>>>> at
>>>>>> org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:88)
>>>>>> at
>>>>>> org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:88)
>>>>>> at
>>>>>> org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:147)
>>>>>> at
>>>>>> org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:87)
>>>>>> at
>>>>>> org.apache.spark.sql.SQLContext$QueryExecution.toRdd$lzycompute(SQLContext.scala:950)
>>>>>> at
>>>>>> org.apache.spark.sql.SQLContext$QueryExecution.toRdd(SQLContext.scala:950)
>>>>>> at org.apache.spark.sql.DataFrame.(DataFrame.scala:144)
>>>>>> at org.apache.spark.sql.DataFrame.(DataFrame.scala:128)
>>>>>> at org.apache.spark.sql.DataFrame$.apply(DataFrame.scala:51)
>>>>>> at org.apache.spark.sql.SQLContext.sql(SQLContext.scala:755)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQueryLocal(SparkAnalyticsExecutor.java:710)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQuery(SparkAnalyticsExecutor.java:692)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeQuery(CarbonAnalyticsProcessorService.java:199)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeScript(CarbonAnalyticsProcessorService.java:149)
>>>>>> at
>>>>>> org.wso2.carbon.analytics.spark.core.A
Re: [Dev] [DAS] Indexing arbitrary fields
ersist all the log events from >>>>>>>>>> different >>>>>>>>>> log sources. The way log data comes in to log REST API is as >>>>>>>>>> arbitrary >>>>>>>>>> fields. So different log sources have different set of arbitrary >>>>>>>>>> fields >>>>>>>>>> which leads log REST API to change the schema of master table every >>>>>>>>>> time it >>>>>>>>>> receives log events from a new/updated log source. That's what i >>>>>>>>>> meant >>>>>>>>>> inaccurate which can be solved much cleaner way by having that flag >>>>>>>>>> to >>>>>>>>>> index or not to index arbitrary fields for a particular stream. >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Malith >>>>>>>>>> >>>>>>>>>> On Tue, Dec 1, 2015 at 6:06 PM, Anjana Fernando <anj...@wso2.com> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Malith, >>>>>>>>>>> >>>>>>>>>>> No, it cannot be done like that. How the indexing and all >>>>>>>>>>> happens is, it looks up the table schema for a table and do the >>>>>>>>>>> indexing >>>>>>>>>>> according to that. So the table schema must be set before hand. It >>>>>>>>>>> is not a >>>>>>>>>>> dynamic thing that can be set, when arbitrary fields are sent to the >>>>>>>>>>> receiver, and it cannot always load the current schema and set it >>>>>>>>>>> always >>>>>>>>>>> for each event, even though we can cache that information and do >>>>>>>>>>> some >>>>>>>>>>> operations, but that gets complicated. So the idea is, it is the >>>>>>>>>>> responsibility of the client to set the target table's schema >>>>>>>>>>> properly >>>>>>>>>>> before hand, which may or may not include arbitrary fields, and >>>>>>>>>>> then send >>>>>>>>>>> the data. >>>>>>>>>>> >>>>>>>>>>> Also, if this requirement is for the log analytics solution >>>>>>>>>>> work, as we've discussed before, there should be a whole new remote >>>>>>>>>>> API for >>>>>>>>>>> that, and that API can do these operations inside the server, using >>>>>>>>>>> the >>>>>>>>>>> OSGi services, and not the original DAS REST API. So those >>>>>>>>>>> operations will >>>>>>>>>>> happen automatically while keeping the remote log related API clean. >>>>>>>>>>> >>>>>>>>>>> Cheers, >>>>>>>>>>> Anjana. >>>>>>>>>>> >>>>>>>>>>> On Tue, Dec 1, 2015 at 5:13 PM, Malith Dhanushka < >>>>>>>>>>> mal...@wso2.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Folks, >>>>>>>>>>>> >>>>>>>>>>>> Currently indexing arbitrary fields is being achieved by >>>>>>>>>>>> dynamically updating analytics table schema through analytics REST >>>>>>>>>>>> API. >>>>>>>>>>>> This is not an accurate solution for a frequently updating schema. >>>>>>>>>>>> So the >>>>>>>>>>>> ideal solution would be to have a flag in data bridge event sink >>>>>>>>>>>> configuration to enable/disable indexing for all arbitrary fields. >>>>>>>>>>>> >>>>>>>>>>>> WDUT? >>>>>>>>>>>> >>>>>>>>>>>> Thanks, >>>>>>>>>>>> Malith >>>>>>>>>>>> -- >>>>>>>>>>>> Malith Dhanushka >>>>>>>>>>>> Senior Software Engineer - Data Technologies >>>>>>>>>>>> *WSO2, Inc. : wso2.com <http://wso2.com/>* >>>>>>>>>>>> *Mobile* : +94 716 506 693 >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> *Anjana Fernando* >>>>>>>>>>> Senior Technical Lead >>>>>>>>>>> WSO2 Inc. | http://wso2.com >>>>>>>>>>> lean . enterprise . middleware >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> Malith Dhanushka >>>>>>>>>> Senior Software Engineer - Data Technologies >>>>>>>>>> *WSO2, Inc. : wso2.com <http://wso2.com/>* >>>>>>>>>> *Mobile* : +94 716 506 693 >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> *Anjana Fernando* >>>>>>>>> Senior Technical Lead >>>>>>>>> WSO2 Inc. | http://wso2.com >>>>>>>>> lean . enterprise . middleware >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Sachith Withana >>>>>>>> Software Engineer; WSO2 Inc.; http://wso2.com >>>>>>>> E-mail: sachith AT wso2.com >>>>>>>> M: +94715518127 >>>>>>>> Linked-In: <http://goog_416592669> >>>>>>>> https://lk.linkedin.com/in/sachithwithana >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Anjana Fernando* >>>>>>> Senior Technical Lead >>>>>>> WSO2 Inc. | http://wso2.com >>>>>>> lean . enterprise . middleware >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Sachith Withana >>>>>> Software Engineer; WSO2 Inc.; http://wso2.com >>>>>> E-mail: sachith AT wso2.com >>>>>> M: +94715518127 >>>>>> Linked-In: <http://goog_416592669> >>>>>> https://lk.linkedin.com/in/sachithwithana >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> *Anjana Fernando* >>>>> Senior Technical Lead >>>>> WSO2 Inc. | http://wso2.com >>>>> lean . enterprise . middleware >>>>> >>>> >>>> >>>> >>>> -- >>>> *Sinthuja Rajendran* >>>> Associate Technical Lead >>>> WSO2, Inc.:http://wso2.com >>>> >>>> Blog: http://sinthu-rajan.blogspot.com/ >>>> Mobile: +94774273955 >>>> >>>> >>>> >>> >>> >>> -- >>> Malith Dhanushka >>> Senior Software Engineer - Data Technologies >>> *WSO2, Inc. : wso2.com <http://wso2.com/>* >>> *Mobile* : +94 716 506 693 >>> >> >> >> >> -- >> *Sinthuja Rajendran* >> Associate Technical Lead >> WSO2, Inc.:http://wso2.com >> >> Blog: http://sinthu-rajan.blogspot.com/ >> Mobile: +94774273955 >> >> >> > > > -- > Malith Dhanushka > Senior Software Engineer - Data Technologies > *WSO2, Inc. : wso2.com <http://wso2.com/>* > *Mobile* : +94 716 506 693 > -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Data bridge - Binary transport
Hi All,
I can see data bridge binary transport ports are open when DAS start as
below. AFAIU, we are not using the binary transport instead we use thrift
by default. So is there any possibility of switching off this? So I don't
need to open additional ports in a restricted environment.
INFO
{org.wso2.carbon.databridge.receiver.binary.internal.BinaryDataReceiver} -
Started Binary SSL Transport on port : 9711
INFO
{org.wso2.carbon.databridge.receiver.binary.internal.BinaryDataReceiver} -
Started Binary TCP Transport on port : 9611
Regards,
Gihan
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Architecture] Carbon Spark JDBC connector
Hi Niranda, No. Not incremental data processing. My question regarding the deleting entire summery table records and re-insert again. IMO, doing upsert will be more efficient than your above approach. Again, if there is no other option, above re-insert is done as a batch operation or are you insert record one by one? Regards, Gihan On Wed, Aug 12, 2015 at 11:40 AM, Niranda Perera nira...@wso2.com wrote: Hi Gihan, are we talking about incremental processing here? insert into/overwrite queries will normally be used to push analyzed data into summary tables. in the spark jargon, insert overwrite table means, completely deleting the table and recreating it. I'm a confused with the meaning of 'overwrite' with respect to the previous 2.5.0 Hive scripts, are doing an update there? rgds On Tue, Aug 11, 2015 at 7:58 PM, Gihan Anuruddha gi...@wso2.com wrote: Hi Niranda, Are we going to solve those limitations before the GA? Specially limitation no.2. Over time we can have stat table with thousands of records, so are we going to remove all the records and reinsert every time that spark script runs? Regards, Gihan On Tue, Aug 11, 2015 at 7:13 AM, Niranda Perera nira...@wso2.com wrote: Hi all, we have implemented a custom Spark JDBC connector to be used in the Carbon environment. this enables the following 1. Now, temporary tables can be created in the Spark environment by specifying an analytics datasource (configured by the analytics-datasources.xml) and a table 2. Spark uses SELECT 1 FROM $table LIMIT 1 query to check the existence of a table and the LIMIT query is not provided by all dbs. With the new connector, this query can be provided with as a config. (this config is still WIP) 3. Adding new spark dialects related for various dbs (WIP) the idea is to test this for the following dbs - mysql - h2 - mssql - oracle - postgres - db2 I have loosely tested the connector with MySQL, and I would like the APIM team to use it with the API usage stats use-case, and provide us some feedback. this connector can be accessed as follows. (docs are still not updated. I will do that ASAP) create temporary table temp_table using CarbonJDBC options (dataSource datasource name, tableName table name); select * from temp_table insert into/overwrite table temp_table some select statement known limitations 1. when creating a temp table, it should already be created in the underlying datasource 2. insert overwrite table deletes the existing table and creates it again would be very grateful if you could use this connector in your current JDBC use cases and provide us with feedback. best -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 https://twitter.com/N1R44 https://pythagoreanscript.wordpress.com/ ___ Architecture mailing list architect...@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 https://twitter.com/N1R44 https://pythagoreanscript.wordpress.com/ -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Architecture] Carbon Spark JDBC connector
Hi Niranda, Are we going to solve those limitations before the GA? Specially limitation no.2. Over time we can have stat table with thousands of records, so are we going to remove all the records and reinsert every time that spark script runs? Regards, Gihan On Tue, Aug 11, 2015 at 7:13 AM, Niranda Perera nira...@wso2.com wrote: Hi all, we have implemented a custom Spark JDBC connector to be used in the Carbon environment. this enables the following 1. Now, temporary tables can be created in the Spark environment by specifying an analytics datasource (configured by the analytics-datasources.xml) and a table 2. Spark uses SELECT 1 FROM $table LIMIT 1 query to check the existence of a table and the LIMIT query is not provided by all dbs. With the new connector, this query can be provided with as a config. (this config is still WIP) 3. Adding new spark dialects related for various dbs (WIP) the idea is to test this for the following dbs - mysql - h2 - mssql - oracle - postgres - db2 I have loosely tested the connector with MySQL, and I would like the APIM team to use it with the API usage stats use-case, and provide us some feedback. this connector can be accessed as follows. (docs are still not updated. I will do that ASAP) create temporary table temp_table using CarbonJDBC options (dataSource datasource name, tableName table name); select * from temp_table insert into/overwrite table temp_table some select statement known limitations 1. when creating a temp table, it should already be created in the underlying datasource 2. insert overwrite table deletes the existing table and creates it again would be very grateful if you could use this connector in your current JDBC use cases and provide us with feedback. best -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 https://twitter.com/N1R44 https://pythagoreanscript.wordpress.com/ ___ Architecture mailing list architect...@wso2.org https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Unnecessary error message printing when realtime dashboard not displaying
Hi CEP team,
When we have a real time dashboard and dashboard not display in the
browser, below message is continuously printing. I think we can't assume
always realtime dashboards are displaying in the browser. So these
redundant messages are unnecessarly filling the logs. I think one error
message would enough and we need to avoid further printing those logs. WDYT?
[2015-08-02 20:54:07,393] ERROR
{org.wso2.carbon.event.output.adapter.ui.UIEventAdapter} - Event dropped
at Output Adapter 'jmx' for tenant id '-1234', No clients registered
[2015-08-02 20:54:08,057] ERROR
{org.wso2.carbon.event.output.adapter.ui.UIEventAdapter} - Event dropped
at Output Adapter 'jmx' for tenant id '-1234', No clients registered
[2015-08-02 20:54:13,111] ERROR
{org.wso2.carbon.event.output.adapter.ui.UIEventAdapter} - Event dropped
at Output Adapter 'jmx' for tenant id '-1234', No clients registered
[2015-08-02 20:54:13,126] ERROR
{org.wso2.carbon.event.output.adapter.ui.UIEventAdapter} - Event dropped
at Output Adapter 'jmx' for tenant id '-1234', No clients registered
[2015-08-02 20:54:14,110] ERROR
{org.wso2.carbon.event.output.adapter.ui.UIEventAdapter} - Event dropped
at Output Adapter 'jmx' for tenant id '-1234', No clients registered
[2015-08-02 20:54:16,053] ERROR
{org.wso2.carbon.event.output.adapter.ui.UIEventAdapter} - Event dropped
at Output Adapter 'jmx' for tenant id '-1234', No clients registered
[2015-08-02 20:54:18,055] ERROR
{org.wso2.carbon.event.output.adapter.ui.UIEventAdapter} - Event dropped
at Output Adapter 'jmx' for tenant id '-1234', No clients registered
Regards,
Gihan
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] simulating event stream with facet attribute
Hi Rukshan, Did you persist the stream? Are you seeing that stream name in the message console table dropdown? On Sun, Aug 2, 2015 at 9:07 PM, Rukshan Premathunga ruks...@wso2.com wrote: Hi all, i try to simulate event stream which contain facet attribute. even though i successfully send sample data through UI simulator, in message console i couldn't see any data. did anyone encounter this? Thanks and Regards. -- Rukshan Chathuranga. Software Engineer. WSO2, Inc. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] simulating event stream with facet attribute
You need to send those values as a json array. Above is the stream
definition. Can you attach sample data event?
On Sun, Aug 2, 2015 at 9:13 PM, Rukshan Premathunga ruks...@wso2.com
wrote:
Hi Niranda,
- here the stream definition:
{
streamId: facet_test:1.0.0,
name: facet_test,
version: 1.0.0,
nickName: ,
description: ,
metaData: [],
correlationData: [],
payloadData: [
{
name: id,
type: INT
},
{
name: name,
type: STRING
},
{
name: add,
type: STRING
},
{
name: type,
type: STRING
}
]
}
- `name`, `add` and `type` attributes are set to facet and indexed
when persistent them.
Thanks and Regards.
On Sun, Aug 2, 2015 at 9:08 PM, Niranda Perera nira...@wso2.com wrote:
Can you attach a sample event you sent?
On Sun, Aug 2, 2015, 21:07 Rukshan Premathunga ruks...@wso2.com wrote:
Hi all,
i try to simulate event stream which contain facet attribute. even
though i successfully send sample data through UI simulator, in message
console i couldn't see any data.
did anyone encounter this?
Thanks and Regards.
--
Rukshan Chathuranga.
Software Engineer.
WSO2, Inc.
--
Rukshan Chathuranga.
Software Engineer.
WSO2, Inc.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [DAS] simulating event stream with facet attribute
Can you please share the sample values that you used in the simulator?
On Sun, Aug 2, 2015 at 9:19 PM, Rukshan Premathunga ruks...@wso2.com
wrote:
Hi Gihan,
I sent the data using event simulator, not the actual event stream.
i used the
https://localhost:9443/carbon/eventsimulator/index.jsp?streamId=facet_test:1.0.0
UI to simulate.
Thanks and Regards.
On Sun, Aug 2, 2015 at 9:16 PM, Gihan Anuruddha gi...@wso2.com wrote:
You need to send those values as a json array. Above is the stream
definition. Can you attach sample data event?
On Sun, Aug 2, 2015 at 9:13 PM, Rukshan Premathunga ruks...@wso2.com
wrote:
Hi Niranda,
- here the stream definition:
{
streamId: facet_test:1.0.0,
name: facet_test,
version: 1.0.0,
nickName: ,
description: ,
metaData: [],
correlationData: [],
payloadData: [
{
name: id,
type: INT
},
{
name: name,
type: STRING
},
{
name: add,
type: STRING
},
{
name: type,
type: STRING
}
]
}
- `name`, `add` and `type` attributes are set to facet and indexed
when persistent them.
Thanks and Regards.
On Sun, Aug 2, 2015 at 9:08 PM, Niranda Perera nira...@wso2.com wrote:
Can you attach a sample event you sent?
On Sun, Aug 2, 2015, 21:07 Rukshan Premathunga ruks...@wso2.com
wrote:
Hi all,
i try to simulate event stream which contain facet attribute. even
though i successfully send sample data through UI simulator, in message
console i couldn't see any data.
did anyone encounter this?
Thanks and Regards.
--
Rukshan Chathuranga.
Software Engineer.
WSO2, Inc.
--
Rukshan Chathuranga.
Software Engineer.
WSO2, Inc.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
--
Rukshan Chathuranga.
Software Engineer.
WSO2, Inc.
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Visualizing room data with BAM
Mainly we changed the analytics engine(Hive/Hadoop to Spark) and introduced the plugable data layer. In BAM, we are bound to Cassandra as a primary persistent storage, but with DAS you can use RDBMS, HBase or Cassandra. Also, we introduced Lucene based indexing and much improved dashboard creation tools. Your existing event publishing will work OOB, so you don't need to do anything. If you have and hive script, then you need to convert those to Spark SQL based script. On Wed, Jul 29, 2015 at 12:32 PM, Corey Denault co...@wso2.com wrote: When I originially started the project it was recommended that I use BAM, however since then I've received several suggestions to use DAS instead. What exactly is the difference between the two frameworks? Would it be worth trying to transfer all of my work so far? -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Visualizing room data with BAM
Hi Corey, Is there any specific reason to use BAM? If it's not can you use DAS[1] for this? Current data publishing will work without any issue. You can find the documentation for DAS[2]. [1] - https://svn.wso2.org/repos/wso2/people/inosh/wso2das-3.0.0-BETA.zip [2] - https://docs.wso2.com/display/DAS300/Event+Streams Regards, Gihan On Wed, Jul 29, 2015 at 12:22 PM, Niranda Perera nira...@wso2.com wrote: Hi Corey, this looks very much like the debs 2014 challenge, isn't it? [1] are you using BAM 2.5.0 or the upcoming DAS 3.0 for your work? rgds [1] http://dl.acm.org/citation.cfm?id=2611333 On Wed, Jul 29, 2015 at 12:06 PM, Corey Denault co...@wso2.com wrote: Hi, I'm currently working on pushing the following data set to bam. http://courses.media.mit.edu/2004fall/mas622j/04.projects/home/ My goal is to produce a web app that summarises the data based on frequency of activities, time spent on those activities, and usage of each sensor. Additionally, I would like to do some prediction of activities, such as at what time certain activities are likely to occur. So far I am working on pushing the data to Cassandra tables. Right now I am hung up on splitting up columns of string arrays into columns of single strings. I will continue to update this thread as my project progresses. Thanks, Corey Denault ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 https://twitter.com/N1R44 https://pythagoreanscript.wordpress.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Which Git Repository belongs, org.wso2.carbon.transport.mgt.feature
Hi Lakmali, We do have. But still we are in snapshot version. Can you check with 1.0.3-SNAPSHOT repo as an analytics version? Regards, Gihan On Mon, Jul 6, 2015 at 12:06 AM, Lakmali Baminiwatta lakm...@wso2.com wrote: Hi Gihan, On 20 March 2015 at 09:01, Gihan Anuruddha gi...@wso2.com wrote: On Fri, Mar 20, 2015 at 8:23 AM, Dhanuka Ranasinghe dhan...@wso2.com wrote: while building product-apim , I couldn't find Git repos for following features. Could you please help me to find these. org.wso2.carbon.transport.mgt.feature org.wso2.carbon.transport.mail.feature org.wso2.carbon.xfer.feature org.wso2.carbon.mex.feature org.wso2.carbon.mediation.security.server org.wso2.carbon.statistics.transport.feature org.wso2.carbon.ec2.client.feature org.wso2.carbon.registry.extensions.feature org.wso2.carbon.caching.server.feature org.wso2.carbon.jaxws.webapp.mgt.server.feature org.wso2.carbon.jaxws.webapp.mgt.feature org.wso2.carbon.bam. message.tracer.handler.feature use org.wso2.carbon.analytics. message.tracer.handler.feature in carbon-analytics repo Don't we have a carbon 4.4.0 based released version of org.wso2.carbon.analytics. message.tracer.handler.feature? Latest released version[1], seems to be carbon 4.3.0 based. [1] https://github.com/wso2/carbon-analytics/blob/v1.0.2/pom.xml Thanks, Lakmali org.wso2.carbon.mediator.bam.feature *Dhanuka Ranasinghe* Senior Software Engineer WSO2 Inc. ; http://wso2.com lean . enterprise . middleware phone : +94 715381915 On Thu, Mar 19, 2015 at 5:58 PM, Dhanuka Ranasinghe dhan...@wso2.com wrote: No they have told that it has been removed from carbon-commons. It's not in here [1]. [1] https://github.com/wso2/carbon-commons/blob/4.3.6/pom.xml Cheers, *Dhanuka Ranasinghe* Senior Software Engineer WSO2 Inc. ; http://wso2.com lean . enterprise . middleware phone : +94 715381915 On Thu, Mar 19, 2015 at 5:51 PM, Mahesh Chinthaka mahe...@wso2.com wrote: Hi Dhanuka, Isnt it in carbon-commons ? In [1] I can see org.wso2.carbon.transport.mgt.feature If so, I think carbon team manages this. [1] - https://github.com/wso2/carbon-commons/tree/master/features/transport-mgt On Thu, Mar 19, 2015 at 5:43 PM, Dhanuka Ranasinghe dhan...@wso2.com wrote: Hi, When I tried to build product-apim with carbon 4.4.0 I am getting following error. So could you please let us know, exactly which Git repository has/maintain org.wso2.carbon.transport.mgt.feature [ERROR] Failed to execute goal org.wso2.maven:carbon-p2-plugin:1.5.3:p2-repo-gen (2-p2-repo-generation) on project am-p2-profile: Error occured when processing the Feature Artifact: org.wso2.carbon.commons:org.wso2.carbon.transport.mgt.feature:4.3.6: ERROR: Could not find artifact org.wso2.carbon.commons:org.wso2.carbon.transport.mgt.feature:zip:4.3.6 in wso2-nexus (http://maven.wso2.org/nexus/content/groups/wso2-public/) Cheers, *Dhanuka Ranasinghe* Senior Software Engineer WSO2 Inc. ; http://wso2.com lean . enterprise . middleware phone : +94 715381915 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Mahesh Chinthaka Vidanagama* | Software Engineer WSO2, Inc | lean. enterprise. middleware. #20, Palm Grove, Colombo 03, Sri Lanka Mobile: +94 71 63 63 083 | Work: +94 112 145 345 Email: mahe...@wso2.com | Web: www.wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Lakmali Baminiwatta Senior Software Engineer WSO2, Inc.: http://wso2.com lean.enterprise.middleware mobile: +94 71 2335936 blog : lakmali.com -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Issues when using DAS features in an external Spark (non-OSGi) environment
will be required to be inside the external spark cluster. Can you please explain more on what is your usecase? And how you have configured the setup with DAS features? Thanks, Sinthuja. On Sunday, June 28, 2015, Nirmal Fernando nir...@wso2.com wrote: Hi DAS team, It appears that we have to think and implement DAS features so that they will run even in an non-OSGi environment like an external Spark scenario. We have some DAS features which are dependent on Task Service etc. and they are failing when we use the from within a Spark job which runs on an external Spark cluster. How can we solve this? -- Thanks regards, Nirmal Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ -- Thanks regards, Nirmal Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ -- *Sinthuja Rajendran* Associate Technical Lead WSO2, Inc.:http://wso2.com Blog: http://sinthu-rajan.blogspot.com/ Mobile: +94774273955 -- Thanks regards, Nirmal Associate Technical Lead - Data Technologies Team, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ -- *Sinthuja Rajendran* Associate Technical Lead WSO2, Inc.:http://wso2.com Blog: http://sinthu-rajan.blogspot.com/ Mobile: +94774273955 -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] DAS How to log publishing events to the terminal
Add new entry to log4j file as below. org.wso2.carbon.analytics.eventsink=DEBUG On Thu, Jun 25, 2015 at 12:08 PM, Rukshan Premathunga ruks...@wso2.com wrote: Hi, I publish the data to the DAS. But it only shoes the msgs saying user connected. How can i see the msg in the terminal? Thanks and Regards. -- Rukshan Chathuranga. Software Engineer. WSO2, Inc. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [Registry] [DAS] Registry search not working in DAS
) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1698) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] {BAM} Message tracing with ESB
Hi, Did you install the message tracer feature to ESB after creating that proxy? There is a know issue with message tracer that, it's not engaging the proxies that created before that feature installed. Can you please try with another newly created proxy and see it working? Regards, Gihan On Tue, Jun 9, 2015 at 12:42 PM, Vijayaratha Vijayasingam rat...@wso2.com wrote: Hi; I tried BAM 2.5 with ESB 4.8.1 fro message tracing . Followed this guide[1] I sent some messages to esb proxy. When check the cassandra, i do not see EVENT_KS keyspace. What i miss here? [1] https://docs.wso2.com/display/BAM250/Setting+up+Message+Tracing+for+WSO2+ESB Thanks. -- -Ratha -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] WSO2 Data Analytics Server 3.0.0 Alpha Released!
Hi Srinath,
On Fri, Jun 5, 2015 at 9:43 AM, Srinath Perera srin...@wso2.com wrote:
1. Gadget dashboard does not work on Mac ( tried with Firefox, Chrome,
Saffari). Does not work means it does how show side icons at all.
We will check this issue.
1. persist tick box in save persist page is misleading in UX sens
Can you explain more about the above issue? Anyway we are going to
improve this like based on the main persistence checkbox, below sub
checkboxes will be disable or enable.
1. What is a facet .. explain in message console or remove
altogether.
We will add more explain information about facet in the documentation.
For message console, we will change the appearance of facet search based
on whether that particular table has a facet column or not.
1. When data type is int, I get the following error.
This is fixed now.
[2015-05-31 12:13:46,594] ERROR
{org.wso2.carbon.event.simulator.admin.EventSimulatorAdminService} -
java.lang.ClassCastException: java.lang.Integer cannot be cast to
java.lang.Long
On Wed, May 27, 2015 at 6:09 PM, Gihan Anuruddha gi...@wso2.com wrote:
Hi,
The WSO2 DAS team is pleased to announce the alpha release of WSO2 DAS
v3.0. The distribution is available at [1]. The release includes the
following new features, improvements, and tasks.
Improvement
- [BAM-1993 https://wso2.org/jira/browse/BAM-1993] - upgrade to
Spark 1.3.0
- [BAM-1994 https://wso2.org/jira/browse/BAM-1994] - enable
multitenancy in the Spark environment
- [BAM-2000 https://wso2.org/jira/browse/BAM-2000] - UI improvement
for Message Console
- [BAM-2003 https://wso2.org/jira/browse/BAM-2003] - Expose
Analytics REST API over HTTPS only
- [BAM-2005 https://wso2.org/jira/browse/BAM-2005] - Activity
publishing with user name
- [BAM-2009 https://wso2.org/jira/browse/BAM-2009] - Create a CApp
deployer to deploy dashboard artifacts
- [BAM-2012 https://wso2.org/jira/browse/BAM-2012] - Attach event
sink dynamically based on the stream persistence configuration
- [BAM-2013 https://wso2.org/jira/browse/BAM-2013] - Adding stream
persistence capability to existing stream store
- [BAM-2016 https://wso2.org/jira/browse/BAM-2016] - Global data
purging configuration
- [BAM-2017 https://wso2.org/jira/browse/BAM-2017] - Implement the
Spark data sources API
- [BAM-2018 https://wso2.org/jira/browse/BAM-2018] - Add a
configuration file to load spark default configs
New Feature
- [BAM-2010 https://wso2.org/jira/browse/BAM-2010] - Rewrite
activity monitoring dashboard
- [BAM-2011 https://wso2.org/jira/browse/BAM-2011] - Carbon
application support for event sink
Task
- [BAM-2015 https://wso2.org/jira/browse/BAM-2015] - Cassandra
Datasource Support
The documentation for DAS v3.0 can be found at [2]. Your feedback is
most welcome, and any issues can be reported to the project at [3].
[1]
https://svn.wso2.org/repos/wso2/people/sinthuja/DAS3.0/wso2das-3.0.0-SNAPSHOT.zip
https://svn.wso2.org/repos/wso2/people/gihan/wso2das-3.0.0-ALPHA.zip
[2]
https://docs.wso2.com/display/DAS300/WSO2+Data+Analytics+Server+Documentation
[3] https://wso2.org/jira/browse/BAM
- WSO2 DAS Team.
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--
Srinath Perera, Ph.D.
http://people.apache.org/~hemapani/
http://srinathsview.blogspot.com/
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Change configuration file during the integration test running
Hi Automation team, I have a configuration file which has below entry. Basically, I want to set true for purging-enable and add table tags. One option is I can maintain a copy and do a file copy and do the server restart. Is there any other way to do this? analytics-data-purging purging-enablefalse/purging-enable purge-nodetrue/purge-node cron-expression0 0 0 * * ?/cron-expression purge-include-table-patterns table.*/table !--table.*jmx.*/table-- /purge-include-table-patterns data-retention-days365/data-retention-days /analytics-data-purging Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Code coverage percentage
Hi Automation team, What we are actually looking as a code coverage stat? In my ServiceHolder class, I added private constructor based on sonar suggestion. Now, due to that I can't make my class, 100% code coverage in term of line, block and method. How do I overcome this problem and increase my code coverage percentage? COVERAGE SUMMARY FOR SOURCE FILE [ServiceHolder.java]nameline, %block, % method, %class, %ServiceHolder.java82% (9/11)83% (15/18)86% (6/7) 100% (1/1)COVERAGE BREAKDOWN BY CLASS AND METHODnameline, %block, %method, % class, % class ServiceHolder82% (9/11)83% (15/18)86% (6/7)100% (1/1) getAnalyticsDataService (): AnalyticsDataService100% (1/1)100% (2/2) 100% (1/1) getAnalyticsEventSinkService (): AnalyticsEventSinkService 100% (1/1)100% (2/2)100% (1/1) getEventStreamService (): EventStreamService 100% (1/1)100% (2/2)100% (1/1) setAnalyticsDataService (AnalyticsDataService): void100% (2/2)100% (3/3) 100% (1/1) setAnalyticsEventSinkService (AnalyticsEventSinkService): void 100% (2/2)100% (3/3)100% (1/1) setEventStreamService (EventStreamService): void100% (2/2)100% (3/3) 100% (1/1) ServiceHolder (): void0% (0/2)0% (0/3)0% (0/1) Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Code coverage percentage
Hi Krishantha, I covered the areas that I need to test in that class. But due to that private constructor, code coverage percentage affects drastically :( Regards, Gihan On Wed, Jun 3, 2015 at 12:16 PM, Krishantha Samaraweera krishan...@wso2.com wrote: Hi Gihan, I think you are writing integration test to cover the case. If it is the case, generating coverage for empty private method is not possible. There is a bug reported in Emma to skip the empty private constructors [1]. If it is a unit test, you can use java reflection to call private method [2]. However it is arguable to invoke private constructor which should never be called. My recommendation is not to cover the private constructor, in coverage POV it doesn't add much value to numbers as the method contain only 2 lines. Thanks, Krishantha. [1]http://sourceforge.net/p/emma/bugs/66/ [2] http://stackoverflow.com/questions/19699634/coverage-for-private-constructor-junit-emma On Wed, Jun 3, 2015 at 12:01 PM, Gihan Anuruddha gi...@wso2.com wrote: Hi Saneth, No. We are only using static methods in that class. So there is no need to call that private method. That was only added as suggest by sonar. Regards, Gihan On Wed, Jun 3, 2015 at 11:58 AM, Saneth Dharmakeerthi sane...@wso2.com wrote: Hi Gihan, Isn't that private constructor is get called by anywhere inside that class?. Thanks and Best Regards, Saneth Dharmakeerthi Senior Software Engineer WSO2, Inc. Mobile: +94772325511 On Wed, Jun 3, 2015 at 11:47 AM, Gihan Anuruddha gi...@wso2.com wrote: Hi Automation team, What we are actually looking as a code coverage stat? In my ServiceHolder class, I added private constructor based on sonar suggestion. Now, due to that I can't make my class, 100% code coverage in term of line, block and method. How do I overcome this problem and increase my code coverage percentage? COVERAGE SUMMARY FOR SOURCE FILE [ServiceHolder.java]nameline, % block, %method, %class, %ServiceHolder.java82% (9/11)83% (15/18) 86% (6/7)100% (1/1)COVERAGE BREAKDOWN BY CLASS AND METHODnameline, % block, %method, %class, % class ServiceHolder82% (9/11) 83% (15/18)86% (6/7)100% (1/1) getAnalyticsDataService (): AnalyticsDataService100% (1/1)100% (2/2) 100% (1/1) getAnalyticsEventSinkService (): AnalyticsEventSinkService 100% (1/1)100% (2/2)100% (1/1) getEventStreamService (): EventStreamService100% (1/1)100% (2/2) 100% (1/1) setAnalyticsDataService (AnalyticsDataService): void 100% (2/2)100% (3/3)100% (1/1) setAnalyticsEventSinkService (AnalyticsEventSinkService): void 100% (2/2)100% (3/3)100% (1/1) setEventStreamService (EventStreamService): void100% (2/2)100% (3/3) 100% (1/1) ServiceHolder (): void0% (0/2)0% (0/3)0% (0/1) Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 -- Krishantha Samaraweera Senior Technical Lead - Test Automation Mobile: +94 77 7759918 WSO2, Inc.; http://wso2.com/ lean . enterprise . middlewear. -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Code coverage percentage
Hi Saneth, No. We are only using static methods in that class. So there is no need to call that private method. That was only added as suggest by sonar. Regards, Gihan On Wed, Jun 3, 2015 at 11:58 AM, Saneth Dharmakeerthi sane...@wso2.com wrote: Hi Gihan, Isn't that private constructor is get called by anywhere inside that class?. Thanks and Best Regards, Saneth Dharmakeerthi Senior Software Engineer WSO2, Inc. Mobile: +94772325511 On Wed, Jun 3, 2015 at 11:47 AM, Gihan Anuruddha gi...@wso2.com wrote: Hi Automation team, What we are actually looking as a code coverage stat? In my ServiceHolder class, I added private constructor based on sonar suggestion. Now, due to that I can't make my class, 100% code coverage in term of line, block and method. How do I overcome this problem and increase my code coverage percentage? COVERAGE SUMMARY FOR SOURCE FILE [ServiceHolder.java]nameline, %block, % method, %class, %ServiceHolder.java82% (9/11)83% (15/18)86% (6/7) 100% (1/1)COVERAGE BREAKDOWN BY CLASS AND METHODnameline, %block, % method, %class, % class ServiceHolder82% (9/11)83% (15/18) 86% (6/7)100% (1/1)getAnalyticsDataService (): AnalyticsDataService 100% (1/1)100% (2/2)100% (1/1) getAnalyticsEventSinkService (): AnalyticsEventSinkService100% (1/1) 100% (2/2)100% (1/1) getEventStreamService (): EventStreamService 100% (1/1)100% (2/2)100% (1/1) setAnalyticsDataService (AnalyticsDataService): void100% (2/2)100% (3/3) 100% (1/1) setAnalyticsEventSinkService (AnalyticsEventSinkService): void 100% (2/2)100% (3/3)100% (1/1) setEventStreamService (EventStreamService): void100% (2/2)100% (3/3) 100% (1/1) ServiceHolder (): void0% (0/2)0% (0/3)0% (0/1) Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [Carbon] Behavior of menu tabs
Hi Carbon team, I have a UI component that adds a UI sub menu under the 'Tools' menu as below. menu idevent_simulator_menu/id i18n-keyevent.simulator/i18n-key i18n-bundleorg.wso2.carbon.event.simulator.ui.i18n.Resources/i18n-bundle parent-menutools_menu/parent-menu link../eventsimulator/index.jsp/ link regionregion5/region order40/order style-classhome/ style-class icon../eventsimulator/images/event-simulator.png/icon require-permission/permission/admin/login/require-permission /menu But in DAS it does not display. Basically, it doesn't have root level 'Tools' tab or this sub menu. This same UI component works with CEP without any issue. Do I need to do any special thing in DAS, in order appear this tools tab and its sub menus? Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [Carbon] Behavior of menu tabs
Where can we define parent menus? Is it not coming from the carbon framework? On Fri, May 29, 2015 at 6:21 PM, Thusitha Thilina Dayaratne thusit...@wso2.com wrote: Hi GIhan, I think if DAS doesn't have a root level Tools menu. since your parent-menutools_menu/parent-menu it can't find the parent menu and so your sub menu is not appearing. Thanks /Thusitha On Fri, May 29, 2015 at 6:05 PM, Gihan Anuruddha gi...@wso2.com wrote: Hi Carbon team, I have a UI component that adds a UI sub menu under the 'Tools' menu as below. menu idevent_simulator_menu/id i18n-keyevent.simulator/i18n-key i18n-bundleorg.wso2.carbon.event.simulator.ui.i18n.Resources/ i18n-bundle parent-menutools_menu/parent-menu link ../eventsimulator/index.jsp/link regionregion5/region order40/ order style-classhome/style-class icon ../eventsimulator/images/event-simulator.png/icon require-permission /permission/admin/login/require-permission /menu But in DAS it does not display. Basically, it doesn't have root level 'Tools' tab or this sub menu. This same UI component works with CEP without any issue. Do I need to do any special thing in DAS, in order appear this tools tab and its sub menus? Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Thusitha Dayaratne Software Engineer WSO2 Inc. - lean . enterprise . middleware | wso2.com Mobile +94712756809 Blog alokayasoya.blogspot.com Abouthttp://about.me/thusithathilina -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] WSO2 Data Analytics Server 3.0.0 Alpha Released!
Hi, The WSO2 DAS team is pleased to announce the alpha release of WSO2 DAS v3.0. The distribution is available at [1]. The release includes the following new features, improvements, and tasks. Improvement - [BAM-1993 https://wso2.org/jira/browse/BAM-1993] - upgrade to Spark 1.3.0 - [BAM-1994 https://wso2.org/jira/browse/BAM-1994] - enable multitenancy in the Spark environment - [BAM-2000 https://wso2.org/jira/browse/BAM-2000] - UI improvement for Message Console - [BAM-2003 https://wso2.org/jira/browse/BAM-2003] - Expose Analytics REST API over HTTPS only - [BAM-2005 https://wso2.org/jira/browse/BAM-2005] - Activity publishing with user name - [BAM-2009 https://wso2.org/jira/browse/BAM-2009] - Create a CApp deployer to deploy dashboard artifacts - [BAM-2012 https://wso2.org/jira/browse/BAM-2012] - Attach event sink dynamically based on the stream persistence configuration - [BAM-2013 https://wso2.org/jira/browse/BAM-2013] - Adding stream persistence capability to existing stream store - [BAM-2016 https://wso2.org/jira/browse/BAM-2016] - Global data purging configuration - [BAM-2017 https://wso2.org/jira/browse/BAM-2017] - Implement the Spark data sources API - [BAM-2018 https://wso2.org/jira/browse/BAM-2018] - Add a configuration file to load spark default configs New Feature - [BAM-2010 https://wso2.org/jira/browse/BAM-2010] - Rewrite activity monitoring dashboard - [BAM-2011 https://wso2.org/jira/browse/BAM-2011] - Carbon application support for event sink Task - [BAM-2015 https://wso2.org/jira/browse/BAM-2015] - Cassandra Datasource Support The documentation for DAS v3.0 can be found at [2]. Your feedback is most welcome, and any issues can be reported to the project at [3]. [1] https://svn.wso2.org/repos/wso2/people/sinthuja/DAS3.0/wso2das-3.0.0-SNAPSHOT.zip https://svn.wso2.org/repos/wso2/people/gihan/wso2das-3.0.0-ALPHA.zip [2] https://docs.wso2.com/display/DAS300/WSO2+Data+Analytics+Server+Documentation [3] https://wso2.org/jira/browse/BAM - WSO2 DAS Team. -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] WSO2 DAS v3.0 M5 Released!
Hi, The WSO2 DAS team is pleased to announce the fifth milestone release of WSO2 DAS v3.0. The distribution is available at [1]. The release includes the following new features, improvements, and tasks. *Improvement* - [BAM-1995 https://wso2.org/jira/browse/BAM-1995] - Adding facet search for message console - [BAM-1999 https://wso2.org/jira/browse/BAM-1999] - Expose Analytics APIs as JavaScript APIs for External webapps *New Feature* - [BAM-1996 https://wso2.org/jira/browse/BAM-1996] - Data Backup and Restore Tool - [BAM-1969 https://wso2.org/jira/browse/BAM-1969] - Feature Rich Dashboard Support *Task* - [BAM-1997 https://wso2.org/jira/browse/BAM-1997] - Adding analytics schema Capp deployer - [BAM-1998 https://wso2.org/jira/browse/BAM-1998] - Moving carbon-analytics and product-das to Carbon kernal 4.4.0 The documentation for DAS v3.0 can be found at [2]. Your feedback is most welcome, and any issues can be reported to the project at [3]. [1] https://svn.wso2.org/repos/wso2/people/sinthuja/DAS3.0/M5/wso2das-3.0.0-SNAPSHOT.zip https://www.google.com/url?q=https%3A%2F%2Fsvn.wso2.org%2Frepos%2Fwso2%2Fpeople%2Fsinthuja%2FDAS3.0%2FM5%2Fwso2das-3.0.0-SNAPSHOT.zipsa=Dsntz=1usg=AFQjCNF32R5hJmbBWEBwY4e7c7T6xg0ztw [2] https://docs.wso2.com/display/DAS300/WSO2+Data+Analytics+Server+Documentation [3] https://wso2.org/jira/browse/BAM - WSO2 DAS Team. -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +9477227259 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [Axis2] org.apache.axis2.databinding.ADBException: Any type element type has not been given
.carbon.analytics.webservice.stub.beans.RecordBean$Factory.parse(RecordBean.java:766) at org.wso2.carbon.analytics.webservice.GetByRangeResponse$Factory.parse(GetByRangeResponse.java:489) at org.wso2.carbon.analytics.webservice.stub.AnalyticsWebServiceStub.fromOM(AnalyticsWebServiceStub.java:4953) ... 48 more Caused by: org.apache.axis2.databinding.ADBException: Any type element type has not been given at org.apache.axis2.databinding.utils.ConverterUtil.getAnyTypeObject(ConverterUtil.java:1637) at org.wso2.carbon.analytics.webservice.stub.beans.RecordValueEntryBean$Factory.parse(RecordValueEntryBean.java:513) ... 51 more Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Username from admin service cookie
Hi, Is it possible to get the $subject? Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Which Git Repository belongs, org.wso2.carbon.transport.mgt.feature
On Fri, Mar 20, 2015 at 8:23 AM, Dhanuka Ranasinghe dhan...@wso2.com wrote: while building product-apim , I couldn't find Git repos for following features. Could you please help me to find these. org.wso2.carbon.transport.mgt.feature org.wso2.carbon.transport.mail.feature org.wso2.carbon.xfer.feature org.wso2.carbon.mex.feature org.wso2.carbon.mediation.security.server org.wso2.carbon.statistics.transport.feature org.wso2.carbon.ec2.client.feature org.wso2.carbon.registry.extensions.feature org.wso2.carbon.caching.server.feature org.wso2.carbon.jaxws.webapp.mgt.server.feature org.wso2.carbon.jaxws.webapp.mgt.feature org.wso2.carbon.bam. message.tracer.handler.feature use org.wso2.carbon.analytics. message.tracer.handler.feature in carbon-analytics repo org.wso2.carbon.mediator.bam.feature *Dhanuka Ranasinghe* Senior Software Engineer WSO2 Inc. ; http://wso2.com lean . enterprise . middleware phone : +94 715381915 On Thu, Mar 19, 2015 at 5:58 PM, Dhanuka Ranasinghe dhan...@wso2.com wrote: No they have told that it has been removed from carbon-commons. It's not in here [1]. [1] https://github.com/wso2/carbon-commons/blob/4.3.6/pom.xml Cheers, *Dhanuka Ranasinghe* Senior Software Engineer WSO2 Inc. ; http://wso2.com lean . enterprise . middleware phone : +94 715381915 On Thu, Mar 19, 2015 at 5:51 PM, Mahesh Chinthaka mahe...@wso2.com wrote: Hi Dhanuka, Isnt it in carbon-commons ? In [1] I can see org.wso2.carbon.transport.mgt.feature If so, I think carbon team manages this. [1] - https://github.com/wso2/carbon-commons/tree/master/features/transport-mgt On Thu, Mar 19, 2015 at 5:43 PM, Dhanuka Ranasinghe dhan...@wso2.com wrote: Hi, When I tried to build product-apim with carbon 4.4.0 I am getting following error. So could you please let us know, exactly which Git repository has/maintain org.wso2.carbon.transport.mgt.feature [ERROR] Failed to execute goal org.wso2.maven:carbon-p2-plugin:1.5.3:p2-repo-gen (2-p2-repo-generation) on project am-p2-profile: Error occured when processing the Feature Artifact: org.wso2.carbon.commons:org.wso2.carbon.transport.mgt.feature:4.3.6: ERROR: Could not find artifact org.wso2.carbon.commons:org.wso2.carbon.transport.mgt.feature:zip:4.3.6 in wso2-nexus (http://maven.wso2.org/nexus/content/groups/wso2-public/) Cheers, *Dhanuka Ranasinghe* Senior Software Engineer WSO2 Inc. ; http://wso2.com lean . enterprise . middleware phone : +94 715381915 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Mahesh Chinthaka Vidanagama* | Software Engineer WSO2, Inc | lean. enterprise. middleware. #20, Palm Grove, Colombo 03, Sri Lanka Mobile: +94 71 63 63 083 | Work: +94 112 145 345 Email: mahe...@wso2.com | Web: www.wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Recommended architecture for a BAM setup with 3 nodes
Hi Sandamal, Our recommended production ready BAM cluster needs 11 nodes. 2 - Dashboard nodes 2 - Receiver nodes 4 - Cassandra nodes 3 - hadoop nodes But based on load we can merge dashboard and receiver nodes. I believe you are not using external Cassandra cluster or hadoop cluster. In that case we are no longer recommending 3 node BAM cluster for production. Regards, Gihan On Sat, Mar 7, 2015 at 12:12 AM, Sandamal Weerasinghe sanda...@wso2.com wrote: Hi all, What is the recommended Architecture for a BAM set up with 3 machines? Thanks. Sandamal Weerasinghe | Software Engineer | WSO2 Lanka (Pvt) Ltd Mobile - +94-77-144-9640 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Recommended architecture for a BAM setup with 3 nodes
Hi Sandamal, We are no longer recommending 3 node cluster due identified problems we had. This will apply to previous BAM versions as well. Regards, Gihan On Sat, Mar 7, 2015 at 12:30 AM, Sandamal Weerasinghe sanda...@wso2.com wrote: HI Gihan, This is using BAM 2.4.1. An external Cassandra cluster is not being used. Can you tell me a suitable deployment using 3 nodes? Thanks. Sandamal Weerasinghe | Software Engineer | WSO2 Lanka (Pvt) Ltd Mobile - +94-77-144-9640 On Fri, Mar 6, 2015 at 12:56 PM, Gihan Anuruddha gi...@wso2.com wrote: Hi Sandamal, Our recommended production ready BAM cluster needs 11 nodes. 2 - Dashboard nodes 2 - Receiver nodes 4 - Cassandra nodes 3 - hadoop nodes But based on load we can merge dashboard and receiver nodes. I believe you are not using external Cassandra cluster or hadoop cluster. In that case we are no longer recommending 3 node BAM cluster for production. Regards, Gihan On Sat, Mar 7, 2015 at 12:12 AM, Sandamal Weerasinghe sanda...@wso2.com wrote: Hi all, What is the recommended Architecture for a BAM set up with 3 machines? Thanks. Sandamal Weerasinghe | Software Engineer | WSO2 Lanka (Pvt) Ltd Mobile - +94-77-144-9640 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] datareceiver Rest Api in BAM 2.4.1 send 302 redirection
Hi Nuwan, If you follow this [1], you can get an idea about how HTTP input adapters are working. [1] - https://docs.wso2.com/display/BAM250/Quick+Start+Guide Regards, Gihan On Wed, Mar 4, 2015 at 6:44 PM, Maninda Edirisooriya mani...@wso2.com wrote: Hi Nuwan, You can see the corresponding 2.5.0 page is not there in docs. The reason is this REST API was removed since BAM 2.5.0. Instead you can use [1] for publishing events with REST. [1] https://docs.wso2.com/display/BAM250/Input+HTTP+Event+Adapter Thanks. *Maninda Edirisooriya* Senior Software Engineer *WSO2, Inc.*lean.enterprise.middleware. *Blog* : http://maninda.blogspot.com/ *E-mail* : mani...@wso2.com *Skype* : @manindae *Twitter* : @maninda On Wed, Mar 4, 2015 at 2:03 PM, Nuwan Wimalasekara nuw...@wso2.com wrote: Hi Actually This happens on BAM 2.5.0. Not 2.4.1. In 2.4.1 datareceiver API is working fine. Thanks, Nuwanw On Tue, Mar 3, 2015 at 11:08 PM, Nuwan Wimalasekara nuw...@wso2.com wrote: Hi I just need to define a stream and publish the event to the created stream using a rest client in BAM 2.4.1. As the documentation[1] , once the datareceiver api is invoked, It redirect to login page with 302 header instead of creating the stream. What is the wrong with this api or am I missing anything [1] https://docs.wso2.com/display/BAM241/Sending+Events+through+the+REST+API Below is the curl request and response I am getting. curl -k --user admin:admin https://localhost:9447/datareceiver/1.0.0/streams/ --data @streamdefn1.json -H Accept: application/json -H Content-type: application/json -X POST -v * Adding handle: conn: 0x7fd1a9003000 * Adding handle: send: 0 * Adding handle: recv: 0 * Curl_addHandleToPipeline: length: 1 * - Conn 0 (0x7fd1a9003000) send_pipe: 1, recv_pipe: 0 * About to connect() to localhost port 9447 (#0) * Trying ::1... * Connected to localhost (::1) port 9447 (#0) * TLS 1.0 connection using TLS_RSA_WITH_AES_128_CBC_SHA * Server certificate: localhost * Server auth using Basic with user 'admin' POST /datareceiver/1.0.0/streams/ HTTP/1.1 Authorization: Basic YWRtaW46YWRtaW4= User-Agent: curl/7.30.0 Host: localhost:9447 Accept: application/json Content-type: application/json Content-Length: 279 * upload completely sent off: 279 out of 279 bytes HTTP/1.1 302 Found Set-Cookie: JSESSIONID=E0495E522FDB3810278BA76F0FBE29BC; Path=/; Secure; HttpOnly Set-Cookie: requestedURI=../../datareceiver/1.0.0/streams/; Path=/ Location: https://localhost:9447/carbon/admin/login.jsp Content-Type: text/html;charset=UTF-8 Content-Length: 0 Date: Wed, 04 Mar 2015 06:49:14 GMT * Server WSO2 Carbon Server is not blacklisted Server: WSO2 Carbon Server * Connection #0 to host localhost left intact Thanks, Nuwanw -- Nuwan Wimalasekara Senior Software Engineer - Test Automation WSO2, Inc.: http://wso2.com lean. enterprise. middleware phone: +94 71 668 4620 -- Nuwan Wimalasekara Senior Software Engineer - Test Automation WSO2, Inc.: http://wso2.com lean. enterprise. middleware phone: +94 71 668 4620 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Intermittent ClassNotFoundException issue in JAX-RS web app
.carbon.analytics.dataservice.restapi.Utils.getOAuthServiceClient(Utils.java:58) at org.wso2.carbon.analytics.dataservice.restapi.resources.AnalyticsResource.getAccessToken(AnalyticsResource.java:574) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180) at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96) ... 46 more Caused by: java.lang.ClassNotFoundException: org.wso2.carbon.analytics.oauth.OAuthServiceClient at org.wso2.carbon.webapp.mgt.loader.CarbonWebappClassLoader.loadClass(CarbonWebappClassLoader.java:154) at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1569) ... 54 more Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] [IS] Is there any osgi service to generate the OAuth token
Hi All, $subject apart from oauth2/token REST endpoint? Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [IS] Is there any osgi service to generate the OAuth token
Thanks Pushpalanka. Can you please tell me what are the mandatory setter methods that need to fill in the OAuth2AccessTokenReqDTO class? Regards, Gihan On Thu, Feb 19, 2015 at 11:47 AM, Pushpalanka Jayawardhana la...@wso2.com wrote: Hi Gihan, org.wso2.carbon.identity.oauth2.OAuth2Service has a method named ' public OAuth2AccessTokenRespDTO issueAccessToken(OAuth2AccessTokenReqDTO tokenReqDTO)'. Hope you can use it. Thanks, Pushpalanka. -- Pushpalanka Jayawardhana, B.Sc.Eng.(Hons). Software Engineer, WSO2 Lanka (pvt) Ltd; wso2.com/ Mobile: +94779716248 Blog: pushpalankajaya.blogspot.com/ | LinkedIn: lk.linkedin.com/in/pushpalanka/ | Twitter: @pushpalanka On Thu, Feb 19, 2015 at 11:40 AM, Gihan Anuruddha gi...@wso2.com wrote: Hi All, $subject apart from oauth2/token REST endpoint? Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [IS] Is there any osgi service to generate the OAuth token
Thanks Pushpalanka. On Thu, Feb 19, 2015 at 12:22 PM, Pushpalanka Jayawardhana la...@wso2.com wrote: Hi Gihan, It depends on the grant type we use. Basically, client ID should be there. You can get idea about the required parameters from the cURL commands mentioned at [1] for each grant type. [1] - https://docs.wso2.com/display/AM180/Token+API Thanks, Pushpalanka. -- Pushpalanka Jayawardhana, B.Sc.Eng.(Hons). Software Engineer, WSO2 Lanka (pvt) Ltd; wso2.com/ Mobile: +94779716248 Blog: pushpalankajaya.blogspot.com/ | LinkedIn: lk.linkedin.com/in/pushpalanka/ | Twitter: @pushpalanka On Thu, Feb 19, 2015 at 12:02 PM, Gihan Anuruddha gi...@wso2.com wrote: Thanks Pushpalanka. Can you please tell me what are the mandatory setter methods that need to fill in the OAuth2AccessTokenReqDTO class? Regards, Gihan On Thu, Feb 19, 2015 at 11:47 AM, Pushpalanka Jayawardhana la...@wso2.com wrote: Hi Gihan, org.wso2.carbon.identity.oauth2.OAuth2Service has a method named ' public OAuth2AccessTokenRespDTO issueAccessToken(OAuth2AccessTokenReqDTO tokenReqDTO)'. Hope you can use it. Thanks, Pushpalanka. -- Pushpalanka Jayawardhana, B.Sc.Eng.(Hons). Software Engineer, WSO2 Lanka (pvt) Ltd; wso2.com/ Mobile: +94779716248 Blog: pushpalankajaya.blogspot.com/ | LinkedIn: lk.linkedin.com/in/pushpalanka/ | Twitter: @pushpalanka On Thu, Feb 19, 2015 at 11:40 AM, Gihan Anuruddha gi...@wso2.com wrote: Hi All, $subject apart from oauth2/token REST endpoint? Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] BAM 2.4.1 with MySQL - Error in hive script
)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:733)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Job Submission failed with exception
'java.lang.NullPointerException(null)'[2015-02-13 16:26:27,101] ERROR
{org.apache.hadoop.hive.ql.exec.ExecDriver} - Job Submission failed with
exception 'java.lang.NullPointerException(null)'
Any idea why this happens? Should tables used in hive be in lower case
always?
Thanks,
--
*Bhathiya Jayasekara*
*Software Engineer,*
*WSO2 inc., http://wso2.com http://wso2.com*
*Phone: +94715478185 %2B94715478185*
*LinkedIn: http://www.linkedin.com/in/bhathiyaj
http://www.linkedin.com/in/bhathiyaj*
*Twitter: https://twitter.com/bhathiyax https://twitter.com/bhathiyax*
*Blog: http://movingaheadblog.blogspot.com
http://movingaheadblog.blogspot.com/*
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] BAM 2.4.1 with MySQL - Error in hive script
Hi Bhathiya,
Can you try to change the mysql setting in order to ignore the case
sensitivity [1].
[1] -
http://dev.mysql.com/doc/refman/5.0/en/identifier-case-sensitivity.html
Regards,
Gihan
On Fri, Feb 13, 2015 at 4:47 PM, Bhathiya Jayasekara bhath...@wso2.com
wrote:
Hi GIhan,
It works with lowercase tables. I think it's better to fix this issue
since it's a common use case. (Or is it already fixed in 2.5.0?)
Thanks,
Bhathiya
On Fri, Feb 13, 2015 at 4:40 PM, Gihan Anuruddha gi...@wso2.com wrote:
Hi Bhathiya,
AFAIR we had an issue with mysql about lowercase/uppercase. Can you
please try that with lowercase table name.
Regards,
Gihan
On Fri, Feb 13, 2015 at 4:31 PM, Bhathiya Jayasekara bhath...@wso2.com
wrote:
Hi all,
I'm getting below error when executing attached hive script. When I run
the same with H2 database it works fine. Issue comes with MySQL. Please
note *highlighted* part.
Here is MySQL database:
mysql emysql use abc;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
mysql
mysql show tables;
+--+
| Tables_in_abc|
+--+
| RSSStatsSummaryTable |
+--+
1 row in set (0.00 sec)
[2015-02-13 16:26:27,097] ERROR
{org.wso2.carbon.hadoop.hive.jdbc.storage.db.DBOperation} - Failed to get
total row count
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Table
*'abc.rssstatsformattedtable'* doesn't exist
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1054)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4120)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4052)
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2503)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2664)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2815)
at
com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2155)
at
com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2322)
at
org.wso2.carbon.hadoop.hive.jdbc.storage.db.DBOperation.getTotalCount(DBOperation.java:335)
at
org.wso2.carbon.hadoop.hive.jdbc.storage.input.JDBCSplit.getSplits(JDBCSplit.java:113)
at
org.wso2.carbon.hadoop.hive.jdbc.storage.input.JDBCDataInputFormat.getSplits(JDBCDataInputFormat.java:41)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:302)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:292)
at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:933)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:925)
at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:839)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:792)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1123)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:792)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:766)
at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:460)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:733)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
java.lang.NullPointerException
at
org.wso2.carbon.hadoop.hive.jdbc.storage.db.DBOperation.getTotalCount(DBOperation.java:344)
at
org.wso2.carbon.hadoop.hive.jdbc.storage.input.JDBCSplit.getSplits(JDBCSplit.java:113)
at
org.wso2.carbon.hadoop.hive.jdbc.storage.input.JDBCDataInputFormat.getSplits(JDBCDataInputFormat.java:41)
at
org.apache.hadoop.hive.ql.io.HiveInputFormat.getSplits(HiveInputFormat.java:302)
at
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:292)
at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:933)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:925)
at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
at org.apache.hadoop.mapred.JobClient
[Dev] [Carbon-multitenancy] Mandatory features
Hi Kernel team, What are mandatory features that should ship with every product out of below list? moduleorg.wso2.carbon.tenant.mgt.server.feature/module moduleorg.wso2.carbon.tenant.mgt.core.feature/module moduleorg.wso2.carbon.tenant.throttling.agent.feature/module moduleorg.wso2.carbon.tenant.usage.agent.feature/module moduleorg.wso2.carbon.tenant.deployment/module moduleorg.wso2.carbon.tenant.common.server.feature/module moduleorg.wso2.carbon.tenant.common.ui.feature/module moduleorg.wso2.carbon.tenant.common.feature/module Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Multi-tenant dashboard
.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) at org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:183) at org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47) at org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:62) at org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47) at org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:146) at org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:159) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:57) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1721) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1679) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Multi-tenant dashboard
Do I need both packages? org.wso2.stratos.xxx.dashboard.ui and org.wso2. Stratos.xxx.login.ui Regards, Gihan On Wed, Jan 21, 2015 at 11:59 AM, KasunG Gajasinghe kas...@wso2.com wrote: Yes, you need to have a separate ui feature for the tenant dashboard. Since you are re-writing this, better if you can remove the stratos package name. On Wed, Jan 21, 2015 at 11:50 AM, Gihan Anuruddha gi...@wso2.com wrote: Hi All, We are building new BAM distribution adding new features to a vanilla carbon server that refrain from using old BAM 2.x source. I have added new BAM style feature to pack, but when I login as a tenant I'm getting below exception. Also, I noticed some products have this org.wso2.stratos.xxx.dashboard.ui and org.wso2. Stratos. xxx.login.ui features within the products. Do I have to create these kind of features to BAM as well? Are we still using this stratos name for our package names? You can find the latest BAM source in here [1]. [1] - https://github.com/wso2-dev/product-bam javax.servlet.ServletException: File quot;/tenant-dashboard/index.jspquot; not found at org.apache.jasper.servlet.JspServlet.handleMissingResource(JspServlet.java:412) at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:379) at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:334) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155) at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(ContextPathServletAdaptor.java:37) at org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:748) at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:604) at org.apache.catalina.core.ApplicationDispatcher.include(ApplicationDispatcher.java:543) at org.eclipse.equinox.http.servlet.internal.RequestDispatcherAdaptor.include(RequestDispatcherAdaptor.java:37) at org.eclipse.equinox.http.helper.ContextPathServletAdaptor$RequestDispatcherAdaptor.include(ContextPathServletAdaptor.java:369) at org.apache.jasper.runtime.JspRuntimeLibrary.include(JspRuntimeLibrary.java:954) at org.apache.jasper.runtime.PageContextImpl.doInclude(PageContextImpl.java:688) at org.apache.jasper.runtime.PageContextImpl.include(PageContextImpl.java:682) at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.tiles.jsp.context.JspUtil.doInclude(JspUtil.java:87) at org.apache.tiles.jsp.context.JspTilesRequestContext.include(JspTilesRequestContext.java:88) at org.apache.tiles.jsp.context.JspTilesRequestContext.dispatch(JspTilesRequestContext.java:82) at org.apache.tiles.impl.BasicTilesContainer.render(BasicTilesContainer.java:465) at org.apache.tiles.jsp.taglib.InsertAttributeTag.render(InsertAttributeTag.java:140) at org.apache.tiles.jsp.taglib.InsertAttributeTag.render(InsertAttributeTag.java:117) at org.apache.tiles.jsp.taglib.RenderTagSupport.execute(RenderTagSupport.java:171) at org.apache.tiles.jsp.taglib.RoleSecurityTagSupport.doEndTag(RoleSecurityTagSupport.java:75) at org.apache.tiles.jsp.taglib.ContainerTagSupport.doEndTag(ContainerTagSupport.java:80) at org.apache.jsp.admin.layout.template_jsp._jspx_meth_tiles_005finsertAttribute_005f7(template_jsp.java:634) at org.apache.jsp.admin.layout.template_jsp._jspService(template_jsp.java:356) at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:432) at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:390) at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:334) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155) at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727
Re: [Dev] ESB 490 P2-profile generation failed
Hi Malaka, We have not released the data publisher feature 4.3.0 yet. Still we are depending on the snapshot. Regards, Gihan On Mon, Jan 12, 2015 at 10:45 AM, Malaka Silva mal...@wso2.com wrote: Hi Bam Team, We are getting the following while generation the P2-profile for ESB. Please check. [ERROR] Failed to execute goal org.wso2.maven:carbon-p2-plugin:1.5.4:p2-repo-gen (2-p2-repo-generation) on project wso2esb-p2-profile: Error occured when processing the Feature Artifact: org.wso2.carbon:org.wso2.carbon.databridge.datapublisher.feature:4.3.0: ERROR: Could not find artifact org.wso2.carbon:org.wso2.carbon.databridge.datapublisher.feature:zip:4.3.0 in wso2-nexus (http://maven.wso2.org/nexus/content/groups/wso2-public/) Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ http://wso2.com/about/team/malaka-silva/ Save a tree -Conserve nature Save the world for your future. Print this email only if it is absolutely necessary. -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [APIM][BAM] Breaking analytic hive script to prevent fail entirely when one CF failed to create
Might be meta database got corrupted. Delete metastore_db.h2.db in
BAM_HOME/repository/database and try.
On Wed, Nov 5, 2014 at 2:10 PM, Lakshman Udayakantha lakshm...@wso2.com
wrote:
Hi Gihan,
I didn't use any tool to explorer the h2 database. just checked the
published statistics in APIM publisher GUI and as you mentioned AUTOSERVER
property is true by default. Any other clue to spot the error?
Thanks
On Wed, Nov 5, 2014 at 1:58 PM, Gihan Anuruddha gi...@wso2.com wrote:
This can happen if you are using any tool to explore h2 database. Make
sure you add AUTO_SERVER=TRUE part at the end of connection url.
urljdbc:h2:BAM_HOME
/repository/database/APIMGTSTATS_DB;AUTO_SERVER=TRUE/url
Regards,
Gihan
On Wed, Nov 5, 2014 at 1:27 PM, Lakshman Udayakantha lakshm...@wso2.com
wrote:
I am working on this jira[1]. As per the offline discussion with Amani,
I have to break the hive script to individual scripts to address follow
analytic logics
org_wso2_apimgt_statistics_destination
org_wso2_apimgt_statistics_request
org_wso2_apimgt_statistics_response
org_wso2_apimgt_statistics_fault
I have attached the analytic toolbox in which include four individual
hive scripts to address above analytic logics here[2]. When I deployed this
new toolbox on BAM, It posts some errors into the server logs. I pasted the
server log part that contain these errors. Anyway I can notice published
statistics on APIM dashboard. Anyone has any idea why I am getting these
errors?
[2014-11-05 12:46:15,955] ERROR
{org.wso2.carbon.hadoop.hive.jdbc.storage.db.DBManager} - Failed to get
connection
org.h2.jdbc.JdbcSQLException: Connection is broken: null [90067-140]
at org.h2.message.DbException.getJdbcSQLException(DbException.java:327)
at org.h2.message.DbException.get(DbException.java:156)
at org.h2.engine.SessionRemote.connectServer(SessionRemote.java:331)
at
org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:253)
at org.h2.engine.SessionRemote.createSession(SessionRemote.java:219)
at org.h2.jdbc.JdbcConnection.init(JdbcConnection.java:111)
at org.h2.jdbc.JdbcConnection.init(JdbcConnection.java:95)
at org.h2.Driver.connect(Driver.java:73)
at java.sql.DriverManager.getConnection(DriverManager.java:582)
at java.sql.DriverManager.getConnection(DriverManager.java:185)
at
org.wso2.carbon.hadoop.hive.jdbc.storage.db.DBManager.createConnection(DBManager.java:73)
at
org.wso2.carbon.hadoop.hive.jdbc.storage.db.DBManager.createConnection(DBManager.java:85)
at
org.wso2.carbon.hadoop.hive.jdbc.storage.JDBCDataOutputFormat.getHiveRecordWriter(JDBCDataOutputFormat.java:48)
at
org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:236)
at
org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:224)
at
org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:478)
at
org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:526)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:467)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:758)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:467)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:758)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:467)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:758)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.forward(GroupByOperator.java:964)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processAggr(GroupByOperator.java:781)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:707)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:467)
at
org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:248)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:518)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:419)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:257)
Caused by: java.net.UnknownHostException: null
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:883)
at java.net.InetAddress.getAddressFromNameService(InetAddress.java:1236)
at java.net.InetAddress.getAllByName0(InetAddress.java:1187)
at java.net.InetAddress.getAllByName(InetAddress.java:1117)
at java.net.InetAddress.getAllByName(InetAddress.java:1053)
at java.net.InetAddress.getByName(InetAddress.java:1003)
at org.h2.util.NetUtils.createSocket(NetUtils.java:90)
at org.h2.engine.SessionRemote.initTransfer(SessionRemote.java:96)
at org.h2.engine.SessionRemote.connectServer(SessionRemote.java:327
Re: [Dev] Issue with BAM Message Tracer Handler
Hi Sewmini, We changed the stream definition of the Message tracer. BAM 2.5.0 only compatible with Message Tracer version 4.2.3 or later. This 4.2.3 version going to release with chunk-13. You can find the 4.2.3 version in this p2- repo [1]. [1] - https://svn.wso2.org/repos/wso2/scratch/chunk13-release/20-10-2014/ On Mon, Nov 3, 2014 at 3:21 PM, Sewmini Jayaweera sewm...@wso2.com wrote: Hi, As an integration scenario I Installed BAM Message Tracer Handler Aggregate feature into ESB (version 4.8.1) and configured message tracing by giving correct thrift port and IP as the Receiver URL. When invoking echo service I got following error in esb log. [2014-11-03 14:56:25,376] ERROR - AsyncDataPublisher Stream definition already exist org.wso2.carbon.databridge.commons.exception.DifferentStreamDefinitionAlreadyDefinedException: Same stream id with different definition already defined before sending this event definitions to TCP,127.0.0.1:7611,TCP,127.0.0.1:7711 Following Jira is also addresses this issue https://wso2.org/jira/browse/BAM-1579 What should be done to overcome this issue? Thank you Best Regards, Sewmi Sewmini Jayaweera Software Engineer - QA Team Mobile: +94 (0) 773 381 250 sewm...@wso2.com ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Dep Sync in Analyzer and Receiver nodes
One solution is to have two repos. Other solution is to use the RW node to create both adapters and toolboxes and make other nodes RO. Even though we categorized these nodes as receiver/analyzer, we can use one manager node to do adapter changes and toolbox changes. @Aparna, Can you try the latter solution. Regards, Gihan On Thu, Oct 30, 2014 at 1:20 PM, Sriskandarajah Suhothayan s...@wso2.com wrote: Hi Gihan So want this make the deployment process complicated? We have to now update 2 servers to add streams. Regards Suho On Wed, Oct 29, 2014 at 11:37 PM, Gihan Anuruddha gi...@wso2.com wrote: Hi Anjana, Can't we create two repositories, one for analyzer and one for receiver regarding this issue? Because analyzers and receivers don't have any common features and those two run independently. Since we are maintaining a two repos, I believe we can have two RW node. WDYT? Regards, Gihan On Thu, Oct 30, 2014 at 4:23 AM, Anjana Fernando anj...@wso2.com wrote: On Wed, Oct 29, 2014 at 10:34 AM, Sriskandarajah Suhothayan s...@wso2.com wrote: On Wed, Oct 29, 2014 at 7:27 AM, Aparna Karunarathna apa...@wso2.com wrote: Hi Anjana/KasunG/suho, According to the new BAM 2.5.0 deployment pattern [1] we have configured the BAM cluster with 11 nodes(4 cassandra, 3 hadoop, 2 analyzer and 2 receiver). Since BAM 2.5.0 is releasing with CEP features, we have to enable the dep sync for receiver nodes as well. Therefore one of the Analyzer/Receiver nodes were configured as RW nodes and other analyzer/receiver nodes were configured as RO nodes and pointed to a single svn repo. Toolboxes can be deployed to the Analyzer RW node and CEP input adapters to the Receiver RW node. We have seen svn conflicts when both RW nodes were trying to commit to svn repo. Therefore, how to configure the Dep Sync for Analyzer/Receiver nodes in BAM 2.5.0 clustered setup? Please advice. We cant have two RW nodes in a single cluster. Here we have to first find out a node that has both CEP and Toolbox deployment components and make that the RW node to make this work, I'm not sure either Analyzer/Receiver profiles have both CEP and Toolbox deployment components, If its not the case we have to fix the BAM profile. @Gihan, please note, check and fix if needed. Cheers, Anjana. Regards Suho [1] https://docs.wso2.com/display/CLUSTER420/Deploying+BAM+with+Puppet Regards, -- *Aparna Karunarathna.* *Senior Software Engineer - QAWSO2 Inc.Mobile: 0714002533 0714002533* -- *S. Suhothayan* Technical Lead Team Lead of WSO2 Complex Event Processor *WSO2 Inc. *http://wso2.com * http://wso2.com/* lean . enterprise . middleware *cell: (+94) 779 756 757 %28%2B94%29%20779%20756%20757 | blog: http://suhothayan.blogspot.com/ http://suhothayan.blogspot.com/twitter: http://twitter.com/suhothayan http://twitter.com/suhothayan | linked-in: http://lk.linkedin.com/in/suhothayan http://lk.linkedin.com/in/suhothayan* -- *Anjana Fernando* Senior Technical Lead WSO2 Inc. | http://wso2.com lean . enterprise . middleware -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 -- *S. Suhothayan* Technical Lead Team Lead of WSO2 Complex Event Processor *WSO2 Inc. *http://wso2.com * http://wso2.com/* lean . enterprise . middleware *cell: (+94) 779 756 757 %28%2B94%29%20779%20756%20757 | blog: http://suhothayan.blogspot.com/ http://suhothayan.blogspot.com/twitter: http://twitter.com/suhothayan http://twitter.com/suhothayan | linked-in: http://lk.linkedin.com/in/suhothayan http://lk.linkedin.com/in/suhothayan* -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] What will be affected when IS is mounting to a Remote Greg
Hi Ishara, Recommended way to use the Registry check-in client [1] for above requirement. [1] - https://docs.wso2.com/display/Governance460/Check-in+Client Regards, Gihan On Mon, Oct 27, 2014 at 3:36 PM, Ishara Cooray isha...@wso2.com wrote: If i want to mount IS to a Remote Governance Registry, i will only need to backup and restore registry database in order to make sure that it will not break existing functionality. Could any one please confirm? Thanks Regards, Ishara Cooray Senior Software Engineer Mobile : +9477 262 9512 WSO2, Inc. | http://wso2.com/ Lean . Enterprise . Middleware ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [BAM][API-Manager] issue in updating API Manager statistics dashboard with BAM
Hi Lakshman, That's is a good observation. So I believe this event should be either first one or the last one. Can you please do a another small test? Shutdown the BAM server. Delete the Cassandra data folder completely (You can find that in repository/databases/cassandra) Truncate the APIM related RDBMS tables. Run your script with 100 requests. Please try to identify the message that going to miss. I think we need to check data sending part in APIM side? Also add a debug log message to publishEvent method with static counter and print that value. So it will be easy to identify the issue. Regards, Gihan On Wed, Oct 22, 2014 at 6:37 PM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi Gihan, I sent 1 requests with the preconditions you have mentioned. only one record is missed in cassendra database for every time I sent 1 requests via APIM. Thanks On Wed, Oct 22, 2014 at 9:28 AM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi Gihan, I will do that test and get back to you. Thanks On Wed, Oct 22, 2014 at 9:23 AM, Inosh Goonewardena in...@wso2.com wrote: Hi, On Wednesday, October 22, 2014, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi Inosh, data in cassandra database are summized to a relational database. records in cassandra database and this relational table is same. so I think there is no problem with cassandra explorer. Ok understood. I have misread your previous email. Thanks On Wed, Oct 22, 2014 at 9:14 AM, Inosh Goonewardena in...@wso2.com wrote: Hi Lakshman, You mean data is therw in cassandra and cassandra explorer doesn't show these data? Did you compare by using cassandra CLI tool? On Wednesday, October 22, 2014, Lakshman Udayakantha lakshm...@wso2.com wrote: HI Gihan , They are lost randomly. Thanks On Wed, Oct 22, 2014 at 9:00 AM, Gihan Anuruddha gi...@wso2.com wrote: Hi Lakshman, How many records did you send to BAM and how many events are lost? Regards, Gihan On Wed, Oct 22, 2014 at 8:18 AM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi Gihan, These data in cassandra database are summarised by a hive script and insert into a relational database. I checked that relational database table also. Number of records in cassandra database and relational database table are same. Then it should not be a problem with cassandra explorer. Thanks On Wed, Oct 22, 2014 at 7:53 AM, Manoj Gunawardena man...@wso2.com wrote: Hi, This can be an issue for other products as well. ES, AS and EMM also publishing data to BAM. In ES we are using load balancing data publisher. I also notice if we call stop method, sometimes data not get publish to BAM. We changed this to initiate data publisher at the first event and call data publishers stop method in the bundle activator's stop method. Need to test with load. Thanks On Tue, Oct 21, 2014 at 10:07 PM, Gihan Anuruddha gi...@wso2.com wrote: Hi Lakshman, It should be in Cassandra if publishEvent method executes. How do you validate the data loss in Cassandra side? BAM embedded Cassandra explorer is a not good tool for that. Can you please verify that with tool like CQL or cassandra-cli? Regards, Gihan On Tue, Oct 21, 2014 at 9:18 PM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi All, I am working on https://wso2.org/jira/browse/APIMANAGER-2064. By looking at the Cassandra database on BAM, I could figure out some requests publish to Cassandra database and some do not when I invoke the api. That is the reason for the missing requests in statistics dashboard. I tried debugging the APIMgtUsageDataBridgeDataPublisher class since it has publishEvent method to publish data. APIMgtUsageDataBridgeDataPublisher class uses LoadBalancingDataPublisher as the dataPublisher in this case. I found that every time when I invoke the api via rest client, this method will execute. but randomly some requests are not publishing in Cassandra database. I used the latest org.wso2.carbon.databridge.agent.thrift jar. but the problem is still there. if requests come to publishEvent method, should they publish in Cassandra database?and is there any known reason for data get not published in cassendra database. if not where I can find the data publisher to cassendra in BAM from API Manager. Thanks -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005 0711241005* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Manoj Gunawardena Tech Lead WSO2, Inc.: http://wso2.com lean.enterprise.middleware Mobile : +94 77 2291643 -- Lakshman Udayakantha WSO2 Inc. www.wso2.com
Re: [Dev] [BAM][API-Manager] issue in updating API Manager statistics dashboard with BAM
Hi Lakshman, It should be in Cassandra if publishEvent method executes. How do you validate the data loss in Cassandra side? BAM embedded Cassandra explorer is a not good tool for that. Can you please verify that with tool like CQL or cassandra-cli? Regards, Gihan On Tue, Oct 21, 2014 at 9:18 PM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi All, I am working on https://wso2.org/jira/browse/APIMANAGER-2064. By looking at the Cassandra database on BAM, I could figure out some requests publish to Cassandra database and some do not when I invoke the api. That is the reason for the missing requests in statistics dashboard. I tried debugging the APIMgtUsageDataBridgeDataPublisher class since it has publishEvent method to publish data. APIMgtUsageDataBridgeDataPublisher class uses LoadBalancingDataPublisher as the dataPublisher in this case. I found that every time when I invoke the api via rest client, this method will execute. but randomly some requests are not publishing in Cassandra database. I used the latest org.wso2.carbon.databridge.agent.thrift jar. but the problem is still there. if requests come to publishEvent method, should they publish in Cassandra database?and is there any known reason for data get not published in cassendra database. if not where I can find the data publisher to cassendra in BAM from API Manager. Thanks -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005 0711241005* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [BAM][API-Manager] issue in updating API Manager statistics dashboard with BAM
Hi Lakshman, How many records did you send to BAM and how many events are lost? Regards, Gihan On Wed, Oct 22, 2014 at 8:18 AM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi Gihan, These data in cassandra database are summarised by a hive script and insert into a relational database. I checked that relational database table also. Number of records in cassandra database and relational database table are same. Then it should not be a problem with cassandra explorer. Thanks On Wed, Oct 22, 2014 at 7:53 AM, Manoj Gunawardena man...@wso2.com wrote: Hi, This can be an issue for other products as well. ES, AS and EMM also publishing data to BAM. In ES we are using load balancing data publisher. I also notice if we call stop method, sometimes data not get publish to BAM. We changed this to initiate data publisher at the first event and call data publishers stop method in the bundle activator's stop method. Need to test with load. Thanks On Tue, Oct 21, 2014 at 10:07 PM, Gihan Anuruddha gi...@wso2.com wrote: Hi Lakshman, It should be in Cassandra if publishEvent method executes. How do you validate the data loss in Cassandra side? BAM embedded Cassandra explorer is a not good tool for that. Can you please verify that with tool like CQL or cassandra-cli? Regards, Gihan On Tue, Oct 21, 2014 at 9:18 PM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi All, I am working on https://wso2.org/jira/browse/APIMANAGER-2064. By looking at the Cassandra database on BAM, I could figure out some requests publish to Cassandra database and some do not when I invoke the api. That is the reason for the missing requests in statistics dashboard. I tried debugging the APIMgtUsageDataBridgeDataPublisher class since it has publishEvent method to publish data. APIMgtUsageDataBridgeDataPublisher class uses LoadBalancingDataPublisher as the dataPublisher in this case. I found that every time when I invoke the api via rest client, this method will execute. but randomly some requests are not publishing in Cassandra database. I used the latest org.wso2.carbon.databridge.agent.thrift jar. but the problem is still there. if requests come to publishEvent method, should they publish in Cassandra database?and is there any known reason for data get not published in cassendra database. if not where I can find the data publisher to cassendra in BAM from API Manager. Thanks -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005 0711241005* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Manoj Gunawardena Tech Lead WSO2, Inc.: http://wso2.com lean.enterprise.middleware Mobile : +94 77 2291643 -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005 0711241005* -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [BAM][API-Manager] issue in updating API Manager statistics dashboard with BAM
Hi Lakshman, Can you please do this test. I believe currently you are using BAM 2.4.1. Please you this 2.5.0 RC [1]. Clean your RDBMS as well. Then using a tool like JMeter send 10,000 requests to APIM and see you are getting 10,000 events in BAM. Please run these tests without any debugging enabled. [1] - https://svn.wso2.org/repos/wso2/people/maninda/BAM_packs/2014-10-10/wso2bam-2.5.0.zip On Wed, Oct 22, 2014 at 9:19 AM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi Inosh, data in cassandra database are summized to a relational database. records in cassandra database and this relational table is same. so I think there is no problem with cassandra explorer. Thanks On Wed, Oct 22, 2014 at 9:14 AM, Inosh Goonewardena in...@wso2.com wrote: Hi Lakshman, You mean data is therw in cassandra and cassandra explorer doesn't show these data? Did you compare by using cassandra CLI tool? On Wednesday, October 22, 2014, Lakshman Udayakantha lakshm...@wso2.com wrote: HI Gihan , They are lost randomly. Thanks On Wed, Oct 22, 2014 at 9:00 AM, Gihan Anuruddha gi...@wso2.com wrote: Hi Lakshman, How many records did you send to BAM and how many events are lost? Regards, Gihan On Wed, Oct 22, 2014 at 8:18 AM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi Gihan, These data in cassandra database are summarised by a hive script and insert into a relational database. I checked that relational database table also. Number of records in cassandra database and relational database table are same. Then it should not be a problem with cassandra explorer. Thanks On Wed, Oct 22, 2014 at 7:53 AM, Manoj Gunawardena man...@wso2.com wrote: Hi, This can be an issue for other products as well. ES, AS and EMM also publishing data to BAM. In ES we are using load balancing data publisher. I also notice if we call stop method, sometimes data not get publish to BAM. We changed this to initiate data publisher at the first event and call data publishers stop method in the bundle activator's stop method. Need to test with load. Thanks On Tue, Oct 21, 2014 at 10:07 PM, Gihan Anuruddha gi...@wso2.com wrote: Hi Lakshman, It should be in Cassandra if publishEvent method executes. How do you validate the data loss in Cassandra side? BAM embedded Cassandra explorer is a not good tool for that. Can you please verify that with tool like CQL or cassandra-cli? Regards, Gihan On Tue, Oct 21, 2014 at 9:18 PM, Lakshman Udayakantha lakshm...@wso2.com wrote: Hi All, I am working on https://wso2.org/jira/browse/APIMANAGER-2064. By looking at the Cassandra database on BAM, I could figure out some requests publish to Cassandra database and some do not when I invoke the api. That is the reason for the missing requests in statistics dashboard. I tried debugging the APIMgtUsageDataBridgeDataPublisher class since it has publishEvent method to publish data. APIMgtUsageDataBridgeDataPublisher class uses LoadBalancingDataPublisher as the dataPublisher in this case. I found that every time when I invoke the api via rest client, this method will execute. but randomly some requests are not publishing in Cassandra database. I used the latest org.wso2.carbon.databridge.agent.thrift jar. but the problem is still there. if requests come to publishEvent method, should they publish in Cassandra database?and is there any known reason for data get not published in cassendra database. if not where I can find the data publisher to cassendra in BAM from API Manager. Thanks -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005 0711241005* ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Manoj Gunawardena Tech Lead WSO2, Inc.: http://wso2.com lean.enterprise.middleware Mobile : +94 77 2291643 -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005 0711241005* -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005 0711241005* -- Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317 -- Lakshman Udayakantha WSO2 Inc. www.wso2.com lean.enterprise.middleware Mobile: *0711241005 0711241005* -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] error in setup BAM server in API cluster setup
validationInterval3/validationInterval
/configuration
/definition
/datasource
Regards,
Akila
*From:* Inosh Goonewardena [mailto:in...@wso2.com]
*Sent:* 16 October 2014 3:37 PM
*To:* Akila Nimantha [IT/EKO/LOITS]
*Cc:* Dinesh J Weerakkody; Gihan Anuruddha; dev@wso2.org
*Subject:* Re: [Dev] error in setup BAM server in API cluster setup
Hi Akila,
Seems like you haven't create the datasource for WSO2AM_STATS_DB to
BAM(BAM_HOME/repository/conf/datasources/bam_datasources.xml) as
mentioned in [1]. However, if you are using BAM version prior to BAM 2.4.1
you have to add the datasource to
master-datasources.xml(BAM_HOME/repository/conf/datasources/master-datasources.xml)
Caused by: java.lang.RuntimeException: Error in getting data source
properties: *The data source: WSO2AM_STATS_DB does not exist for tenant:
carbon.super*
at
org.wso2.carbon.hive.data.source.access.util.DataSourceAccessUtil.getDataSourceProperties(DataSourceAccessUtil.java:57)
... 25 more
Caused by: java.lang.RuntimeException: T*he data source: WSO2AM_STATS_DB
does not exist for tenant: carbon.super*
at
org.wso2.carbon.hive.data.source.access.util.DataSourceAccessUtil.getDataSourceProperties(DataSourceAccessUtil.java:47)
... 25 more
[1] -
https://docs.wso2.com/display/AM170/Publishing+API+Runtime+Statistics#PublishingAPIRuntimeStatistics-ConfiguringWSO2BAM
On Thu, Oct 16, 2014 at 3:20 PM, Akila Nimantha [IT/EKO/LOITS]
aki...@lolctech.com wrote:
Hi Dinesh, Gihan,
I think not yet solved the problem.
What I did was changed to Oracle and try the same. First started bam
server and after gateway, keymanager,publisher and finally store. Now noe
api manager nodes up and running without any error.but bam server give
error repeatedly. Please check server logs bam and store servers.
But I can see api invoke events from bam console(by login to the Cassandra
cluster).
When I trying to subscribe to a api, bam server going down with
outofmemmory message.
Regards,
Akila
*From:* Dinesh J Weerakkody [mailto:dine...@wso2.com]
*Sent:* 14 October 2014 5:02 PM
*To:* Akila Nimantha [IT/EKO/LOITS]
*Cc:* dev@wso2.org
*Subject:* Re: [Dev] error in setup BAM server in API cluster setup
Hi Akila,
Have you solved your problem?
On Mon, Oct 13, 2014 at 11:21 PM, Inosh Goonewardena in...@wso2.com
wrote:
Hi,
On Mon, Oct 13, 2014 at 6:15 PM, Akila Nimantha [IT/EKO/LOITS]
aki...@lolctech.com wrote:
Dear Gihan,
Yes I used figures displayed in my BAM log.
Can you please tell me is there a specific server that I should put these
configurations. Because I am trying to add BAM in a clustered setup. My
followed document says just api_home and so on. So what should I change
or both. For now I did same configuration in both four
components(Gateway,keymanager,publisher and store).
You need to configure usage tracking only in APIM-Gateway nodes. Please
make sure APIM-Gateway nodes have the access to above BAM thrift server
ports(telnet from gateway nodes to make sure).
Regards,
Akila
*From:* Gihan Anuruddha [mailto:gi...@wso2.com]
*Sent:* 13 October 2014 5:50 PM
*To:* Akila Nimantha [IT/EKO/LOITS]
*Cc:* dev@wso2.org
*Subject:* Re: [Dev] error in setup BAM server in API cluster setup
Hi Akila,
During the BAM server startup, it will show a message like below. Please
use that IP address to connect to BAM.
[2014-10-13 14:51:17,448] INFO
{org.wso2.carbon.databridge.receiver.thrift.internal.ThriftDataReceiver} -
Thrift Server started at 0.0.0.0
[2014-10-13 14:51:17,453] INFO
{org.wso2.carbon.databridge.receiver.thrift.internal.ThriftDataReceiver} -
Thrift SSL port : 7711
[2014-10-13 14:51:17,456] INFO
{org.wso2.carbon.databridge.receiver.thrift.internal.ThriftDataReceiver} -
Thrift port : 7611
Regards,
Gihan
On Mon, Oct 13, 2014 at 5:46 PM, Akila Nimantha [IT/EKO/LOITS]
aki...@lolctech.com wrote:
Hi harsha,
Yes ip is correct .i put port as 7617 because I used 6 as BAM offset.
please check below for apiusagetracking element details,
APIUsageTracking
Enabledtrue/Enabled
PublisherClassorg.wso2.carbon.apimgt.usage.publisher.APIMgtUsageDataBridgeDataPublisher/PublisherClass
ThriftPort7617/ThriftPort
BAMServerURLtcp://172.20.2.150:7617//BAMServerURL
BAMUsernameadmin/BAMUsername
BAMPasswordadmin/BAMPassword
DataSourceNamejdbc/WSO2AM_STATS_DB/DataSourceName
/APIUsageTracking
Regards,
Akila
*From:* Harsha Kumara [mailto:hars...@wso2.com]
*Sent:* 13 October 2014 4:46 PM
*To:* Akila Nimantha [IT/EKO/LOITS]
*Cc:* dev@wso2.org
*Subject:* Re: [Dev] error in setup BAM server in API cluster setup
Hi Akila,
Seems like it's a connection issue. Have you specified correct IPs and
ports in the configurations.
Thanks,
Harsha
On Mon, Oct 13
Re: [Dev] Backup Hive queries on BAM
Hi Inosh, All the hive scripts are saved in the registry under /_system/config/repository/hive/scripts location. At the moment we don't provide backup/restore functionality. What is your use case? Regards, Gihan On Mon, Oct 13, 2014 at 5:34 PM, Inosh Perera ino...@wso2.com wrote: Hi all, Is there a way to backup/restore the Hive queries(Analytics) you write on BAM. Where are these queries stored? Regards, Inosh -- Inosh Perera Software Engineer, WSO2 Inc. Tel: 0785293686 -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] error in setup BAM server in API cluster setup
of the individual or entity to which it is addressed and may contain information that is non-public, proprietary, privileged, confidential, and exempt from disclosure under applicable law or may constitute as attorney work product. If you are not the intended recipient, you are hereby notified that any use, dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, notify us immediately by telephone and (i) destroy this message if a facsimile or (ii) delete this message immediately if this is an electronic communication. Thank you. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Harsha Kumara Software Engineer, WSO2 Inc. Mobile: +94775505618 Blog:harshcreationz.blogspot.com This message (including any attachments) is intended only for the use of the individual or entity to which it is addressed and may contain information that is non-public, proprietary, privileged, confidential, and exempt from disclosure under applicable law or may constitute as attorney work product. If you are not the intended recipient, you are hereby notified that any use, dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, notify us immediately by telephone and (i) destroy this message if a facsimile or (ii) delete this message immediately if this is an electronic communication. Thank you. ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Using AsyncDataPublisher of BAM
Hi Inosh, Yes, You can. You can use one object to handle all the requests for one stream. No need to create multiple objects. Regards, Gihan On Fri, Oct 10, 2014 at 11:50 AM, Inosh Perera ino...@wso2.com wrote: Hi all, When publishing data to BAM, it is possible to use AsyncDataPublisher as mentioned here[1]. Can we use a single AsyncDataPublisher to publish data, or is it necessary to create separate object of AsyncDataPublisher for each request? If one object is enough, does it handle multiple request coming at once? [1]. https://docs.wso2.com/display/BAM230/Data+Publisher Regards, Inosh -- Inosh Perera Software Engineer, WSO2 Inc. Tel: 0785293686 -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] WSO2 BAM 2.5.0 Beta Released!!!
://svn.wso2.org/repos/wso2/people/malith/BAM-2.5.0/BAM-2.5.0-Beta/wso2bam-2.5.0.zip Regards, Gihan -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Info about Encrypted data stored in registry in WSO2 products
Below BAM component using the encryptAndBase64Encode method to store passwords in the registry. org.wso2.carbon.bam.jmx.agent org.wso2.carbon.mediator.bam.config.ui org.wso2.carbon.mediator.bam.config On Tue, Sep 23, 2014 at 6:30 PM, Susinda Perera susi...@wso2.com wrote: Thanks prabath for the quick response. Yes i have to grep both encrypt and encryptAndBase64Encode methods. But issue i faced was then i have to find the registry.put methods followed by this. And also i found some wrapper/utility classes written by using CryptoUtil class. then i have to find their uses and then again find registry insertions and do so on. Thats why i thought to get some help from developers who might have some idea if they have done such coding. Any idea? On Tue, Sep 23, 2014 at 6:20 PM, Prabath Siriwardena prab...@wso2.com wrote: I think you need to grep for encrypt() method of CryptoUtil class [1] [1]: https://svn.wso2.org/repos/wso2/carbon/kernel/branches/4.2.0/patches/patch0009/core/org.wso2.carbon.core/4.2.0/src/main/java/org/wso2/carbon/core/util/CryptoUtil.java Thanks regards, -Prabath On Tue, Sep 23, 2014 at 5:50 PM, Susinda Perera susi...@wso2.com wrote: Hi Developers/Product Leads Need your help to figure out the $subject. Could you point out any places that you put encrypted data to registry in the products (ESB, GREG, CEP, IS, AS, API MANAGER, BAM) that you are working. I want to know what and where (i.e registry path) such info is saved. I have tried a approach in searching for places of occurrences of [1], however this approach does not seems to be a easy one since i have to do several iterations to find this. Also it is difficult because my requirement is to find the registry insertions of such encrypted data. In that case i have to first find the occurrences of [1] and the find the registry.put followed by that. Therefore i think easy way is to contact the developers and get this info. Please reply corresponding to your product. [1] CryptoUtil.getDefaultCryptoUtil().encryptAndBase64Encode Thanks -- Susinda Perera Software Engineer Mobile:(+94)716049075 WSO2 Inc. http://wso2.com/ Tel : 94 11 214 5345 Fax :94 11 2145300 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Thanks Regards, Prabath Twitter : @prabath LinkedIn : http://www.linkedin.com/in/prabathsiriwardena Mobile : +94 71 809 6732 http://blog.facilelogin.com http://blog.api-security.org -- *Susinda Perera* Software Engineer Mobile:(+94)716049075 WSO2 Inc. http://wso2.com/ Tel : 94 11 214 5345 Fax :94 11 2145300 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Info about Encrypted data stored in registry in WSO2 products
All the JMX profiles are saved in the governance registry under repository/components/org.wso2.carbon.publish.jmx.agent/ path. On Wed, Sep 24, 2014 at 3:03 PM, Susinda Perera susi...@wso2.com wrote: Thanks Gihan Could you also tell me when ds is happen and where in registry those are saved from the code i see that it stores profile registry in addProfile method components/data-agents/org.wso2.carbon.bam.jmx.agent/4.2.1/src/main/java/org/wso2/carbon/bam/jmx/agent/profiles/ProfileManager.java: Can you explain bit Thanks in advanced On Wed, Sep 24, 2014 at 2:59 PM, Gihan Anuruddha gi...@wso2.com wrote: Below BAM component using the encryptAndBase64Encode method to store passwords in the registry. org.wso2.carbon.bam.jmx.agent org.wso2.carbon.mediator.bam.config.ui org.wso2.carbon.mediator.bam.config On Tue, Sep 23, 2014 at 6:30 PM, Susinda Perera susi...@wso2.com wrote: Thanks prabath for the quick response. Yes i have to grep both encrypt and encryptAndBase64Encode methods. But issue i faced was then i have to find the registry.put methods followed by this. And also i found some wrapper/utility classes written by using CryptoUtil class. then i have to find their uses and then again find registry insertions and do so on. Thats why i thought to get some help from developers who might have some idea if they have done such coding. Any idea? On Tue, Sep 23, 2014 at 6:20 PM, Prabath Siriwardena prab...@wso2.com wrote: I think you need to grep for encrypt() method of CryptoUtil class [1] [1]: https://svn.wso2.org/repos/wso2/carbon/kernel/branches/4.2.0/patches/patch0009/core/org.wso2.carbon.core/4.2.0/src/main/java/org/wso2/carbon/core/util/CryptoUtil.java Thanks regards, -Prabath On Tue, Sep 23, 2014 at 5:50 PM, Susinda Perera susi...@wso2.com wrote: Hi Developers/Product Leads Need your help to figure out the $subject. Could you point out any places that you put encrypted data to registry in the products (ESB, GREG, CEP, IS, AS, API MANAGER, BAM) that you are working. I want to know what and where (i.e registry path) such info is saved. I have tried a approach in searching for places of occurrences of [1], however this approach does not seems to be a easy one since i have to do several iterations to find this. Also it is difficult because my requirement is to find the registry insertions of such encrypted data. In that case i have to first find the occurrences of [1] and the find the registry.put followed by that. Therefore i think easy way is to contact the developers and get this info. Please reply corresponding to your product. [1] CryptoUtil.getDefaultCryptoUtil().encryptAndBase64Encode Thanks -- Susinda Perera Software Engineer Mobile:(+94)716049075 WSO2 Inc. http://wso2.com/ Tel : 94 11 214 5345 Fax :94 11 2145300 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Thanks Regards, Prabath Twitter : @prabath LinkedIn : http://www.linkedin.com/in/prabathsiriwardena Mobile : +94 71 809 6732 http://blog.facilelogin.com http://blog.api-security.org -- *Susinda Perera* Software Engineer Mobile:(+94)716049075 WSO2 Inc. http://wso2.com/ Tel : 94 11 214 5345 Fax :94 11 2145300 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 -- *Susinda Perera* Software Engineer Mobile:(+94)716049075 WSO2 Inc. http://wso2.com/ Tel : 94 11 214 5345 Fax :94 11 2145300 -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Hazlecast Error in Centos 6.5
Hi Thayalan,
AFAIK Maninda fixed this issue with alpha pack. Can you please try on that?
Alpha pack location:
https://svn.wso2.org/repos/wso2/people/maninda/BAM_packs/wso2bam-2.5.0_Alpha.zip
On Thu, Sep 18, 2014 at 8:44 AM, Selvaratnam Uthaiyashankar
shan...@wso2.com wrote:
Hi Thayalan,
Did you report this in JIRA? I couldn't see any issues reported
Also, did you try the alpha pack? Do they still have this issue?
On Wed, Sep 10, 2014 at 4:29 PM, Thayalan thaya...@wso2.com wrote:
Set-up the cluster using the build [1] below. There were no other patches
applied to the build. Java version detail is in [2].
1.
https://svn.wso2.org/repos/wso2/people/maninda/BAM_packs/2014-09-05_wso2bam-2.5.0.zip
2. Java Version details
java version 1.7.0_65
Java(TM) SE Runtime Environment (build 1.7.0_65-b17)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)
On Wed, Sep 10, 2014 at 4:21 PM, Afkham Azeez az...@wso2.com wrote:
Looks like a jar incompatibility. What patches have you put? Is the
Hazelcast upgrade patch there? Also, is the corresponding kernel patch
there?
Azeez
On Wed, Sep 10, 2014 at 4:13 PM, Thayalan thaya...@wso2.com wrote:
Hi All,
While setting up BAM 2.4.2 cluster set-up in Centos 6.5 noticed the
below error during server start-up. Any idea for this exception.
ERROR {org.apache.cassandra.service.CassandraDaemon} - Exception in
thread Thread[Cluster [wso2.carbon.domain] coordinator elector
thread,5,main]
java.lang.NoSuchMethodError:
com.hazelcast.core.HazelcastInstance.getLock(Ljava/lang/String;)Lcom/hazelcast/core/ILock;
at
org.wso2.carbon.core.clustering.hazelcast.HazelcastClusteringAgent$2.run(HazelcastClusteringAgent.java:227)
--
Regards,
Thayalan Sivapaleswararajah
Associate Technical Lead - QA
Mob: +94(0)777872485
Tel : +94(0)(11)2145345
Fax : +94(0)(11)2145300
Email: thaya...@wso2.com
*Disclaimer*: *This communication may contain privileged or other
confidential information and is intended exclusively for the addressee/s.
If you are not the intended recipient/s, or believe that you may have
received this communication in error, please reply to the sender indicating
that fact and delete the copy you received and in addition, you should not
print, copy, retransmit, disseminate, or otherwise use the information
contained in this communication. Internet communications cannot be
guaranteed to be timely, secure, error or virus-free. The sender does not
accept liability for any errors or omissions.*
--
*Afkham Azeez*
Director of Architecture; WSO2, Inc.; http://wso2.com
Member; Apache Software Foundation; http://www.apache.org/
* http://www.apache.org/*
*email: **az...@wso2.com* az...@wso2.com
* cell: +94 77 3320919 %2B94%2077%203320919blog: *
*http://blog.afkham.org* http://blog.afkham.org
*twitter: **http://twitter.com/afkham_azeez*
http://twitter.com/afkham_azeez
*linked-in: **http://lk.linkedin.com/in/afkhamazeez
http://lk.linkedin.com/in/afkhamazeez*
*Lean . Enterprise . Middleware*
--
Regards,
Thayalan Sivapaleswararajah
Associate Technical Lead - QA
Mob: +94(0)777872485
Tel : +94(0)(11)2145345
Fax : +94(0)(11)2145300
Email: thaya...@wso2.com
*Disclaimer*: *This communication may contain privileged or other
confidential information and is intended exclusively for the addressee/s.
If you are not the intended recipient/s, or believe that you may have
received this communication in error, please reply to the sender indicating
that fact and delete the copy you received and in addition, you should not
print, copy, retransmit, disseminate, or otherwise use the information
contained in this communication. Internet communications cannot be
guaranteed to be timely, secure, error or virus-free. The sender does not
accept liability for any errors or omissions.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--
S.Uthaiyashankar
VP Engineering
WSO2 Inc.
http://wso2.com/ - lean . enterprise . middleware
Phone: +94 714897591
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
--
W.G. Gihan Anuruddha
Senior Software Engineer | WSO2, Inc.
M: +94772272595
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Link CEP event adaptor doc with BAM 2.5.0
Hi Praneesha, With BAM 2.5.0 we have integrated several event adaptors to BAM. At the moment these event adaptors are available with CEP. Can you please link existing CEP event adaptor doc [1] with BAM 2.5.0 doc space? [1] - https://docs.wso2.com/display/CEP310/Working+with+Event+Adaptors -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] [BAM] [Clustering] How to verify whether hadoop cluster is created correctly?
Yes, This is correct. Based on above output you have 1 NameNode, 1 SecondaryNameNode and 3 DataNodes. Please use localhost:9000 and localhost:9001 to check your cluster. On Fri, Aug 8, 2014 at 12:21 PM, Rajkumar Rajaratnam rajkum...@wso2.com wrote: Hi, I am configuring Fully-Distributed, High-Availability BAM Setup by following [1] [2] says that when we run jps, the output should look like below, hadoop@ubuntu:/usr/local/hadoop$ jps 2287 TaskTracker 2149 JobTracker 1788 NameNode Which node will have above status? I didn't get above output in any nodes. After configuring hadoop cluster, when I run jps command in each node, output is as below, Node-1 hadoop@bam-n1:~$ jps 15324 Jps 14953 NameNode 15130 JobTracker Node-2 hadoop@bam-n2:~$ jps 14384 Jps 14232 SecondaryNameNode Node-3 hadoop@bam-n3:~/hadoop-1.0.4$ jps 12259 TaskTracker 12329 Jps 12087 DataNode Node-4 hadoop@bam-n4:/home/ubuntu$ jps 11907 DataNode 12157 Jps 12081 TaskTracker Node-5 hadoop@bam-node-5:~/hadoop-1.0.4$ jps 12220 Jps 11960 DataNode 12134 TaskTracker Is hadoop cluster created correctly? 1. https://docs.wso2.com/display/CLUSTER420/Fully-Distributed%2C+High-Availability+BAM+Setup 2. https://docs.wso2.com/display/CLUSTER420/Known+Issues+in+Hadoop+Cluster Thanks. -- Rajkumar Rajaratnam Software Engineer | WSO2, Inc. Mobile +94777568639 | +94783498120 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
