[Dev] WSO2 Committers += Buddhi Kothalawala

[Mohanadarshan Vivekanandalingam]

Hi Devs,

It is my pleasure to welcome Buddhi Kothalawala as a WSO2 Committer. He has
been a valuable contributor to the Siddhi team and took over a lot of
responsibilities of the team. He has done the major work to make Siddhi as
Cloud Native Stream Processor by writing necessary K8S operators, etc..

Buddhi, welcome aboard and keep up the good work.

Thanks,
Mohan

-- 
*V. Mohanadarshan* | Senior Technical Lead | WSO2 Inc.
 |
(M) 94-771117673 | (E) mo...@wso2.com |
GET INTEGRATION AGILE
Integration Agility for Digitally Driven Business
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Issue with R extension in WSO2 Stream processor

[Mohanadarshan Vivekanandalingam]

FYA..


On Thu, Nov 14, 2019 at 6:38 PM A. V.  wrote:

> Hi,Im trying to make windows with a length batch of 100 rows each and to
> use some R functions to calculate some statistical data for each batch. In
> the below code I:
>
>- * define a inputstream
>- * I create a query to convert the features into the right datatype
>- * In the below query I make window batches for 100 rows each and im
>getting the max and standard deviation value for the "Result" feature. When
>I run the code below it works for the first 100 rows. As u can see in the
>output below. But the output below only gives a log of the first batch of
>100 rows. I want to do this for batch 1-100, 101-200, 201-300 etc. How can
>I do this? What am I doing wrong?
>
> *[2019-11-13_14-43-11_280] INFO
> {org.wso2.siddhi.core.stream.output.sink.LogSink} - LOGGER :
> Event{timestamp=1573652690107, data=[100, 96.73, 11.004484222861702],
> isExpired=false}*
>
> *define stream HBA1CStream(measurementID String, dateTime String, result
> String, unixDateTime String);**@sink(type='log', prefix='LOGGER')**define
> stream OutputStream(measurementID int, maxValue double, sdValue 
> double);**@info(name
> = 'Query')**from HBA1CStream**select convert(measurementID, 'int') as
> measurementID, convert(str:replaceAll(result,',','.'), 'double') as result,
> dateTime, convert(unixDateTime, 'long') as unixDateTime**insert into
> RStream;**@info(name = 'RStream')**from
> RStream#window.lengthBatch(100)#r:eval("c <- max(result); m <-
> sd(result);", "c double, m double ", result, result)**select
> measurementID, c as maxValue , m as sdValue**insert into OutputStream;*
>
> Thanks for the help.
>
> Best regards,
> Wiedo
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>


-- 
*V. Mohanadarshan* | Senior Technical Lead | WSO2 Inc.
 |
(M) 94-771117673 | (E) mo...@wso2.com |
GET INTEGRATION AGILE
Integration Agility for Digitally Driven Business
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [VOTE] Release of WSO2 Stream Processor 4.4.0 RC5

[Mohanadarshan Vivekanandalingam]

Closing the vote since we have found some corrupted artifacts in the
distribution. RC6 vote is called due to this.

Thanks,
Mohan


On Tue, May 14, 2019 at 12:53 PM Ramindu De Silva  wrote:

> Hi all,
>
> WSO2 Stream Processor team is pleased to announce the fifth release
> candidate of WSO2 Stream Processor 4.4.0.
>
> WSO2 Stream Processor is an open source embodiment of the WSO2 Analytics
> platform, of which the real-time, incremental & intelligent data processing
> capabilities let digital businesses create actionable business insights and
> data products.
>
> Please find the improvements and fixes related to this release:
>
>- siddhi
>
> 
>- carbon-analytics-common
>
> 
>- carbon-analytics
>
> 
>- carbon-dashboards
>
> 
>- analytics-solutions
>
> 
>- product-sp
>
> 
>
> You can download the product distribution from here
> 
>
> The tag to be voted upon:
> https://github.com/wso2/product-sp/releases/tag/v4.4.0-RC5
>
> Please download, test the product and vote.
>
> [+] Stable - go ahead and release
> [-] Broken - do not release (explain why)
>
> You can find the official documentation in
> https://docs.wso2.com/display/SP440
>
> Best Regards,
> WSO2 Stream Processor Team
> --
> *Ramindu De Silva*
> Associate Technical Lead
> WSO2 Inc.: http://wso2.com
> lean.enterprise.middleware
>
> email: ramin...@wso2.com 
> mob: +94 719678895
>
> --
> You received this message because you are subscribed to the Google Groups
> "Analytics Group" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to analytics-group+unsubscr...@wso2.com.
> To view this discussion on the web visit
> https://groups.google.com/a/wso2.com/d/msgid/analytics-group/CANLowD5-SNPAAxthqMkweUzu1n%2B4nT%2BiDDw1iy5LBvRjJdQfcw%40mail.gmail.com
> 
> .
>


-- 
*V. Mohanadarshan* | Senior Technical Lead | WSO2 Inc.
 |
(M) 94-771117673 | (E) mo...@wso2.com |
GET INTEGRATION AGILE
Integration Agility for Digitally Driven Business
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [VOTE] Release of WSO2 Stream Processor 4.4.0 RC3

[Mohanadarshan Vivekanandalingam]

HI All,

We have found some issues in our testing cycle hence closing off the vote
and will be doing another RC release.

Thanks,
Mohan


On Thu, Apr 25, 2019 at 12:02 PM Minudika Malshan  wrote:

> Hi all,
>
>
> WSO2 Stream Processor team is pleased to announce the third release candidate
> of *WSO2 Stream Processor 4.4.0*.
>
>
> WSO2 Stream Processor is an open source embodiment of the WSO2 Analytics
> platform, of which the real-time, incremental & intelligent data processing
> capabilities let digital businesses create actionable business insights and
> data products.
>
>
> Please find the improvements and fixes related to this release:
>
> - siddhi
> 
>
> - carbon-analytics-common
> 
>
> - carbon-analytics
> 
>
> - carbon-dashboards
> 
>
> - analytics-solutions
> 
>
> - product-sp
> 
>
>
> You can download the product distribution from here
> 
>
>
> The tag to be voted upon:
> https://github.com/wso2/product-sp/releases/tag/v4.4.0-RC3
>
>
> Please download, test the product and vote.
>
>
> *[+] Stable - go ahead and release*
>
> *[-] Broken - do not release *(explain why)
>
>
>
> Thanks!
>
> *- WSO2 Stream Processor Team -*
>
>
> --
> *Minudika Gammanpila*
> Software Engineer - WSO2
>
> Email   :  minud...@wso2.com
> Mobile :  +94715659887
> Web :  http://wso2.com
>
>  
>


-- 
*V. Mohanadarshan* | Senior Technical Lead | WSO2 Inc.
 |
(M) 94-771117673 | (E) mo...@wso2.com |
GET INTEGRATION AGILE
Integration Agility for Digitally Driven Business
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [VOTE] Release of WSO2 Stream Processor 4.4.0 RC2

[Mohanadarshan Vivekanandalingam]

Hi All,

WSO2 Stream Processor team is pleased to announce the second release
candidate of WSO2 Stream Processor 4.4.0.

WSO2 Stream Processor is an open source embodiment of the WSO2 Analytics
platform, of which the real-time, incremental & intelligent data processing
capabilities let digital businesses create actionable business insights and
data products.

Please find the improvements and fixes related to this release:

   - siddhi
   

   - carbon-analytics-common
   

   - carbon-analytics
   

   - carbon-dashboards
   

   - analytics-solutions
   

   - product-sp
   


You can download the product distribution from here


The tag to be voted upon:
https://github.com/wso2/product-sp/releases/edit/v4.4.0-RC2

Please download, test the product and vote.

[+] Stable - go ahead and release
[-] Broken - do not release (explain why)

You can find the official documentation in
https://docs.wso2.com/display/SP440  

Thanks,
WSO2 Stream Processor Team

-- 
*V. Mohanadarshan* | Senior Technical Lead | WSO2 Inc.
 |
(M) 94-771117673 | (E) mo...@wso2.com |
GET INTEGRATION AGILE
Integration Agility for Digitally Driven Business
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Issue when sending json arrays via http eventAdapter

[Mohanadarshan Vivekanandalingam]

On Tue, Dec 11, 2018 at 11:43 AM Ruwan Yatawara  wrote:

> Adding Dev Group.
>
> On Tue, Dec 11, 2018 at 11:41 AM Ruwan Yatawara  wrote:
>
>> Hi All,
>>
>> We have encountered a problem when sending json arrays as input events
>> via http eventAdapterType. Basically, if inputs json contains an array in
>> the root element level, everything works fine, if other elements exist in
>> the json, at root level in addition to the array; see below structure :
>>
>> {
>> "recordsTotal": 100,
>> "recordsFiltered": 1000,
>> *"data": [{*
>> * "uuid": "ABCD",*
>> * "severity": 10,*
>> * "inAction": false*
>> * },{*
>> * "uuid": "EFGH",*
>> * "severity": 10,*
>> * "inAction": false*
>> * }*
>> * ]*
>> }
>>
>> Input fails with a malformation exception. Note that when adding the
>> mappings we opted to use the json path in format: *$.data[*].uuid* to
>> refer to each uuid element inside the payload. However, this json path
>> expression does not seem to be recognized by CEP. But when using absolute
>> references indicating the array index: i.e. *$.data[1].uuid *, everything
>> works as expected.
>>
>> This appears to be an issue in CEP. Can you please advise on how we can
>> work this out?
>>
>> Thanks and Regards,
>> Ruwan
>>
>>
>>

-- 
*V. Mohanadarshan* | Technical Lead | WSO2 Inc.  |
(M) 94-771117673 | (E) mo...@wso2.com |
GET INTEGRATION AGILE
Integration Agility for Digitally Driven Business
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Siddhi Store Redis - update or insert into table (on Redis) won't work

[Mohanadarshan Vivekanandalingam]

Hi Anusha,

Can you please followup and respond to this..

Thanks,
Mohan


On Tue, Nov 20, 2018 at 3:57 PM Bahtiyar KARANLIK <
bahtiyar.karan...@gmail.com> wrote:

> Hi All,
>
> I'm trying to retrieve the records in a PostgreSQL table and update or
> insert them into Redis. Below code creates all KEYS in the Redis instance,
> BUT all items contain the very same record (of Threshold rule) (hgetall
> keyname1 and hgetall keyname2 returns the same result)
>
> I'm not sure if this is a bug or a feature, and stuck here.. Any advices
> are highly appreciated..
>
> best regards,
>
> define trigger ConfigReloadTrigger at every 60 sec;
>
> @Store(type = "rdbms", jdbc.url = "jdbc:postgresql://localhost/my_db", 
> username = "my_user", password = "my_pwd" , jdbc.driver.name = 
> "org.postgresql.Driver", table.name = 'pm_threshold')
> @Index('metric_name')
> @primaryKey('id')
> define table ThresholdTable(id int, created_at string, updated_at string, 
> path_regex string, aggr_field string, aggr_function string, warning double, 
> warning_action int, critical double, critical_action int, is_active bool, 
> task_step_id int, metric_name string, selectivity int);
>
> @Store(type='redis', table.name='pm_threshold', nodes='localhost:6373', 
> cluster.mode='false')
> @primaryKey('threshold_id')
> define table ThresholdCache(threshold_id string, is_active bool, path_regex 
> string, threshold_updated_at string, threshold_context object, cache_time 
> long);
>
> from ConfigReloadTrigger join ThresholdTable
> select
> str:concat('threshold_rule_', ThresholdTable.id 
> ) as threshold_id,
> ThresholdTable.is_active,
> ThresholdTable.path_regex,
> ThresholdTable.updated_at as threshold_updated_at,
> map:create(
> "id", ThresholdTable.id ,
> "metric_name", ThresholdTable.metric_name,
> "path_regex", ThresholdTable.path_regex,
> "selectivity", ThresholdTable.selectivity,
> "aggr_field", ThresholdTable.aggr_field,
> "aggr_function", ThresholdTable.aggr_function,
> "warning", ThresholdTable.warning,
> "warning_action", ThresholdTable.warning_action,
> "critical", ThresholdTable.critical,
> "critical_action", ThresholdTable.critical_action,
> "is_active", ThresholdTable.is_active,
> "task_step_id", ThresholdTable.task_step_id,
> "created_at", ThresholdTable.created_at,
> "updated_at", ThresholdTable.updated_at
> ) as threshold_context,
> eventTimestamp() as cache_time
> insert into ThresholdTableStream;
>
> from ThresholdTableStream#log(true)
> select
> ThresholdTableStream.threshold_id,
> ThresholdTableStream.is_active,
> ThresholdTableStream.path_regex,
> ThresholdTableStream.threshold_updated_at,
> ThresholdTableStream.threshold_context,
> ThresholdTableStream.cache_time
> update or insert into ThresholdCache
> set
> ThresholdCache.threshold_id = threshold_id,
> ThresholdCache.is_active = is_active,
> ThresholdCache.path_regex = path_regex,
> ThresholdCache.threshold_updated_at = threshold_updated_at,
> ThresholdCache.threshold_context = threshold_context,
> ThresholdCache.cache_time = cache_time
> on ThresholdCache.threshold_id == threshold_id;
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>


-- 
*V. Mohanadarshan* | Technical Lead | WSO2 Inc.  |
(M) 94-771117673 | (E) mo...@wso2.com |
GET INTEGRATION AGILE
Integration Agility for Digitally Driven Business
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] TestCaseName is not setting properly

[Mohanadarshan Vivekanandalingam]

Hi Vasanth,

It seems, you have to pass the className as the header parameter as per
yout MSF4J service implementation. Please set the className as the header
in the http sink and tryout.

Thanks,
Mohan


On Thu, Oct 11, 2018 at 10:52 AM, Vasanthan Sivalingam 
wrote:

> Hi SP team,
>
> Currently i have written a siddhi application,
>
>
>
>
>
>
>
>
>
>
>
> *@App:name('TestMinimumHA')@source(type='http', receiver.url=
> 'http://192.168.48.26:9006/endpoints
> ', topic='symbol',
> @map(type='xml'))define stream FooStream (symbol string, price float, class
> string);@sink(type='http',
> publisher.url='http://192.168.48.254:8080/testresults
> ',
> method='{{method}}',headers="'content-type:text/plain'",@map(type='json'))define
> stream BarStream (message string, value float, method string, headers
> string);from FooStream#window.length(5)select symbol as message, max(price)
> as value, 'POST' as method, class as headersinsert into BarStream;from
> BarStream#log("Events: ")insert into OutputStream;*
>
> through postman i am  passing an event with POST
> http://192.168.48.26:9006/endpoints -H content-type="plain/text"
> with body
> 
> 
> First
> 20f
> cclassName:com.sp.test.StateSync
> 
> 
>
> in the server side i am getting a response :
> [2018-10-11 03:57:10,666] INFO {org.wso2.siddhi.core.query.
> processor.stream.LogStreamProcessor} - TestMinimumHA: Events: ,
> StreamEvent{ timestamp=1539230230663, beforeWindowData=null,
> onAfterWindowData=null, outputData=[First, 20.0, POST,
> *cclassName:com.sp.test.StateSync*], type=CURRENT, next=null}
> [2018-10-11 03:57:13,387] ERROR {org.wso2.carbon.stream.
> processor.core.persistence.PersistenceManager}
>
> I am running a MSF4J in host: 192.168.48.254, port:8080,in the MSF4J side
> i am getting a response as below.
>
> 2018-10-11 03:57:11 INFO VerifyTest:144 - POST invoked
> 2018-10-11 03:57:11 INFO VerifyTest:145 - Content-Type=application/json
> 2018-10-11 03:57:11 INFO VerifyTest:145 - HTTP_METHOD=POST
> 2018-10-11 03:57:11 INFO VerifyTest:145 - connection=keep-alive
> 2018-10-11 03:57:11 INFO VerifyTest:145 - forwarded=by=192.168.48.26;
> proto=http
> 2018-10-11 03:57:11 INFO VerifyTest:145 - content-length=103
> 2018-10-11 03:57:11 INFO VerifyTest:153 - adding event under new test case.
> 2018-10-11 03:57:11 INFO VerifyTest:158 - *TestCaseName: null*
>
> Can i have some suggestions on how to set the TestCaseName as , *TestCaseName:
> com.sp.test.StateSync*
>
> Thanks,
> Vasanth
>



-- 
*V. Mohanadarshan* | Technical Lead | WSO2 Inc.  |
(M) 94-771117673 | (E) mo...@wso2.com |
GET INTEGRATION AGILE
Integration Agility for Digitally Driven Business
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Communication Error between Active and Passive nodes.

[Mohanadarshan Vivekanandalingam]

Hi Damith/Nisala,

I think, we could improve the error handling bit more. Seems like we are
not printing the error trace here. Shall we improve that?

Thanks,
Mohan

On Fri, Sep 21, 2018 at 7:38 PM, Damith Wickramasinghe 
wrote:

> Hi vasanthan,
>
> It seems active node cannot create a tcp connection to passive node.
> Please make sure above advertisedHost value should be the host of own node.
> Not the host of other node.  If they are correct then try to telnet to
> passive node {passive node host} 9893 from active node.  I think you may
> need a host mapping too.
>
> Adding thilina since he did a same setup with new HA.
>
>
> Regards,
> Damith.
>
> On Fri, Sep 21, 2018 at 1:35 PM Vasanthan Sivalingam 
> wrote:
>
>>
>> Hi Sp team,
>>
>> With the latest 4.3.0 release an HA deployment was done with kubernetes.
>> the deployment configurations has been done as [1] and [2]. It was noticed
>> that the active node is not communicating with the passive node with the
>> following logs.
>>
>> ...
>> [2018-09-21 11:54:32,435]  INFO {org.wso2.carbon.stream.
>> processor.core.internal.StreamProcessorService} - Setting SinksHandlers
>> of TestSiddhiApp to Active
>> [2018-09-21 11:54:32,436]  INFO {org.wso2.carbon.stream.
>> processor.core.internal.StreamProcessorService} - Setting
>> RecordTableHandlers of TestSiddhiApp to Active
>> [2018-09-21 11:54:32,436]  INFO {org.wso2.carbon.stream.
>> processor.core.internal.StreamProcessorService} - Siddhi App
>> TestSiddhiApp deployed successfully
>> [2018-09-21 11:54:32,446]  INFO 
>> {org.wso2.carbon.kernel.internal.CarbonStartupHandler}
>> - WSO2 Stream Processor started in 6.922 sec
>> [*2018-09-21 11:54:33,377] ERROR
>> {org.wso2.carbon.stream.processor.core.persistence.PersistenceManager} -
>> Error in getting a connection to the Passive node. null*
>> [2018-09-21 11:54:33,379] DEBUG {org.wso2.carbon.stream.
>> processor.core.ha.HACoordinationSourceHandler} - Active Node: Saving
>> state of Source Handler with Id TestSiddhiApp-1 with timestamp 0
>> [2018-09-21 11:54:33,395] ERROR {org.wso2.carbon.stream.
>> processor.core.persistence.PersistenceManager} - Error in getting the
>> TCP connection to the passive node. Hence not sending the control message
>> to the passive node
>> [2018-09-21 11:55:31,531]  INFO {org.wso2.carbon.stream.
>> processor.core.persistence.PersistenceManager} - siddhi Apps are
>> persisted successfully.
>> ...
>>
>> The deployment config was done as below,
>>
>> deployment.config:
>>   type: ha
>>   eventSyncServer:
>> host: localhost
>> port: 9893
>> advertisedHost: sp-ha-node-1
>> advertisedPort: 9893
>> bossThreads: 10
>> workerThreads: 10
>>   eventSyncClientPool:
>> maxActive: 10
>> maxTotal: 10
>> maxIdle: 10
>> maxWait: 6
>> minEvictableIdleTimeMillis: 12
>>
>> Attached the log file.
>> Can you please suggest a method to make this communication work between
>> active node and the passive node.
>>
>> [1] https://github.com/sameerawickramasekara/product-
>> sp/blob/master/modules/integration/tests-kubernetes-integration/src/test/
>> resources/artifacts/docker-files/deployment-ha-node-1.yaml
>> [2] https://github.com/sameerawickramasekara/product-
>> sp/blob/master/modules/integration/tests-kubernetes-integration/src/test/
>> resources/artifacts/docker-files/deployment-ha-node-2.yaml
>>
>> Thanks,
>> Vasanth
>>
>
>
> --
> Senior Software Engineer
> WSO2 Inc.; http://wso2.com
> 
> lean.enterprise.middleware
>
> mobile: *+94728671315*
>
>


-- 
*V. Mohanadarshan*
*Technical Lead,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Siddhi][SDK] Update dependency versions

[Mohanadarshan Vivekanandalingam]

On Wed, Jul 4, 2018 at 11:58 PM, Raveen Rathnayake 
wrote:

> Hi Mohan,
>
> Thank you for merging the PR. Could you please upload the created zip in
> [1] to [2] and release the SDK?
>
> [1] https://wso2.org/jenkins/job/products/job/siddhi-sdk/
> lastSuccessfulBuild/artifact/target/checkout/modules/
> siddhi-launcher/target/siddhi-sdk-1.0.3.zip
> [2] https://github.com/wso2/siddhi-sdk/releases/tag/v1.0.3
>
>
It is done..

Thanks,
Mohan


> Thank you,
> Raveen.
>
>
> *Raveen Savinda RathnayakeFinal Year Undergraduate, Informatics Institute
> of Technology*
> *+94 7711 44549 | raveen@gmail.com
>  | Blog: blog.raveen.me <http://blog.raveen.me/>*
> *www.raveen.me* <http://www.raveen.me/>
> <https://lk.linkedin.com/in/raveensr>
>
>
> On Wed, Jul 4, 2018 at 11:39 PM Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> Thanks Raveen for the PR.. Merged and triggered a release build.
>>
>>
>>
>> On Wed, Jul 4, 2018 at 11:09 PM, Raveen Rathnayake 
>> wrote:
>>
>>> Hi all,
>>>
>>> Please review and merge [1]. This PR updates the dependencies of the
>>> Siddhi SDK. After merging this PR please trigger a release build of SIddhi
>>> SDK 1.0.3.
>>>
>>> [1] https://github.com/wso2/siddhi-sdk/pull/13
>>>
>>> Thank you.
>>> Raveen.
>>>
>>> *Raveen Savinda Rathnayake*
>>> *Final Year Undergraduate, Informatics Institute of Technology*
>>> *+94 7711 44549 | raveen@gmail.com
>>>  | Blog: blog.raveen.me <http://blog.raveen.me/>*
>>> *www.raveen.me* <http://www.raveen.me/>
>>> <https://lk.linkedin.com/in/raveensr>
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Technical Lead,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673
>>
>


-- 
*V. Mohanadarshan*
*Technical Lead,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Siddhi][SDK] Update dependency versions

[Mohanadarshan Vivekanandalingam]

Thanks Raveen for the PR.. Merged and triggered a release build.



On Wed, Jul 4, 2018 at 11:09 PM, Raveen Rathnayake 
wrote:

> Hi all,
>
> Please review and merge [1]. This PR updates the dependencies of the
> Siddhi SDK. After merging this PR please trigger a release build of SIddhi
> SDK 1.0.3.
>
> [1] https://github.com/wso2/siddhi-sdk/pull/13
>
> Thank you.
> Raveen.
>
> *Raveen Savinda Rathnayake*
> *Final Year Undergraduate, Informatics Institute of Technology*
> *+94 7711 44549 | raveen@gmail.com
>  | Blog: blog.raveen.me *
> *www.raveen.me* 
> 
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Technical Lead,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [EI]EI-6.1.1 Event Sink support for tenants

[Mohanadarshan Vivekanandalingam]

On Thu, Mar 29, 2018 at 3:54 PM, Sajith Abeywardhana 
wrote:

> Hi Mohan,
>
>
>
> Hi Devs,
>>>
>>> How can I call the tenant specific wso2event receiver endpoint in the
>>> DAS-3.1.0 from the EI event sink?
>>>
>>> I can call the HTTP event receiver endpoint in the DAS like this[1] from
>>> the EI if the tenant is abc.com
>>>
>>> I need to do the same via the event sink by using wso2event receiver in
>>> DAS side. Is this achievable?
>>>
>>
>> If you are using super tenant credentials to publish events to WSO2Event
>> receiver then events goes to tenant space in DAS.
>>
>
> Thanks. It works as expected. I guess you means "tenant admin credentials"
> rather than "super tenant credentials" in here.
>

Yes, sorry about the confusion.

>
>
>> IMO, if possible it would be good to process events in super-tenant space
>> and use some unique ID (in the event) to segregate the data in tenant
>> specific manner. Check [1] for reference.
>>
>
> If I go with different data stores for different tenant than having tenant
> id in the each stream will there be any issues when it comes to multi
> tenancy?
>

OK, if you want to use different data-store for each tenant then my
solution would not be ideal.

>
>
>
>>
>> [1] https://github.com/wso2/analytics-is/blob/master/feature
>> s/org.wso2.analytics.is.feature/src/main/capp/realtime
>> /AuthenticationAnalyticsExecutionPlan/IsAnalytics-ExecutionP
>> lan-AuthenticationData.siddhiql#L61
>>
>> Thanks,
>> Mohan
>>
>>
>>
>>>
>>>
>>>
>>> *[1]http://:/endpoints/t/abc.com/temp-receiver
>>>  *
>>> Thanks,
>>> Sajith.
>>>
>>>
>>
>>
> In the DAS event publishers, how can I append the current tenant id or
> tenant domain as a header parameter dynamically when I call the external
> API. I know under "Dynamic Adapter Properties" I can hard cored[1] the
> tenant domain or id but I need to add this as a dynamic header value so
> that I can deploy same car app for all tenants.
>

Yes, if attribute name is "tenantDomain" and available in event then you
can follow below approach to make it dynamic.

Content-Type:application/json,X-Tenant:{{tenantDomain}}

specify the attribute name with in {{...}} .

Thanks,
Mohan



>
> [1]
>
>
>
> Thanks,
> Sajith.
>



-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [EI]EI-6.1.1 Event Sink support for tenants

[Mohanadarshan Vivekanandalingam]

On Wed, Mar 28, 2018 at 9:15 PM, Sajith Abeywardhana 
wrote:

> Hi Devs,
>
> How can I call the tenant specific wso2event receiver endpoint in the
> DAS-3.1.0 from the EI event sink?
>
> I can call the HTTP event receiver endpoint in the DAS like this[1] from
> the EI if the tenant is abc.com
>
> I need to do the same via the event sink by using wso2event receiver in
> DAS side. Is this achievable?
>

If you are using super tenant credentials to publish events to WSO2Event
receiver then events goes to tenant space in DAS.

IMO, if possible it would be good to process events in super-tenant space
and use some unique ID (in the event) to segregate the data in tenant
specific manner. Check [1] for reference.

[1]
https://github.com/wso2/analytics-is/blob/master/features/org.wso2.analytics.is.feature/src/main/capp/realtime/AuthenticationAnalyticsExecutionPlan/IsAnalytics-ExecutionPlan-AuthenticationData.siddhiql#L61

Thanks,
Mohan



>
>
>
> *[1]http://:/endpoints/t/abc.com/temp-receiver
>  *
> Thanks,
> Sajith.
>
>


-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Siddhi] Handling XML namespaces in map:createFromXML extension

[Mohanadarshan Vivekanandalingam]

On Tue, Feb 27, 2018 at 1:43 AM, Mohanadarshan Vivekanandalingam <
mo...@wso2.com> wrote:

>
>
> On Sat, Feb 24, 2018 at 8:08 PM, Minudika Malshan <minud...@wso2.com>
> wrote:
>
>> Hi all,
>>
>> In Siddhi Map Extension, map:createFromXML will return a hashmap created
>> from the given XML payload.
>>
>> However, when this payload has a namespace, that namespace is propagated
>> to the child elements also. Therefore in such cases, in the generated hash
>> map will have the keys in the following format instead of having only the
>> element name.
>>
>> *{namespace}elementName*
>>
>> Therefore, when trying to retrieve values from that map, Instead of using
>> only the element name as the key, we have to provide the key in above
>> format.
>>
>> Eg :
>> We have to use,
>>
>> *map:get(map, '{namespace}key)*
>> instead of
>> *map:get(map, 'key')*
>>
>> In the documentation, this has not been mentioned. [1]
>>
>> Shall we add these info to the doc?
>> Or  Is it safe to change the implementation to drop the namespace and to
>> generate the map with element names as the keys?
>>
>
> When processing a XML element, we have to consider the namespace. If not,
> we will end up many issues. I am OK for using namespace with key. Let's
> document that.
> BTW, do we need to provide namespace inside curly brace ?
>
> Thanks,
> Mohan
>
>
>
>>
>> [1] https://docs.wso2.com/display/CEP420/Map+Extension
>>
>> Thanks and regards!
>> --
>> *Minudika Gammanpila*
>> Software Engineer - WSO2
>>
>> Email   :  minud...@wso2.com
>> Mobile :  +94715659887 <+94%2071%20565%209887>
>> Web :  http://wso2.com
>>
>> <http://wso2.com> <http://wso2.com/signature>
>>
>
>
>
> --
> *V. Mohanadarshan*
> *Technical Lead,*
> *Data Technologies Team,*
> *WSO2, Inc. http://wso2.com <http://wso2.com> *
> *lean.enterprise.middleware.*
>
> email: mo...@wso2.com
> phone:(+94) 771117673 <+94%2077%20111%207673>
>



-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Siddhi] Handling XML namespaces in map:createFromXML extension

[Mohanadarshan Vivekanandalingam]

On Sat, Feb 24, 2018 at 8:08 PM, Minudika Malshan  wrote:

> Hi all,
>
> In Siddhi Map Extension, map:createFromXML will return a hashmap created
> from the given XML payload.
>
> However, when this payload has a namespace, that namespace is propagated
> to the child elements also. Therefore in such cases, in the generated hash
> map will have the keys in the following format instead of having only the
> element name.
>
> *{namespace}elementName*
>
> Therefore, when trying to retrieve values from that map, Instead of using
> only the element name as the key, we have to provide the key in above
> format.
>
> Eg :
> We have to use,
>
> *map:get(map, '{namespace}key)*
> instead of
> *map:get(map, 'key')*
>
> In the documentation, this has not been mentioned. [1]
>
> Shall we add these info to the doc?
> Or  Is it safe to change the implementation to drop the namespace and to
> generate the map with element names as the keys?
>

When processing a XML element, we have to consider the namespace. If not,
we will end up many issues. I am OK for using namespace with key. Let's
document that.
BTW, do we need to provide namespace inside curly brace ?

Thanks,
Mohan



>
> [1] https://docs.wso2.com/display/CEP420/Map+Extension
>
> Thanks and regards!
> --
> *Minudika Gammanpila*
> Software Engineer - WSO2
>
> Email   :  minud...@wso2.com
> Mobile :  +94715659887 <+94%2071%20565%209887>
> Web :  http://wso2.com
>
>  
>



-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Error in visualizing an execution plan

[Mohanadarshan Vivekanandalingam]

Hi Pamoda,

I believe this will not affect the event processing cases and only happens
when viewing the execution plan. Can you please report a github issue for
this?

Thanks,
Mohan


On Thu, Feb 8, 2018 at 11:16 AM, Pamoda Wimalasiri  wrote:

> Hi,
>
> The following error occurred when visualizing an execution plan with a
> customized javascript function.
>
> [2018-02-08 11:11:53,907] ERROR {org.wso2.carbon.event.
> processor.ui.executionPlan.flow.ExecutionPlanFlow} -  Error in
> visualizing execution plan '/* Enter a unique ExecutionPlan */
> @Plan:name('RiskScoreCalculator-AllowedIpRange-ip2-realtime1')
>
> /* Enter a unique description for ExecutionPlan */
> @Plan:description('Detect logins outside the allowed ip range')
>
> define function ipToLong[JavaScript] return double {
> var octetsOfIp = data[0].split(".");
> var ipAddressAsLong = octetsOfIp[0]* 256 * 256 * 256
> + octetsOfIp[1]* 256 * 256
> + octetsOfIp[2] * 256
> + octetsOfIp[3] * 1;
> return ipAddressAsLong;
> };
>
> /* define streams/tables and write queries here ... */
>
> @Import('org.wso2.is.analytics.stream.ProcessedOverallAuthentication
> :1.0.0')
> define stream ProcessedOverallAuthentication (meta_tenantId int, contextId
> string, eventId string, eventType string, authenticationSuccess bool,
> username string, localUsername string, userStoreDomain string, tenantDomain
> string, remoteIp string, region string, inboundAuthType string,
> serviceProvider string, rememberMeEnabled bool, forceAuthEnabled bool,
> passiveAuthEnabled bool, rolesCommaSeparated string, authenticationStep
> string, identityProvider string, authStepSuccess bool, stepAuthenticator
> string, isFirstLogin bool, identityProviderType string, _timestamp long);
>
> @Export('org.wso2.is.analytics.stream.SuspiciousLoginAttempt:1.0.0')
> define stream SuspiciousLoginAttempt (meta_tenantId int, username string,
> userStoreDomain string, tenantDomain string, remoteIp string, region
> string, _timestamp long, message string);
>
> from ProcessedOverallAuthentication[(authStepSuccess == true) AND
> (eventType =='step') AND ipToLong(remoteIp) < ipToLong("123.56.7.8") OR
> ipToLong(remoteIp) > ipToLong("123.9.9.1")]
> select meta_tenantId, username, userStoreDomain, tenantDomain, remoteIp,
> region, _timestamp, "WARNING : IP is not in the allowed range" as message
> insert into SuspiciousLoginAttempt;
> ', null
> java.lang.NullPointerException
> at org.wso2.carbon.event.processor.ui.executionPlan.
> flow.ExtractJsonValueImpl.setTriggerJsonValue(
> ExtractJsonValueImpl.java:202)
> at org.wso2.carbon.event.processor.ui.executionPlan.
> flow.ExtractJsonValueImpl.setJsonValues(ExtractJsonValueImpl.java:123)
> at org.wso2.carbon.event.processor.ui.executionPlan.
> flow.ExecutionPlanFlow.getExecutionPlanFlow(ExecutionPlanFlow.java:37)
> at org.apache.jsp.eventprocessor.execution_005fplan_
> 005fdetails_jsp._jspService(execution_005fplan_005fdetails_jsp.java:207)
> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at org.apache.jasper.servlet.JspServletWrapper.service(
> JspServletWrapper.java:439)
> at org.apache.jasper.servlet.JspServlet.serviceJspFile(
> JspServlet.java:395)
> at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:339)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at org.wso2.carbon.ui.JspServlet.service(JspServlet.java:155)
> at org.wso2.carbon.ui.TilesJspServlet.service(TilesJspServlet.java:80)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at org.eclipse.equinox.http.helper.ContextPathServletAdaptor.service(
> ContextPathServletAdaptor.java:37)
> at org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(
> ServletRegistration.java:61)
> at org.eclipse.equinox.http.servlet.internal.ProxyServlet.
> processAlias(ProxyServlet.java:128)
> at org.eclipse.equinox.http.servlet.internal.ProxyServlet.
> service(ProxyServlet.java:68)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
> at org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.
> service(DelegationServlet.java:68)
> at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(
> ApplicationFilterChain.java:303)
> at org.apache.catalina.core.ApplicationFilterChain.doFilter(
> ApplicationFilterChain.java:208)
> at org.apache.catalina.core.ApplicationDispatcher.invoke(
> ApplicationDispatcher.java:743)
> at org.apache.catalina.core.ApplicationDispatcher.doInclude(
> ApplicationDispatcher.java:603)
> at org.apache.catalina.core.ApplicationDispatcher.include(
> ApplicationDispatcher.java:542)
> at org.eclipse.equinox.http.servlet.internal.RequestDispatcherAdaptor.
> include(RequestDispatcherAdaptor.java:37)
> at org.eclipse.equinox.http.helper.ContextPathServletAdaptor$
> RequestDispatcherAdaptor.include(ContextPathServletAdaptor.java:369)
> at org.apache.jasper.runtime.JspRuntimeLibrary.include(
> 

Re: [Dev] Docs for how to create Siddhi Extensions using Maven Archetypes

[Mohanadarshan Vivekanandalingam]

On Thu, Jan 11, 2018 at 12:15 PM, Mohanadarshan Vivekanandalingam <
mo...@wso2.com> wrote:

>
>
> On Thu, Jan 11, 2018 at 12:14 PM, Sriskandarajah Suhothayan <s...@wso2.com
> > wrote:
>
>> @mohan
>> Shall we get a person to create sample extensions and validate this
>> against SP-4.0
>> and then release these archetypes?
>>
>
>
>
@Nisala, can you please take this ?

Thanks.
Mohan


>
>
>>
>> Regards
>> Suho
>>
>> On Thu, Jan 11, 2018 at 10:06 AM, Kalaiyarasi Ganeshalingam <
>> kalaiyar...@wso2.com> wrote:
>>
>>> Thanks.
>>>
>>> Kalaiyarasi Ganeshalingam
>>> Associate Software Engineer| WSO2
>>> WSO2 Inc : http://wso2.org
>>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
>>> Tel:+94 076 6792895 <076%20679%202895>
>>> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
>>> Blogs : https://kalaiyarasig.blogspot.com/ <http://kalai4.blogspot.com/>
>>>
>>> On Thu, Jan 11, 2018 at 10:04 AM, Mohanadarshan Vivekanandalingam <
>>> mo...@wso2.com> wrote:
>>>
>>>>
>>>>
>>>> On Thu, Jan 11, 2018 at 9:58 AM, Kalaiyarasi Ganeshalingam <
>>>> kalaiyar...@wso2.com> wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> Please find the PR [1] for this.
>>>>>
>>>>> [1] https://github.com/wso2-extensions/siddhi-maven-acrchetype/pull/2
>>>>>
>>>>
>>>> merged. Thanks.
>>>>
>>>>
>>>>>
>>>>> Regards,
>>>>>
>>>>> Kalaiyarasi Ganeshalingam
>>>>> Associate Software Engineer| WSO2
>>>>> WSO2 Inc : http://wso2.org
>>>>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
>>>>> Tel:+94 076 6792895 <+94%2076%20679%202895>
>>>>> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
>>>>> Blogs : https://kalaiyarasig.blogspot.com/
>>>>> <http://kalai4.blogspot.com/>
>>>>>
>>>>> On Wed, Jan 10, 2018 at 6:25 PM, Kalaiyarasi Ganeshalingam <
>>>>> kalaiyar...@wso2.com> wrote:
>>>>>
>>>>>> Hi Mohanadarshan,
>>>>>>
>>>>>> Yeah, currently I am working on this. Once I have done this, I'll
>>>>>> update the thread.
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>> Kalaiyarasi Ganeshalingam
>>>>>> Associate Software Engineer| WSO2
>>>>>> WSO2 Inc : http://wso2.org
>>>>>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
>>>>>> Tel:+94 076 6792895 <+94%2076%20679%202895>
>>>>>> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
>>>>>> Blogs : https://kalaiyarasig.blogspot.com/
>>>>>> <http://kalai4.blogspot.com/>
>>>>>>
>>>>>> On Wed, Jan 10, 2018 at 6:17 PM, Mohanadarshan Vivekanandalingam <
>>>>>> mo...@wso2.com> wrote:
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Wed, Jan 10, 2018 at 6:17 PM, Mohanadarshan Vivekanandalingam <
>>>>>>> mo...@wso2.com> wrote:
>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, Jan 10, 2018 at 5:30 PM, Kalaiyarasi Ganeshalingam <
>>>>>>>> kalaiyar...@wso2.com> wrote:
>>>>>>>>
>>>>>>>>> Hi Suho,
>>>>>>>>>
>>>>>>>>> Please find the docs [1] for how to create Siddhi Extensions using
>>>>>>>>> Maven archetypes.
>>>>>>>>>
>>>>>>>>> [1] https://github.com/wso2-extensions/siddhi-maven-acrchety
>>>>>>>>> pe/blob/master/siddhi-extension-archetype/setup.txt
>>>>>>>>>
>>>>>>>>
>>>>>>>> @Kalaiyarasi, IMO above should come to our official documentation
>>>>>>>> as well. Again, better to add above information which is available in
>>>>>>>> setup.txt to the readme file rather having a separate file.
>>>>>&g

Re: [Dev] Docs for how to create Siddhi Extensions using Maven Archetypes

[Mohanadarshan Vivekanandalingam]

On Thu, Jan 11, 2018 at 12:14 PM, Sriskandarajah Suhothayan <s...@wso2.com>
wrote:

> @mohan
> Shall we get a person to create sample extensions and validate this
> against SP-4.0
> and then release these archetypes?
>

Sure, will get someone for this..

Thanks,
Mohan


>
> Regards
> Suho
>
> On Thu, Jan 11, 2018 at 10:06 AM, Kalaiyarasi Ganeshalingam <
> kalaiyar...@wso2.com> wrote:
>
>> Thanks.
>>
>> Kalaiyarasi Ganeshalingam
>> Associate Software Engineer| WSO2
>> WSO2 Inc : http://wso2.org
>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
>> Tel:+94 076 6792895 <076%20679%202895>
>> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
>> Blogs : https://kalaiyarasig.blogspot.com/ <http://kalai4.blogspot.com/>
>>
>> On Thu, Jan 11, 2018 at 10:04 AM, Mohanadarshan Vivekanandalingam <
>> mo...@wso2.com> wrote:
>>
>>>
>>>
>>> On Thu, Jan 11, 2018 at 9:58 AM, Kalaiyarasi Ganeshalingam <
>>> kalaiyar...@wso2.com> wrote:
>>>
>>>> Hi all,
>>>>
>>>> Please find the PR [1] for this.
>>>>
>>>> [1] https://github.com/wso2-extensions/siddhi-maven-acrchetype/pull/2
>>>>
>>>
>>> merged. Thanks.
>>>
>>>
>>>>
>>>> Regards,
>>>>
>>>> Kalaiyarasi Ganeshalingam
>>>> Associate Software Engineer| WSO2
>>>> WSO2 Inc : http://wso2.org
>>>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
>>>> Tel:+94 076 6792895 <+94%2076%20679%202895>
>>>> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
>>>> Blogs : https://kalaiyarasig.blogspot.com/
>>>> <http://kalai4.blogspot.com/>
>>>>
>>>> On Wed, Jan 10, 2018 at 6:25 PM, Kalaiyarasi Ganeshalingam <
>>>> kalaiyar...@wso2.com> wrote:
>>>>
>>>>> Hi Mohanadarshan,
>>>>>
>>>>> Yeah, currently I am working on this. Once I have done this, I'll
>>>>> update the thread.
>>>>>
>>>>> Regards,
>>>>>
>>>>> Kalaiyarasi Ganeshalingam
>>>>> Associate Software Engineer| WSO2
>>>>> WSO2 Inc : http://wso2.org
>>>>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
>>>>> Tel:+94 076 6792895 <+94%2076%20679%202895>
>>>>> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
>>>>> Blogs : https://kalaiyarasig.blogspot.com/
>>>>> <http://kalai4.blogspot.com/>
>>>>>
>>>>> On Wed, Jan 10, 2018 at 6:17 PM, Mohanadarshan Vivekanandalingam <
>>>>> mo...@wso2.com> wrote:
>>>>>
>>>>>>
>>>>>>
>>>>>> On Wed, Jan 10, 2018 at 6:17 PM, Mohanadarshan Vivekanandalingam <
>>>>>> mo...@wso2.com> wrote:
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Wed, Jan 10, 2018 at 5:30 PM, Kalaiyarasi Ganeshalingam <
>>>>>>> kalaiyar...@wso2.com> wrote:
>>>>>>>
>>>>>>>> Hi Suho,
>>>>>>>>
>>>>>>>> Please find the docs [1] for how to create Siddhi Extensions using
>>>>>>>> Maven archetypes.
>>>>>>>>
>>>>>>>> [1] https://github.com/wso2-extensions/siddhi-maven-acrchety
>>>>>>>> pe/blob/master/siddhi-extension-archetype/setup.txt
>>>>>>>>
>>>>>>>
>>>>>>> @Kalaiyarasi, IMO above should come to our official documentation as
>>>>>>> well. Again, better to add above information which is available in
>>>>>>> setup.txt to the readme file rather having a separate file.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Mohan
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>>
>>>>>>>> Kalaiyarasi Ganeshalingam
>>>>>>>> Associate Software Engineer| WSO2
>>>>>>>> WSO2 Inc : http://wso2.org
>>>>>>>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>

Re: [Dev] Docs for how to create Siddhi Extensions using Maven Archetypes

[Mohanadarshan Vivekanandalingam]

On Thu, Jan 11, 2018 at 9:58 AM, Kalaiyarasi Ganeshalingam <
kalaiyar...@wso2.com> wrote:

> Hi all,
>
> Please find the PR [1] for this.
>
> [1] https://github.com/wso2-extensions/siddhi-maven-acrchetype/pull/2
>

merged. Thanks.


>
> Regards,
>
> Kalaiyarasi Ganeshalingam
> Associate Software Engineer| WSO2
> WSO2 Inc : http://wso2.org
> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
> Tel:+94 076 6792895 <+94%2076%20679%202895>
> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
> Blogs : https://kalaiyarasig.blogspot.com/ <http://kalai4.blogspot.com/>
>
> On Wed, Jan 10, 2018 at 6:25 PM, Kalaiyarasi Ganeshalingam <
> kalaiyar...@wso2.com> wrote:
>
>> Hi Mohanadarshan,
>>
>> Yeah, currently I am working on this. Once I have done this, I'll update
>> the thread.
>>
>> Regards,
>>
>> Kalaiyarasi Ganeshalingam
>> Associate Software Engineer| WSO2
>> WSO2 Inc : http://wso2.org
>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
>> Tel:+94 076 6792895 <+94%2076%20679%202895>
>> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
>> Blogs : https://kalaiyarasig.blogspot.com/ <http://kalai4.blogspot.com/>
>>
>> On Wed, Jan 10, 2018 at 6:17 PM, Mohanadarshan Vivekanandalingam <
>> mo...@wso2.com> wrote:
>>
>>>
>>>
>>> On Wed, Jan 10, 2018 at 6:17 PM, Mohanadarshan Vivekanandalingam <
>>> mo...@wso2.com> wrote:
>>>
>>>>
>>>>
>>>> On Wed, Jan 10, 2018 at 5:30 PM, Kalaiyarasi Ganeshalingam <
>>>> kalaiyar...@wso2.com> wrote:
>>>>
>>>>> Hi Suho,
>>>>>
>>>>> Please find the docs [1] for how to create Siddhi Extensions using
>>>>> Maven archetypes.
>>>>>
>>>>> [1] https://github.com/wso2-extensions/siddhi-maven-acrchety
>>>>> pe/blob/master/siddhi-extension-archetype/setup.txt
>>>>>
>>>>
>>>> @Kalaiyarasi, IMO above should come to our official documentation as
>>>> well. Again, better to add above information which is available in
>>>> setup.txt to the readme file rather having a separate file.
>>>>
>>>> Thanks,
>>>> Mohan
>>>>
>>>>
>>>>>
>>>>> Regards,
>>>>>
>>>>> Kalaiyarasi Ganeshalingam
>>>>> Associate Software Engineer| WSO2
>>>>> WSO2 Inc : http://wso2.org
>>>>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
>>>>> Tel:+94 076 6792895 <+94%2076%20679%202895>
>>>>> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
>>>>> Blogs : https://kalaiyarasig.blogspot.com/
>>>>> <http://kalai4.blogspot.com/>
>>>>>
>>>>> On Wed, Jan 10, 2018 at 5:18 PM, Sriskandarajah Suhothayan <
>>>>> s...@wso2.com> wrote:
>>>>>
>>>>>> Hi Kalaiyarasi
>>>>>>
>>>>>> Where can I find $Subject?
>>>>>>
>>>>>> Regards
>>>>>> Suho
>>>>>>
>>>>>> --
>>>>>>
>>>>>> *S. Suhothayan*
>>>>>> Director
>>>>>> *WSO2 Inc. *
>>>>>> http://wso2.com  <http://wso2.com/>
>>>>>>
>>>>>>
>>>>>> *cell: (+94) 779 756 757 <+94%2077%20975%206757> | blog:
>>>>>> http://suhothayan.blogspot.com/ <http://suhothayan.blogspot.com/>twitter:
>>>>>> http://twitter.com/suhothayan <http://twitter.com/suhothayan> | 
>>>>>> linked-in:
>>>>>> http://lk.linkedin.com/in/suhothayan 
>>>>>> <http://lk.linkedin.com/in/suhothayan>*
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> *V. Mohanadarshan*
>>>> *Technical Lead,*
>>>> *Data Technologies Team,*
>>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>>> *lean.enterprise.middleware.*
>>>>
>>>> email: mo...@wso2.com
>>>> phone:(+94) 771117673 <+94%2077%20111%207673>
>>>>
>>>
>>>
>>>
>>> --
>>> *V. Mohanadarshan*
>>> *Technical Lead,*
>>> *Data Technologies Team,*
>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>> *lean.enterprise.middleware.*
>>>
>>> email: mo...@wso2.com
>>> phone:(+94) 771117673 <+94%2077%20111%207673>
>>>
>>
>>
>


-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Docs for how to create Siddhi Extensions using Maven Archetypes

[Mohanadarshan Vivekanandalingam]

On Wed, Jan 10, 2018 at 5:30 PM, Kalaiyarasi Ganeshalingam <
kalaiyar...@wso2.com> wrote:

> Hi Suho,
>
> Please find the docs [1] for how to create Siddhi Extensions using Maven
> archetypes.
>
> [1] https://github.com/wso2-extensions/siddhi-maven-
> acrchetype/blob/master/siddhi-extension-archetype/setup.txt
>

@Kalaiyarasi, IMO above should come to our official documentation as well.
Again, better to add above information which is available in setup.txt to
the readme file rather having a separate file.

Thanks,
Mohan


>
> Regards,
>
> Kalaiyarasi Ganeshalingam
> Associate Software Engineer| WSO2
> WSO2 Inc : http://wso2.org
> 
> Tel:+94 076 6792895 <+94%2076%20679%202895>
> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
> Blogs : https://kalaiyarasig.blogspot.com/ 
>
> On Wed, Jan 10, 2018 at 5:18 PM, Sriskandarajah Suhothayan 
> wrote:
>
>> Hi Kalaiyarasi
>>
>> Where can I find $Subject?
>>
>> Regards
>> Suho
>>
>> --
>>
>> *S. Suhothayan*
>> Director
>> *WSO2 Inc. *
>> http://wso2.com  
>>
>>
>> *cell: (+94) 779 756 757 <+94%2077%20975%206757> | blog:
>> http://suhothayan.blogspot.com/ twitter:
>> http://twitter.com/suhothayan  | linked-in:
>> http://lk.linkedin.com/in/suhothayan *
>>
>
>


-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Docs for how to create Siddhi Extensions using Maven Archetypes

[Mohanadarshan Vivekanandalingam]

On Wed, Jan 10, 2018 at 6:17 PM, Mohanadarshan Vivekanandalingam <
mo...@wso2.com> wrote:

>
>
> On Wed, Jan 10, 2018 at 5:30 PM, Kalaiyarasi Ganeshalingam <
> kalaiyar...@wso2.com> wrote:
>
>> Hi Suho,
>>
>> Please find the docs [1] for how to create Siddhi Extensions using Maven
>> archetypes.
>>
>> [1] https://github.com/wso2-extensions/siddhi-maven-acrchety
>> pe/blob/master/siddhi-extension-archetype/setup.txt
>>
>
> @Kalaiyarasi, IMO above should come to our official documentation as well.
> Again, better to add above information which is available in setup.txt to
> the readme file rather having a separate file.
>
> Thanks,
> Mohan
>
>
>>
>> Regards,
>>
>> Kalaiyarasi Ganeshalingam
>> Associate Software Engineer| WSO2
>> WSO2 Inc : http://wso2.org
>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.org=D=1=AFQjCNE_eTDfyl2ibPcq0hcXvRDNVuQmMg>
>> Tel:+94 076 6792895 <+94%2076%20679%202895>
>> LinkedIn :www.linkedin.com/in/kalaiyarasiganeshalingam
>> Blogs : https://kalaiyarasig.blogspot.com/ <http://kalai4.blogspot.com/>
>>
>> On Wed, Jan 10, 2018 at 5:18 PM, Sriskandarajah Suhothayan <s...@wso2.com
>> > wrote:
>>
>>> Hi Kalaiyarasi
>>>
>>> Where can I find $Subject?
>>>
>>> Regards
>>> Suho
>>>
>>> --
>>>
>>> *S. Suhothayan*
>>> Director
>>> *WSO2 Inc. *
>>> http://wso2.com  <http://wso2.com/>
>>>
>>>
>>> *cell: (+94) 779 756 757 <+94%2077%20975%206757> | blog:
>>> http://suhothayan.blogspot.com/ <http://suhothayan.blogspot.com/>twitter:
>>> http://twitter.com/suhothayan <http://twitter.com/suhothayan> | linked-in:
>>> http://lk.linkedin.com/in/suhothayan <http://lk.linkedin.com/in/suhothayan>*
>>>
>>
>>
>
>
> --
> *V. Mohanadarshan*
> *Technical Lead,*
> *Data Technologies Team,*
> *WSO2, Inc. http://wso2.com <http://wso2.com> *
> *lean.enterprise.middleware.*
>
> email: mo...@wso2.com
> phone:(+94) 771117673 <+94%2077%20111%207673>
>



-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Avoiding Carbon Metrics releases every time the Databridge component is released.

[Mohanadarshan Vivekanandalingam]

Hi All,

Above is fixed now..

Thanks,
Mohan


On Thu, Nov 2, 2017 at 1:42 PM, Isuru Perera <isu...@wso2.com> wrote:

> Thank you!
>
> On Thu, Nov 2, 2017 at 12:32 PM, Sajith Perera <saji...@wso2.com> wrote:
>
>> Noted!, Please find the relevant GitHub issue :
>> https://github.com/wso2/carbon-analytics-common/issues/397
>>
>> On Thu, Nov 2, 2017 at 12:12 PM, Mohanadarshan Vivekanandalingam <
>> mo...@wso2.com> wrote:
>>
>>>
>>>
>>> On Thu, Nov 2, 2017 at 12:08 PM, Isuru Perera <isu...@wso2.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> We need to avoid releasing Carbon Metrics every time the Data bridge
>>>> related components are released. It should be possible if Carbon Metrics
>>>> can depend on a Data Publisher feature.
>>>>
>>>> Shall we fix this soon?
>>>>
>>>
>>> Yes, we have to fix this. Data publisher features are implemented but
>>> faced some issues when embedding the features with carbon-metrics. We'll
>>> take this for our next release and fix it.
>>>
>>> @SajithD, let's create a github issue for this.
>>>
>>> Thanks,
>>> Mohan
>>>
>>>
>>>> Thank you.
>>>>
>>>> --
>>>> Isuru Perera
>>>> Technical Lead | WSO2, Inc. | http://wso2.com/
>>>> Lean . Enterprise . Middleware
>>>>
>>>> about.me/chrishantha
>>>> Contact: +IsuruPereraWSO2
>>>> <https://www.google.com/+IsuruPereraWSO2/about>
>>>>
>>>
>>>
>>>
>>> --
>>> *V. Mohanadarshan*
>>> *Technical Lead,*
>>> *Data Technologies Team,*
>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>> *lean.enterprise.middleware.*
>>>
>>> email: mo...@wso2.com
>>> phone:(+94) 771117673 <+94%2077%20111%207673>
>>>
>>
>>
>>
>> --
>> <http://wso2.com/signature>
>> Sajith Dimal
>> Software Engineer
>> Email : saji...@wso2.com
>> Mobile : +94783101496
>> WSO2 Inc. | http://wso2.com
>> lean.enterprise.middleware
>>
>
>
>
> --
> Isuru Perera
> Technical Lead | WSO2, Inc. | http://wso2.com/
> Lean . Enterprise . Middleware
>
> about.me/chrishantha
> Contact: +IsuruPereraWSO2 <https://www.google.com/+IsuruPereraWSO2/about>
>



-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Avoiding Carbon Metrics releases every time the Databridge component is released.

[Mohanadarshan Vivekanandalingam]

On Thu, Nov 2, 2017 at 12:08 PM, Isuru Perera  wrote:

> Hi,
>
> We need to avoid releasing Carbon Metrics every time the Data bridge
> related components are released. It should be possible if Carbon Metrics
> can depend on a Data Publisher feature.
>
> Shall we fix this soon?
>

Yes, we have to fix this. Data publisher features are implemented but faced
some issues when embedding the features with carbon-metrics. We'll take
this for our next release and fix it.

@SajithD, let's create a github issue for this.

Thanks,
Mohan


> Thank you.
>
> --
> Isuru Perera
> Technical Lead | WSO2, Inc. | http://wso2.com/
> Lean . Enterprise . Middleware
>
> about.me/chrishantha
> Contact: +IsuruPereraWSO2 
>



-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Data Types used in DAS are inconsistent

[Mohanadarshan Vivekanandalingam]

On Fri, Oct 20, 2017 at 2:32 PM, Nirodha Gallage  wrote:

> Hi,
>
> In DAS, in stream definitions, Spark scripts etc we use the term 'INT' for
> integers. But in Event store definitions we have to use the term 'INTEGER'
> for integers. This is error prone, and actually I came across this issue
> and had to spend over a day to figure out what was the issue. Even the
> error was not descriptive and was giving only a NPE.
>
> Isn't this a bug that should be fixed?
>

@Nirodha, please create a public jira for this. We'll check for the
possibility to fix this without affecting existing scripts.

Thanks,
Mohan


>
> Thanks,
> Nirodha
>
> --
>
> *Nirodha Gallage*
> Associate Technical Lead
> WSO2 Inc.: http://wso2.com/
> Mobile: +94716429078 <+94%2071%20642%209078>
>



-- 
*V. Mohanadarshan*
*Technical Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [DAS] Reading data from stream inside the siddhi

[Mohanadarshan Vivekanandalingam]

Hi Sajith,

You can achieve above with Analytics Event table. Please refer below
resources as reference.

https://github.com/wso2/analytics-apim/blob/master/
features/org.wso2.analytics.apim.feature/src/main/
resources/template-manager/executionplans/APIMAnalytics-
AbnormalAccessTokenRefresh.siddhiql

https://docs.wso2.com/display/DAS310/Understanding+Event+
Streams+and+Event+Tables#UnderstandingEventStreamsandEventTables-
AnalyticseventtableAnalyticseventtable

Thanks,
Mohan


On Wed, Aug 16, 2017 at 12:45 PM, Sajith Abeywardhana 
wrote:

> Hi,
>
> How to read the data from the already stored stream(com.xxx.sensor.
> notification.configuration.stream) when the below siddhi query get
> executed. Query is getting executed when data is arriving to the 
> *com.xxx.sensor.event.data.stream
> *stream.
>
>
> /* Enter a unique ExecutionPlan */
> @Plan:name('light-sensor-notification-execution-plan')
>
> @Plan:trace('true')
>
> @Import('com.xxx.sensor.event.data.stream:1.0.0')
> define stream input_sensor_data_event_stream (BS_ID string, PIR int, SOUND
> int, LIGHT int, A_T double,
> EVENT_TIME long, FROM_TIME long, TO_TIME long, DAY_OF_WEEK string,
> TIME_AS_24_HOUR string);
>
> @Import('com.xxx.sensor.notification.configuration.stream:1.0.0')
> define stream notification_configuration_stream (sensorType string,
> deviceKey string, fromTime string, toTime string, datOfWeek string,
> detectionStatus string, slot int, reArmTime int);
>
> @Export('com.mitrai.notification.sending.stream:1.0.0')
> define stream output_sensor_data_events_stream (DEVICE_KEY string,
> SENSOR_TYPE string, SENSOR_VALUE int, DAY_OF_WEEK string,
> TIME_AS_24_HOUR string, FROM_TIME string, TO_TIME string, SLOT int,
> RE_ARM_TIME int, DETECTION_STATUS string);
>
>
> from input_sensor_data_event_stream#window.length(1) as evt unidirectional
> join notification_configuration_stream#window.time(5 min) as conf
> on evt.BS_ID == conf.deviceKey
> select BS_ID as DEVICE_KEY, "light" as SENSOR_TYPE, LIGHT as SENSOR_VALUE,
> DAY_OF_WEEK as DAY_OF_WEEK,
> TIME_AS_24_HOUR as TIME_AS_24_HOUR, "0600" as FROM_TIME, "0830" as
> TO_TIME, 1 as SLOT,
> 20 as RE_ARM_TIME, "temp" as DETECTION_STATUS
> insert into output_sensor_data_events_stream;
>
> Thanks,
> Sajith.
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Is quartz-2.3.0.wso2v1 orbit bundle created properly ?

[Mohanadarshan Vivekanandalingam]

On Fri, Jul 21, 2017 at 12:39 PM, Pubudu Fernando <pubu...@wso2.com> wrote:

> Hi Mohan,
>
> No, this was not tested in a product distribution. Really sorry about
> that. Will send a PR to fix this as you suggested.
>

No worries Pubudu.. Let's do a orbit release and fix the
carbon-transports..

Thanks,
Mohan


>
> Thanks,
> Pubudu
>
> On Thu, Jul 20, 2017 at 10:19 PM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> Hi Team,
>>
>> We have faced below issue after upgrading the carbon-transports version
>> for product-sp milestone release.
>>
>> Cannot complete the install because one or more required items could not
>> be found.
>>  Software being installed: WSO2 MSF4J Feature 2.3.0.m2
>> (org.wso2.msf4j.feature.group 2.3.0.m2)
>>  Missing requirement: quartz 2.3.0.wso2v1 (quartz 2.3.0.wso2v1) requires
>> 'package commonj.work 0.0.0' but it could not be found
>>  Cannot satisfy dependency:
>>   From: WSO2 Carbon Transport Connector Framework Feature 4.4.17
>> (org.wso2.carbon.connector.framework.feature.group 4.4.17)
>>   To: quartz [2.3.0.wso2v1]
>>  Cannot satisfy dependency:
>>   From: WSO2 MSF4J Feature 2.3.0.m2 (org.wso2.msf4j.feature.group
>> 2.3.0.m2)
>>   To: org.wso2.carbon.connector.framework.feature.group [4.3.0.m2,5.0.0)
>>
>> When we analyzed the related orbit bundle, I could see there are some
>> external dependencies are defined in the Import-Package section of the
>> manifest as shown below.
>>
>> Import-Package: com.mchange.v2.c3p0,com.zaxxer.hikari;version="[2.3,3)
>>  ",commonj.work;resolution:=optional,javax.ejb;resolution:=optional,ja
>>  vax.jms;resolution:=optional,javax.mail;resolution:=optional,javax.ma
>>  il.internet;resolution:=optional,javax.management,javax.management.op
>>  enmbean,javax.naming,javax.servlet;resolution:=optional,javax.servlet
>>  .http;resolution:=optional,javax.sql;resolution:=optional,javax.trans
>>  action;resolution:=optional,javax.xml.bind,javax.xml.namespace,javax.
>>  xml.parsers,javax.xml.xpath,oracle.sql;resolution:=optional,org.jboss
>>  .logging;resolution:=optional,org.jboss.naming;resolution:=optional,o
>>  rg.jboss.system;resolution:=optional,org.quartz,org.quartz.impl.match
>>  ers,org.quartz.impl.triggers,org.quartz.jobs;resolution:=optional,org
>>  .quartz.spi,org.slf4j;version="[1.7,2)",org.terracotta.toolkit;resolu
>>  tion:=optional,org.terracotta.toolkit.atomic;resolution:=optional,org
>>  .terracotta.toolkit.builder;resolution:=optional,org.terracotta.toolk
>>  it.cluster;resolution:=optional,org.terracotta.toolkit.collections;re
>>  solution:=optional,org.terracotta.toolkit.concurrent.locks;resolution
>>  :=optional,org.terracotta.toolkit.config;resolution:=optional,org.ter
>>  racotta.toolkit.internal;resolution:=optional,org.terracotta.toolkit.
>>  internal.concurrent.locks;resolution:=optional,org.terracotta.toolkit
>>  .rejoin;resolution:=optional,org.terracotta.toolkit.search;resolution
>>  :=optional,org.terracotta.toolkit.search.attribute;resolution:=option
>>  al,org.terracotta.toolkit.store;resolution:=optional,org.w3c.dom,org.
>>  xml.sax,weblogic.jdbc.jts;resolution:=optional,weblogic.jdbc.vendor.o
>>  racle;resolution:=optional
>>
>> IMO, above is not correct, then we'll ended up adding more and more
>> external dependencies to use this orbit bundle. @Pubudu, Have we tested
>> above orbit bundle in any product distribution before doing the release ?
>>
>> I have checked the pom file of existing orbit release of quartz
>> (2.1.1.wso2v1) and it has below entries. IMO, below should be the correct
>> way to handle this..
>>
>>   
>> 
>> org.apache.felix
>> maven-bundle-plugin
>> 1.4.0
>> true
>> 
>> 
>> ${pom.art
>> ifactId}
>> ${pom.artifactId}
>> 
>> org.quartz.*;version="2.1.1"
>> 
>> **
>> ***
>> 
>> 
>> 
>> 
>>
>> @Thusitha, Nira and team, appreciate your input on this ?
>>
>> Thanks,
>> Mohan
>>
>> --
>> *V. Mohanadarshan*
>> *Associate Tech Lead,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo.

[Dev] Is quartz-2.3.0.wso2v1 orbit bundle created properly ?

[Mohanadarshan Vivekanandalingam]

Hi Team,

We have faced below issue after upgrading the carbon-transports version for
product-sp milestone release.

Cannot complete the install because one or more required items could not be
found.
 Software being installed: WSO2 MSF4J Feature 2.3.0.m2
(org.wso2.msf4j.feature.group 2.3.0.m2)
 Missing requirement: quartz 2.3.0.wso2v1 (quartz 2.3.0.wso2v1) requires
'package commonj.work 0.0.0' but it could not be found
 Cannot satisfy dependency:
  From: WSO2 Carbon Transport Connector Framework Feature 4.4.17
(org.wso2.carbon.connector.framework.feature.group 4.4.17)
  To: quartz [2.3.0.wso2v1]
 Cannot satisfy dependency:
  From: WSO2 MSF4J Feature 2.3.0.m2 (org.wso2.msf4j.feature.group 2.3.0.m2)
  To: org.wso2.carbon.connector.framework.feature.group [4.3.0.m2,5.0.0)

When we analyzed the related orbit bundle, I could see there are some
external dependencies are defined in the Import-Package section of the
manifest as shown below.

Import-Package: com.mchange.v2.c3p0,com.zaxxer.hikari;version="[2.3,3)
 ",commonj.work;resolution:=optional,javax.ejb;resolution:=optional,ja
 vax.jms;resolution:=optional,javax.mail;resolution:=optional,javax.ma
 il.internet;resolution:=optional,javax.management,javax.management.op
 enmbean,javax.naming,javax.servlet;resolution:=optional,javax.servlet
 .http;resolution:=optional,javax.sql;resolution:=optional,javax.trans
 action;resolution:=optional,javax.xml.bind,javax.xml.namespace,javax.
 xml.parsers,javax.xml.xpath,oracle.sql;resolution:=optional,org.jboss
 .logging;resolution:=optional,org.jboss.naming;resolution:=optional,o
 rg.jboss.system;resolution:=optional,org.quartz,org.quartz.impl.match
 ers,org.quartz.impl.triggers,org.quartz.jobs;resolution:=optional,org
 .quartz.spi,org.slf4j;version="[1.7,2)",org.terracotta.toolkit;resolu
 tion:=optional,org.terracotta.toolkit.atomic;resolution:=optional,org
 .terracotta.toolkit.builder;resolution:=optional,org.terracotta.toolk
 it.cluster;resolution:=optional,org.terracotta.toolkit.collections;re
 solution:=optional,org.terracotta.toolkit.concurrent.locks;resolution
 :=optional,org.terracotta.toolkit.config;resolution:=optional,org.ter
 racotta.toolkit.internal;resolution:=optional,org.terracotta.toolkit.
 internal.concurrent.locks;resolution:=optional,org.terracotta.toolkit
 .rejoin;resolution:=optional,org.terracotta.toolkit.search;resolution
 :=optional,org.terracotta.toolkit.search.attribute;resolution:=option
 al,org.terracotta.toolkit.store;resolution:=optional,org.w3c.dom,org.
 xml.sax,weblogic.jdbc.jts;resolution:=optional,weblogic.jdbc.vendor.o
 racle;resolution:=optional

IMO, above is not correct, then we'll ended up adding more and more
external dependencies to use this orbit bundle. @Pubudu, Have we tested
above orbit bundle in any product distribution before doing the release ?

I have checked the pom file of existing orbit release of quartz
(2.1.1.wso2v1) and it has below entries. IMO, below should be the correct
way to handle this..

  

org.apache.felix
maven-bundle-plugin
1.4.0
true



${pom.artifactId}
${pom.artifactId}

org.quartz.*;version="2.1.1"

**
***





@Thusitha, Nira and team, appreciate your input on this ?

Thanks,
Mohan

-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [GSOC][DAS][DEV] Python Client on DAS 4.0

[Mohanadarshan Vivekanandalingam]

On Sat, Jul 15, 2017 at 9:24 PM, Madhawa Vidanapathirana <
madhawavidanapathir...@gmail.com> wrote:

> Hi,
>
> Where can I find the up to date REST endpoints for DAS 4.0?
>
> The endpoints I am aware so far are available at [1] but they seem to be
> not working (probably outdated).
>
> I tried sending a post request to Endpoint 1 in [1] (
> http://localhost:9090/siddhi/artifact/deploy) with a Siddhi App as plain
> text request body but the response I got was "Problem accessing:
> /siddhi/artifact/deploy. Reason: Not Found". Postman was used for sending
> the request.
>
> [1] - https://docs.google.com/document/d/154ndex3OBoE0zNOLHatmMOvt2JHh9
> RJya2VdHlHOTl4/edit?usp=sharing
>

Above is outdated. Please refer [0] for latest Siddhi-App APIs. Please use
"admin:admin" as the credentials..

[0] https://docs.wso2.com/display/DAS400/apidocs/siddhiapps/

Thanks,
Mohan


>
> Kind Regards,
> Madhawa
>
>
>
> On Sat, Jul 8, 2017 at 12:47 PM, Sriskandarajah Suhothayan 
> wrote:
>
>> @Ramindu
>>
>> Do we have a doc that has different options that we can have for
>> simulation. If so please share.
>>
>> On Fri, Jul 7, 2017 at 11:18 PM Madhawa Vidanapathirana <
>> madhawavidanapathir...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> So far I've managed to implement the REST endpoints of Event Simulator
>>> mentioned at [1]. The code is available at repository [2].
>>>
>>> The objects passed to REST API has been mapped to Python Classes. All
>>> the fields mentioned in POSTMAN samples (attached) given by Ramindu has
>>> been added to the classes. Additionally, most of the POSTMAN samples has
>>> been implemented as tests in Python Code.
>>>
>>> Is their any technique I can use to identify the possible fields of any
>>> object that could be passed to REST API?
>>>
>>> [1] - https://docs.google.com/document/d/154ndex3OBoE0zNOLHatmMO
>>> vt2JHh9RJya2VdHlHOTl4/edit?usp=sharing
>>> [2] - https://github.com/madhawav/DASPythonClient
>>>
>>> Kind Regards,
>>> Madhawa
>>>
>>> --
>>> *Madhawa Vidanapathirana*
>>> Student
>>> Department of Computer Science and Engineering
>>> University of Moratuwa
>>> Sri Lanka
>>>
>>> Mobile: (+94) 716874425 <+94%2071%20687%204425>
>>> Email: madhawavidanapathir...@gmail.com
>>> Linked-In: https://lk.linkedin.com/in/madhawa-vidanapathirana-3430b94
>>>
>> --
>>
>> *S. Suhothayan*
>> Associate Director / Architect
>> *WSO2 Inc. *http://wso2.com
>> * *
>> lean . enterprise . middleware
>>
>>
>> *cell: (+94) 779 756 757 <+94%2077%20975%206757> | blog:
>> http://suhothayan.blogspot.com/ twitter:
>> http://twitter.com/suhothayan  | linked-in:
>> http://lk.linkedin.com/in/suhothayan *
>>
>
>
>
> --
> *Madhawa Vidanapathirana*
> Student
> Department of Computer Science and Engineering
> University of Moratuwa
> Sri Lanka
>
> Mobile: (+94) 716874425 <+94%2071%20687%204425>
> Email: madhawavidanapathir...@gmail.com
> Linked-In: https://lk.linkedin.com/in/madhawa-vidanapathirana-3430b94
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] WSO2 DAS data export

[Mohanadarshan Vivekanandalingam]

On Tue, Jul 11, 2017 at 1:31 PM, Sajith Abeywardhana 
wrote:

> Hi Team,
>
> Is there any way that I can export the data to the CSV format from the
> given table? I used the APIs[1] but it won't gives me a total number of
> records as a result. When I looked from the data explorer it shows more
> than 10 records but APIs gives me only 7000+ records.
>
>
AFAIK, you have used the correct API, I have tried with few records and it
worked fine.. Whether you have encountered above situation when there are
large number of events ? Hope there is no any connection timeout with the
server when executing above request.

@Gimanatha, can you please provide your input on this.

Thanks,
Mohan

>
> [1].
> curl -X POST -H "Content-Type: application/json" -H "Authorization: Basic
> YWRtaW46YWRtaW4=" https://10.0.4.42:9443/analy tics/search_count -d
> '{"tableName":"SENSOR_EVENT_DATA_STREAM"}' -k
>
> curl -k -X POST   https://10.0.4.42:9443/analytics/search   -H
> 'authorization: Basic YWRtaW46YWRtaW4='   -H 'cache-contr ol: no-cache'
> -H 'content-type: application/json'   -H 'postman-token:
> 96b4b45b-dcae-841b-40ed-0e6e1f12d36b'   -d '{
>  "tableName":"SENSOR_EVENT_DATA_STREAM",
>  "start":0,
>  "count":100
> }' >> das1-data.json
>
> Thanks,
> Sajith.
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [DEV] [SIDDHI] Handling transport properties which have not been provided in source configuration.

[Mohanadarshan Vivekanandalingam]

On Sun, Jul 9, 2017 at 5:01 PM, Sajith Ravindra <saji...@wso2.com> wrote:

> Can't we adding default values when possible ?
>
> For an example, localhost for URL?
>

IMHO, we should avoid this.. This might cause issues in support front.. For
example. "localhost" could be valid for a demo or developer environment and
not useful in real production cases.

And yes, there are some default values that we use for optional properties.
All of them are commonly known/defined cases (like optional parameters in
Kafka, JMS and etc.. )

Thanks,
Mohan



>
> On Sun, Jul 9, 2017 at 4:49 PM Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> On Sun, Jul 9, 2017 at 4:37 PM, Minudika Malshan <minud...@wso2.com>
>> wrote:
>>
>>> Hi,
>>>
>>> @Mohan : In that case, are we going to use *fail.on.missing.attribute*
>>> parameter in siddhi-io level. AFAIK it is used only in mapper level now.
>>>
>>
>> OK, I am confused with $trp in mapping configuration and trp:uri in
>> source configuration.
>>
>> Now, regarding your actual question. If we are defining a source
>> configuration property as a mandatory property, then it means we cannot
>> continue without that property. In this case, we need to throw an
>> exception. If we can continue with a null value then that property cannot
>> be a required property and it is an optional property.
>>
>> Thanks,
>> Mohan
>>
>>
>>>
>>> Thanks and regards!
>>>
>>> On Sun, Jul 9, 2017 at 4:24 PM, Mohanadarshan Vivekanandalingam <
>>> mo...@wso2.com> wrote:
>>>
>>>> @Minudika, I believe you are aware about the property 
>>>> 'fail.on.missing.attributes'.
>>>> Let's decide whether to set null or throw exception as per the value that
>>>> defined for this property..
>>>>
>>>> Thanks,
>>>> Mohan
>>>>
>>>> On Sun, Jul 9, 2017 at 4:13 PM, Sajith Ravindra <saji...@wso2.com>
>>>> wrote:
>>>>
>>>>> either we should, assign a default value or throw and exceptions
>>>>>
>>>>> AFAIU, we can proceed with out and url for sources there for it will
>>>>> not be possible to assign null and proceed.
>>>>>
>>>>> Thanks
>>>>> *,Sajith Ravindra*
>>>>> Senior Software Engineer
>>>>> WSO2 Inc.; http://wso2.com
>>>>> lean.enterprise.middleware
>>>>>
>>>>> mobile: +94 77 2273550
>>>>> blog: http://sajithr.blogspot.com/
>>>>> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab>
>>>>>
>>>>> On Sun, Jul 9, 2017 at 4:04 PM, Minudika Malshan <minud...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> In source, when a required transport property *(eg. trp:uri)* is not
>>>>>> present in the source configuration, should we assign null for that
>>>>>> property and proceed or should we throw an exception?
>>>>>>
>>>>>> Thanks and regards!
>>>>>>
>>>>>> --
>>>>>> *Minudika Gammanpila*
>>>>>> Software Engineer - WSO2
>>>>>>
>>>>>> Email   :  minud...@wso2.com
>>>>>> Mobile :  +94715659887 <+94%2071%20565%209887>
>>>>>> Web :  http://wso2.com <http://wso2.com/signature>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> *V. Mohanadarshan*
>>>> *Associate Tech Lead,*
>>>> *Data Technologies Team,*
>>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>>> *lean.enterprise.middleware.*
>>>>
>>>> email: mo...@wso2.com
>>>> phone:(+94) 771117673 <+94%2077%20111%207673>
>>>>
>>>
>>>
>>>
>>> --
>>> *Minudika Gammanpila*
>>> Software Engineer - WSO2
>>>
>>> Email   :  minud...@wso2.com
>>> Mobile :  +94715659887 <+94%2071%20565%209887>
>>> Web :  http://wso2.com <http://wso2.com/signature>
>>>
>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Associate Tech Lead,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673 <+94%2077%20111%207673>
>>
> --
> Thanks
> *,Sajith Ravindra*
> Senior Software Engineer
> WSO2 Inc.; http://wso2.com
> lean.enterprise.middleware
>
> mobile: +94 77 2273550
> blog: http://sajithr.blogspot.com/
> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab>
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [DEV] [SIDDHI] Handling transport properties which have not been provided in source configuration.

[Mohanadarshan Vivekanandalingam]

On Sun, Jul 9, 2017 at 4:37 PM, Minudika Malshan <minud...@wso2.com> wrote:

> Hi,
>
> @Mohan : In that case, are we going to use *fail.on.missing.attribute*
> parameter in siddhi-io level. AFAIK it is used only in mapper level now.
>

OK, I am confused with $trp in mapping configuration and trp:uri in source
configuration.

Now, regarding your actual question. If we are defining a source
configuration property as a mandatory property, then it means we cannot
continue without that property. In this case, we need to throw an
exception. If we can continue with a null value then that property cannot
be a required property and it is an optional property.

Thanks,
Mohan


>
> Thanks and regards!
>
> On Sun, Jul 9, 2017 at 4:24 PM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> @Minudika, I believe you are aware about the property 
>> 'fail.on.missing.attributes'.
>> Let's decide whether to set null or throw exception as per the value that
>> defined for this property..
>>
>> Thanks,
>> Mohan
>>
>> On Sun, Jul 9, 2017 at 4:13 PM, Sajith Ravindra <saji...@wso2.com> wrote:
>>
>>> either we should, assign a default value or throw and exceptions
>>>
>>> AFAIU, we can proceed with out and url for sources there for it will not
>>> be possible to assign null and proceed.
>>>
>>> Thanks
>>> *,Sajith Ravindra*
>>> Senior Software Engineer
>>> WSO2 Inc.; http://wso2.com
>>> lean.enterprise.middleware
>>>
>>> mobile: +94 77 2273550
>>> blog: http://sajithr.blogspot.com/
>>> <http://lk.linkedin.com/pub/shani-ranasinghe/34/111/ab>
>>>
>>> On Sun, Jul 9, 2017 at 4:04 PM, Minudika Malshan <minud...@wso2.com>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> In source, when a required transport property *(eg. trp:uri)* is not
>>>> present in the source configuration, should we assign null for that
>>>> property and proceed or should we throw an exception?
>>>>
>>>> Thanks and regards!
>>>>
>>>> --
>>>> *Minudika Gammanpila*
>>>> Software Engineer - WSO2
>>>>
>>>> Email   :  minud...@wso2.com
>>>> Mobile :  +94715659887 <+94%2071%20565%209887>
>>>> Web :  http://wso2.com <http://wso2.com/signature>
>>>>
>>>
>>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Associate Tech Lead,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673 <+94%2077%20111%207673>
>>
>
>
>
> --
> *Minudika Gammanpila*
> Software Engineer - WSO2
>
> Email   :  minud...@wso2.com
> Mobile :  +94715659887 <+94%2071%20565%209887>
> Web :  http://wso2.com <http://wso2.com/signature>
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [DEV] [SIDDHI] Handling transport properties which have not been provided in source configuration.

[Mohanadarshan Vivekanandalingam]

@Minudika, I believe you are aware about the property
'fail.on.missing.attributes'.
Let's decide whether to set null or throw exception as per the value that
defined for this property..

Thanks,
Mohan

On Sun, Jul 9, 2017 at 4:13 PM, Sajith Ravindra  wrote:

> either we should, assign a default value or throw and exceptions
>
> AFAIU, we can proceed with out and url for sources there for it will not
> be possible to assign null and proceed.
>
> Thanks
> *,Sajith Ravindra*
> Senior Software Engineer
> WSO2 Inc.; http://wso2.com
> lean.enterprise.middleware
>
> mobile: +94 77 2273550
> blog: http://sajithr.blogspot.com/
> 
>
> On Sun, Jul 9, 2017 at 4:04 PM, Minudika Malshan 
> wrote:
>
>> Hi,
>>
>> In source, when a required transport property *(eg. trp:uri)* is not
>> present in the source configuration, should we assign null for that
>> property and proceed or should we throw an exception?
>>
>> Thanks and regards!
>>
>> --
>> *Minudika Gammanpila*
>> Software Engineer - WSO2
>>
>> Email   :  minud...@wso2.com
>> Mobile :  +94715659887 <+94%2071%20565%209887>
>> Web :  http://wso2.com 
>>
>
>


-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [Config Provider Non-OSGI Mode] Make secure-vault related configuration files optional when using Config Provider

[Mohanadarshan Vivekanandalingam]

Hi Team,

At the moment, we have to add secure vault related configuration files
(around 3-4 files) when using Config Provider in non-osgi mode even though
I don't want secure vault (and only need config-provide features). Can we
make these files mandatory only when secure vault is enabled. Can we
consider fixing this for next release of Carbon-Config ?

I have created an issue in [1].

[1] https://github.com/wso2/carbon-config/issues/40

Thanks,
Mohan

-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [GSOC][CEP][DEV] Python API for Siddhi CEP

[Mohanadarshan Vivekanandalingam]

On Sat, May 6, 2017 at 9:06 AM, Sriskandarajah Suhothayan <s...@wso2.com>
wrote:

> @Mohan on DAS 4.0 do we have similar services like admin services at the
> worker?
>
> Shall we come up with the exact list of apis that we need to have ? So he
> can also incorporate them.
>

Yes, I have already listed some apis in [1].. Will get the finalized list
soon and share with Madhawa..

[1]
https://docs.google.com/spreadsheets/d/1m0sh4DLABCFzCBmjEXtVTrRGM0Mc6lvyYQP6rI99zhQ/edit#gid=0

Thanks,
Mohan


>
> Regards
> Suho
>
> On Fri, May 5, 2017 at 9:16 PM Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> [Adding other project mentors]
>>
>> On Fri, May 5, 2017 at 5:52 PM, Madhawa Vidanapathirana <
>> madhawavidanapathir...@gmail.com> wrote:
>>
>>> Hi,
>>> Thank you for accepting my proposal for Project "Python API for Siddhi
>>> CEP" in GSoC.
>>>
>>> The original proposal submitted by myself is available at [1].
>>>
>>> Progress made so far is as follows.
>>>
>>>1. Figured out a good technique to access JAVA APIs from Python via
>>>Native Calls.
>>>- Pyjnius Framework supports both method calls and callbacks between
>>>   Python and Java.
>>>2. Has wrapped the basic functionality of Siddhi CEP Java Library
>>>using Python in prototype implementations [2].
>>>3. Currently in the process of figuring out a good method to
>>>communicate with Admin Services from Python.
>>>   - Zeep API [3] seems to be a good solution. It supports SSL as
>>>   well. I have already managed to authenticate and invoke some methods 
>>> of
>>>   WSO2 DAS through this API.
>>>
>>> During the community bonding period, my plan is to gain more clarity on
>>> expected architecture of the system such as what sort of a public interface
>>> would be suitable for the Python API. I also hope to learn more on Admin
>>> Services Interface of WSO2 DAS.
>>>
>>> Would you like to see any changes in the proposal? Shall I proceed as
>>> per the plan their?
>>>
>>> [1] - https://drive.google.com/file/d/0B7wIuEzJseiwUF9xWGFRUnQyMWc/
>>> view?usp=sharing
>>> [2] - https://github.com/madhawav/CEP-Python-Wraps/tree/master/
>>> Pyjnius_Prototype_Wrap_Python2_3
>>> [3] - http://docs.python-zeep.org/en/master/
>>>
>>> Thanks and Regards,
>>>
>>> Madhawa
>>>
>>> On Tue, Apr 4, 2017 at 1:52 PM, Sriskandarajah Suhothayan <s...@wso2.com
>>> > wrote:
>>>
>>>> Great
>>>>
>>>> Suho
>>>>
>>>> On Tue, Apr 4, 2017 at 11:10 AM, Madhawa Vidanapathirana <
>>>> madhawavidanapathir...@gmail.com> wrote:
>>>>
>>>>> Hi Suho,
>>>>>
>>>>> I have submitted the final proposal through GSoC Dashboard. Thank you
>>>>> for all the support given.
>>>>>
>>>>> Looking forward for a great GSoC with WSO2.
>>>>>
>>>>> Regards,
>>>>> Madhawa
>>>>>
>>>>>
>>>>> On Monday, March 27, 2017, Madhawa Vidanapathirana <
>>>>> madhawavidanapathir...@gmail.com> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I have shared the finalized draft proposal via the Google Summer of
>>>>>> Code Web Portal. Kindly let me know if any changes are required.
>>>>>> Hoping to submit the final proposal with changes based on your
>>>>>> feedback.
>>>>>>
>>>>>> Regards,
>>>>>> Madhawa
>>>>>>
>>>>>>
>>>>>> On Fri, Mar 24, 2017 at 4:15 PM, Madhawa Vidanapathirana <
>>>>>> madhawavidanapathir...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Good news.
>>>>>>>
>>>>>>> Requested a release from Pyjnius Developer Team [1] and managed to
>>>>>>> get a new release [2] to Python Package Index (PIP). Therefore, we no
>>>>>>> longer have to develop their library from GitHub code.
>>>>>>> We can simply consider it as a dependency which gets auto installed
>>>>>>> when our final product is deployed.
>>>>>>>
>>>>>>> [1] - https:

Re: [Dev] [GSOC][CEP][DEV] Python API for Siddhi CEP

[Mohanadarshan Vivekanandalingam]

[Adding other project mentors]

On Fri, May 5, 2017 at 5:52 PM, Madhawa Vidanapathirana <
madhawavidanapathir...@gmail.com> wrote:

> Hi,
> Thank you for accepting my proposal for Project "Python API for Siddhi
> CEP" in GSoC.
>
> The original proposal submitted by myself is available at [1].
>
> Progress made so far is as follows.
>
>1. Figured out a good technique to access JAVA APIs from Python via
>Native Calls.
>- Pyjnius Framework supports both method calls and callbacks between
>   Python and Java.
>2. Has wrapped the basic functionality of Siddhi CEP Java Library
>using Python in prototype implementations [2].
>3. Currently in the process of figuring out a good method to
>communicate with Admin Services from Python.
>   - Zeep API [3] seems to be a good solution. It supports SSL as
>   well. I have already managed to authenticate and invoke some methods of
>   WSO2 DAS through this API.
>
> During the community bonding period, my plan is to gain more clarity on
> expected architecture of the system such as what sort of a public interface
> would be suitable for the Python API. I also hope to learn more on Admin
> Services Interface of WSO2 DAS.
>
> Would you like to see any changes in the proposal? Shall I proceed as per
> the plan their?
>
> [1] - https://drive.google.com/file/d/0B7wIuEzJseiwUF9xWGFRUnQyMWc
> /view?usp=sharing
> [2] - https://github.com/madhawav/CEP-Python-Wraps/tree/master/Pyj
> nius_Prototype_Wrap_Python2_3
> [3] - http://docs.python-zeep.org/en/master/
>
> Thanks and Regards,
>
> Madhawa
>
> On Tue, Apr 4, 2017 at 1:52 PM, Sriskandarajah Suhothayan 
> wrote:
>
>> Great
>>
>> Suho
>>
>> On Tue, Apr 4, 2017 at 11:10 AM, Madhawa Vidanapathirana <
>> madhawavidanapathir...@gmail.com> wrote:
>>
>>> Hi Suho,
>>>
>>> I have submitted the final proposal through GSoC Dashboard. Thank you
>>> for all the support given.
>>>
>>> Looking forward for a great GSoC with WSO2.
>>>
>>> Regards,
>>> Madhawa
>>>
>>>
>>> On Monday, March 27, 2017, Madhawa Vidanapathirana <
>>> madhawavidanapathir...@gmail.com> wrote:
>>>
 Hi,

 I have shared the finalized draft proposal via the Google Summer of
 Code Web Portal. Kindly let me know if any changes are required.
 Hoping to submit the final proposal with changes based on your feedback.

 Regards,
 Madhawa


 On Fri, Mar 24, 2017 at 4:15 PM, Madhawa Vidanapathirana <
 madhawavidanapathir...@gmail.com> wrote:

> Hi,
>
> Good news.
>
> Requested a release from Pyjnius Developer Team [1] and managed to get
> a new release [2] to Python Package Index (PIP). Therefore, we no longer
> have to develop their library from GitHub code.
> We can simply consider it as a dependency which gets auto installed
> when our final product is deployed.
>
> [1] - https://github.com/kivy/pyjnius/issues/189#issuecomment-2887
> 50222
> [2] - https://pypi.python.org/pypi/pyjnius/1.1.1
>
> Pyjnius is a library which can be used for calling Java methods from
> Python and obtaining callback responses. It uses native method calls.
>
> Regards,
> Madhawa
>
> On Thu, Mar 23, 2017 at 1:48 AM, Sriskandarajah Suhothayan <
> s...@wso2.com> wrote:
>
>> Good to know that it worked :)
>>
>> Regards
>> Suho
>>
>> On Wed, Mar 22, 2017 at 11:24 PM, Madhawa Vidanapathirana <
>> madhawavidanapathir...@gmail.com> wrote:
>>
>>> Hi Suho,
>>>
>>> Got the prototype working with Python 3 as well. Refer the link
>>> below for sources.
>>>
>>> https://github.com/madhawav/CEP-Python-Wraps/tree/master/Pyj
>>> nius_Prototype_Wrap_Python2_3
>>>
>>> This version works with both Python 2.7 and 3.x. (Tested on 2.7 and
>>> 3.5). Uses native calls via Pyjnius API.
>>>
>>> Please note: When you are installing Pyjnius from source, don't use
>>> the same local copy of source files for both Python2 and Python3. The
>>> install scripts of Pyjnius leaves temporary files that make subsequent
>>> installs on a different version of Python fail.
>>>
>>> Regards,
>>> Madhawa
>>>
>>>
>>> On Mon, Mar 20, 2017 at 12:44 PM, Madhawa Vidanapathirana <
>>> madhawavidanapathir...@gmail.com> wrote:
>>>
 Hi Suho,

 Installation via PIP can be done. I will add it to Project
 Proposal.

 Regards,
 Madhawa

 On Mon, Mar 20, 2017 at 11:25 AM, Sriskandarajah Suhothayan <
 s...@wso2.com> wrote:

>
>
> On Sun, Mar 19, 2017 at 4:02 PM, Madhawa Vidanapathirana <
> madhawavidanapathir...@gmail.com> wrote:
>
>> Hi Suho,
>>
>> Going ahead with the proposal, few questions crossed my mind.
>>
>>1. You mentioned previously that WSO2 DAS should also be

Re: [Dev] GSoC 2017- Proposal 4: Idea Plugin for Siddhi

[Mohanadarshan Vivekanandalingam]

[Adding Mentors]

Hi Raveen,

As mentioned in the description in [1] Siddhi is a realtime processing
engine that used in WSO2 CEP. You can get more information about Siddhi
language in [2].. Do a quick google search as" WSO2 Siddhi" if you want to
get more information about Siddhi..

[1]
https://docs.wso2.com/display/GSoC/Project+Proposals+for+2017#ProjectProposalsfor2017-Proposal4:IdeaPluginforSiddhi

[2] https://docs.wso2.com/display/CEP420/SiddhiQL+Guide+3.1

Thanks,
Mohan


On Tue, Feb 28, 2017 at 2:01 AM, Raveen Rathnayake 
wrote:

> Hi,
> I am a second year Software Engineering student from Informatics Institute
> of Technology. Since I have a good knowledge in Java and I am familiar with
> IDEA, I selected the *Proposal 4: Idea Plugin for Siddhi *from the GSoC
> project proposals. I want to get to know more about the Siddhi. If you
> all can help me and give a guide for me, it will be a great start for me on
> this project.
>
> Thank you.
>
> Best Regards,
> Raveen Savinda Rathnayake.
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [DEV] Response appends with Request in ISO Connector

[Mohanadarshan Vivekanandalingam]

Hi Team,

In ESB ISO connector, the response which is received from an ISO server (or
device) is embedded with the request itself. Then, the client which invokes
the message get both request and response.

For example,

*Request *

 
 


 
  

*Response*

  
 


 
  
  
 
0210
0014
 
  


I had an offline chat with Kanapriya and seems like it was implemented such
manner as per [1]. What is the reason for such approach? I don't think it
is a correct approach. Whether other connectors have the similar
implementation?


[1] https://github.com/wso2-extensions/esb-connector-
iso8583/blob/master/src/main/java/org/wso2/carbon/connector/ISO8583/
ISO8583MessageHandler.java#L115

Thanks,
Mohan

-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] WSO2 Identity Server analytic username/password configuration

[Mohanadarshan Vivekanandalingam]

On Tue, Jan 10, 2017 at 11:52 AM, Godwin Shrimal  wrote:

> Hi All,
>
> As described in [1] we need to configure username/password in
> IsAnalytics-Publisher-wso2event-AuthenticationData.xml and
> IsAnalytics-Publisher-wso2event-SessionData.xml files. How do we handle
> when some user store has policies to change credentials periodically. Do we
> have to change credentials in those configs file and restart Identity
> Server all the time or do we have any alternative for this ?
>

ATM, we only support basicAuth; there is no any other option.. Only thing
that you can do is, have a seperate user (in another usestore) which have
login and event pulisher permissions..

Actually these files are hot deployable artifacts.. You don't have to
restart the server for a change.


Thanks,
Mohan



>
> [1] https://docs.wso2.com/display/IS520/Prerequisites+to+
> Publish+Statistics#PrerequisitestoPublishStatisti
> cs-Configuringeventpublishers
>
> Thanks
> Godwin
>
> --
> *Godwin Amila Shrimal*
> Senior Software Engineer
> WSO2 Inc.; http://wso2.com
> lean.enterprise.middleware
>
> mobile: *+94772264165*
> linkedin: *http://lnkd.in/KUum6D *
> twitter: https://twitter.com/godwinamila
> 
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] WSO2 Committers += Sajith Perera

[Mohanadarshan Vivekanandalingam]

Hi Devs,

It is my pleasure to welcome Sajith Perera as a WSO2 Committer. Sajith has
been a valuable contributor in WSO2 analytics space and performed enormous
tasks on CEP tooling, CEP HA and Log Analyzer.

SajithD, welcome aboard and keep up the good work.


Thanks,
Mohan


-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673 <+94%2077%20111%207673>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Error in deploying throttling policies from API Manager 2.0 [API Manager]

[Mohanadarshan Vivekanandalingam]

On Thu, Oct 6, 2016 at 10:07 AM, Thilini Cooray <thili...@wso2.com> wrote:

> Hi Nadeesha,
>
> Are you still getting the Illegal char error in Windows with Java 1.8 ?
> I encountered this issue while trying to add an event receiver from APIM
> 2.0.0 Management console UI and it got fixed after running on Java 1.8.
>
> My case the error popped out from CarbonEventReceiverService and not from
> ThrottlePolicyDeploymentManager and it got solved.
>
> @Mohan : I think there are many places which needs to be addressed if we
> are going for a fix.
>

Yes, we have tested in Windows OS and with multiple jdk combinations and it
worked fine. But, I believe there needs to be combination of OS bit version
and jdk version which we need to explore further..

@Thilini, fix needs to be done nearly in 5 components in that case..

Thanks,
Mohan



>
> Thanks.
>
> On Thu, Oct 6, 2016 at 9:44 AM, Nadeesha Gamage <nadee...@wso2.com> wrote:
>
>> Hi Mohan,
>> I tried with jdk1.8.0_101 but the issue still exist so I dont think its
>> an issue that would be fixed by JDK version update.
>>
>> Thank you,
>> Nadeesha
>>
>> On Wed, Oct 5, 2016 at 10:56 AM, Nadeesha Gamage <nadee...@wso2.com>
>> wrote:
>>
>>> Ok, will try and update the thread.
>>>
>>> Thank you,
>>> Nadeesha
>>>
>>> On Wed, Oct 5, 2016 at 10:48 AM, Mohanadarshan Vivekanandalingam <
>>> mo...@wso2.com> wrote:
>>>
>>>> Hi Nadeesha,
>>>>
>>>> Thilini has done a test on this sometime back with jdk 1.8.0_73 and
>>>> works fine.. If you don't mind can you please try with this version (or
>>>> higher version) ?..
>>>>
>>>> Thanks,
>>>> Mohan
>>>>
>>>>
>>>> On Wed, Oct 5, 2016 at 10:27 AM, Nadeesha Gamage <nadee...@wso2.com>
>>>> wrote:
>>>>
>>>>> Hi Mohan,
>>>>> It still gives the same issue on jdk1.8.0_65.
>>>>>
>>>>> Thank you,
>>>>> Nadeesha
>>>>>
>>>>> On Wed, Oct 5, 2016 at 10:25 AM, Mohanadarshan Vivekanandalingam <
>>>>> mo...@wso2.com> wrote:
>>>>>
>>>>>> Hi Nadeesha,
>>>>>>
>>>>>> It is a known issue that we have seen in some windows version (with
>>>>>> combine with specific jdk). It is already fixed in latest components and
>>>>>> current APIM source code is depend on those components..  See related
>>>>>> references below..
>>>>>>
>>>>>> But again, as per our previous tests above issue cannot be reproduced
>>>>>> in JDK 1.8.0.. What is the minor version of the jdk 1.8 that you tried?
>>>>>>
>>>>>> [1] https://wso2.org/jira/browse/DAS-470
>>>>>>
>>>>>> [2] https://wso2.org/jira/browse/DAS-467
>>>>>>
>>>>>> Thanks,
>>>>>> Mohan
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Wed, Oct 5, 2016 at 10:20 AM, Nadeesha Gamage <nadee...@wso2.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Rukshan,
>>>>>>> No Siddhi file is created in mentioned directory.
>>>>>>>
>>>>>>> Thank you,
>>>>>>> Nadeesha
>>>>>>>
>>>>>>> On Wed, Oct 5, 2016 at 10:03 AM, Rukshan Premathunga <
>>>>>>> ruks...@wso2.com> wrote:
>>>>>>>
>>>>>>>> Hi Nadeeshan,
>>>>>>>>
>>>>>>>> I think you try to deploy policy using admin UI. So can you check
>>>>>>>> the repository/deployment/server/executionplans directory and see
>>>>>>>> created *.siddhiql file contain any invalid characters?
>>>>>>>>
>>>>>>>> Thanks and Regards
>>>>>>>>
>>>>>>>> On Wed, Oct 5, 2016 at 9:55 AM, Nadeesha Gamage <nadee...@wso2.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Devs,
>>>>>>>>> I am having an issue in deploying a new API throttling policy in
>>>>>>>>> API M 2.0. The issue is described in the ticket below
>>>>>>>>>
>>>>>>>>> https://wso2.org/ji

Re: [Dev] Error in deploying throttling policies from API Manager 2.0 [API Manager]

[Mohanadarshan Vivekanandalingam]

On Thu, Oct 6, 2016 at 9:44 AM, Nadeesha Gamage <nadee...@wso2.com> wrote:

> Hi Mohan,
> I tried with jdk1.8.0_101 but the issue still exist so I dont think its an
> issue that would be fixed by JDK version update.
>

OK, then we need a code level fix..


>
> Thank you,
> Nadeesha
>
> On Wed, Oct 5, 2016 at 10:56 AM, Nadeesha Gamage <nadee...@wso2.com>
> wrote:
>
>> Ok, will try and update the thread.
>>
>> Thank you,
>> Nadeesha
>>
>> On Wed, Oct 5, 2016 at 10:48 AM, Mohanadarshan Vivekanandalingam <
>> mo...@wso2.com> wrote:
>>
>>> Hi Nadeesha,
>>>
>>> Thilini has done a test on this sometime back with jdk 1.8.0_73 and
>>> works fine.. If you don't mind can you please try with this version (or
>>> higher version) ?..
>>>
>>> Thanks,
>>> Mohan
>>>
>>>
>>> On Wed, Oct 5, 2016 at 10:27 AM, Nadeesha Gamage <nadee...@wso2.com>
>>> wrote:
>>>
>>>> Hi Mohan,
>>>> It still gives the same issue on jdk1.8.0_65.
>>>>
>>>> Thank you,
>>>> Nadeesha
>>>>
>>>> On Wed, Oct 5, 2016 at 10:25 AM, Mohanadarshan Vivekanandalingam <
>>>> mo...@wso2.com> wrote:
>>>>
>>>>> Hi Nadeesha,
>>>>>
>>>>> It is a known issue that we have seen in some windows version (with
>>>>> combine with specific jdk). It is already fixed in latest components and
>>>>> current APIM source code is depend on those components..  See related
>>>>> references below..
>>>>>
>>>>> But again, as per our previous tests above issue cannot be reproduced
>>>>> in JDK 1.8.0.. What is the minor version of the jdk 1.8 that you tried?
>>>>>
>>>>> [1] https://wso2.org/jira/browse/DAS-470
>>>>>
>>>>> [2] https://wso2.org/jira/browse/DAS-467
>>>>>
>>>>> Thanks,
>>>>> Mohan
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Oct 5, 2016 at 10:20 AM, Nadeesha Gamage <nadee...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Rukshan,
>>>>>> No Siddhi file is created in mentioned directory.
>>>>>>
>>>>>> Thank you,
>>>>>> Nadeesha
>>>>>>
>>>>>> On Wed, Oct 5, 2016 at 10:03 AM, Rukshan Premathunga <
>>>>>> ruks...@wso2.com> wrote:
>>>>>>
>>>>>>> Hi Nadeeshan,
>>>>>>>
>>>>>>> I think you try to deploy policy using admin UI. So can you check
>>>>>>> the repository/deployment/server/executionplans directory and see
>>>>>>> created *.siddhiql file contain any invalid characters?
>>>>>>>
>>>>>>> Thanks and Regards
>>>>>>>
>>>>>>> On Wed, Oct 5, 2016 at 9:55 AM, Nadeesha Gamage <nadee...@wso2.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Devs,
>>>>>>>> I am having an issue in deploying a new API throttling policy in
>>>>>>>> API M 2.0. The issue is described in the ticket below
>>>>>>>>
>>>>>>>> https://wso2.org/jira/browse/APIMANAGER-5415
>>>>>>>>
>>>>>>>>
>>>>>>>> Error log is given below
>>>>>>>>
>>>>>>>> [2016-10-05 09:49:26,237] ERROR - ThrottlePolicyDeploymentManager
>>>>>>>> Error while deploying policy to global policy server.Illegal char <:> 
>>>>>>>> at
>>>>>>>> index 2: /D:/APIM-D~1/API_M_2.0/WSO2AM~
>>>>>>>> 1.0/bin/../repository/deployment/server/\executionplans
>>>>>>>>
>>>>>>>>
>>>>>>>> I am using a *Windows OS* and this error occurs with both *Java
>>>>>>>> 1.7 and 1.8*.
>>>>>>>>
>>>>>>>> Thank you,
>>>>>>>> --
>>>>>>>> Nadeesha Gamage
>>>>>>>> Associate Technical Lead - Solutions Engineering
>>>>>>>> T : +94 77 394 5706
>>>>>>>> B : https://nadeesha678.wordpress.com/
>>>>>>>>
>>>>>

Re: [Dev] Error in deploying throttling policies from API Manager 2.0 [API Manager]

[Mohanadarshan Vivekanandalingam]

Hi Nadeesha,

Thilini has done a test on this sometime back with jdk 1.8.0_73 and works
fine.. If you don't mind can you please try with this version (or higher
version) ?..

Thanks,
Mohan


On Wed, Oct 5, 2016 at 10:27 AM, Nadeesha Gamage <nadee...@wso2.com> wrote:

> Hi Mohan,
> It still gives the same issue on jdk1.8.0_65.
>
> Thank you,
> Nadeesha
>
> On Wed, Oct 5, 2016 at 10:25 AM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> Hi Nadeesha,
>>
>> It is a known issue that we have seen in some windows version (with
>> combine with specific jdk). It is already fixed in latest components and
>> current APIM source code is depend on those components..  See related
>> references below..
>>
>> But again, as per our previous tests above issue cannot be reproduced in
>> JDK 1.8.0.. What is the minor version of the jdk 1.8 that you tried?
>>
>> [1] https://wso2.org/jira/browse/DAS-470
>>
>> [2] https://wso2.org/jira/browse/DAS-467
>>
>> Thanks,
>> Mohan
>>
>>
>>
>>
>> On Wed, Oct 5, 2016 at 10:20 AM, Nadeesha Gamage <nadee...@wso2.com>
>> wrote:
>>
>>> Hi Rukshan,
>>> No Siddhi file is created in mentioned directory.
>>>
>>> Thank you,
>>> Nadeesha
>>>
>>> On Wed, Oct 5, 2016 at 10:03 AM, Rukshan Premathunga <ruks...@wso2.com>
>>> wrote:
>>>
>>>> Hi Nadeeshan,
>>>>
>>>> I think you try to deploy policy using admin UI. So can you check the
>>>> repository/deployment/server/executionplans directory and see created
>>>> *.siddhiql file contain any invalid characters?
>>>>
>>>> Thanks and Regards
>>>>
>>>> On Wed, Oct 5, 2016 at 9:55 AM, Nadeesha Gamage <nadee...@wso2.com>
>>>> wrote:
>>>>
>>>>> Hi Devs,
>>>>> I am having an issue in deploying a new API throttling policy in API M
>>>>> 2.0. The issue is described in the ticket below
>>>>>
>>>>> https://wso2.org/jira/browse/APIMANAGER-5415
>>>>>
>>>>>
>>>>> Error log is given below
>>>>>
>>>>> [2016-10-05 09:49:26,237] ERROR - ThrottlePolicyDeploymentManager
>>>>> Error while deploying policy to global policy server.Illegal char <:> at
>>>>> index 2: /D:/APIM-D~1/API_M_2.0/WSO2AM~1.0/bin/../repository/deployme
>>>>> nt/server/\executionplans
>>>>>
>>>>>
>>>>> I am using a *Windows OS* and this error occurs with both *Java 1.7
>>>>> and 1.8*.
>>>>>
>>>>> Thank you,
>>>>> --
>>>>> Nadeesha Gamage
>>>>> Associate Technical Lead - Solutions Engineering
>>>>> T : +94 77 394 5706
>>>>> B : https://nadeesha678.wordpress.com/
>>>>>
>>>>> ___
>>>>> Dev mailing list
>>>>> Dev@wso2.org
>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Rukshan Chathuranga.
>>>> Software Engineer.
>>>> WSO2, Inc.
>>>>
>>>
>>>
>>>
>>> --
>>> Nadeesha Gamage
>>> Associate Technical Lead - Solutions Engineering
>>> T : +94 77 394 5706
>>> B : https://nadeesha678.wordpress.com/
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Associate Tech Lead,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673
>>
>
>
>
> --
> Nadeesha Gamage
> Associate Technical Lead - Solutions Engineering
> T : +94 77 394 5706
> B : https://nadeesha678.wordpress.com/
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Error in deploying throttling policies from API Manager 2.0 [API Manager]

[Mohanadarshan Vivekanandalingam]

Hi Nadeesha,

It is a known issue that we have seen in some windows version (with combine
with specific jdk). It is already fixed in latest components and current
APIM source code is depend on those components..  See related references
below..

But again, as per our previous tests above issue cannot be reproduced in
JDK 1.8.0.. What is the minor version of the jdk 1.8 that you tried?

[1] https://wso2.org/jira/browse/DAS-470

[2] https://wso2.org/jira/browse/DAS-467

Thanks,
Mohan




On Wed, Oct 5, 2016 at 10:20 AM, Nadeesha Gamage  wrote:

> Hi Rukshan,
> No Siddhi file is created in mentioned directory.
>
> Thank you,
> Nadeesha
>
> On Wed, Oct 5, 2016 at 10:03 AM, Rukshan Premathunga 
> wrote:
>
>> Hi Nadeeshan,
>>
>> I think you try to deploy policy using admin UI. So can you check the
>> repository/deployment/server/executionplans directory and see created
>> *.siddhiql file contain any invalid characters?
>>
>> Thanks and Regards
>>
>> On Wed, Oct 5, 2016 at 9:55 AM, Nadeesha Gamage 
>> wrote:
>>
>>> Hi Devs,
>>> I am having an issue in deploying a new API throttling policy in API M
>>> 2.0. The issue is described in the ticket below
>>>
>>> https://wso2.org/jira/browse/APIMANAGER-5415
>>>
>>>
>>> Error log is given below
>>>
>>> [2016-10-05 09:49:26,237] ERROR - ThrottlePolicyDeploymentManager Error
>>> while deploying policy to global policy server.Illegal char <:> at index 2:
>>> /D:/APIM-D~1/API_M_2.0/WSO2AM~1.0/bin/../repository/deployme
>>> nt/server/\executionplans
>>>
>>>
>>> I am using a *Windows OS* and this error occurs with both *Java 1.7 and
>>> 1.8*.
>>>
>>> Thank you,
>>> --
>>> Nadeesha Gamage
>>> Associate Technical Lead - Solutions Engineering
>>> T : +94 77 394 5706
>>> B : https://nadeesha678.wordpress.com/
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>> Rukshan Chathuranga.
>> Software Engineer.
>> WSO2, Inc.
>>
>
>
>
> --
> Nadeesha Gamage
> Associate Technical Lead - Solutions Engineering
> T : +94 77 394 5706
> B : https://nadeesha678.wordpress.com/
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Test Mail

[Mohanadarshan Vivekanandalingam]

This a test mail

-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [APIM] Problem with integrating Event Stream OSGi Service

[Mohanadarshan Vivekanandalingam]

On Thu, Aug 25, 2016 at 11:33 AM, Malintha Amarasinghe <malint...@wso2.com>
wrote:

> Hi,
>
> On Wed, Aug 24, 2016 at 11:02 AM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> HI Malintha/Nuwan,
>>
>> I have few queries and like to provide few clarifications on this..
>>
>> Actually most of the points that you guys raised are discussed before and
>> changed based on some experiences..
>>
>> - Defining stream from client side  : We had this in old datapublisher
>> component and removed due to various complications.. As Srinath mentioned
>> this was done after many rounds of discussions..
>>
>> - Having single configuration file to add DAS endpoint : In past, we had
>> two level of configs (one for adapter which deals with transport and one
>> for event formatting which deals with stream). That means we can use one
>> event adapter for multiple streams.. But, there were some complaints saying
>> it is not user friendly and should have one config to publish events..
>>
>> And also, event publisher is also another deployable artifact like other
>> synapse files.. In APIM, we are configuring key manager url in multiple api
>> configs (revoke api and etc.. ), event publisher is also similar to that..
>>
>> But, I do understand that your points are valid and think we have two
>> options..
>>
>> - Have a global property in output-adapter-config.xml and use that in
>> Thrift event publisher (if that property exists)..
>>
>
@All, I have incorporated above fix by introducing a global default
property in master branch

Thanks,
Mohan


>

> - Allow to keep the DAS endpoint as a registry resource and use that..
>>
>> Thanks for the response. It would be great to have above in order to
> mitigate the duplicated configuration issues.
>


> Thanks!
> Malintha
>
>> Thanks,
>> Mohan
>>
>>
>> On Wed, Aug 24, 2016 at 10:05 AM, Nuwan Dias <nuw...@wso2.com> wrote:
>>
>>> Hi,
>>>
>>> I spoke with Srinath regarding this too. It would be ideal to have a
>>> global config which can override the per-stream configs so that we won't
>>> have to maintain the DAS configs in multiple places. In all cases we've
>>> come across so far we've only seen people use a single DAS (or cluster) and
>>> publish all streams to that DAS cluster. So at least as of now I don't see
>>> much value in having per stream config files.
>>>
>>> It would also be good if we can omit the necessity of having to define
>>> the streams on the client side (because they're already defined on the
>>> server). I see two main problems of having to define them on the clients.
>>>
>>> 1. When we have multiple event generators (a gateway cluster), the
>>> streams will have to be defined on all nodes. Do we use dep-sync to sync up
>>> the configs on the clients? Even if we do, I think its better to not depend
>>> on dep-sync for the new stuff we're developing because we're moving away
>>> from dep-sync soon.
>>>
>>> 2. Problems in upgrading to newer product versions. When upgrading the
>>> product version, if a schema change has occurred, currently we only have to
>>> worry about changing the schema on the server side. With the above
>>> limitation, we now have to worry about changing the clients too.
>>>
>>> Thanks,
>>> NuwanD.
>>>
>>> On Tue, Aug 23, 2016 at 10:16 PM, Malintha Amarasinghe <
>>> malint...@wso2.com> wrote:
>>>
>>>> Hi All,
>>>>
>>>> Currently APIM is using an internal APIM specific configuration resides
>>>> in api-manager.xml which include DAS server URL, username, password etc.
>>>> Those configuration are used to instantiate an org.wso2.carbon.databridge.
>>>> agent.DataPublisher object, which is then used to publish events
>>>> directly to streams in DAS.
>>>>
>>>> As it is an APIM specific configuration, it is not reusable by other
>>>> non-APIM features. Also org.wso2.carbon.databridge.agent.DataPublisher is
>>>> intended to be used in non-carbon environments, for carbon environments,
>>>> the recommended way is to use the Event Stream OSGi Service.
>>>>
>>>> So we were trying to re-structure APIM data publishing code to use new
>>>> Event Stream OSGi service explained in [1].
>>>>
>>>> 1. Create all the streams defined in DAS in APIM.
>>>> 2. Create an *event publisher per each str

Re: [Dev] [APIM] Problem with integrating Event Stream OSGi Service

[Mohanadarshan Vivekanandalingam]

HI Malintha/Nuwan,

I have few queries and like to provide few clarifications on this..

Actually most of the points that you guys raised are discussed before and
changed based on some experiences..

- Defining stream from client side  : We had this in old datapublisher
component and removed due to various complications.. As Srinath mentioned
this was done after many rounds of discussions..

- Having single configuration file to add DAS endpoint : In past, we had
two level of configs (one for adapter which deals with transport and one
for event formatting which deals with stream). That means we can use one
event adapter for multiple streams.. But, there were some complaints saying
it is not user friendly and should have one config to publish events..

And also, event publisher is also another deployable artifact like other
synapse files.. In APIM, we are configuring key manager url in multiple api
configs (revoke api and etc.. ), event publisher is also similar to that..

But, I do understand that your points are valid and think we have two
options..

- Have a global property in output-adapter-config.xml and use that in
Thrift event publisher (if that property exists)..
- Allow to keep the DAS endpoint as a registry resource and use that..

Thanks,
Mohan


On Wed, Aug 24, 2016 at 10:05 AM, Nuwan Dias  wrote:

> Hi,
>
> I spoke with Srinath regarding this too. It would be ideal to have a
> global config which can override the per-stream configs so that we won't
> have to maintain the DAS configs in multiple places. In all cases we've
> come across so far we've only seen people use a single DAS (or cluster) and
> publish all streams to that DAS cluster. So at least as of now I don't see
> much value in having per stream config files.
>
> It would also be good if we can omit the necessity of having to define the
> streams on the client side (because they're already defined on the server).
> I see two main problems of having to define them on the clients.
>
> 1. When we have multiple event generators (a gateway cluster), the streams
> will have to be defined on all nodes. Do we use dep-sync to sync up the
> configs on the clients? Even if we do, I think its better to not depend on
> dep-sync for the new stuff we're developing because we're moving away from
> dep-sync soon.
>
> 2. Problems in upgrading to newer product versions. When upgrading the
> product version, if a schema change has occurred, currently we only have to
> worry about changing the schema on the server side. With the above
> limitation, we now have to worry about changing the clients too.
>
> Thanks,
> NuwanD.
>
> On Tue, Aug 23, 2016 at 10:16 PM, Malintha Amarasinghe  > wrote:
>
>> Hi All,
>>
>> Currently APIM is using an internal APIM specific configuration resides
>> in api-manager.xml which include DAS server URL, username, password etc.
>> Those configuration are used to instantiate an org.wso2.carbon.databridge.
>> agent.DataPublisher object, which is then used to publish events
>> directly to streams in DAS.
>>
>> As it is an APIM specific configuration, it is not reusable by other
>> non-APIM features. Also org.wso2.carbon.databridge.agent.DataPublisher is
>> intended to be used in non-carbon environments, for carbon environments,
>> the recommended way is to use the Event Stream OSGi Service.
>>
>> So we were trying to re-structure APIM data publishing code to use new
>> Event Stream OSGi service explained in [1].
>>
>> 1. Create all the streams defined in DAS in APIM.
>> 2. Create an *event publisher per each stream *which takes data from the
>> stream and publish to DAS.
>> 3. In each event publisher we need to configure DAS specific
>> configuration.
>>
>> Ex:
>> 
>> http://wso2.org/carbon/eventpublisher;>
>>   
>>   
>>   
>> admin
>> thrift
>> non-blocking
>> 0
>> tcp://localhost:7611
>> 
>>   
>> 
>>
>> But we are facing a small problem here; in APIM there are many event
>> streams being used. If there's a change happen to DAS configuration, we
>> need to change it in all the event publishers which makes it difficult to
>> maintain. As per the offline chat with DAS team, this is a current
>> limitation.
>>
>> Are we going to move forward with the existing implementation?
>>
>> Thanks,
>> Malintha
>>
>> [1] [Dev] Common configuration for publishing events from carbon servers
>> to DAS/CEP
>> --
>> Malintha Amarasinghe
>> Software Engineer
>> *WSO2, Inc. - lean | enterprise | middleware*
>> http://wso2.com/
>>
>> Mobile : +94 712383306
>>
>
>
>
> --
> Nuwan Dias
>
> Software Architect - WSO2, Inc. http://wso2.com
> email : nuw...@wso2.com
> Phone : +94 777 775 729
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: 

Re: [Dev] [ESB] Error connecting to esb-analutics

[Mohanadarshan Vivekanandalingam]

On Tue, Aug 23, 2016 at 7:32 PM, Supun Malinga  wrote:

> Hi,
>
> I already configured MessageFlowConfigurationPublisher.xml and
> MessageFlowStatisticsPublisher.xml files.
> tcp://esb-analytics:7612
>
> This is the http port I believe. But the error saying it cannot connect to
> the ssl port 7712 which is not in the configuration..
>
> analytics server runs on a different docker container.
> http : tcp://esb-analytics:7612
> https: tcp://esb-analytics:7712
>

@Supun, this is a Thrift communication which uses TCP underneath..

By default thrift port is 7611 and corresponding ssl thrift port is 7711
(7611+100), check the data-bridge-config.xml file which is in analytics
server config directory . Since we are shipping analytics products in
offset 1 then thrift port is 7612 and ssl port is 7712.. Here, ssl port
(7712) is used for initial authentication purposes of data publisher
afterwards it uses the thrift port (7612) for event publishing..

Thanks,
Mohan


>
>
>
> On Tue, Aug 23, 2016 at 7:28 PM, Chanaka Fernando 
> wrote:
>
>> Hi Supun,
>>
>> Where did you configure the hostname for the analytics server node?
>> Publisher configurations files are in the 
>> ESB_HOME/repository/deployment/server/eventpublishers/
>> directory. According to the error log, ESB is trying to connect to
>> localhost:7712 port. Are you starting the analytics server on the same node?
>>
>> On Tue, Aug 23, 2016 at 7:11 PM, Supun Malinga  wrote:
>>
>>> Hi,
>>>
>>> I configured a ESB cluster with analytics in docker. Followed the guide
>>> [1] and updated the hostname/port in event publisher artifacts. But still
>>> ESB gives and error when I try to anable statistics in a proxy service.
>>>
>>> Looks like some configuration is missing. However I searched in configs
>>> and find any place to change the hostname to the analytics server
>>> connection. Can someone point me to the correct config pls ?.
>>>
>>> esb_worker1  | [2016-08-23 11:58:51,041]  WARN - DataEndpointGroup
>>> No receiver is reachable at reconnection, will try to reconnect every 30 sec
>>> esb_worker1  | [2016-08-23 11:58:51,044] ERROR -
>>> DataEndpointConnectionWorker Error while trying to connect to
>>> ssl://localhost:7712
>>> esb_worker1  | org.wso2.carbon.databridge.age
>>> nt.exception.DataEndpointSecurityException: Error while trying to
>>> connect to ssl://localhost:7712
>>> esb_worker1  | at org.wso2.carbon.databridge.age
>>> nt.endpoint.thrift.ThriftSecureClientPoolFactory.createClien
>>> t(ThriftSecureClientPoolFactory.java:61)
>>> esb_worker1  | at org.wso2.carbon.databridge.age
>>> nt.client.AbstractClientPoolFactory.makeObject(AbstractClien
>>> tPoolFactory.java:39)
>>> esb_worker1  | at org.apache.commons.pool.impl.G
>>> enericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:1212)
>>> esb_worker1  | at org.wso2.carbon.databridge.age
>>> nt.endpoint.DataEndpointConnectionWorker.connect(DataEndpoin
>>> tConnectionWorker.java:91)
>>> esb_worker1  | at org.wso2.carbon.databridge.age
>>> nt.endpoint.DataEndpointConnectionWorker.run(DataEndpointCon
>>> nectionWorker.java:42)
>>> esb_worker1  | at java.util.concurrent.Executors
>>> $RunnableAdapter.call(Executors.java:471)
>>> esb_worker1  | at java.util.concurrent.FutureTas
>>> k.run(FutureTask.java:262)
>>> esb_worker1  | at java.util.concurrent.ThreadPoo
>>> lExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> esb_worker1  | at java.util.concurrent.ThreadPoo
>>> lExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> esb_worker1  | at java.lang.Thread.run(Thread.java:745)
>>> esb_worker1  | Caused by: 
>>> org.apache.thrift.transport.TTransportException:
>>> Could not connect to localhost on port 7712
>>> esb_worker1  | at org.apache.thrift.transport.TS
>>> SLTransportFactory.createClient(TSSLTransportFactory.java:237)
>>> esb_worker1  | at org.apache.thrift.transport.TS
>>> SLTransportFactory.getClientSocket(TSSLTransportFactory.java:169)
>>> esb_worker1  | at org.wso2.carbon.databridge.age
>>> nt.endpoint.thrift.ThriftSecureClientPoolFactory.createClien
>>> t(ThriftSecureClientPoolFactory.java:56)
>>> esb_worker1  | ... 9 more
>>> esb_worker1  | Caused by: java.net.ConnectException: Connection
>>> refused
>>> esb_worker1  | at java.net.PlainSocketImpl.socketConnect(Native
>>> Method)
>>> esb_worker1  | at java.net.AbstractPlainSocketIm
>>> pl.doConnect(AbstractPlainSocketImpl.java:339)
>>> esb_worker1  | at java.net.AbstractPlainSocketIm
>>> pl.connectToAddress(AbstractPlainSocketImpl.java:200)
>>> esb_worker1  | at java.net.AbstractPlainSocketIm
>>> pl.connect(AbstractPlainSocketImpl.java:182)
>>> esb_worker1  | at java.net.SocksSocketImpl.conne
>>> ct(SocksSocketImpl.java:392)
>>> esb_worker1  | at java.net.Socket.connect(Socket.java:579)
>>> esb_worker1  | at sun.security.ssl.SSLSocketImpl
>>> .connect(SSLSocketImpl.java:625)
>>> 

Re: [Dev] How to configure Analytics cluster with MB 3.2.0 cluster?

[Mohanadarshan Vivekanandalingam]

On Tue, Aug 23, 2016 at 12:56 AM, Isuru Perera  wrote:

> Hi,
>
> Do you need to publish data to multiple receiver nodes? You should be able
> to use multiple Receiver URLs. Metrics uses the Data Publisher API. Please
> check [1].
>
> I think it's better to ask from DAS team.
>
> [1] https://docs.wso2.com/display/CEP420/Setting+up+Multi+
> Receiver+and+Load+Balancing+Data+Agent
>

+1..

@Sashika, how did you configured the event receiver in DAS side ? what is
the value for "events duplicated in cluster" property ? Based on that
property you have to configure DAS urls.. If this property is true then you
have to use option [1]

.. If this property is false then you can use load balancing or fail over
options which send events only to one node at a time..

Thanks,
Mohan


>
>
> On Mon, Aug 22, 2016 at 8:45 PM, Sashika Wijesinghe 
> wrote:
>
>> Hi All,
>>
>> I have a requirement to connect Analytics cluster with the MB cluster (MB
>> 3.2.0 M2).
>>
>> To connect a single analytics node with MB 3.2.0 pack, there is a
>> configuration [1] in the metrics.xml file  to provide the data receiver URL
>> of the analytics node.
>> When Configuring analytics cluster, I have used the minimum HA deployment
>> [2]. May I know how to configure the two analytics data receiver nodes with
>> MB to publish stats?
>>
>> [1]
>> 
>> true
>> 
>> 
>> 
>> 60
>> 
>> thrift
>> 
>> tcp://localhost:7612
>> 
>> 
>> admin
>> admin
>> 
>> repository/conf/data-bridge/data-agent-
>> config.xml
>> 
>>
>> [2] https://docs.wso2.com/display/CLUSTER44x/Minimum+High+
>> Availability+Deployment+-+DAS+3.0.1
>>
>> Thanks
>>
>> --
>>
>> *Sashika WijesingheSoftware Engineer - QA Team*
>> Mobile : +94 (0) 774537487
>> sash...@wso2.com
>>
>
>
>
> --
> Isuru Perera
> Associate Technical Lead | WSO2, Inc. | http://wso2.com/
> Lean . Enterprise . Middleware
>
> about.me/chrishantha
> Contact: +IsuruPereraWSO2 
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Extensive amount of warning logs are printed once the IS520-Analytics server starts up.

[Mohanadarshan Vivekanandalingam]

On Thu, Aug 18, 2016 at 3:55 PM, Tanya Madurapperuma <ta...@wso2.com> wrote:

> This warning is coming from shindig which is the underlying library that
> we used for gadget rendering and is a 3rd party library. Quick solution for
> this is to increase maxDepth value as mentioned in [1] by Mohan.
> If not we will have to analyze EhCache memory for memory consuming objects
> [2] [3]
>
> [1] https://wso2.org/jira/browse/ANLYIS-48
> [2] https://cwiki.apache.org/confluence/display/SHINDIG/
> Debugging+EhCache's+SizeOfEngine
> [3] https://cwiki.apache.org/confluence/display/SHINDIG/
> EhCache+Memory+Analysis
>

@Tanya, Thanks for the response.. I think, increasing the maxDepth value is
not helpful all the time.. Whether you guys, explored about this more ?
Since it is observed in various products/cases. If this log does not
reflect any useful info then can, we disable that at log4j level ?

Thanks,
Mohan


>
> Thanks,
> Tanya
>
> On Thu, Aug 18, 2016 at 3:40 PM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> [Moving to DEV]
>>
>> Related UES/DS jira is [1]..
>>
>> @Sewmini, above logs are only printed once for a user (When loading a
>> gadget for first time - once for each gadget)..
>>
>> [1] https://wso2.org/jira/browse/UES-658
>>
>>
>> Thanks,
>> Mohan
>>
>>
>> On Thu, Aug 18, 2016 at 3:34 PM, Sewmini Jayaweera <sewm...@wso2.com>
>> wrote:
>>
>>> Hi DS team,
>>>
>>> I observed the same issue reported in [1] in the latest Analytics pack
>>> given. I reopened the issue since repeatedly printed warning may mislead
>>> user thinking it's a critical issue eve,n though it is harmless and it
>>> doesn't give a good impression to the user.
>>>
>>> It would be great if we can get this fixed. If it is difficult to fix it
>>> in this release can we change it to an improvement and fix it later without
>>> having it as won't fix?
>>>
>>> [1]. https://wso2.org/jira/browse/ANLYIS-48
>>>
>>> Thank you in advance.
>>> Kind regards,
>>>
>>> Sewmini Jayaweera
>>> *Software Engineer - QA Team*
>>> Mobile: +94 (0) 773 381 250
>>> sewm...@wso2.com
>>>
>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Associate Tech Lead,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673
>>
>
>
>
> --
> Tanya Madurapperuma
>
> Senior Software Engineer,
> WSO2 Inc. : wso2.com
> Mobile : +94718184439
> Blog : http://tanyamadurapperuma.blogspot.com
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [DAS 310] ML Siddhi Extension doc update

[Mohanadarshan Vivekanandalingam]

>
>>> I can see in the doc[1] for the ML siddhi extension, we need to install
>>> the features (ML Siddhi extension ...etc). This was true for previous
>>> releases.
>>>
>>> But I can see these features are already installed in the latest DAS
>>> pack.
>>>
>>> If that's so, we need to update the docs accordingly.
>>>
>>> Can someone please confirm this?
>>>
>>> [1] https://docs.wso2.com/display/ML111/WSO2+CEP+Extension+for+M
>>> L+Predictions
>>>
>>
Yes, correct for DAS.. But,we are not shipping above extension with WSO2
CEP then we need to correct above document appropriately and mention that
DAS does not required these.. BTW, below [1] is the latest documentation
for above..

[1] https://docs.wso2.com/display/CEP420/Installing+Machine+Learner+Features

Thanks,
Mohan


>
>>>
>>> Thanks,
>>> Sachith
>>> --
>>> Sachith Withana
>>> Software Engineer; WSO2 Inc.; http://wso2.com
>>> E-mail: sachith AT wso2.com
>>> M: +94715518127
>>> Linked-In: https://lk.linkedin.com/in/sac
>>> hithwithana
>>>
>>
>>
>>
>> --
>> Rukshani Weerasinha
>>
>> WSO2 Inc.
>> Web:http://wso2.com
>> Mobile: 0777 683 738
>>
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> W.G. Gihan Anuruddha
> Senior Software Engineer | WSO2, Inc.
> M: +94772272595
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Extensive amount of warning logs are printed once the IS520-Analytics server starts up.

[Mohanadarshan Vivekanandalingam]

[Moving to DEV]

Related UES/DS jira is [1]..

@Sewmini, above logs are only printed once for a user (When loading a
gadget for first time - once for each gadget)..

[1] https://wso2.org/jira/browse/UES-658


Thanks,
Mohan


On Thu, Aug 18, 2016 at 3:34 PM, Sewmini Jayaweera  wrote:

> Hi DS team,
>
> I observed the same issue reported in [1] in the latest Analytics pack
> given. I reopened the issue since repeatedly printed warning may mislead
> user thinking it's a critical issue eve,n though it is harmless and it
> doesn't give a good impression to the user.
>
> It would be great if we can get this fixed. If it is difficult to fix it
> in this release can we change it to an improvement and fix it later without
> having it as won't fix?
>
> [1]. https://wso2.org/jira/browse/ANLYIS-48
>
> Thank you in advance.
> Kind regards,
>
> Sewmini Jayaweera
> *Software Engineer - QA Team*
> Mobile: +94 (0) 773 381 250
> sewm...@wso2.com
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Architecture] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

[Mohanadarshan Vivekanandalingam]

On Mon, Aug 15, 2016 at 3:07 AM, Johann Nallathamby <joh...@wso2.com> wrote:

>
>
>>
>> But IMO, this is a notification task isn't. Then, I don't see a need to
>> worry much about performance and throughput..
>>
>
> Performance is not the issue here.
>
>
>> And I don't think it is correct to change the generic notification event
>> publisher component as something which does some IS specific operation
>> which violates its design expectation and looks like a hack ..
>>
>
> That is not quite correct Mohan. Adding claim values to email template is
> nothing IS specific. The CEP's output adaptor framework is used by many
> WSO2 products for notifications. This is a common and valid requirement for
> all the products IMHO. It is with that intension we implemented HTML
> templating support and multi language template support in CEP itself.
> Similarly this is also another requirement.
>
> And I also don't think it is violating the existing architecture.
>
> I would think the same if the adaptors are implemented like a library
> which don't have any other carbon runtime dependency. However fetching the
> email template from registry is also done within the adaptor. So there is
> no good explanation to say fetching user claims from user store violates
> the adaptor design.
>
> If there was a layer before the adaptor layer which handles fetching email
> templates from registry, then in the same layer we can enrich the event
> stream with user claims defined in that template. So by the time the event
> reaches the adaptor all necessary values are in the stream.
>
> What I am saying is whether this code is in the adaptor or in a higher
> layer, ultimately it must be in CEP for all the products to use it. That is
> why we reckon that it is an improvement for CEP.
>

Thanks Johann for the explanation.. I like to add some comments on above..
Event Publisher component consists of two layers, they are event enrichment
layer and transport layer.. Calling registry to get the template, multi
language support and HTML things are acceptable in event enrichment layer
since they used to enhance the event but retrieving claims to create/fill
the event cannot be considered as event enrichment IMHO..

Eventhough IS only sends event specific properties, it sends those
properties through stream then they are considered as event in the eventing
context.. In Event publisher layer, we can do enrichment for that event..

Anyway, Suho and myself had a quick offline chat last Friday.. After that,
I also have a mixed opinion like Suho have.. Anyway, we thought best
approach would be providing an extension point for event enrichment layer..
Then whenever need to perform any operation like above we can use that
extension.. Hope that solves above requirement..

Regards,
Mohan


>
> Regards,
> Johann.
>
>
>> Let's have a quick chat if that help..
>>
>> Thanks,
>> Mohan
>>
>>
>>
>>>
>>> Regards
>>> Suho
>>>
>>> On Thu, Aug 11, 2016 at 4:42 PM, Mohanadarshan Vivekanandalingam <
>>> mo...@wso2.com> wrote:
>>>
>>>>
>>>>
>>>> On Thu, Aug 11, 2016 at 11:32 AM, Indunil Upeksha Rathnayake <
>>>> indu...@wso2.com> wrote:
>>>>
>>>>> Hi Suhothayan,
>>>>>
>>>>> You can refer [1] for the current approach we have taken in IS side
>>>>> when improving notification sending with siddhi streams. As per the
>>>>> discussion we had previously, this approach has been taken in order to
>>>>> avoid the performance degradation due to the redundant loading of email
>>>>> template in IS and analytics. The main reason for the redundant loading is
>>>>> that only in IS side, the user claims can be loaded which needs for 
>>>>> filling
>>>>> out the placeholders in email template.
>>>>>
>>>>> As per the current implementation you are having, we can provide the
>>>>> registry path and let the email template get loaded in analytics side. For
>>>>> that there has to be some improvement in analytics side to get the user
>>>>> claims from user store and filling out the template with those claim
>>>>> values. So that without loading the email template from IS side, we can do
>>>>> it in analytics side.
>>>>>
>>>>> So the suggested improvements as follows.
>>>>> *IS side:*
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> *1) Modified the publisher defi

Re: [Dev] [Architecture] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

[Mohanadarshan Vivekanandalingam]

On Thu, Aug 11, 2016 at 11:45 PM, Sriskandarajah Suhothayan <s...@wso2.com>
wrote:

> I think getting the claims will improve the message formatting when
> sending the message, and based on the discussion with Johann they cannot
> determine what claims the message formatting will need. if IS need to send
> the claims it has to also read the message to understand the necessary
> claims.
>
> Any suggestions ?
>

Hmm.. Message is created/originated from IS side, Isn't it ? Then, why
can't we get whatever claims that required and send them.. Sorry, I don't
see any overall impact because of that (Only thing is there going to be
another registry access to get the template and load relevant claims). If
this is an huge overhead then can't we send all the claims with in the
event (Not sure whether it is acceptable)..

But IMO, this is a notification task isn't. Then, I don't see a need to
worry much about performance and throughput.. And I don't think it is
correct to change the generic notification event publisher component as
something which does some IS specific operation which violates its design
expectation and looks like a hack ..

Let's have a quick chat if that help..

Thanks,
Mohan



>
> Regards
> Suho
>
> On Thu, Aug 11, 2016 at 4:42 PM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>>
>>
>> On Thu, Aug 11, 2016 at 11:32 AM, Indunil Upeksha Rathnayake <
>> indu...@wso2.com> wrote:
>>
>>> Hi Suhothayan,
>>>
>>> You can refer [1] for the current approach we have taken in IS side when
>>> improving notification sending with siddhi streams. As per the discussion
>>> we had previously, this approach has been taken in order to avoid the
>>> performance degradation due to the redundant loading of email template in
>>> IS and analytics. The main reason for the redundant loading is that only in
>>> IS side, the user claims can be loaded which needs for filling out the
>>> placeholders in email template.
>>>
>>> As per the current implementation you are having, we can provide the
>>> registry path and let the email template get loaded in analytics side. For
>>> that there has to be some improvement in analytics side to get the user
>>> claims from user store and filling out the template with those claim
>>> values. So that without loading the email template from IS side, we can do
>>> it in analytics side.
>>>
>>> So the suggested improvements as follows.
>>> *IS side:*
>>>
>>>
>>>
>>>
>>>
>>>
>>> *1) Modified the publisher definition to include registry path of the
>>> email template, specifying the notification type and locale as
>>> placeholders2) When an email notification need to be send, an arbitrary map
>>> (including the data needs to load the email template from registry) will be
>>> published to the streamAnalytics side:1) Load the email template from the
>>> registry (use the arbitrary data values we have provided)2) Extract the
>>> placeholders in email template3) Get the user claims from user store and
>>> fill out the placeholders in the template with the necessary claim values*
>>>
>>
>> Above [1] and [2] are already implemented in Event Publisher level and
>> can be usable for above usecase.. But [2] (which is mentioned as an
>> improvement for Analytics side) is not valid IMO.. That is not something
>> that we need to handle in analytics or Event Publisher side, it is
>> architecturally incorrect to handle in that level.. What need to be done
>> is, we need to get those claims from identity level and send those relevant
>> claims in the event itself..
>>
>> What is the reason for defining [3] as an improvement for analytics ?
>>
>> Thanks,
>> Mohan
>>
>>
>>>
>>>
>>> We have used two prefixes in placeholders of email templates as
>>> "user.claim.identity" and "user.claim", in order to specify that the
>>> placeholders has to be filled with an identity claim and other wso2 claim
>>> respectively. The claim URIs which we are using when retrieving necessary
>>> user claims for the email templates, will be generated appending necessary
>>> prefix to the "http://wso2.org/claims/;. As an example if the
>>> placeholder is "user.claim.givenname", the claim URI should be "
>>> http://wso2.org/claims/givenname;. So that placeholder has to be filled
>>> with the user claim value corresponding to the above mentioned claim URI.
>>> You can refer [2] for th

Re: [Dev] [Architecture] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

[Mohanadarshan Vivekanandalingam]

On Thu, Aug 11, 2016 at 11:32 AM, Indunil Upeksha Rathnayake <
indu...@wso2.com> wrote:

> Hi Suhothayan,
>
> You can refer [1] for the current approach we have taken in IS side when
> improving notification sending with siddhi streams. As per the discussion
> we had previously, this approach has been taken in order to avoid the
> performance degradation due to the redundant loading of email template in
> IS and analytics. The main reason for the redundant loading is that only in
> IS side, the user claims can be loaded which needs for filling out the
> placeholders in email template.
>
> As per the current implementation you are having, we can provide the
> registry path and let the email template get loaded in analytics side. For
> that there has to be some improvement in analytics side to get the user
> claims from user store and filling out the template with those claim
> values. So that without loading the email template from IS side, we can do
> it in analytics side.
>
> So the suggested improvements as follows.
> *IS side:*
>
>
>
>
>
>
> *1) Modified the publisher definition to include registry path of the
> email template, specifying the notification type and locale as
> placeholders2) When an email notification need to be send, an arbitrary map
> (including the data needs to load the email template from registry) will be
> published to the streamAnalytics side:1) Load the email template from the
> registry (use the arbitrary data values we have provided)2) Extract the
> placeholders in email template3) Get the user claims from user store and
> fill out the placeholders in the template with the necessary claim values*
>

Above [1] and [2] are already implemented in Event Publisher level and can
be usable for above usecase.. But [2] (which is mentioned as an improvement
for Analytics side) is not valid IMO.. That is not something that we need
to handle in analytics or Event Publisher side, it is architecturally
incorrect to handle in that level.. What need to be done is, we need to get
those claims from identity level and send those relevant claims in the
event itself..

What is the reason for defining [3] as an improvement for analytics ?

Thanks,
Mohan


>
>
> We have used two prefixes in placeholders of email templates as
> "user.claim.identity" and "user.claim", in order to specify that the
> placeholders has to be filled with an identity claim and other wso2 claim
> respectively. The claim URIs which we are using when retrieving necessary
> user claims for the email templates, will be generated appending necessary
> prefix to the "http://wso2.org/claims/;. As an example if the placeholder
> is "user.claim.givenname", the claim URI should be "
> http://wso2.org/claims/givenname;. So that placeholder has to be filled
> with the user claim value corresponding to the above mentioned claim URI.
> You can refer [2] for the implementation done in IS side, we can move that
> logic to analytics side.
>
> [1] https://github.com/wso2-extensions/identity-event-
> handler-notification/pull/26/files
> [2] https://github.com/wso2-extensions/identity-event-
> handler-notification/pull/26/files#diff-2200b351eeef81ebbb5ea7f0d1f1ec
> b7R119
>
> Thanks and Regards
>
> On Tue, Aug 9, 2016 at 9:50 PM, Sriskandarajah Suhothayan <s...@wso2.com>
> wrote:
>
>> Based on the chat with Johann he suggested to support claims at event
>> publisher.
>> @Indunil, can you get the full requirements and update the thread.
>>
>> Regards
>> Suho
>>
>> On Mon, Aug 1, 2016 at 11:24 PM, Mohanadarshan Vivekanandalingam <
>> mo...@wso2.com> wrote:
>>
>>>
>>>
>>> On Mon, Aug 1, 2016 at 8:38 PM, Indunil Upeksha Rathnayake <
>>> indu...@wso2.com> wrote:
>>>
>>>> Hi Suhothayan,
>>>>
>>>> Hi Indunil,
>>>
>>> I like to add some comments on this.. Please find them below..
>>>
>>>
>>>> There was an issue in EventPublisherServiceDS where
>>>> setConfigurationContextService() method get invoked after the bundle
>>>> get activated. Due to that, when we are trying to invoke
>>>> deployEventPublisherConfiguration() of EventPublisherService from the
>>>> activate method of an osgi bundle in IS side, it's receiving a null
>>>> pointer(Since it refers the ConfigurationContextService object in
>>>> EventPublisherServiceValueHolder). I think you can resolve it by
>>>> changing the osgi reference cardinality in [1] as "1..1"(Mandatory), if
>>>> there is no specific reason for making it optional.
>>>>
>>>
&g

Re: [Dev] [Architecture] [IS] [Analytics] Improvement to use Siddhi streams to send notifications

[Mohanadarshan Vivekanandalingam]

On Mon, Aug 1, 2016 at 8:38 PM, Indunil Upeksha Rathnayake  wrote:

> Hi Suhothayan,
>
> Hi Indunil,

I like to add some comments on this.. Please find them below..


> There was an issue in EventPublisherServiceDS where
> setConfigurationContextService() method get invoked after the bundle get
> activated. Due to that, when we are trying to invoke
> deployEventPublisherConfiguration() of EventPublisherService from the
> activate method of an osgi bundle in IS side, it's receiving a null
> pointer(Since it refers the ConfigurationContextService object in
> EventPublisherServiceValueHolder). I think you can resolve it by changing
> the osgi reference cardinality in [1] as "1..1"(Mandatory), if there is no
> specific reason for making it optional.
>

There is a valid reason for this..
I believe, as you know we cannot guarantee about OSGI bundle loading in
carbon environment.. In this case, there is a possibility where axis2
deployment can start before bundle activation of a OSGI component. To avoid
this we'll follow a similar approach like below,



   org.wso2.carbon.event.publisher.core.EventPublisherService



Here, we are adding the reference of the corresponding OSGI service which
is exposed by relevant OSGI module.. If you want to use above approach
(Axis2RequiredServices), we cannot have 1..1 mapping for
ConfigurationContextService since it causes cyclic dependency and affects
bundle loading..

In IS side we were able to get rid of the null pointer by adding an osgi
> reference for ConfigurationContextService in the service component and
> invoked the deployEventPublisherConfiguration() in activate() method.
>

No, above solution is not correct and will not work all the time.. There is
a possibility where you'll encounter same issue when
ConfigurationContextService is bind to you component first and takes
sometime to resolve for Event Publisher..

What is the usecase for creating an Event Publisher in server restart ? Can
you ship the pack with an Event Publisher or deploy an event publisher for
first event if it is not there..


> And also there was an issue in filling out dynamic properties of an output
> adapter from the arbitrary data values, and sent a PR for that. Please
> review and merge the PR in [2].
>

Thanks, Merged it..

Regards,
Mohan


>
> [1]
> https://github.com/wso2/carbon-analytics-common/blob/master/components/event-publisher/org.wso2.carbon.event.publisher.core/src/main/java/org/wso2/carbon/event/publisher/core/internal/ds/EventPublisherServiceDS.java#L56
> [2] https://github.com/wso2/carbon-analytics-common/pull/306/files
>
> Thanks and Regards
>
> On Mon, Aug 1, 2016 at 3:06 PM, Sriskandarajah Suhothayan 
> wrote:
>
>> HI Indunil
>>
>> Any update on this? Was the provided solution working?
>>
>> We released CEP 4.2-RC1. If we need new features/improvements for this
>> effort, we can incorporate them in the next component release.
>>
>> Regards
>> Suho
>>
>> On Fri, Jul 22, 2016 at 3:10 PM, Sriskandarajah Suhothayan > > wrote:
>>
>>>
>>>
>>> On Fri, Jul 22, 2016 at 3:00 PM, Johann Nallathamby 
>>> wrote:
>>>


 On Fri, Jul 22, 2016 at 8:33 AM, Indunil Upeksha Rathnayake <
 indu...@wso2.com> wrote:

> Hi,
>
> On Fri, Jul 22, 2016 at 12:28 PM, Sriskandarajah Suhothayan <
> s...@wso2.com> wrote:
>
>>
>>
>> On Fri, Jul 22, 2016 at 12:00 PM, Indunil Upeksha Rathnayake <
>> indu...@wso2.com> wrote:
>>
>>> Hi,
>>>
>>> Please find the meeting notes in [1].  I have following
>>> considerations regarding the improvements we have discussed.
>>>
>>> (1) Even though we have configured to load the email template from
>>> EventPublisher(analytics side), the placeholder values has to be sent as
>>> meta data/correlation data/payload data/arbitrary data, since in 
>>> analytics
>>> side, the user claim values are not getting from the user store.
>>> In order to send the placeholder values from IS side, anyway we have
>>> to load the email template and retrieve the placeholders. So as I have
>>> understood, for email notifications, it's not needed to use the email
>>> template loading part in analytics, since it'll be a redundant task. 
>>> (Refer
>>> [2])
>>>
>>
>> Here we can set the claim values as arbitrary data, and the
>> notification specific details as the meta, correlation & payload data.
>> Then we can use the template loading only at the analytics side.
>>
> In this case, from IS side, without parsing only the user claims
> needed for a particular email template(i.e.user claim values for the
> placeholders in email template), we have to pass all the user claims as
> arbitrary data values. In that case there's no need for loading the
> template from the registry in IS side. So that in analytics side, all the
> values needed for 

Re: [Dev] Adding YARN configuration files in anlytics4x distributions

[Mohanadarshan Vivekanandalingam]

Thanks Niranda.. Added them..


On Fri, Jul 22, 2016 at 9:34 PM, Niranda Perera  wrote:

> Hi all,
>
> Since the YARN support for DAS, the following config files were added to
> the spark server feature. [1]
>
> Please add those files in the relevant bin.xml file in the product
> analytic4x distribution to maintain the consistency [2]
>
> Best
>
> [1]
> https://github.com/wso2/carbon-analytics/tree/master/features/analytics-processors/org.wso2.carbon.analytics.spark.server.feature/resources/yarn
> [2]
> https://github.com/wso2/product-das/commit/df328c73ead9ca11b4c3e3c91fbc8c95ea70620b
>
> --
> *Niranda Perera*
> Software Engineer, WSO2 Inc.
> Mobile: +94-71-554-8430
> Twitter: @n1r44 
> https://pythagoreanscript.wordpress.com/
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] IS Analytics - Handling zero values in Login Attempts over Time chart

[Mohanadarshan Vivekanandalingam]

I prefer the figure [2] which shows 0 values since it gives more meaningful
information to the user..

@Prabath/Johann/Hasintha, wdyt ?


Thanks,
Mohan


On Mon, Jul 25, 2016 at 11:08 AM, Manorama Perera  wrote:

> Hi all,
>
> In Authentication dashboard we show login attempts using an area chart.
> The current implementation of this chart doesn't show zero values when
> there are no login attempts corresponding to some points of time within the
> selected period of time.
>
> For example, as described in [1], consider following scenario where we
> have login events from 10.10 AM to 10.25 AM
>
> From 10.10 - 10.13 - There are some login attempts
> From 10.14 - 10.17 - *Zero login attempts*
> From 10.18 - 10.25 - Some login attempts
>
> Currently we are showing the above information in the chart as follows,
>
> [image: Inline image 1]
>
> In this chart we are not showing the information about the zero login
> attempts.
>
> In order to show these information, we have changed the chart as below,
>
> [image: Inline image 2]
>
> Now it is showing the zero login attempts. But the chart now is divided
> into two areas.
>
> What is the better way to draw chart when we have zero login attempts.
> Appreciate any suggestions and opinions on this.
>
> [1] https://wso2.org/jira/browse/ANLYIS-64
>
> Thanks
> --
> Manorama Perera
> Software Engineer
> WSO2, Inc.;  http://wso2.com/
> Mobile : +94716436216
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Adding drill down capabilities to the Area Chart in IS Analytics Server Dashboard

[Mohanadarshan Vivekanandalingam]

HI Johann & Hasintha,

Appreciate any feedback on above, then we can implement accordingly and do
some perf tests.. If drill capability is required for Map then we need to
follow above option.. Here, we can

1) Change the stream in Identity level and publish
2) Change at DAS level by adding another attributes in Siddhi scope..

But, I like to avoid option [2] to avoid unnecessary event conversions
(which impact the TPS).. Then, option [1] is the only solution in this
case..

Thanks,
Mohan


On Tue, Jun 28, 2016 at 4:16 PM, Nuwandi Wickramasinghe 
wrote:

> Hi all,
>
> IS Analytics dashboard contains a map in which we have marked the regions
> of users who have authenticated through Identity Server. Our concern is
> whether we should allow to drill down from this map.
>
> Normally when drilling down from a gadget, in the dashboard we only show
> the data related to that selected field. And there's a data table below
> which shows the raw data corresponding to the selected field. This data
> table is populated using the raw stream which is published from Identity
> Server side.
>
> When implementing drill down capabilities from the area chart (map), we
> are facing an issue in populating the data table since the raw data stream
> published from IS contains only the remoteIp (which is used to determine
> the region) but not the region field itself.
>
> Regions and IP addresses have one to many relationship. Which means a
> large range of IPs corresponds to one region. Therefore we can get the
> region from IP but not vise versa. This leaves the issue that we cannot
> search in the raw stream using the region selected from the map.
>
> Suggested solution is to change the raw data stream to contain an
> additional 'region' attribute which could be used to search for the data
> related to a particular region. The value of region for the raw data will
> be sent as 'NOT_AVAILABLE'. We are planning to update this value to the
> correct region according to the remoteIp value using a spark query. We
> considered updating the records from the execution plan but that could
> delay the real time process.
>
> If we are going to implement this, Hasintha will have to introduce the new
> region attribute to the stream with a default value. Also this might
> introduce some performance degrade in the db level.
>
> We are still considering the need of drilling down from the region map.
> Appreciate other opinions regarding the subject.
>
> Thanks
> Nuwandi
>
> --
>
> Best Regards,
>
> Nuwandi Wickramasinghe
>
> Software Engineer
>
> WSO2 Inc.
>
> Web : http://wso2.com
>
> Mobile : 0719214873
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Analytics] Error running server.sh script with spaces in the directory path

[Mohanadarshan Vivekanandalingam]

On Mon, Jun 20, 2016 at 9:13 PM, Dulindra Wijethilake <dulin...@wso2.com>
wrote:

> Will do Mohan. However, is there any reason which you can think of Carbon
> 4.4.3 starting without an error where as IS analytics getting this error?


Yes.. In DAS, they are copying a separate wso2server.sh file than using the
same wso2sever.sh file which is coming from kernal because there are some
customization required. May be they are using an older version of
wso2server.sh file which does not have required fix..

Thanks,
Mohan


> Regards,
>
>
> On Monday, June 20, 2016, Mohanadarshan Vivekanandalingam <mo...@wso2.com>
> wrote:
>
>>
>>
>> On Mon, Jun 20, 2016 at 3:17 PM, Dulindra Wijethilake <dulin...@wso2.com>
>> wrote:
>>
>>> Hi Niranjan,
>>> It seems IS analytics is based on Carbon 4.4.3.
>>>
>>> @DAS team,
>>> Do we have any plans to update the carbon version to a newer version?
>>>
>>
>> Yes, we have to move Carbon 4.4.6.. Already. ground work is going on
>> this.. Anyway, can you please raise a jira on this ? It will help to track
>>
>> Thanks,
>> Mohan
>>
>>
>>>
>>> On Mon, Jun 20, 2016 at 3:02 PM, Niranjan Karunanandham <
>>> niran...@wso2.com> wrote:
>>>
>>>> Hi Dulindra,
>>>>
>>>> This was a known issue in windows and we have fixed it by using the
>>>> short path. I have tested with spaces in the folder name for Kenerl 4.4.5
>>>> in Ubuntu 14.04 (with JDK Oracle 1.7) and I did not get any issues. Will
>>>> you be able to verify this in Kernel 4.4.5?
>>>>
>>>> Regardsm
>>>> Nira
>>>>
>>>> On Mon, Jun 20, 2016 at 2:33 PM, Dulindra Wijethilake <
>>>> dulin...@wso2.com> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> While trying to run IS Analytics [1], I got the error below:
>>>>>
>>>>> *..*
>>>>>
>>>>> *Dulindras-MacBook-Pro:bin dulindrawijethilake$ sh wso2server.sh*
>>>>>
>>>>> *JAVA_HOME environment variable is set to
>>>>> /Library/Java/JavaVirtualMachines/jdk1.8.0_65.jdk/Contents/Home*
>>>>>
>>>>> *CARBON_HOME environment variable is set to
>>>>> /Users/dulindrawijethilake/Documents/WSO2 - Products/IS/IS
>>>>> Analytics/wso2analytics-is-1.0.0-beta*
>>>>>
>>>>> *wso2server.sh: line 286: /Users/dulindrawijethilake/Documents/WSO2:
>>>>> No such file or directory*
>>>>>
>>>>> *.*
>>>>>
>>>>> I realized that there is an issue with the wso2server.sh script when
>>>>> there are spaces used in the directory path. Once spaces were removed, the
>>>>> script worked as expected.
>>>>>
>>>>> Is this something already known which we have addressed in the kernel?
>>>>>
>>>>>
>>>>>
>>>>> [1]
>>>>> https://github.com/wso2/analytics-is/releases/download/v1.0.0-beta/wso2analytics-is-1.0.0-beta.zip
>>>>>
>>>>> --
>>>>> Dulindra Wijethilake
>>>>> Senior Product Manager
>>>>> WSO2, Inc.; http://wso2.com
>>>>> lean.enterprise.middleware
>>>>> mobile- +94 71 312 0005
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>>
>>>> *Niranjan Karunanandham*
>>>> Associate Technical Lead - WSO2 Inc.
>>>> WSO2 Inc.: http://www.wso2.com
>>>>
>>>
>>>
>>>
>>> --
>>> Dulindra Wijethilake
>>> Senior Product Manager
>>> WSO2, Inc.; http://wso2.com
>>> lean.enterprise.middleware
>>> mobile- +94 71 312 0005
>>>
>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Associate Tech Lead,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673
>>
>
>
> --
> Dulindra Wijethilake
> Senior Product Manager
> WSO2, Inc.; http://wso2.com
> lean.enterprise.middleware
> mobile- +94 71 312 0005
>
>


-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Analytics] Error running server.sh script with spaces in the directory path

[Mohanadarshan Vivekanandalingam]

On Mon, Jun 20, 2016 at 3:17 PM, Dulindra Wijethilake 
wrote:

> Hi Niranjan,
> It seems IS analytics is based on Carbon 4.4.3.
>
> @DAS team,
> Do we have any plans to update the carbon version to a newer version?
>

Yes, we have to move Carbon 4.4.6.. Already. ground work is going on this..
Anyway, can you please raise a jira on this ? It will help to track

Thanks,
Mohan


>
> On Mon, Jun 20, 2016 at 3:02 PM, Niranjan Karunanandham  > wrote:
>
>> Hi Dulindra,
>>
>> This was a known issue in windows and we have fixed it by using the short
>> path. I have tested with spaces in the folder name for Kenerl 4.4.5 in
>> Ubuntu 14.04 (with JDK Oracle 1.7) and I did not get any issues. Will you
>> be able to verify this in Kernel 4.4.5?
>>
>> Regardsm
>> Nira
>>
>> On Mon, Jun 20, 2016 at 2:33 PM, Dulindra Wijethilake 
>> wrote:
>>
>>> Hi All,
>>>
>>> While trying to run IS Analytics [1], I got the error below:
>>>
>>> *..*
>>>
>>> *Dulindras-MacBook-Pro:bin dulindrawijethilake$ sh wso2server.sh*
>>>
>>> *JAVA_HOME environment variable is set to
>>> /Library/Java/JavaVirtualMachines/jdk1.8.0_65.jdk/Contents/Home*
>>>
>>> *CARBON_HOME environment variable is set to
>>> /Users/dulindrawijethilake/Documents/WSO2 - Products/IS/IS
>>> Analytics/wso2analytics-is-1.0.0-beta*
>>>
>>> *wso2server.sh: line 286: /Users/dulindrawijethilake/Documents/WSO2: No
>>> such file or directory*
>>>
>>> *.*
>>>
>>> I realized that there is an issue with the wso2server.sh script when
>>> there are spaces used in the directory path. Once spaces were removed, the
>>> script worked as expected.
>>>
>>> Is this something already known which we have addressed in the kernel?
>>>
>>>
>>>
>>> [1]
>>> https://github.com/wso2/analytics-is/releases/download/v1.0.0-beta/wso2analytics-is-1.0.0-beta.zip
>>>
>>> --
>>> Dulindra Wijethilake
>>> Senior Product Manager
>>> WSO2, Inc.; http://wso2.com
>>> lean.enterprise.middleware
>>> mobile- +94 71 312 0005
>>>
>>
>>
>>
>> --
>>
>>
>> *Niranjan Karunanandham*
>> Associate Technical Lead - WSO2 Inc.
>> WSO2 Inc.: http://www.wso2.com
>>
>
>
>
> --
> Dulindra Wijethilake
> Senior Product Manager
> WSO2, Inc.; http://wso2.com
> lean.enterprise.middleware
> mobile- +94 71 312 0005
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Siddhi table join behavior

[Mohanadarshan Vivekanandalingam]

On Wed, Jun 15, 2016 at 1:47 PM, CD Athuraliya  wrote:

> Hi CEP team,
>
> HI CD,


> I'm running performance tests for an execution plan which is used to send
> session termination events for security analytics dashboard. I need to
> perform a load test for flushing an event table scenario. We have added
> another temp stream to trigger the event table flush as below. Since we
> need to measure throughput/latency for event table flushing we have
> (temporally) added current timestamp to one attribute of each event. But it
> appears that the timestamp is same for every event, which causes erroneous
> latency values. Is this the expected behavior of below Siddhi syntax? Or
> else what would be the best approach to load test a scenario like this?
> Appreciate your thoughts/comments. I'm using this consumers/publishers,
> based on these samples [1].
>
> from flushStream join EventTerminationTable
> select sessionId, time:timestampInMilliseconds(time:currentTimestamp(),
> '-MM-dd HH:mm:ss') as sessionStart, sessionRenew, sessionTermination,
> action, username, userStoreDomain, ip, tenantId, rememberFlag
> insert into TestSessionAnalyticsOutputStream;
>

As I mentioned offline, time:timestampInMilliseconds  method will be called
for every join. Since this operation if faster you couldn't see much
difference in the timestamp value, (when you have large no of events then
you can see some change in timestamp)..

Thanks,
Mohan


>
> [1] https://github.com/wso2/product-cep/tree/master/modules/samples
>
> Thanks,
> CD
>
> --
> *CD Athuraliya*
> Software Engineer
> WSO2, Inc.
> lean . enterprise . middleware
> Mobile: +94 716288847 <94716288847>
> LinkedIn  | Twitter
>  | Blog
> 
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [CEP][MB][ANALYTICS][APIM] couldn't connect to the MB, Analytics Components when email user name enabled

[Mohanadarshan Vivekanandalingam]

On Wed, Jun 15, 2016 at 10:44 AM, Ushani Balasooriya 
wrote:

> Hi CEP team,
>
> Any update on this? Should this be included in the documentation or are we
> going to fix it as a convention?
>

@Ushani, give us sometime.. There are some other priorities that we are
working on.. Is this something that blocks your testing ? If not, please
give us some time.. Will respond asap..

Thanks,
Mohan

>
> Thanks,
>
>
> On Tue, Jun 14, 2016 at 12:03 PM, Pamod Sylvester  wrote:
>
>> Hi Ushani,
>>
>> When email username is enabled, we need a mechanism to identify the
>> tenant domain. Hence in that case we need to have the username defined in
>> the following format, ad...@wso2.com@*tenantdomain. *
>>
>> For the case of super tenant when email username is enabled, an option
>> could be considered to do another check to default to super tenant if a
>> tenant domain is not specified (in order to omit suffixing with 
>> @carbon.super).
>> However, also note this would slightly impact performance.
>>
>> Also i believe we need to check with the CEP team on possibility of
>> changing the convention.
>>
>> Thanks,
>> Pamod
>>
>> On Tue, Jun 14, 2016 at 11:34 AM, Ushani Balasooriya 
>> wrote:
>>
>>> Hi Pamod,
>>>
>>> So according to this issue [1],when you enable email as username, to
>>> connect to decision server we have to provide domain name of the super
>>> tenant as e.g., ad...@wso2.com@carbon.super.
>>>
>>> But when email is not enabled, you can go with 'admin' as username. Also
>>> we do not specifically mention the domain name for super tenant.
>>>
>>> Shouldn't it be in the same format when providing credentials? Otherwise
>>> a user will be mislead with configurations. Or we need to specifically
>>> mention this in documentation. WDYT?
>>>
>>> [1] https://wso2.org/jira/browse/APIMANAGER-4987
>>>
>>> Thanks,
>>> Ushani
>>>
>>>
>>> On Wed, Jun 8, 2016 at 9:30 PM, Pamod Sylvester  wrote:
>>>
 Hi Tharindu,

 To further elaborate, AMQP connection URL is in the following format
 [1],


 *amqp://[:@][][?=''[&=&'']]*

 '@' character is used to partition between client credentials with the
 rest of the uri. hence having the '@' for the user name (email as user
 name) would violate the specification.

 As Indika explained we use '!' character as an alternative to the
 restricted character '@' to identify tenant users. Hence, when you send a
 user name as *"foo!bar.com "*  it would try to find a
 user *foo* in tenant *bar.com * instead of finding the
 user in *super tenant* by email *'f...@bar.com '*. That
 would be the possible reason for you to get the error "invalid tenant
 domain".

 [1]
 https://qpid.apache.org/releases/qpid-0.30/jms-client-0-8/book/JMS-Client-0-8-Connection-URL.html

 Thanks,
 Pamod

 On Wed, Jun 8, 2016 at 6:59 PM, Tharindu Dharmarathna <
 tharin...@wso2.com> wrote:

> Hi All,
>
> In APIM 2.0 Snapshot Pack we have got issue when authenticate with the
> CEP, DAS and MB components.
>
>
> *CEP and DAS Components*
>
> As per the debugging session with Mohan we have found when we
> authenticate the email user from [1] , It will not proper username with
> tenant domain which caused to get the invalid tenant domain from [2].
>
> *MB Components*
>
>  When we do authentication request with MB it will not suppose to send
> the email user in connection url since its a restricted character. As per
> the Pamod pointed out we had replace the '@' mark with '!' in order to
> overcome that issue . But this was not getting worked as correctly.
>
> Can any one give any clue to overcome this issue.
>
>
> [1] -
> https://github.com/wso2/carbon-analytics-common/blob/release-5.0.12-alpha/components/data-bridge/org.wso2.carbon.databridge.core/src/main/java/org/wso2/carbon/databridge/core/internal/authentication/CarbonAuthenticationHandler.java#L51
>
> [2] -
> https://github.com/wso2/carbon-commons/blob/v4.4.8/components/authentication/org.wso2.carbon.identity.authentication/src/main/java/org/wso2/carbon/identity/authentication/AuthenticationServiceImpl.java#L59
>
>
> --
>
> *Tharindu Dharmarathna*Software Engineer
> WSO2 Inc.; http://wso2.com
> lean.enterprise.middleware
>
> mobile: *+94779109091 <%2B94779109091>*
>



 --
 *Pamod Sylvester *

 *WSO2 Inc.; http://wso2.com *
 cell: +94 77 7779495

 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev


>>>
>>>
>>> --
>>> *Ushani Balasooriya*
>>> Senior Software Engineer - QA;
>>> WSO2 Inc; http://www.wso2.com/.
>>>
>>>
>>>
>>
>>
>> --
>> *Pamod Sylvester *
>>

Re: [Dev] [CEP] Dynamic key and values support in CEP output adapter

[Mohanadarshan Vivekanandalingam]

On Fri, Jun 10, 2016 at 3:13 PM, Rajjaz Mohammed <raj...@wso2.com> wrote:

> Hi,
>
> I'm planning to follow the same approach followed in CEP kafka input event
> adapter to get optional configuration properties.
>
> @Mohanadharshan
> WDYT?
>

If that is the requirement then +1..

Thanks,
Mohan


>
> [1]
> https://docs.wso2.com/display/CEP300/Input+Kafka+Event+Adapter#InputKafkaEventAdapter-ConfiguringinputKafkaeventadapter
> <https://docs.wso2.com/display/CEP300/Input+Kafka+Event+Adapter>
>
>
>
> On Fri, Jun 10, 2016 at 1:39 PM, Rajjaz Mohammed <raj...@wso2.com> wrote:
>
>> Hi,
>>
>> Currently, FileWriter will Save the events in given file but As we
>> discussed I need to add events to different files based on some unique keys
>> from the single stream. So we need to keep unique value and the file name
>> belongs to the unique key. How this possible in CEP output adapter?
>>
>> On Fri, Jun 10, 2016 at 12:14 PM, Mohanadarshan Vivekanandalingam <
>> mo...@wso2.com> wrote:
>>
>>> HI Rajjaz,
>>>
>>> I am not clear about your requirement.. Can you explain your requirement
>>> please ?
>>>
>>> Thanks,
>>> Mohan
>>>
>>>
>>> On Fri, Jun 10, 2016 at 11:21 AM, Rajjaz Mohammed <raj...@wso2.com>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I'm developing File event publisher as an analytics extension. I have
>>>> the requirement to get the key and  values dynamically. How can achieve
>>>> this in CEP? any idea?
>>>>
>>>> eg:
>>>> uniqueID1--> filePath1
>>>> uniqueID2--> filePath2
>>>> uniqueID3--> filePath3
>>>> uniqueID4--> filePath4
>>>>
>>>>
>>>> --
>>>> Thank you
>>>> Best Regards
>>>>
>>>> *Rajjaz HM*
>>>> Associate Software Engineer
>>>> Platform Extension Team
>>>> WSO2 Inc. <http://wso2.com/>
>>>> lean | enterprise | middleware
>>>> Mobile | +94752833834|+94777226874
>>>> Email   | raj...@wso2.com
>>>> LinkedIn <https://lk.linkedin.com/in/hmohammedrajjaz> | Blogger
>>>> <http://rajjazhm.blogspot.com/> | WSO2 Profile
>>>> <http://wso2.com/about/team/mohammer-rajjaz/>
>>>>
>>>
>>>
>>>
>>> --
>>> *V. Mohanadarshan*
>>> *Associate Tech Lead,*
>>> *Data Technologies Team,*
>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>> *lean.enterprise.middleware.*
>>>
>>> email: mo...@wso2.com
>>> phone:(+94) 771117673
>>>
>>
>>
>>
>> --
>> Thank you
>> Best Regards
>>
>> *Rajjaz HM*
>> Associate Software Engineer
>> Platform Extension Team
>> WSO2 Inc. <http://wso2.com/>
>> lean | enterprise | middleware
>> Mobile | +94752833834|+94777226874
>> Email   | raj...@wso2.com
>> LinkedIn <https://lk.linkedin.com/in/hmohammedrajjaz> | Blogger
>> <http://rajjazhm.blogspot.com/> | WSO2 Profile
>> <http://wso2.com/about/team/mohammer-rajjaz/>
>>
>
>
>
> --
> Thank you
> Best Regards
>
> *Rajjaz HM*
> Associate Software Engineer
> Platform Extension Team
> WSO2 Inc. <http://wso2.com/>
> lean | enterprise | middleware
> Mobile | +94752833834|+94777226874
> Email   | raj...@wso2.com
> LinkedIn <https://lk.linkedin.com/in/hmohammedrajjaz> | Blogger
> <http://rajjazhm.blogspot.com/> | WSO2 Profile
> <http://wso2.com/about/team/mohammer-rajjaz/>
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [CEP] Dynamic key and values support in CEP output adapter

[Mohanadarshan Vivekanandalingam]

HI Rajjaz,

I am not clear about your requirement.. Can you explain your requirement
please ?

Thanks,
Mohan


On Fri, Jun 10, 2016 at 11:21 AM, Rajjaz Mohammed  wrote:

> Hi All,
>
> I'm developing File event publisher as an analytics extension. I have the
> requirement to get the key and  values dynamically. How can achieve this in
> CEP? any idea?
>
> eg:
> uniqueID1--> filePath1
> uniqueID2--> filePath2
> uniqueID3--> filePath3
> uniqueID4--> filePath4
>
>
> --
> Thank you
> Best Regards
>
> *Rajjaz HM*
> Associate Software Engineer
> Platform Extension Team
> WSO2 Inc. 
> lean | enterprise | middleware
> Mobile | +94752833834|+94777226874
> Email   | raj...@wso2.com
> LinkedIn  | Blogger
>  | WSO2 Profile
> 
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] SnapshotService info logs to debug mode

[Mohanadarshan Vivekanandalingam]

On Thu, Jun 9, 2016 at 2:56 PM, Nirmal Fernando  wrote:

> Still see these INFO logs. Shall we please remove them?
>

Yes, we'll check and fix.. Grainer has added to jira [1].

[1] https://wso2.org/jira/browse/CEP-1508

Thanks,
Mohan


>
> On Wed, Apr 13, 2016 at 8:03 AM, Nirmal Fernando  wrote:
>
>> I think I found what's happening.
>>
>> * CEP starts to synch from a Snapshot as soon as it got to know that
>> there's a new member, hence, it complains that there're no exec. plans
>> (other node is still starting up, hence no execution plans yet). (there was
>> a NPE while doing this and I fixed it in
>> https://github.com/wso2/siddhi/pull/135/files)
>> * Then the active node, keeps trying till the other node gets to the
>> correct state.
>>
>> And I think we can implement an exponential backoff instead of doing the
>> check one after another. Wdyt?
>>
>>
>> On Tue, Apr 12, 2016 at 2:26 PM, Nirmal Fernando  wrote:
>>
>>> Yes me too. There were more logs. Basically, once the other node joined,
>>> these kind of logs got printed around 3/4 times.
>>>
>>> On Tue, Apr 12, 2016 at 2:18 PM, Sriskandarajah Suhothayan <
>>> s...@wso2.com> wrote:
>>>
 I'm wondering why there are lots of Snapshot taken at with close time
 gap.

 On Tue, Apr 12, 2016 at 1:56 PM, Nirmal Fernando 
 wrote:

> Hi CEP team,
>
> Shall we move these info logs to debug level?
>
> TID: [-1] [] [2016-04-12 08:24:47,094]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Snapshot
> serialization finished. 
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,096]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Taking snapshot 
> ...
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,097]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Taking snapshot
> finished. {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,097]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Snapshot
> serialization started ...
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,097]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Snapshot
> serialization finished. 
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,097]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Taking snapshot 
> ...
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,098]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Taking snapshot
> finished. {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,098]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Snapshot
> serialization started ...
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,101]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Snapshot
> serialization finished. 
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,101]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Taking snapshot 
> ...
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,101]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Taking snapshot
> finished. {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,101]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Snapshot
> serialization started ...
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,102]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Snapshot
> serialization finished. 
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,102]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Taking snapshot 
> ...
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,102]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Taking snapshot
> finished. {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,102]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Snapshot
> serialization started ...
> {org.wso2.siddhi.core.util.snapshot.SnapshotService}
>
> TID: [-1] [] [2016-04-12 08:24:47,103]  INFO
> {org.wso2.siddhi.core.util.snapshot.SnapshotService} -  Snapshot
> serialization 

Re: [Dev] Analytics IS - Handling null or empty Strings to show on respective gadgets

[Mohanadarshan Vivekanandalingam]

On Thu, Jun 9, 2016 at 2:03 AM, Sriskandarajah Suhothayan <s...@wso2.com>
wrote:

> I think the way to handle this is by sending some default value, or
> identify nulls and replacing them with default value.
> I think the trick here is to find a default value that users cannot
> create. How about using  "NOT AVAILABLE" with space. I think IS does not
> allow users to create username with spaces so it will not conflict with any
> other username.
>

Yes, we should have a default value for this.. But, I think IS allows to
have user name with spaces by changing the relevant regex in user-mgt.xml
file.. Then, we need to think about some unique value where IS does not
allow..

Can't we introduce a config file to add this default value ?  Then, it is
the responsibility of the server-admin to configure it accordingly..

Thanks,
Mohan


>
> Regards
> Suho
>
> On Tue, Jun 7, 2016 at 8:29 PM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>>
>>
>> On Tue, Jun 7, 2016 at 6:35 PM, Hasintha Indrajee <hasin...@wso2.com>
>> wrote:
>>
>>> Hi Damith,
>>>
>>> For the time being we can follow this approach. But this seems like a
>>> standard problem we may face in other products as well. Any standard way of
>>> handling this ? Any ideas for handling this issue in future ?
>>>
>>>
>> Hmm, AFAIK above was not became an issue for other analytics
>> products/usecases ..
>>
>> @Srinath and all, do you guys have any suggestions ? what should be the
>> best approach ?..
>>
>> Thanks,
>> Mohan
>>
>>
>>
>>> On Tue, Jun 7, 2016 at 12:32 PM, Damith Wickramasinghe <dami...@wso2.com
>>> > wrote:
>>>
>>>> Hi Johann and all,
>>>>
>>>> Our decided approach was to send a empty string for all the cases from
>>>> IS side and from DAS after retrieving data, provide a default string with
>>>> some style to show that its a special empty case. But in lucene we cannot
>>>> have empty attributes since they cannot be indexed and search will not work
>>>> for them. Our next option is to provide a standard naming for a default
>>>> value and also provide some configuration in IS to change it if needed.
>>>> WDYT ?
>>>>
>>>> Regards,
>>>> Damith.
>>>>
>>>> On Mon, Jun 6, 2016 at 7:19 PM, Damith Wickramasinghe <dami...@wso2.com
>>>> > wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> When it comes to authentication scenarios in some cases we cannot
>>>>> specify roles etc to publishing events eg:- non existing user tried to
>>>>> login with username and password. Then for the said events roles attribute
>>>>> will be empty/null  .
>>>>>
>>>>> Also as discussed with Pulasthi there can be other attributes as well
>>>>> which can be empty or null. For all those scenarios we need to show a
>>>>> authentication failure count for all the dimensions of User, Role,
>>>>> IdentityProvider etc.For that we need a constant String which can be used
>>>>> to show the respective fail counts.  Having a constant value like
>>>>> "NOT-AVAILABLE" can be sent from IS side or populated from DAS side but 
>>>>> any
>>>>> user can create an username of any sort . eg:NOT-AVAILABLE .So there can 
>>>>> be
>>>>> issues in calculating authentication failure counts.
>>>>>
>>>>> Any insights on handling such scenarios ?
>>>>>
>>>>> Regards,
>>>>> Damith.
>>>>>
>>>>> --
>>>>> Software Engineer
>>>>> WSO2 Inc.; http://wso2.com
>>>>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.com=D=1=AFQjCNEZvyc0uMD1HhBaEGCBxs6e9fBObg>
>>>>> lean.enterprise.middleware
>>>>>
>>>>> mobile: *+94728671315 <%2B94728671315>*
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Software Engineer
>>>> WSO2 Inc.; http://wso2.com
>>>> <http://www.google.com/url?q=http%3A%2F%2Fwso2.com=D=1=AFQjCNEZvyc0uMD1HhBaEGCBxs6e9fBObg>
>>>> lean.enterprise.middleware
>>>>
>>>> mobile: *+94728671315 <%2B94728671315>*
>>>>
>>>>
>>>
>>>
>>> --
>>> Hasintha Indrajee
>>> Software Engineer
>>> WSO2, Inc.
>>> Mobile:+94 771892453
>>>
>>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Associate Tech Lead,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673
>>
>
>
>
> --
>
> *S. Suhothayan*
> Technical Lead & Team Lead of WSO2 Complex Event Processor
> *WSO2 Inc. *http://wso2.com
> * <http://wso2.com/>*
> lean . enterprise . middleware
>
>
> *cell: (+94) 779 756 757 <%28%2B94%29%20779%20756%20757> | blog:
> http://suhothayan.blogspot.com/ <http://suhothayan.blogspot.com/>twitter:
> http://twitter.com/suhothayan <http://twitter.com/suhothayan> | linked-in:
> http://lk.linkedin.com/in/suhothayan <http://lk.linkedin.com/in/suhothayan>*
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [APIM 2.0]What is the exact functionality on API Advance resource level throttling invert condition?

[Mohanadarshan Vivekanandalingam]

On Tue, Jun 7, 2016 at 11:32 PM, Harsha Kumara  wrote:

> Hi Ushani,
>
> If you send a request without a header which is the 3rd scenario this will
> be happen.
>
>- Since specified tier has two condition group we are having two CEP
>execution plans, one for default and one for conditional group.
>- What we have done for the default policy is, we have taken the all
>the conditions available in the conditional groups and take a invert of it
>where non of the request matching the conditional  groups will fall into
>the default tier.
>- But in the absence of configured field, the leads not to match with
>any configured policy.
>- Ideally I think this should go for the default policy.
>
> We will need add filter for check whether the condition is null and apply
> the default policy. Let's create a JIRA to track down this.
>

yes, +1.. We have to consider that case as well..


>
> Thanks,
> Harsha
>
> On Tue, Jun 7, 2016 at 6:52 PM, Ushani Balasooriya 
> wrote:
>
>> Hi All,
>>
>> When you enable invert condition of a particular header condition, should
>> it look at the whole header name, or just the value?
>>
>> To collaborate more on this scenario, pls have a look at the below
>> example.
>>
>> I have configured a tier (named *Tier1*), with default limit as 50
>> req/1min and a header condition policy as Header:value -> myheader:*123*
>> with execution policy of 20req/1min and *invert condition* is switched
>> *on*
>>
>> *Scenario 1 *: So when I invoke a request with myheader:*123*, since the
>> inverter is switched on, it will throttle out at 50req/1min which is
>> expected.
>> *Scenario 2*: when I invoke a request with myheader:*1234*, since the
>> inverter is switched on, it will throttle out at 20req/1min which is
>> expected.
>> *Scenario 3* :But when I invoke a request *without* a header named
>> myheader, it does not throttle out at all, and can be invoked unlimited.
>>
>> Shouldn't this behave same as Scenario 2? Because when a publisher
>> assigns a tier as Tier1, he can be in a mindset that it should consent to
>> the configured tier request count.
>>
>> Please advice.
>>
>> Thanks,
>> -
>> *Ushani Balasooriya*
>> Senior Software Engineer - QA;
>> WSO2 Inc; http://www.wso2.com/.
>>
>>
>
>
> --
> Harsha Kumara
> Software Engineer, WSO2 Inc.
> Mobile: +94775505618
> Blog:harshcreationz.blogspot.com
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Analytics IS - Handling null or empty Strings to show on respective gadgets

[Mohanadarshan Vivekanandalingam]

On Tue, Jun 7, 2016 at 6:35 PM, Hasintha Indrajee  wrote:

> Hi Damith,
>
> For the time being we can follow this approach. But this seems like a
> standard problem we may face in other products as well. Any standard way of
> handling this ? Any ideas for handling this issue in future ?
>
>
Hmm, AFAIK above was not became an issue for other analytics
products/usecases ..

@Srinath and all, do you guys have any suggestions ? what should be the
best approach ?..

Thanks,
Mohan



> On Tue, Jun 7, 2016 at 12:32 PM, Damith Wickramasinghe 
> wrote:
>
>> Hi Johann and all,
>>
>> Our decided approach was to send a empty string for all the cases from IS
>> side and from DAS after retrieving data, provide a default string with some
>> style to show that its a special empty case. But in lucene we cannot have
>> empty attributes since they cannot be indexed and search will not work for
>> them. Our next option is to provide a standard naming for a default value
>> and also provide some configuration in IS to change it if needed. WDYT ?
>>
>> Regards,
>> Damith.
>>
>> On Mon, Jun 6, 2016 at 7:19 PM, Damith Wickramasinghe 
>> wrote:
>>
>>> Hi,
>>>
>>> When it comes to authentication scenarios in some cases we cannot
>>> specify roles etc to publishing events eg:- non existing user tried to
>>> login with username and password. Then for the said events roles attribute
>>> will be empty/null  .
>>>
>>> Also as discussed with Pulasthi there can be other attributes as well
>>> which can be empty or null. For all those scenarios we need to show a
>>> authentication failure count for all the dimensions of User, Role,
>>> IdentityProvider etc.For that we need a constant String which can be used
>>> to show the respective fail counts.  Having a constant value like
>>> "NOT-AVAILABLE" can be sent from IS side or populated from DAS side but any
>>> user can create an username of any sort . eg:NOT-AVAILABLE .So there can be
>>> issues in calculating authentication failure counts.
>>>
>>> Any insights on handling such scenarios ?
>>>
>>> Regards,
>>> Damith.
>>>
>>> --
>>> Software Engineer
>>> WSO2 Inc.; http://wso2.com
>>> 
>>> lean.enterprise.middleware
>>>
>>> mobile: *+94728671315 <%2B94728671315>*
>>>
>>>
>>
>>
>> --
>> Software Engineer
>> WSO2 Inc.; http://wso2.com
>> 
>> lean.enterprise.middleware
>>
>> mobile: *+94728671315 <%2B94728671315>*
>>
>>
>
>
> --
> Hasintha Indrajee
> Software Engineer
> WSO2, Inc.
> Mobile:+94 771892453
>
>


-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [DAS] java.lang.NoSuchMethodError when trying to add Kafka Event Receiver

[Mohanadarshan Vivekanandalingam]

On Sun, Jun 5, 2016 at 11:33 PM, Sajith Ravindra  wrote:

> It seems Spark has a dependency on scala-library_2.10.4 and this jar is
> already included in DAS pack, therefore copying scala-library-2.11.7.jar as
> per the documentation will lead to a conflict. I tested deleting
> ./repository/components/plugins/org.scala-lang.scala-library_2.10.4.v20140209-180020-VFINAL-b66a39653b.jar
> in DAS pack and it fixes the above error. But it give a NoClassDefFound
> error in startup.
>
> AFAIU there's no straightforward way to workaround this issue as it
> requires to two different versions of the same .jar other than upgrading
> the Spark scla-library dependency.
>

Yes, @Charith you have few options..

1) Build a single jar/bundle by wrapping necessary dependencies and use.
2) Try with Kafka 2.10-0.8.1.1 server


>
> P.S : @Charith if this is for the sake of testing you can use CEP as it
> has not scala-libarary dependency.
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Requesting the parameters for throttling policy configurations in api-manager.xml

[Mohanadarshan Vivekanandalingam]

On Sun, Jun 5, 2016 at 9:56 AM, Harsha Kumara  wrote:

> Yes AFAIK it won't add any processing delay from CEP side if we don't
> access any data in the json map. Since we have to go through header maps
> and extract the query param this will add delay for data publishing side.
> We can enable this by default. I think it's better to have the option to
> disable.
>
>
If you take the processing side, we are converting these properties which
coming as json in to map to perform necessary processing.. And, there might
be slight impact due to json string size but IMO it is negligible..

Thanks,
Mohan


> Thanks,
> Harsha
>
> On Sat, Jun 4, 2016 at 1:19 PM, Nuwan Dias  wrote:
>
>> Why would we have to check if there are conditions which require query
>> params? Or headers? I think we should publish them anyway. Does it cause a
>> performance impact to send additional data to CEP? I don't think getting
>> those data from the request has an overhead.
>>
>> Thanks,
>> NuwanD.
>>
>> On Sat, Jun 4, 2016 at 10:40 AM, Harsha Kumara  wrote:
>>
>>> Hi Ushani,
>>>
>>> We add that property because, sometime users may not need publishing the
>>> query params to the CEP as they don't have policies associated with them.
>>> Going through the policies applied for a particular API and determine it
>>> has query param conditions and then publishing the query param to the CEP
>>> is expensive. So we have added those configurations.
>>>
>>>
>>> On Sat, Jun 4, 2016 at 7:46 AM, Ushani Balasooriya 
>>> wrote:
>>>
 Additionaly why do we need to control EnableQueryParamConditions via
 api-manager.xml when we have a on/off switch button to each conditional
 header in Advanced throttling configuration UI?
 On Jun 4, 2016 7:24 AM, "Ushani Balasooriya"  wrote:

> Hi Amila,
>
> So these configurations will be applicable across all tenants?
>
> Akso I think it would be better if we can hide Conditional groups when
> EnableHeaderConditions is set to false or make them disable. Likewise will
> it be possible to have UI level improvements to notify the admin? Just a
> thought.
>
 Yes this would be a good improvement to have in the UI.
>>>
 Thanks,
> On Jun 3, 2016 11:00 PM, "Amila De Silva"  wrote:
>
>> Hi Ushani,
>>
>> For the new throttling to work you first have to
>> set EnableAdvanceThrottling to true. When EnableHeaderConditions is set 
>> to
>> true, all the headers in the incoming message will be published to the 
>> CEP.
>> Similarly Setting EnableJWTClaimConditions and EnableQueryParamConditions
>> to true would publish JWT claims and the query parameters coming with the
>> request to the CEP. In the latest pack, spike arrest is only enabled
>> through the UI, so there's no config element for that.
>>
>> On Fri, Jun 3, 2016 at 6:35 PM, Ushani Balasooriya 
>> wrote:
>>
>>> Hi APIM Team,
>>>
>>> It would be highly appreciated, if you can let us know the
>>> parameters that need to be enabled in api-manager.xml when working with
>>> throttling since the documents are not ready yet.
>>>
>>> E.g., Spike arrest policy parameter, Query param parameter.
>>>
>>>
>>> Thanks and regards,
>>> --
>>> *Ushani Balasooriya*
>>> Senior Software Engineer - QA;
>>> WSO2 Inc; http://www.wso2.com/.
>>>
>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "WSO2 Documentation Group" group.
>>> To unsubscribe from this group and stop receiving emails from it,
>>> send an email to documentation+unsubscr...@wso2.com.
>>> For more options, visit
>>> https://groups.google.com/a/wso2.com/d/optout.
>>>
>>
>>
>>
>> --
>> *Amila De Silva*
>>
>> WSO2 Inc.
>> mobile :(+94) 775119302
>>
>>
>>>
>>>
>>> --
>>> Harsha Kumara
>>> Software Engineer, WSO2 Inc.
>>> Mobile: +94775505618
>>> Blog:harshcreationz.blogspot.com
>>>
>>
>>
>>
>> --
>> Nuwan Dias
>>
>> Technical Lead - WSO2, Inc. http://wso2.com
>> email : nuw...@wso2.com
>> Phone : +94 777 775 729
>>
>
>
>
> --
> Harsha Kumara
> Software Engineer, WSO2 Inc.
> Mobile: +94775505618
> Blog:harshcreationz.blogspot.com
>



-- 
*V. Mohanadarshan*
*Associate Tech Lead,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [DEV] [CEP] MySQL table storage engine and character set used with Output Mysql Event Adaptor

[Mohanadarshan Vivekanandalingam]

On Fri, May 27, 2016 at 12:17 AM, Thanuja Uruththirakodeeswaran <
thanu...@wso2.com> wrote:

> Hi ,
>
> Do we need to set the MySQL *storage engine* as '*MyISAM*' and *character
> set *to* utf8* for the tables created by the CEP Output MySQL Event
> Adaptors?
>
> I'm using CEP 3.0.0/3.1.0 with MySQL server version *5.6.30*. If I don't
> set those, by default storage engine is set to *InnoDB* and character set
> is set to *latin1 *and events are not persisted in the table. Once I
> change those as said above, events are persisted in the table.
>
>
No, it is not a requirement..

I am using MySQL server version 5.6.28.. Tried with InnoDB engine and
latin1 charset and it is working fine.. Have you checked data format that
you tried to insert ?

Thanks,
Mohan



> Thanks.
>
> --
> Thanuja Uruththirakodeeswaran
> Software Engineer
> WSO2 Inc.;http://wso2.com
> lean.enterprise.middleware
>
> mobile: +94 774363167
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Architecture] Why APIM don't impose any permission for deleting an API

[Mohanadarshan Vivekanandalingam]

[adding dev]

On Fri, May 20, 2016 at 9:48 PM, Abimaran Kugathasan 
wrote:

> Hi All,
>
> API Manager has permissions for Create, Publish and Subscribe an API. Why
> API Manager don't check any permission for deleting an API?
>
> A user can create an API, another one varified the API and publish it, in
> the same way, we need to give permission for the user to delete the API.
>
> Was there any reason for allowing the user who created the API to delete
> it?
>
> --
> Thanks
> Abimaran Kugathasan
>
> Software Engineer | WSO2 Inc
> Data & APIs Technologies Team
> Mobile : +94 773922820
>
> 
> 
>   
> 
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Release tag's not available in ML repo

[Mohanadarshan Vivekanandalingam]

On Tue, May 17, 2016 at 11:34 AM, Supun Sethunga  wrote:

> Hi Manoj,
>
> What is the naming convention for this released tag?
>
> Btw, seems it is not mentioned in the release process docs [1].. If this
> is a required step, shall we update the docs too?
>

Mentioned in below line..

What is SCM release tag or label for "WSO2 Carbon Kernel"?
(org.wso2.carbon:carbon-kernel) carbon-4.4.0: : *v4.4.0*


> [1] https://docs.wso2.com/display/Carbon445/Releasing+a+Git+Repository
>
> On Wed, May 11, 2016 at 12:31 PM, Manoj Kumara  wrote:
>
>> Great Thanks Supun.
>>
>> *Manoj Kumara*
>> WSO2 Inc. *| **lean. enterprise. middleware.*
>> *Mobile:* +94 713 448188
>>
>> On Wed, May 11, 2016 at 12:30 PM, Supun Sethunga  wrote:
>>
>>> Hi Manoj,
>>>
>>> Yes, latest RCs contain the released versions of dependencies. Please go
>>> ahead with 1.0.0-RC2 and 1.1.0-RC5.
>>>
>>> We'll create a release tag as well.
>>>
>>> Regards,
>>> Supun
>>>
>>> On Wed, May 11, 2016 at 12:16 PM, Manoj Kumara  wrote:
>>>
 Hi ML Team,

 I'll looking into released tags of each product to issue an security
 patch and noticed that tag correspond to 1.0.0 and 1.1.0 version is not
 available in the repo.

 Can I assume the latest RC tag contain the released version of each
 dependency repo's. IMO this tag need to be created as well for supporting
 purposes.

 Regards,
 Manoj

>>>
>>>
>>>
>>> --
>>> *Supun Sethunga*
>>> Software Engineer
>>> WSO2, Inc.
>>> http://wso2.com/
>>> lean | enterprise | middleware
>>> Mobile : +94 716546324
>>>
>>
>>
>
>
> --
> *Supun Sethunga*
> Software Engineer
> WSO2, Inc.
> http://wso2.com/
> lean | enterprise | middleware
> Mobile : +94 716546324
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Cannot generate P2 metadata: P2 publisher return code was 13

[Mohanadarshan Vivekanandalingam]

Hi Damith,

I can see few mail threads related to this.. Seems like a maven version
issue.. What is the maven version you are using here ? and can you add the
complete error log please ?

Thanks,
Mohan


On Sun, Apr 17, 2016 at 5:52 PM, Damith Wickramasinghe 
wrote:

> Hi,
>
> I'm trying to build product CEP in a clean m2 repo. I have successfully
> built siddhi,carbon-event-processing,carbon-analytics-common and
> carbon-dashboards. But When building product CEP I'm getting below
> exception. Any idea what may be the cause of it ?
>
> [ERROR] Failed to execute goal
> org.wso2.maven:carbon-p2-plugin:1.5.4:materialize-product
> (creating-worker-profile) on project wso2cep-profile-gen: Cannot generate
> P2 metadata: P2 publisher return code was 13
>
> Thanks,
> Damith.
>
> --
> Software Engineer
> WSO2 Inc.; http://wso2.com
> 
> lean.enterprise.middleware
>
> mobile: *+94728671315 <%2B94728671315>*
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] US Election Analytics - Data won't persist in DAS

[Mohanadarshan Vivekanandalingam]

On Sat, Apr 2, 2016 at 9:56 PM, Udara Rathnayake <uda...@wso2.com> wrote:

> Sure Niranda, Let me know whether I have to report this in CEP or DAS?
>
> It should be DAS :)


> On Sat, Apr 2, 2016 at 12:21 PM, Niranda Perera <nira...@wso2.com> wrote:
>
>> Hi Udara,
>>
>> Ah. Never came across it but yes, you are correct. This seems to be a UI
>> bug.
>>
>> Can you report a JIRA in this?
>>
>> Rgds
>> On Apr 2, 2016 21:45, "Udara Rathnayake" <uda...@wso2.com> wrote:
>>
>>> Hi Niranda,
>>>
>>> ​If we edit and save an existing stream definition (without going to the
>>> persistence UI)​ this can happen right? I have faced similar thing but
>>> never tried reproducing.
>>>
>>> However we should bring tooling support(dev studio) ASAP to DAS
>>> artifacts, so we can create and deploy via car apps easily.
>>>
>>>
>>> On Fri, Apr 1, 2016 at 11:32 AM, Niranda Perera <nira...@wso2.com>
>>> wrote:
>>>
>>>> Hi Chehara,
>>>>
>>>> It's highly unlikely that a stream persistence configuration to get
>>>> disabled automatically. Looks like someone have mistakenly disabled it from
>>>> the UI. As per the current persistence UI, there is a possibility that such
>>>> an incident may occur.
>>>>
>>>>
>>>> On Fri, Apr 1, 2016 at 8:43 PM, Chehara Pathmabandu <cheh...@wso2.com>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> Solved. event persistent had been disabled automatically.
>>>>>
>>>>> On Fri, Apr 1, 2016 at 8:16 PM, Niranda Perera <nira...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Yasara,
>>>>>>
>>>>>> We need to find where exactly the data stopped persisting. can you
>>>>>> find the final entry? Are there any error in the logs?
>>>>>>
>>>>>> also, we need to check the mysql connections. Check if it has grown
>>>>>> out of proportion as previously.
>>>>>> And the CPU and memory usage of the node.
>>>>>>
>>>>>> On Fri, Apr 1, 2016 at 7:37 PM, Mohanadarshan Vivekanandalingam <
>>>>>> mo...@wso2.com> wrote:
>>>>>>
>>>>>>> [Adding Dev mail thread]
>>>>>>>
>>>>>>> @Niranda, can you please dig on this issue and find the root cause..
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Apr 1, 2016 at 7:26 PM, Yasara Dissanayake <yas...@wso2.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> As you can see from the image attached here[1]:
>>>>>>>> Current status is growing as the data receive and we use this same
>>>>>>>> stream to persist. But from a particular date data had not been 
>>>>>>>> persisted.
>>>>>>>>
>>>>>>>> regards,
>>>>>>>> yasara
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> *V. Mohanadarshan*
>>>>>>> *Senior Software Engineer,*
>>>>>>> *Data Technologies Team,*
>>>>>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>>>>>> *lean.enterprise.middleware.*
>>>>>>>
>>>>>>> email: mo...@wso2.com
>>>>>>> phone:(+94) 771117673
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Niranda Perera*
>>>>>> Software Engineer, WSO2 Inc.
>>>>>> Mobile: +94-71-554-8430
>>>>>> Twitter: @n1r44 <https://twitter.com/N1R44>
>>>>>> https://pythagoreanscript.wordpress.com/
>>>>>>
>>>>>> ___
>>>>>> Dev mailing list
>>>>>> Dev@wso2.org
>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Chehara Pathmabandu
>>>>> *Software Engineer - Intern*
>>>>> Mobile : +94711976407
>>>>> cheh...@wso2.com
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> *Niranda Perera*
>>>> Software Engineer, WSO2 Inc.
>>>> Mobile: +94-71-554-8430
>>>> Twitter: @n1r44 <https://twitter.com/N1R44>
>>>> https://pythagoreanscript.wordpress.com/
>>>>
>>>> ___
>>>> Dev mailing list
>>>> Dev@wso2.org
>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>
>>>>
>>>
>>>
>>> --
>>> Regards,
>>> UdaraR
>>>
>>
>
>
> --
> Regards,
> UdaraR
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] US Election Analytics - Data won't persist in DAS

[Mohanadarshan Vivekanandalingam]

Hi Niranda,

Thanks for quick hint.. Now it is working fine.. It seems, event stream is
not persisted properly.. That is the root cause for the issue..

Regards,
Mohan


On Fri, Apr 1, 2016 at 8:16 PM, Niranda Perera <nira...@wso2.com> wrote:

> Hi Yasara,
>
> We need to find where exactly the data stopped persisting. can you find
> the final entry? Are there any error in the logs?
>
> also, we need to check the mysql connections. Check if it has grown out of
> proportion as previously.
> And the CPU and memory usage of the node.
>
> On Fri, Apr 1, 2016 at 7:37 PM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> [Adding Dev mail thread]
>>
>> @Niranda, can you please dig on this issue and find the root cause..
>>
>>
>>
>> On Fri, Apr 1, 2016 at 7:26 PM, Yasara Dissanayake <yas...@wso2.com>
>> wrote:
>>
>>> Hi,
>>>
>>> As you can see from the image attached here[1]:
>>> Current status is growing as the data receive and we use this same
>>> stream to persist. But from a particular date data had not been persisted.
>>>
>>> regards,
>>> yasara
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Senior Software Engineer,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673
>>
>
>
>
> --
> *Niranda Perera*
> Software Engineer, WSO2 Inc.
> Mobile: +94-71-554-8430
> Twitter: @n1r44 <https://twitter.com/N1R44>
> https://pythagoreanscript.wordpress.com/
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] US Election Analytics - Data won't persist in DAS

[Mohanadarshan Vivekanandalingam]

[Adding Dev mail thread]

@Niranda, can you please dig on this issue and find the root cause..



On Fri, Apr 1, 2016 at 7:26 PM, Yasara Dissanayake  wrote:

> Hi,
>
> As you can see from the image attached here[1]:
> Current status is growing as the data receive and we use this same stream
> to persist. But from a particular date data had not been persisted.
>
> regards,
> yasara
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Test Automation] Mocking Thrift server for an integration test

[Mohanadarshan Vivekanandalingam]

On Mon, Mar 28, 2016 at 5:36 PM, Kalpa Welivitigoda  wrote:

> Hi Lasantha,
>
> Is there a way in which we can verify the events being published to the
> thrift server?
>

Why can't you have a counter in thrift agent server side and increment it
when event received.. We have used similar approach in our test cases [1] ..

[1]
https://github.com/wso2/product-cep/blob/master/modules/integration/tests-integration/tests/src/test/java/org/wso2/carbon/integration/test/client/Wso2EventServer.java#L160



>
> We have the http statistics publishing module in application server 6.0.0
> and need to verify the events published to the thrift server in an
> integration test.
>
> On Tue, Dec 1, 2015 at 3:20 PM, Thanuja Uruththirakodeeswaran <
> thanu...@wso2.com> wrote:
>
>> Hi Lasantha,
>>
>> Sorry, I tried this with different ports and when changing the client
>> port to 7613, forgot to change the server port to 7613. I've corrected it
>> and attached the new log.
>>
>> [main] INFO
>>  org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver  - Thrift
>> Server started at localhost
>> [main] INFO
>>  org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver  - Thrift
>> SSL port : 7713
>> [main] INFO
>>  org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver  - Thrift
>> port : 7613
>> [main] INFO
>>  org.apache.stratos.cloud.controller.statistics.publisher.ThriftTestServer
>>  - Test Server Started
>> [main] INFO  org.wso2.carbon.databridge.agent.thrift.AgentHolder  - Agent
>> created !
>> [main] INFO  org.apache.stratos.common.threading.StratosThreadPool  -
>> Thread pool created: [type] Executor Service [id]
>> cloud.controller.stats.publisher.thread.pool [size] 10
>> [pool-5-thread-1] ERROR
>> org.wso2.carbon.databridge.agent.thrift.AsyncDataPublisher  - Error while
>> connection to event receiver
>> org.wso2.carbon.databridge.agent.thrift.exception.AgentException: Cannot
>> borrow client for TCP,localhost:7613,TCP,localhost:7713
>> at
>> org.wso2.carbon.databridge.agent.thrift.internal.publisher.authenticator.AgentAuthenticator.connect(AgentAuthenticator.java:58)
>> at
>> org.wso2.carbon.databridge.agent.thrift.DataPublisher.start(DataPublisher.java:273)
>> at
>> org.wso2.carbon.databridge.agent.thrift.DataPublisher.(DataPublisher.java:161)
>> at
>> org.wso2.carbon.databridge.agent.thrift.AsyncDataPublisher$ReceiverConnectionWorker.run(AsyncDataPublisher.java:787)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:745)
>> Caused by: org.apache.thrift.transport.TTransportException: Could not
>> connect to 172.17.8.1 on port 7713
>> at
>> org.apache.thrift.transport.TSSLTransportFactory.createClient(TSSLTransportFactory.java:212)
>> at
>> org.apache.thrift.transport.TSSLTransportFactory.getClientSocket(TSSLTransportFactory.java:166)
>> at
>> org.wso2.carbon.databridge.agent.thrift.internal.pool.client.secure.SecureClientPoolFactory.makeObject(SecureClientPoolFactory.java:90)
>> at
>> org.wso2.carbon.databridge.agent.thrift.internal.pool.client.secure.SecureClientPoolFactory.makeObject(SecureClientPoolFactory.java:48)
>> at
>> org.apache.commons.pool.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:1212)
>> at
>> org.wso2.carbon.databridge.agent.thrift.internal.publisher.authenticator.AgentAuthenticator.connect(AgentAuthenticator.java:50)
>> ... 8 more
>> Caused by: java.net.ConnectException: Connection refused
>> at java.net.PlainSocketImpl.socketConnect(Native Method)
>> at
>> java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
>> at
>> java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
>> at
>> java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
>> at java.net.Socket.connect(Socket.java:579)
>> at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:625)
>> at sun.security.ssl.SSLSocketImpl.(SSLSocketImpl.java:413)
>> at
>> sun.security.ssl.SSLSocketFactoryImpl.createSocket(SSLSocketFactoryImpl.java:88)
>> at
>> org.apache.thrift.transport.TSSLTransportFactory.createClient(TSSLTransportFactory.java:208)
>> ... 13 more
>>
>> Thanks.
>>
>> On Tue, Dec 1, 2015 at 3:14 PM, Lasantha Fernando 
>> wrote:
>>
>>> Hi Thanuja,
>>>
>>> Looking at the logs above, it seems that the ThriftDataReceiver started
>>> on port 7612, with SSL port 7712.
>>>
>>> [main] INFO
>>>  org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver  - Thrift
>>> SSL port : 7712
>>> [main] INFO
>>>  org.wso2.carbon.databridge.receiver.thrift.ThriftDataReceiver  - Thrift
>>> port : 7612
>>> [main] INFO
>>>  

Re: [Dev] GSoC - [CEP] Visual Query Composer for WSO2 CEP

[Mohanadarshan Vivekanandalingam]

Hi Monish,

I hope you are aware about the deadline for proposal submission (It is 26th
March 00:30 IST) .. Please try to submit it before the deadline..

Thanks,
Mohan

On Sun, Mar 6, 2016 at 2:37 PM, monish godhia  wrote:

> Sir,
> Thanks for the prompt reply. I would rightaway start with the
> above guidelines and get back to you incase of any difficulty.
>  Thanks and Regards,
> Monish Godhia
>
> On Sun, Mar 6, 2016 at 2:34 PM, Sriskandarajah Suhothayan 
> wrote:
>
>> Looping the dev list
>>
>> Good here your interest.
>>
>> Please download WSO2CEP 4.1
>> http://wso2.com/products/complex-event-processor/
>> and try the getting started guide
>> https://docs.wso2.com/display/CEP410/Quick+Start+Guide
>>
>> When you add an execution plan (the core logic of CEP) it can be viewed.
>> from "Manage -> Execution Plans" and clicking on the execution plan name.
>> Here you will be able to see the written query as a graph.
>>
>> Learn how this is been done in
>> https://github.com/wso2/carbon-event-processing/tree/master/components/event-processor/org.wso2.carbon.event.processor.ui
>>
>> What you need to do is basically build some UI to build that graph and
>> then create the query from that.
>>
>> Regards
>> Suho
>>
>> On Sun, Mar 6, 2016 at 2:12 PM, monish godhia 
>> wrote:
>>
>>> Sir,
>>>  My name is Monish Godhia and I am a third year B.E. Hons Computer
>>> Science undergraduate student from BITS Pilani Hyderabad, India. My
>>> proficiency revolves around the areas of machine learning , C/C++, python,
>>> java, web development (frontend and backend). Many of my developments can
>>> be checked through my github profile - *https://github.com/share-with-me/
>>> *
>>> I have successfully completed my projects with Google India
>>> (code for India) and also been a part of the idea that was appreciated by
>>> the elite panel of internet.org challenge by Facebook.
>>> I would love to contribute to the 2016 GSoC by being a part
>>> of the project - [CEP] Visual Query Composer for WSO2 CEP. I have
>>> developed numerous websites (for my college fests) using frontend tools-
>>> HTML, CSS , Javascript and Jquery (on bootstrap framework) and used PHP,
>>> SQL, AngularJS for the vaildation of backend. To start with, I have forked
>>> dagre - d3 library of javascript and have gone through the product complex
>>> event processor.
>>> It would be great if you could mentor me to understand the
>>> idea in an elaborated manner so it can be worked upon.
>>>Thanks and Regards,
>>>Monish Godhia
>>>
>>
>>
>>
>> --
>>
>> *S. Suhothayan*
>> Technical Lead & Team Lead of WSO2 Complex Event Processor
>> *WSO2 Inc. *http://wso2.com
>> * *
>> lean . enterprise . middleware
>>
>>
>> *cell: (+94) 779 756 757 <%28%2B94%29%20779%20756%20757> | blog:
>> http://suhothayan.blogspot.com/ twitter:
>> http://twitter.com/suhothayan  | linked-in:
>> http://lk.linkedin.com/in/suhothayan *
>>
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] GSoC 2016

[Mohanadarshan Vivekanandalingam]

Hi Jawadh,

I hope you are aware about the deadline for proposal submission (It is 26th
March 00:30 IST) .. Please try to submit it before the deadline..

Thanks,
Mohan


On Tue, Mar 22, 2016 at 2:44 PM, Mohanadarshan Vivekanandalingam <
mo...@wso2.com> wrote:

>
>
> On Mon, Mar 21, 2016 at 4:01 PM, Jawadh Salih Rifath <
> jawadhsalih.wo...@gmail.com> wrote:
>
>> Sorry the project I was looking for Visual Query Composer. the project 32.
>>
>>
> Happy to hear your interest in WSO2 and CEP..
>
>
>> Please clarify me .When it's mentioned as a query graph, does it mean of
>> a tree (acyclic graph) of one siddhi query of anything else. I understood
>> it as a tree of a siddhi query.
>>
>
> Yes, It is somewhat similar..
>
> In CEP, When you are adding an execution plan (the core logic of CEP) it
> can be viewed. from "Manage -> Execution Plans" and clicking on the
> execution plan name. Here you will be able to see the written query as a
> graph.
>
> Learn how this is been done in
> https://github.com/wso2/carbon-event-processing/tree/master/components/event-processor/org.wso2.carbon.event.processor.ui
>
> In the project you have to build some UI to build that graph and then
> create the query from that.
>
>
> Thanks,
> Mohan
>
>
>>
>>
>> Thank you
>> Jawadh Salih Rifath
>> 3rd year (2nd semester) Undergraduate Dept. of Computer Science and
>> Engineering
>> University of Moratuwa,
>>
>>
>>
>> On 21 March 2016 at 15:05, Jawadh Salih Rifath <
>> jawadhsalih.wo...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'd like to contribute to Auto tuner CEP project of WSO2. Please guide me
>>>
>>
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> *V. Mohanadarshan*
> *Senior Software Engineer,*
> *Data Technologies Team,*
> *WSO2, Inc. http://wso2.com <http://wso2.com> *
> *lean.enterprise.middleware.*
>
> email: mo...@wso2.com
> phone:(+94) 771117673
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Proposal Structure

[Mohanadarshan Vivekanandalingam]

On Mon, Mar 21, 2016 at 4:03 PM, Jawadh Salih Rifath <
jawadhsalih.wo...@gmail.com> wrote:

> Hi,
>
> Is there any specific structure for the project proposal that I need to
> send. Or do I can make my own and send. If so please let me know the
> essential details that need to be included in the proposal
>

No, There is no such specific structure.. You can follow some common
structure or make your own one to show your creativeness as well.. J

Thanks,
Mohan


>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Proposal 17: [CEP] Auto-tuning of WSO2 CEP

[Mohanadarshan Vivekanandalingam]

[Adding relevant mentors]

Happy to hear your interest Rilfi.. Thanks for the update..

On Tue, Mar 22, 2016 at 8:35 PM, Mohamed Rilfi  wrote:

> Hi , everyone
>
> I am working on my proposal to " Auto-tuning of WSO2 CEP" project.
>
> I am doing MSc research at CSE, University of Moratuwa. Where im using
> WSO2 CEP combine with WSO2 DAS  to find matching events from multiple
> streams (real-time and historical events)
>
> Also i have an good  knowledge in database, NoSQL, query optimization,
> Distributed computing, Java Network programming, Threads and  Concurrency ,
> Java i/o(NIO,NIO2), Java performance Optimization , Non blocking
> Programming , Apache spark, Streaming ,WSO2  CEP and other development
> utilities.
>
> Also i referred both research papers mentioned in the  "Auto-tuning of
> WSO2 CEP" project description.
>
> Based on those research papers and other research findings im working on
> the proposal.
>
> --
>
> *M.R.M.Rilfi
> M.Sc in Computer Science (Reading) Moratuwa
> B.Sc Sp. Computer Science
> Dept. Computer Science & Engineering,University of Moratuwa
> ri...@live.com  , ri...@cse.mrt.ac.lk 
> +94776284627 <%2B94776284627> *
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] GSoC 2016

[Mohanadarshan Vivekanandalingam]

On Mon, Mar 21, 2016 at 4:01 PM, Jawadh Salih Rifath <
jawadhsalih.wo...@gmail.com> wrote:

> Sorry the project I was looking for Visual Query Composer. the project 32.
>
>
Happy to hear your interest in WSO2 and CEP..


> Please clarify me .When it's mentioned as a query graph, does it mean of a
> tree (acyclic graph) of one siddhi query of anything else. I understood it
> as a tree of a siddhi query.
>

Yes, It is somewhat similar..

In CEP, When you are adding an execution plan (the core logic of CEP) it
can be viewed. from "Manage -> Execution Plans" and clicking on the
execution plan name. Here you will be able to see the written query as a
graph.

Learn how this is been done in
https://github.com/wso2/carbon-event-processing/tree/master/components/event-processor/org.wso2.carbon.event.processor.ui

In the project you have to build some UI to build that graph and then
create the query from that.


Thanks,
Mohan


>
>
> Thank you
> Jawadh Salih Rifath
> 3rd year (2nd semester) Undergraduate Dept. of Computer Science and
> Engineering
> University of Moratuwa,
>
>
>
> On 21 March 2016 at 15:05, Jawadh Salih Rifath <
> jawadhsalih.wo...@gmail.com> wrote:
>
>> Hi,
>>
>> I'd like to contribute to Auto tuner CEP project of WSO2. Please guide me
>>
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] About Google Summer of code 2016

[Mohanadarshan Vivekanandalingam]

[Adding Dev mailing list]

Hi,

First of all Welcome and Thanks for reaching WSO2 community... It is
pleasure to hear your interest in WSO2 CEP and real-time event processing..

Please download the WSO2 CEP [1] and try some samples to get familiar with
the product..

In CEP, When you are adding an execution plan (the core logic of CEP) it
can be viewed. from "Manage -> Execution Plans" and clicking on the
execution plan name. Here you will be able to see the written query as a
graph.

Learn how this is been done in
https://github.com/wso2/carbon-event-processing/tree/master/components/event-processor/org.wso2.carbon.event.processor.ui

In the project you need to build some UI to build that graph and then
create the query from that.

Submitting a well explained proposal which sound research (with some of
your technical background details) would be enough..

I believe, you are aware about GSOC program very well. (You can refer [2]
if you need any further information).. By the way, GSOC proposal and
project needs to be done by a individual, not by a team..

[1] http://wso2.com/products/complex-event-processor/
[2] https://summerofcode.withgoogle.com/

Thanks,
Mohan

On Thu, Mar 17, 2016 at 8:38 AM, 임대빈  wrote:

> Dear Suho, and Mohan,
>
>
>
> Hello, we are undergraduate senior students in Chungnam National
> University in South Korea.
>
> Our team is composed of three members majoring in computer science.
>
>
>
> We would like to participate in google summer of code 2016 and are
> interested in proposal 32 : [CEP] Visual Query Composer for WSO2 CEP.
>
> So, we hope to submit proposal.
>
>
>
> We have made a small compiler using Java and ANTLR, and built a Web site
> using JavaScript and MySQL.
>
> Last winter, we tried to solve problems in ACM DEBS 2015 Grand Challenge
> using ESPER EPL/Java, and now we are working on the problems of this year.
>
>
>
> We expect it will be helpful for the project.
>
>
>
> We would like to know what we are supposed to do to submit our proposal.
>
>
>
> Do we have any essential documents that we have to submit?
>
>
>
> If you let us know, we will do our best to satisfy your criteria.
>
>
>
> Thank you.
>
> With best regards.
>
>
>
> From Dae-bin, Jin-ho, Hyung-ken.
>
> Dae-bin email : dla9...@naver.com
>
> Jin-ho email : thdwlsg...@nate.com
>
> Hyung-ken email : tmxhsf...@naver.com
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Fix the error message fund->found

[Mohanadarshan Vivekanandalingam]

On Mon, Mar 14, 2016 at 8:18 AM, Srinath Perera  wrote:

> Exception in thread "main"
> org.wso2.siddhi.core.exception.QueryNotExistException: No query fund with
> name: WordFreqByDay
>

We have fixed this from Siddhi 3.0.5 version.. Are you using older Siddhi
version ?

Thanks,
Mohan


>
> --
> 
> Blog: http://srinathsview.blogspot.com twitter:@srinath_perera
> Site: http://people.apache.org/~hemapani/
> Photos: http://www.flickr.com/photos/hemapani/
> Phone: 0772360902
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Sample/ Docs on Embedding Siddhi from Java

[Mohanadarshan Vivekanandalingam]

On Sun, Mar 13, 2016 at 8:12 AM, Srinath Perera <srin...@wso2.com> wrote:

> That blog post give 3.0 instructions I think!!
>
> Shall we take it in and put the doc, and maintain with releases?
>

Yes, actually Siddhi 3.0.x is the latest Siddhi version which packed with
CEP 4.0.0 and 4.1.0 (Which means it is the updated one)..

Sure, will move them to the documentation and maintain it..

Thanks,
Mohan



>
> On Sun, Mar 13, 2016 at 8:06 AM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>>
>>
>> On Sun, Mar 13, 2016 at 7:10 AM, Srinath Perera <srin...@wso2.com> wrote:
>>
>>> Where can I found it in docs?
>>>
>>>
>> It is mentioned in the FAQ section [1] and pointed to a blog-post from
>> there..
>>
>> [1]
>> https://docs.wso2.com/display/CEP410/FAQ#FAQ-CanSiddhibeusedoutsideWSO2CEP
>> ?
>>
>> Thanks,
>> Mohan
>>
>>
>>
>>> --Srinath
>>>
>>> --
>>> 
>>> Blog: http://srinathsview.blogspot.com twitter:@srinath_perera
>>> Site: http://people.apache.org/~hemapani/
>>> Photos: http://www.flickr.com/photos/hemapani/
>>> Phone: 0772360902
>>>
>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Senior Software Engineer,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673
>>
>
>
>
> --
> 
> Blog: http://srinathsview.blogspot.com twitter:@srinath_perera
> Site: http://people.apache.org/~hemapani/
> Photos: http://www.flickr.com/photos/hemapani/
> Phone: 0772360902
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Sample/ Docs on Embedding Siddhi from Java

[Mohanadarshan Vivekanandalingam]

On Sun, Mar 13, 2016 at 7:10 AM, Srinath Perera  wrote:

> Where can I found it in docs?
>
>
It is mentioned in the FAQ section [1] and pointed to a blog-post from
there..

[1]
https://docs.wso2.com/display/CEP410/FAQ#FAQ-CanSiddhibeusedoutsideWSO2CEP?

Thanks,
Mohan



> --Srinath
>
> --
> 
> Blog: http://srinathsview.blogspot.com twitter:@srinath_perera
> Site: http://people.apache.org/~hemapani/
> Photos: http://www.flickr.com/photos/hemapani/
> Phone: 0772360902
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] CEP does not accept requests after receiving a high rate of events for some time

[Mohanadarshan Vivekanandalingam]

[Adding Dev and Removing Architecture]

On Fri, Mar 11, 2016 at 8:08 PM, Mohanadarshan Vivekanandalingam <
mo...@wso2.com> wrote:

> Hi,
>>
>>
> Hi Isuru,
>
> Please find my comments below..
>
>
>
>> This is regarding the analytics for US Election 2016 Tweets. The ESB uses
>> Twitter Connector to find tweets with some specific hashtags and sends the
>> tweets as events to CEP via HTTP. The CEP version is 4.0.0.
>>
>> The CEP receives the events via the Tomcat HTTP Connector (port 9763). As
>> mentioned in $subject, the CEP fails to accept requests as there are no
>> worker threads to handle the requests.
>>
>> I have attached a thread dump and I analyzed it using the ThreadLogic
>> application [1]. All 250 HTTP worker threads (http-nio-9763-exec-*) are in
>> "PARKING" state and following is a part of stack trace in each thread.
>>
>> "http-nio-9763-exec-102" #810 daemon prio=5 os_prio=0
>> tid=0x7f7678010800 nid=0x710 waiting on condition [0x7f75da48f000]
>>*java.lang.Thread.State: WAITING (parking)*
>> at sun.misc.Unsafe.park(Native Method)
>> - parking to wait for  <0x0005cc6bd6a8> (a
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>> at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>> at
>> java.util.concurrent.LinkedBlockingQueue.put(LinkedBlockingQueue.java:350)
>>
>>
>>
>>
>> *at
>> org.wso2.carbon.event.input.adapter.http.HTTPEventAdapter$1.rejectedExecution(HTTPEventAdapter.java:99)
>> at
>> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
>> at
>> java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
>> at
>> java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
>> at
>> org.wso2.carbon.event.input.adapter.http.HTTPMessageServlet.doPost(HTTPMessageServlet.java:177)*
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:646)
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>> at
>> org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
>>
>>
>> The HTTPMessageServlet submits a HTTPRequestProcessor [2] to an executor
>> service and the executor service rejects it as the worker queue is full.
>> However in the RejectedExecutionHandler, the task is put back to same
>> queue [3]. Here the thread gets parked while waiting for some condition.
>> This is why the Tomcat HTTP connector can no longer process any requests.
>>
>>
> Yes, above implementation is done purposefully.. We had a requirement
> where we need to block the HTTP requests when there is no thread (or space
> in the queue) rather dropping the events. That is why above HTTP adapter is
> implemented in such way.. Because of above implementation, there will not
> be an event loss at receiver level.
>
>
>> Then I checked the thread pool used in [2] and found out that all 100
>> threads (pool-75-thread-*) in that pool are also in "PARKING" state.
>> Following is the stack trace.
>>
>>
>> "pool-75-thread-100" #758 prio=5 os_prio=0 tid=0x7f7634017800
>> nid=0x6ba runnable [0x7f75dd8c4000]
>> *   java.lang.Thread.State: TIMED_WAITING (parking)*
>> at sun.misc.Unsafe.park(Native Method)
>> at
>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:338)
>> at
>> com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:136)
>> at
>> com.lmax.disruptor.MultiProducerSequencer.next(MultiProducerSequencer.java:105)
>> at *com.lmax.disruptor.RingBuffer.next(RingBuffer.java:246)*
>> at
>> *org.wso2.siddhi.core.stream.input.SingleStreamEntryValve.send(SingleStreamEntryValve.java:74)*
>> at
>> org.wso2.siddhi.core.stream.input.SingleStreamEntryValve.send(SingleStreamEntryValve.java:99)
>> at
>> org.wso2.siddhi.core.stream.input.InputHandler.send(InputHandler.java:49)
>> at
>> org.wso2.carbon.event.processor.core.internal.listener.SiddhiInputEventDispatcher.sendEvent(SiddhiInputEventDispatcher.java:39)
>> at
>> org.wso2.carbon.event.processor.core.internal.listener.AbstractSiddhiInputEventDispatcher.consumeEvent(AbstractSiddhiInputEventDispatcher.java:92)
>> at
>> org.wso2.carbon.event.stream.core.internal.EventJunction.sendEvent(EventJunction.jav

Re: [Dev] Aggregate feature for event publishing

[Mohanadarshan Vivekanandalingam]

Hi All,

We have created the aggregate feature for event publisher and committed to
carbon-analytics-common repo... Please find it in [1]..

[1]
https://github.com/wso2/carbon-analytics-common/tree/master/features/event-publisher/org.wso2.carbon.event.publisher.aggregate.feature

Thanks,
Mohan


On Tue, Mar 8, 2016 at 3:25 PM, Mohanadarshan Vivekanandalingam <
mo...@wso2.com> wrote:

>
> On Tue, Mar 8, 2016 at 12:09 PM, Malith Dhanushka <mal...@wso2.com> wrote:
>
>> Hi CEP team,
>>
>> Hi Malith,
>
>
>
>> I tried to configure a vanilla carbon server to publish events to DAS by
>> installing event publisher features. So following are the features that i
>> had to install to get it working.
>>
>> Application Deployer Event Processing
>> Data Bridge - Data Publisher Aggregate
>> Event Processor
>> Event Processor Manager Commons
>> Event Processor Manager Core
>> Event Publisher
>> Event Publisher Output Adapter
>> Event Statistics
>> Event Stream
>> Registry Core
>>
>> And also noticed that server features related to event publishing are not
>> available in the p2 repo. So shall we create a aggregate feature for event
>> publishing by including server features of above list ?
>>
>
> Yes, Let's start work on creating $subjected feature..  May be we can
> avoid some unrelated features as well..
>
> Thanks,
> Mohan
>
>
>> Thanks
>> Malith
>> --
>> Malith Dhanushka
>> Senior Software Engineer - Data Technologies
>> *WSO2, Inc. : wso2.com <http://wso2.com/>*
>> *Mobile*  : +94 716 506 693
>>
>
>
>
> --
> *V. Mohanadarshan*
> *Senior Software Engineer,*
> *Data Technologies Team,*
> *WSO2, Inc. http://wso2.com <http://wso2.com> *
> *lean.enterprise.middleware.*
>
> email: mo...@wso2.com
> phone:(+94) 771117673
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Aggregate feature for event publishing

[Mohanadarshan Vivekanandalingam]

On Tue, Mar 8, 2016 at 12:09 PM, Malith Dhanushka  wrote:

> Hi CEP team,
>
> Hi Malith,



> I tried to configure a vanilla carbon server to publish events to DAS by
> installing event publisher features. So following are the features that i
> had to install to get it working.
>
> Application Deployer Event Processing
> Data Bridge - Data Publisher Aggregate
> Event Processor
> Event Processor Manager Commons
> Event Processor Manager Core
> Event Publisher
> Event Publisher Output Adapter
> Event Statistics
> Event Stream
> Registry Core
>
> And also noticed that server features related to event publishing are not
> available in the p2 repo. So shall we create a aggregate feature for event
> publishing by including server features of above list ?
>

Yes, Let's start work on creating $subjected feature..  May be we can avoid
some unrelated features as well..

Thanks,
Mohan


> Thanks
> Malith
> --
> Malith Dhanushka
> Senior Software Engineer - Data Technologies
> *WSO2, Inc. : wso2.com *
> *Mobile*  : +94 716 506 693
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Implementing Geographical based Analytics in API Manager

[Mohanadarshan Vivekanandalingam]

AFAIR, there is an external third party API used to find the location of IP
address in fraud detection tool-kit.. But I think, it has many
restrictions..

I agree with Jo where some customers might want to use paid services for
that, we need to implement the feature in such a way.. Yes, going with a
free database by default would be good or can't we host a service in our
end and use it in the pack ?

Thanks,
Mohan


On Sun, Feb 21, 2016 at 10:34 PM, Joseph Fonseka  wrote:

> Hi Tharindu
>
> They both use the same source of data from MaxMind. And the database is
> licensed under "CC Attribution-ShareAlike" thus we should attribute them if
> we are using it. see [1]
>
> On an on premise deployment customers might want to use a paid service to
> get the location so I think we should support that. And to ship with the
> product like suggested we can use a free database.
>
> Also when will the location be resolved ? will it be a background task or
> are you planing to do it real-time ?
>
> Regards
> Jo
>
>
>
> [1] http://dev.maxmind.com/geoip/geoip2/geolite2/
>
> On Sun, Feb 21, 2016 at 8:27 PM, Tharindu Dharmarathna  > wrote:
>
>> HI Nuwan,
>>
>> There are two lightweight databases we can use as I found from [1] and
>> [2] and those are open source projects.
>>
>> [1] - https://freegeoip.net/
>> [2] -
>> http://gis.stackexchange.com/questions/88/how-can-i-determine-the-location-of-a-visitor-to-my-website
>>
>> Thanks
>> Tharindu
>>
>> On Sun, Feb 21, 2016 at 8:23 PM, Nirmal Fernando  wrote:
>>
>>> @Seshika any thoughts?
>>>
>>> On Sun, Feb 21, 2016 at 8:19 PM, Nuwan Dias  wrote:
>>>
 I have doubts on using an HTTP API to get these details because,

 1. It will be costly in terms of performance to call these APIs (and
 they might not be free as well).
 2. We have no control nor guarantee on their availability (they can
 shutdown whenever they want).
 3. They will only work if the stats visualizing agent (store/publisher)
 or DAS has access to internet.

 Can we look for a light-weight open-source database which has region
 information based on IP ranges?

 Thanks,
 NuwanD.

 On Sun, Feb 21, 2016 at 10:29 AM, Tharindu Dharmarathna <
 tharin...@wso2.com> wrote:

> Hi All,
>
> We are going to implement $Subject on latest release . I want to know
> is there any best way to extract Geographical location from IP . And here
> are my findings of the ways of do.
>
> [1] - http://www.geoplugin.com
> Thi will retrive all the data according to the location as json
>
> [2] - http://www.telize.com/
>
> This is another REST API which can used to extract location.
>
> *Thanks*
> *Tharindu Dharmarathna*
> Associate Software Engineer
> WSO2 Inc.; http://wso2.com
> lean.enterprise.middleware
>
> mobile: *+94779109091 <%2B94779109091>*
>



 --
 Nuwan Dias

 Technical Lead - WSO2, Inc. http://wso2.com
 email : nuw...@wso2.com
 Phone : +94 777 775 729

 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev


>>>
>>>
>>> --
>>>
>>> Thanks & regards,
>>> Nirmal
>>>
>>> Team Lead - WSO2 Machine Learner
>>> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
>>> Mobile: +94715779733
>>> Blog: http://nirmalfdo.blogspot.com/
>>>
>>>
>>>
>>
>>
>> --
>>
>> *Tharindu Dharmarathna*Associate Software Engineer
>> WSO2 Inc.; http://wso2.com
>> lean.enterprise.middleware
>>
>> mobile: *+94779109091 <%2B94779109091>*
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
>
> --
> *Joseph Fonseka*
> WSO2 Inc.; http://wso2.com
> lean.enterprise.middleware
>
> mobile: +94 772 512 430
> skype: jpfonseka
>
> * *
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [VOTE] Release WSO2 Complex Event Processor 4.1.0 RC2

[Mohanadarshan Vivekanandalingam]

Tested following scenarios/features..

1. All Samples(-0022) related to Event Receivers
2. Basic end-to-end execution Flow
3. Execution Manager
4. Event Tracer

No issues found.
[x] Stable - Please go ahead and release..

Thanks,
Mohan

On Fri, Feb 19, 2016 at 2:04 AM, Grainier Perera  wrote:
> Hi Devs,
>
> This is the second release candidate of WSO2 Complex Event Processor 4.1.0.
>
> This release fixes the following issues:
> https://wso2.org/jira/issues/?filter=12644
>
> Please download CEP 4.1.0 RC2 and test the functionality and vote. Vote will
> be open for 72 hours or as needed.
>
> Source & binary distribution files:
> https://github.com/wso2/product-cep/releases/tag/v4.1.0-RC2
>
> The tag to be voted upon:
> https://github.com/wso2/product-cep/tree/release-4.1.0-RC2
>
> [+] Stable - go ahead and release
> [-] Broken - do not release (explain why)
>
> Thanks and Regards,
> WSO2 CEP Team.
>
> --
> Grainier Perera
> Software Engineer
> Mobile : +94716122384
> WSO2 Inc. | http://wso2.com
> lean.enterprise.middleware
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>



-- 
V. Mohanadarshan
Senior Software Engineer,
Data Technologies Team,
WSO2, Inc. http://wso2.com
lean.enterprise.middleware.

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] ML 1.1.0 is not backward compatible with older models

[Mohanadarshan Vivekanandalingam]

On Thu, Feb 18, 2016 at 2:42 PM, Fazlan Nazeem  wrote:

> Hi NIranjan,
>
> Yes, but currently we do not have a migration guide for ML. The changes
> needed were minimal and hence was decided not to include a migration guide.
>

No Fazlan.. It is not correct.. Eventhough changes are minimal we need a
migration guide specifying those minimal things or to say there is nothing
to migrate.. It is a mandatory doc requirement for a release..



>
> On Thu, Feb 18, 2016 at 12:27 PM, Niranjan Karunanandham <
> niran...@wso2.com> wrote:
>
>> Hi Fazlan,
>>
>> IMO we need to also mention this in the ML migration doc from 1.0.0 to
>> 1.1.0.
>>
>> Regards,
>> Nira
>>
>> On Thu, Feb 18, 2016 at 12:22 PM, Fazlan Nazeem  wrote:
>>
>>> Hi Tishan,
>>>
>>> This is an expected behaviour since we have changed the model classes in
>>> ML 1.1.0.
>>>
>>> @Rukshani can you please document this under [1].
>>>
>>> [1]
>>> https://docs.wso2.com/display/ML110/WSO2+CEP+Extension+for+ML+Predictions
>>>
>>> On Thu, Feb 18, 2016 at 12:12 PM, Tishan Dahanayakage 
>>> wrote:
>>>
 Hi all,

 ML models built with ML 1.0.0 is not compatible with ML 1.1.0. If we
 try to use a model build with 1.0.0 against ML 1.1.0 features following
 exception is generated. Came across this when testing ML extension for CEP.


 org.wso2.carbon.event.processor.core.exception.ExecutionPlanConfigurationException:
 org.wso2.siddhi.core.exception.ExecutionPlanCreationException: Error while
 retrieving ML-model :
 registry:/_system/governance/2.Model.2015-12-22_19-47-59
 org.wso2.carbon.ml.core.spark.models.MLGeneralizedLinearModel; local
 class incompatible: stream classdesc serialVersionUID =
 -1410218250358516850, local class serialVersionUID = 8020448562088344988 in
 execution plan "ExecutionPlanML"
 at
 org.wso2.carbon.event.processor.core.internal.util.helper.EventProcessorHelper.validateExecutionPlan(EventProcessorHelper.java:193)
 ...
 Caused by:
 org.wso2.siddhi.core.exception.ExecutionPlanCreationException: Error while
 retrieving ML-model :
 registry:/_system/governance/2.Model.2015-12-22_19-47-59
 org.wso2.carbon.ml.core.spark.models.MLGeneralizedLinearModel; local
 class incompatible: stream classdesc serialVersionUID =
 -1410218250358516850, local class serialVersionUID = 8020448562088344988
 at
 org.wso2.carbon.ml.siddhi.extension.PredictStreamProcessor.logError(PredictStreamProcessor.java:350)
 at
 org.wso2.carbon.ml.siddhi.extension.PredictStreamProcessor.init(PredictStreamProcessor.java:187)
 ... 82 more

 Is this expected behavior? If so ​I think we need to mention that
 models are not backward compatible in docs.​


 --
 Tishan Dahanayakage
 Software Engineer
 WSO2, Inc.
 Mobile:+94 716481328

 Disclaimer: This communication may contain privileged or other
 confidential information and is intended exclusively for the addressee/s.
 If you are not the intended recipient/s, or believe that you may have
 received this communication in error, please reply to the sender indicating
 that fact and delete the copy you received and in addition, you should not
 print, copy, re-transmit, disseminate, or otherwise use the information
 contained in this communication. Internet communications cannot be
 guaranteed to be timely, secure, error or virus-free. The sender does not
 accept liability for any errors or omissions.

 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev


>>>
>>>
>>> --
>>> Thanks & Regards,
>>>
>>> Fazlan Nazeem
>>>
>>> *Software Engineer*
>>>
>>> *WSO2 Inc*
>>> Mobile : +94772338839
>>> <%2B94%20%280%29%20773%20451194>
>>> fazl...@wso2.com
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>>
>> *Niranjan Karunanandham*
>> Senior Software Engineer - WSO2 Inc.
>> WSO2 Inc.: http://www.wso2.com
>>
>
>
>
> --
> Thanks & Regards,
>
> Fazlan Nazeem
>
> *Software Engineer*
>
> *WSO2 Inc*
> Mobile : +94772338839
> <%2B94%20%280%29%20773%20451194>
> fazl...@wso2.com
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [DEV] WSO2 Complex Event Processor 4.1.0 Beta Released

[Mohanadarshan Vivekanandalingam]

Hi All,

WSO2 CEP Team is pleased to announce the Beta release of WSO2 Complex Event
Processor 4.1.0.

WSO2 Complex Event Processor (CEP) can be used to identify the most
meaningful events within an event cloud, analyzes their impacts, and acts
on them in real time. Built to be extremely high performing it offers
significant time saving and affordable acquisition. WSO2 CEP Manager is
released under the Apache Software License 2.0.

The distribution is available at [1]. The documentation for CEP 4.1.0 Beta
can be found at [2] (which is WIP). Your feedback is most welcome, and any
issues can be reported to the project at [3].

Following bug fixes and improvements have been added along with this
release .

*Bug*

   - [CEP-1347 ] - Refreshing Arc
   and Map charts is visible when throughput is high
   - [CEP-1367 ] - Cannot add a
   datasource, with name having character 's'
   - [CEP-1383 ] - Intermittently an
   NPE is thrown on worker logs when updating execution planner with Output
   Rate Limiting patterns
   - [CEP-1387 ] - Analytics
   Dashboard - Multiline Y axis Limitations
   - [CEP-1388 ] - "Error while
   indexing" issue observed in worker node when starting a fresh pack in CEP
   distributed cluster
   - [CEP-1389 ] - Analytics
   Dashboard - Line and Area charts miss first event when plotting
   - [CEP-1391 ] - OOM when nodes
   are disconnected from hazelcast cluster in distributed mode
   - [CEP-1392 ] - Restrict setting
   up incorrect configurations in event simulator configuration files for
   sample mode
   - [CEP-1395 ] - Analytics
   Dashboard - Login redirection does not work in Sample mode
   - [CEP-1431 ] - Cannot put
   "((true) in SomeEventTable)" as an attribute in the select statement
   - [CEP-1438 ] - Siddhi PMML
   extension is always expecting an output field
   - [CEP-1460 ] - MQTT Event
   receiver unsubscribes from the topic on shutdown, even cleanSession is set
   to false.
   - [CEP-1461 ] - Issue on viewing
   system logs in management console
   - [CEP-1466 ] - two get calls
   executes when datasources getting populated for Batch and realtime


*Improvement*

   - [CEP-1406 ] - Need to have tool
   tips for icons in the Dashboard
   - [CEP-1467 ] - When deleting a
   gadget need a configurable option to either delete whole layout with block
   or only the block(gadget content))



References:

​[1] https://github.com/wso2/product-cep/releases/tag/v4.1.0-beta
[2]
https://docs.wso2.com/display/CEP410/WSO2+Complex+Event+Processor+Documentation
[3] https://wso2.org/jira/browse/CEP


Thanks,
-WSO2 CEP Team-

-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [DEV] WSO2 Complex Event Processor 4.1.0 Alpha Released

[Mohanadarshan Vivekanandalingam]

Hi All,

WSO2 CEP Team is pleased to announce the Alpha release of WSO2 Complex
Event Processor 4.1.0.

WSO2 Complex Event Processor (CEP) can be used to identify the most
meaningful events within an event cloud, analyzes their impacts, and acts
on them in real time. Built to be extremely high performing it offers
significant time saving and affordable acquisition. WSO2 CEP Manager is
released under the Apache Software License 2.0.

The distribution is available at [1]. The documentation for CEP 4.1.0 Alpha
can be found at [2] (which is WIP). Your feedback is most welcome, and any
issues can be reported to the project at [3].

Following bug fixes, improvements and new features have been added along
with this release .

*Improvements*

   - [CEP-644 ] - add insertOrUpdate
   to event table
   - [CEP-1419 ] - Provide "insert
   or update" functionality to event tables
   - [CEP-1426 ] - When passing
   parameters to function allow the syntax func(*) if all the attributes of
   the inputstream have to be passed
   - [CEP-1439 ] - Map extension
   support
   - [CEP-1445 ] - Improve
   user-friendliness by sorting drop-down lists
   - [CEP-1448 ] - Hazelcast Event
   Table for Siddhi
   - [CEP-1450 ] - Adding Arbitrary
   Map support for Receiver Components
   - [CEP-1453 ] - Pause, Resume and
   Stop support for Event Simulator
   - [CEP-1458 ] - Support for more
   then 2 nodes in HA deployment


*New Features*

   - [CEP-101 ] - Indexing for
   Hazelcast table
   - [CEP-105 ] - Time length window
   implementation for Siddhi
   - [CEP-1365 ] - Add a function to
   extract 'DAY OF WEEK' from time/timestamp
   - [CEP-1423 ] - Support
   outer/left joins in Siddhi
   - [CEP-1440 ] - Geo Closest
   function
   - [CEP-1441 ] - External Batch
   window for siddhi
   - [CEP-1457 ] - Minima and Maxima
   detection on Siddhi
   - [CEP-1459 ] - Instrumentation &
   Monitoring support for CEP and Siddhi


*Bugs*

   - [CEP-1117 ] - No default value
   support for Map mapping
   - [CEP-1338 ] - [Intermittent]
   Error observed in edit tenant UI
   - [CEP-1352 ] - 'The [action]
   cannot be processed at the receiver' error when clicked on 'Streams' option
   - [CEP-1361 ] - Index Out of
   Bounds Exception after a new field is added to Stream
   - [CEP-1363 ] - Execution plan
   does not display "from" when we type @ symbol as a result this needs to be
   added
   - [CEP-1375 ] -
   org.wso2.carbon.event.processor.admin bundle activation is getting delayed
   because it get wires with wrong dependency version
   - [CEP-1393 ] - NPE thrown for
   Websocket Local Input Receiver if the same receiver is redeployed
   - [CEP-1400 ] - Error when
   integrating ML extension to CEP storm cluster
   - [CEP-1401 ] - Issue in email
   event adapter
   - [CEP-1405 ] - "No extension
   exist for StreamFunctionExtension{namespace='ml'}" exception when started
   worker node with -DworkerNode=true property
   - [CEP-1407 ] - In conditions
   cannot be used in select statement
   - [CEP-1408 ] - Concurrent
   Modification exception
   - [CEP-1409 ] - When modifying an
   event stream, information does not get removed from in-memory cache at
   databridge
   - [CEP-1410 ] - Validate Input
   Stream for WSO2Event custom mapping
   - [CEP-1411 ] - Siddhi thread
   dead on invalid inputs
   - [CEP-1415 ] - Event Table
   Update results in duplicate inserts
   - [CEP-1418 ] - Test cases are
   failing in SnapshotOutputRateLimitTestCase due to possible thread
   contention issue
   - [CEP-1422 ] -
   ArrayIndexOutOfBoundsException when adding wso2-event publisher with
   invalid Receiver URL
   - [CEP-1427 

Re: [Dev] Problem with init() Method of Window Processors in Apache Stratos CEP Extension

[Mohanadarshan Vivekanandalingam]

On Thu, Jan 28, 2016 at 1:59 PM, Tharindu Munasinghe <
tharindu...@cse.mrt.ac.lk> wrote:

> Hi all,
>
> We have written a custom window processor [1] following the same code
> structure as in [2], and invoked it via [3], as part of a project for
> improving Apache Stratos prediction techniques. Previously we had assumed
> that window processors are instantiated one-time when the corresponding
> execution plan is deployed, so we thought we can maintain the history of
> health stat information inside the window processors.
>
> However, when testing our implementation on AWS infrastructure with an
> external CEP instance (v3.1.0) we noticed that the init() method of window
> processors attached to the same stream is invoked multiple times. It
> appears that the invocation happens periodically. As a result, the Stratos
> autoscaler receives multiple health stat events of the same type within a
> given time interval. We investigated the problem with an existing window
> processor [2] and observed the same phenomenon.
>
> At which stage(s) could the init() method be getting invoked, under our
> current implementation? Also, it is possible that multiple window processor
> instances could be getting instantiated in case of exceptions occurring in
> the window processor?
>

Yes, It is a known behavior of Siddhi where init method is called twice
(not many times).. AFAIR it called in validation flow and actual flow.. In
latest Siddhi this was implemented differently by introducing new functions
which called only once..

Thanks,
Mohan


>
>
> [1]
> https://github.com/ridwannaruto/stratos/blob/fyp/extensions/cep/modules/stratos-cep-extension/wso2cep-3.1.0/src/main/java/org/apache/stratos/cep/extension/PredictorWindowProcessor.java
>
> [2]
> https://github.com/ridwannaruto/stratos/blob/fyp/extensions/cep/modules/stratos-cep-extension/wso2cep-3.1.0/src/main/java/org/apache/stratos/cep/extension/GradientFinderWindowProcessor.java
>
> [3]
> https://github.com/ridwannaruto/stratos/blob/fyp/extensions/cep/modules/artifacts/wso2cep-3.1.0/executionplans/PredictorOfHealthRequest.xml
>
> Thanks,
> Tharindu
> --
> *Th**a**rindu Munasin**ghe.*
> *Undergraduate ,Department of Computer **S**cience and Engineering*
> *University of Moratuwa.*
> *Contact no. +94770460887*
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Request the PRs to be merged (analytics-common & event-processing repos)

[Mohanadarshan Vivekanandalingam]

On Tue, Jan 26, 2016 at 4:52 PM, Sachith Withana <sach...@wso2.com> wrote:

> @Mohan: Do we have to release Siddhi as well? since there's a dependency
> on Siddhi from carbon-analytics-common.
>

No need a Siddhi release.. Please use the existing released Siddhi
dependency..


> On Tue, Jan 26, 2016 at 4:35 PM, Mohanadarshan Vivekanandalingam <
> mo...@wso2.com> wrote:
>
>> By the Sachith, please update once you are done with
>> carbon-analytics-common release..  Then I can move with
>> carbon-event-processing release..
>>
>> On Tue, Jan 26, 2016 at 3:23 PM, Mohanadarshan Vivekanandalingam <
>> mo...@wso2.com> wrote:
>>
>>>
>>>
>>> On Tue, Jan 26, 2016 at 3:06 PM, Sachith Withana <sach...@wso2.com>
>>> wrote:
>>>
>>>> @Mohan: I can release the analytics-common now, if you guys are not
>>>> doing any active development on it.
>>>>
>>>
>>> Sachith, please go ahead and release it..
>>>
>>>
>>>>
>>>> On Tue, Jan 26, 2016 at 3:03 PM, Ruwan Yatawara <ruw...@wso2.com>
>>>> wrote:
>>>>
>>>>> Actually I was about to ask the same thing. Please correct me if I am
>>>>> wrong, but i didnt see there being a reference to event-processing in
>>>>> analytics-common.
>>>>>
>>>>> Thanks and Regards,
>>>>>
>>>>> Ruwan Yatawara
>>>>>
>>>>> Senior Software Engineer,
>>>>> WSO2 Inc.
>>>>>
>>>>> email : ruw...@wso2.com
>>>>> mobile : +94 77 9110413
>>>>> blog : http://ruwansrants.blogspot.com/
>>>>> www: :http://wso2.com
>>>>>
>>>>>
>>>>> On Tue, Jan 26, 2016 at 3:01 PM, Mohanadarshan Vivekanandalingam <
>>>>> mo...@wso2.com> wrote:
>>>>>
>>>>>>
>>>>>>
>>>>>> On Tue, Jan 26, 2016 at 2:21 PM, Sachith Withana <sach...@wso2.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Mohan,
>>>>>>>
>>>>>>> Can you merge and release the Carbon-event-processing first? so that
>>>>>>> It can be included in carbon-analytics-common release?
>>>>>>>
>>>>>>
>>>>>> Sorry, why do you need a Carbon-event-processing release first?
>>>>>> carbon-analytics-common is not depend on that..
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Sachith
>>>>>>>
>>>>>>> On Tue, Jan 26, 2016 at 12:36 PM, Ruwan Yatawara <ruw...@wso2.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Team,
>>>>>>>>
>>>>>>>> Ran in to a few OSGI issues again whilst packing DAS components in
>>>>>>>> IoTS and did some fixes. Can we get the below PRs ([1] & [2]) merged 
>>>>>>>> to the
>>>>>>>> respective Repos and get them released?
>>>>>>>>
>>>>>>>> There is another fix that need to go in to carbon-analytics. But in
>>>>>>>> order to add that fix, the following two repos need to be released as 
>>>>>>>> they
>>>>>>>> are inter-dependent.
>>>>>>>>
>>>>>>>> [1] - https://github.com/wso2/carbon-event-processing/pull/197
>>>>>>>> [2] - https://github.com/wso2/carbon-analytics-common/pull/174
>>>>>>>>
>>>>>>>> Thanks and Regards,
>>>>>>>>
>>>>>>>> Ruwan Yatawara
>>>>>>>>
>>>>>>>> Senior Software Engineer,
>>>>>>>> WSO2 Inc.
>>>>>>>>
>>>>>>>> email : ruw...@wso2.com
>>>>>>>> mobile : +94 77 9110413
>>>>>>>> blog : http://ruwansrants.blogspot.com/
>>>>>>>> www: :http://wso2.com
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Sachith Withana
>>>>>>> Software Engineer; WSO2 Inc.; http://wso2.com
>>>>>>> E-mail: sachith AT wso2.com
>>>>>>> M: +94715518127
>>>>>>> Linked-In: <http://goog_416592669>
>>>>>>> https://lk.linkedin.com/in/sachithwithana
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *V. Mohanadarshan*
>>>>>> *Senior Software Engineer,*
>>>>>> *Data Technologies Team,*
>>>>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>>>>> *lean.enterprise.middleware.*
>>>>>>
>>>>>> email: mo...@wso2.com
>>>>>> phone:(+94) 771117673
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Sachith Withana
>>>> Software Engineer; WSO2 Inc.; http://wso2.com
>>>> E-mail: sachith AT wso2.com
>>>> M: +94715518127
>>>> Linked-In: <http://goog_416592669>
>>>> https://lk.linkedin.com/in/sachithwithana
>>>>
>>>
>>>
>>>
>>> --
>>> *V. Mohanadarshan*
>>> *Senior Software Engineer,*
>>> *Data Technologies Team,*
>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>> *lean.enterprise.middleware.*
>>>
>>> email: mo...@wso2.com
>>> phone:(+94) 771117673
>>>
>>
>>
>>
>> --
>> *V. Mohanadarshan*
>> *Senior Software Engineer,*
>> *Data Technologies Team,*
>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>> *lean.enterprise.middleware.*
>>
>> email: mo...@wso2.com
>> phone:(+94) 771117673
>>
>
>
>
> --
> Sachith Withana
> Software Engineer; WSO2 Inc.; http://wso2.com
> E-mail: sachith AT wso2.com
> M: +94715518127
> Linked-In: <http://goog_416592669>
> https://lk.linkedin.com/in/sachithwithana
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Request the PRs to be merged (analytics-common & event-processing repos)

[Mohanadarshan Vivekanandalingam]

On Tue, Jan 26, 2016 at 3:06 PM, Sachith Withana <sach...@wso2.com> wrote:

> @Mohan: I can release the analytics-common now, if you guys are not doing
> any active development on it.
>

Sachith, please go ahead and release it..


>
> On Tue, Jan 26, 2016 at 3:03 PM, Ruwan Yatawara <ruw...@wso2.com> wrote:
>
>> Actually I was about to ask the same thing. Please correct me if I am
>> wrong, but i didnt see there being a reference to event-processing in
>> analytics-common.
>>
>> Thanks and Regards,
>>
>> Ruwan Yatawara
>>
>> Senior Software Engineer,
>> WSO2 Inc.
>>
>> email : ruw...@wso2.com
>> mobile : +94 77 9110413
>> blog : http://ruwansrants.blogspot.com/
>> www: :http://wso2.com
>>
>>
>> On Tue, Jan 26, 2016 at 3:01 PM, Mohanadarshan Vivekanandalingam <
>> mo...@wso2.com> wrote:
>>
>>>
>>>
>>> On Tue, Jan 26, 2016 at 2:21 PM, Sachith Withana <sach...@wso2.com>
>>> wrote:
>>>
>>>> Hi Mohan,
>>>>
>>>> Can you merge and release the Carbon-event-processing first? so that It
>>>> can be included in carbon-analytics-common release?
>>>>
>>>
>>> Sorry, why do you need a Carbon-event-processing release first?
>>> carbon-analytics-common is not depend on that..
>>>
>>>
>>>
>>>>
>>>> Thanks,
>>>> Sachith
>>>>
>>>> On Tue, Jan 26, 2016 at 12:36 PM, Ruwan Yatawara <ruw...@wso2.com>
>>>> wrote:
>>>>
>>>>> Hi Team,
>>>>>
>>>>> Ran in to a few OSGI issues again whilst packing DAS components in
>>>>> IoTS and did some fixes. Can we get the below PRs ([1] & [2]) merged to 
>>>>> the
>>>>> respective Repos and get them released?
>>>>>
>>>>> There is another fix that need to go in to carbon-analytics. But in
>>>>> order to add that fix, the following two repos need to be released as they
>>>>> are inter-dependent.
>>>>>
>>>>> [1] - https://github.com/wso2/carbon-event-processing/pull/197
>>>>> [2] - https://github.com/wso2/carbon-analytics-common/pull/174
>>>>>
>>>>> Thanks and Regards,
>>>>>
>>>>> Ruwan Yatawara
>>>>>
>>>>> Senior Software Engineer,
>>>>> WSO2 Inc.
>>>>>
>>>>> email : ruw...@wso2.com
>>>>> mobile : +94 77 9110413
>>>>> blog : http://ruwansrants.blogspot.com/
>>>>> www: :http://wso2.com
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Sachith Withana
>>>> Software Engineer; WSO2 Inc.; http://wso2.com
>>>> E-mail: sachith AT wso2.com
>>>> M: +94715518127
>>>> Linked-In: <http://goog_416592669>
>>>> https://lk.linkedin.com/in/sachithwithana
>>>>
>>>
>>>
>>>
>>> --
>>> *V. Mohanadarshan*
>>> *Senior Software Engineer,*
>>> *Data Technologies Team,*
>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>> *lean.enterprise.middleware.*
>>>
>>> email: mo...@wso2.com
>>> phone:(+94) 771117673
>>>
>>
>>
>
>
> --
> Sachith Withana
> Software Engineer; WSO2 Inc.; http://wso2.com
> E-mail: sachith AT wso2.com
> M: +94715518127
> Linked-In: <http://goog_416592669>
> https://lk.linkedin.com/in/sachithwithana
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Request the PRs to be merged (analytics-common & event-processing repos)

[Mohanadarshan Vivekanandalingam]

On Tue, Jan 26, 2016 at 2:21 PM, Sachith Withana  wrote:

> Hi Mohan,
>
> Can you merge and release the Carbon-event-processing first? so that It
> can be included in carbon-analytics-common release?
>

Sorry, why do you need a Carbon-event-processing release first?
carbon-analytics-common is not depend on that..



>
> Thanks,
> Sachith
>
> On Tue, Jan 26, 2016 at 12:36 PM, Ruwan Yatawara  wrote:
>
>> Hi Team,
>>
>> Ran in to a few OSGI issues again whilst packing DAS components in IoTS
>> and did some fixes. Can we get the below PRs ([1] & [2]) merged to the
>> respective Repos and get them released?
>>
>> There is another fix that need to go in to carbon-analytics. But in order
>> to add that fix, the following two repos need to be released as they are
>> inter-dependent.
>>
>> [1] - https://github.com/wso2/carbon-event-processing/pull/197
>> [2] - https://github.com/wso2/carbon-analytics-common/pull/174
>>
>> Thanks and Regards,
>>
>> Ruwan Yatawara
>>
>> Senior Software Engineer,
>> WSO2 Inc.
>>
>> email : ruw...@wso2.com
>> mobile : +94 77 9110413
>> blog : http://ruwansrants.blogspot.com/
>> www: :http://wso2.com
>>
>>
>
>
> --
> Sachith Withana
> Software Engineer; WSO2 Inc.; http://wso2.com
> E-mail: sachith AT wso2.com
> M: +94715518127
> Linked-In: 
> https://lk.linkedin.com/in/sachithwithana
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com  *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Request the PRs to be merged (analytics-common & event-processing repos)

[Mohanadarshan Vivekanandalingam]

By the Sachith, please update once you are done with
carbon-analytics-common release..  Then I can move with
carbon-event-processing release..

On Tue, Jan 26, 2016 at 3:23 PM, Mohanadarshan Vivekanandalingam <
mo...@wso2.com> wrote:

>
>
> On Tue, Jan 26, 2016 at 3:06 PM, Sachith Withana <sach...@wso2.com> wrote:
>
>> @Mohan: I can release the analytics-common now, if you guys are not doing
>> any active development on it.
>>
>
> Sachith, please go ahead and release it..
>
>
>>
>> On Tue, Jan 26, 2016 at 3:03 PM, Ruwan Yatawara <ruw...@wso2.com> wrote:
>>
>>> Actually I was about to ask the same thing. Please correct me if I am
>>> wrong, but i didnt see there being a reference to event-processing in
>>> analytics-common.
>>>
>>> Thanks and Regards,
>>>
>>> Ruwan Yatawara
>>>
>>> Senior Software Engineer,
>>> WSO2 Inc.
>>>
>>> email : ruw...@wso2.com
>>> mobile : +94 77 9110413
>>> blog : http://ruwansrants.blogspot.com/
>>> www: :http://wso2.com
>>>
>>>
>>> On Tue, Jan 26, 2016 at 3:01 PM, Mohanadarshan Vivekanandalingam <
>>> mo...@wso2.com> wrote:
>>>
>>>>
>>>>
>>>> On Tue, Jan 26, 2016 at 2:21 PM, Sachith Withana <sach...@wso2.com>
>>>> wrote:
>>>>
>>>>> Hi Mohan,
>>>>>
>>>>> Can you merge and release the Carbon-event-processing first? so that
>>>>> It can be included in carbon-analytics-common release?
>>>>>
>>>>
>>>> Sorry, why do you need a Carbon-event-processing release first?
>>>> carbon-analytics-common is not depend on that..
>>>>
>>>>
>>>>
>>>>>
>>>>> Thanks,
>>>>> Sachith
>>>>>
>>>>> On Tue, Jan 26, 2016 at 12:36 PM, Ruwan Yatawara <ruw...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> Hi Team,
>>>>>>
>>>>>> Ran in to a few OSGI issues again whilst packing DAS components in
>>>>>> IoTS and did some fixes. Can we get the below PRs ([1] & [2]) merged to 
>>>>>> the
>>>>>> respective Repos and get them released?
>>>>>>
>>>>>> There is another fix that need to go in to carbon-analytics. But in
>>>>>> order to add that fix, the following two repos need to be released as 
>>>>>> they
>>>>>> are inter-dependent.
>>>>>>
>>>>>> [1] - https://github.com/wso2/carbon-event-processing/pull/197
>>>>>> [2] - https://github.com/wso2/carbon-analytics-common/pull/174
>>>>>>
>>>>>> Thanks and Regards,
>>>>>>
>>>>>> Ruwan Yatawara
>>>>>>
>>>>>> Senior Software Engineer,
>>>>>> WSO2 Inc.
>>>>>>
>>>>>> email : ruw...@wso2.com
>>>>>> mobile : +94 77 9110413
>>>>>> blog : http://ruwansrants.blogspot.com/
>>>>>> www: :http://wso2.com
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Sachith Withana
>>>>> Software Engineer; WSO2 Inc.; http://wso2.com
>>>>> E-mail: sachith AT wso2.com
>>>>> M: +94715518127
>>>>> Linked-In: <http://goog_416592669>
>>>>> https://lk.linkedin.com/in/sachithwithana
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> *V. Mohanadarshan*
>>>> *Senior Software Engineer,*
>>>> *Data Technologies Team,*
>>>> *WSO2, Inc. http://wso2.com <http://wso2.com> *
>>>> *lean.enterprise.middleware.*
>>>>
>>>> email: mo...@wso2.com
>>>> phone:(+94) 771117673
>>>>
>>>
>>>
>>
>>
>> --
>> Sachith Withana
>> Software Engineer; WSO2 Inc.; http://wso2.com
>> E-mail: sachith AT wso2.com
>> M: +94715518127
>> Linked-In: <http://goog_416592669>
>> https://lk.linkedin.com/in/sachithwithana
>>
>
>
>
> --
> *V. Mohanadarshan*
> *Senior Software Engineer,*
> *Data Technologies Team,*
> *WSO2, Inc. http://wso2.com <http://wso2.com> *
> *lean.enterprise.middleware.*
>
> email: mo...@wso2.com
> phone:(+94) 771117673
>



-- 
*V. Mohanadarshan*
*Senior Software Engineer,*
*Data Technologies Team,*
*WSO2, Inc. http://wso2.com <http://wso2.com> *
*lean.enterprise.middleware.*

email: mo...@wso2.com
phone:(+94) 771117673
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev