[Architecture] Proposed Device Operations Flow of CDM

2014-11-03 Thread Harshan Liyanage
Hi, Please find the attached proposed device operations flow of CDM. Your suggestions feedback is highly appreciated. Thanks, Best Regards, Lakshitha Harshan Software Engineer Mobile: *+94724423048* Email: hars...@wso2.com Blog : http://harshanliyanage.blogspot.com/ *WSO2, Inc. :** wso2.com

[Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Tishan Dahanayakage
Hi all, Following is a draft of the interface of Siddhi window data structure that will be exposed. Rationale behind this is to seamlessly support different implementations such as bloom ​ ​ filters, disk backed window, etc. Please review this and propose necessary modifications. //Initializes

Re: [Architecture] Proposed Device Operations Flow of CDM

2014-11-03 Thread Inosh Perera
Hi Harshan, If for example, a message to a device is already in the queue and when monitoring happen, a similar payload is generated. How is it handled when it comes to communication between out queue and device platform bundle? Regards, Inosh On Mon, Nov 3, 2014 at 3:20 PM, Harshan Liyanage

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Rajeev Sampath
Hi, On Mon, Nov 3, 2014 at 3:26 PM, Tishan Dahanayakage tis...@wso2.com wrote: Hi all, Following is a draft of the interface of Siddhi window data structure that will be exposed. Rationale behind this is to seamlessly support different implementations such as bloom ​ ​ filters, disk

Re: [Architecture] [AppFac][Issue]Deployment Notification for Single Tenant Cartridges

2014-11-03 Thread Harsha Thirimanna
After doing JGit checkout, you will get CheckoutResult and there is a modified list. *Harsha Thirimanna* Senior Software Engineer; WSO2, Inc.; http://wso2.com * http://www.apache.org/* *email: **hars...@wso2.com* az...@wso2.com* cell: +94 71 5186770 , +94 * *774617784twitter:

Re: [Architecture] ESB Connector for BAM CEP

2014-11-03 Thread Vijitha Ekanayake
Hi All, Following is the mediator xml format we are going to use. publishEvent eventSinkbam_event_sink/eventSink streamNamestream_2/streamName streamVersion1.7.6/streamVersion attributes meta attribute name=method type=string default=

Re: [Architecture] Proposed Device Operations Flow of CDM

2014-11-03 Thread Harshan Liyanage
Hi InoshP, Before explaining the above scenario I'll explain the process of payload generation when a request for new operation comes to the CDM core. 1. CDM Core bundle will detect its device platform using the operation code 2. Validate the operation against the supported device operations 3.

Re: [Architecture] ESB Connector for BAM CEP

2014-11-03 Thread Sriskandarajah Suhothayan
On Mon, Nov 3, 2014 at 6:49 AM, Vijitha Ekanayake vijit...@wso2.com wrote: Hi All, Following is the mediator xml format we are going to use. publishEvent eventSinkbam_event_sink/eventSink streamNamestream_2/streamName streamVersion1.7.6/streamVersion attributes

Re: [Architecture] Making appfactory installation in a single node using ppuppet

2014-11-03 Thread Dimuthu Leelarathne
Hi all, At the startos side we have to use single JVMs to make our 8GB target a reality. Are we using single JVM stratots? If not we need to change that. @Udara - Can we have one puppet master with 3 envs? thanks, dimuthu On Sun, Nov 2, 2014 at 8:07 PM, Udara Liyanage ud...@wso2.com wrote:

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Sriskandarajah Suhothayan
I believe in the new implementation we should not give the iterator out This will bring lots of issues like people might get all the events and iterate them :(. Suho On Mon, Nov 3, 2014 at 5:37 AM, Rajeev Sampath raje...@wso2.com wrote: Hi, On Mon, Nov 3, 2014 at 3:26 PM, Tishan Dahanayakage

Re: [Architecture] Remove multiple backend calls that happens when loading resource overview page

2014-11-03 Thread Janaka Ranabahu
Hi Amalka, Previously we had database users and database template creation capability from the databases/datasources page. Where are these operations now? Are they with the newly added 'Databases' page? I'm unable to locate them in the attached screenshots. Thanks, Janaka On Wed, Oct 15, 2014

Re: [Architecture] Remove multiple backend calls that happens when loading resource overview page

2014-11-03 Thread Amalka Subasinghe
Hi Janaka, According to the new changes, when creating a database, it will create default user and template. If user want to create his own user and template, he can go for 'advanced options'. Thanks Amalka On Tue, Nov 4, 2014 at 8:03 AM, Janaka Ranabahu jan...@wso2.com wrote: Hi Amalka,

Re: [Architecture] Remove multiple backend calls that happens when loading resource overview page

2014-11-03 Thread Janaka Ranabahu
Hi Amalka, On Tue, Nov 4, 2014 at 8:13 AM, Amalka Subasinghe ama...@wso2.com wrote: Hi Janaka, According to the new changes, when creating a database, it will create default user and template. If user want to create his own user and template, he can go for 'advanced options'. So that mean

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Tishan Dahanayakage
Suho, On Tue, Nov 4, 2014 at 5:02 AM, Sriskandarajah Suhothayan s...@wso2.com wrote: I believe in the new implementation we should not give the iterator out This will bring lots of issues like people might get all the events and iterate them :(. ​So are you suggesting to expose last event

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Srinath Perera
Big picture is CEP retain events within Windows, Windows with Join, and for patterns and sequence matching. When those windows (or data structures) are small they work ok, but when they are big they need specific optimisations like Indexes (B-Trees), Bloom Filters, Compression, disk based etc.

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Tishan Dahanayakage
On Tue, Nov 4, 2014 at 9:45 AM, Srinath Perera srin...@wso2.com wrote: Big picture is CEP retain events within Windows, Windows with Join, and for patterns and sequence matching. When those windows (or data structures) are small they work ok, but when they are big they need specific

Re: [Architecture] Proposed Device Operations Flow of CDM

2014-11-03 Thread Niranjan Karunanandham
Hi Harshan 1. Device platform bundle will take the platform-specific payload in the queue merge it with the new operation In this case, the overhead of the device platform bundle will be much higher because it must know how to convert back the *platform-specific payload* to the

Re: [Architecture] [AppFac][Issue]Deployment Notification for Single Tenant Cartridges

2014-11-03 Thread Roshan Deniyage
Hi Dimuthu, +1 for the suggestion. we were thinking the same way. but the issue here is to get the modified artifact name list from the jgit api. There is no direct way of getting modified artifacts since, we keep all the version of the application artifacts as folders in the same master

Re: [Architecture] Proposed Device Operations Flow of CDM

2014-11-03 Thread Harshan Liyanage
Hi Niranjan, Please find my comments in line. IMO this would be the a better option since the overhead is removed when the device tries to communicate with the server to get the payload. AFAIU even in the option 2 and 3, the device platform bundle should be able to convert the

Re: [Architecture] Making appfactory installation in a single node using ppuppet

2014-11-03 Thread Harsha Thirimanna
Hi Anuruddha, No, We have already done this puppet for appservers that removing wget part and committed in puppet manifest. You have to just use clean base image for that. thanks *Harsha Thirimanna* Senior Software Engineer; WSO2, Inc.; http://wso2.com * http://www.apache.org/* *email:

Re: [Architecture] Remove multiple backend calls that happens when loading resource overview page

2014-11-03 Thread Danushka Fernando
I don't agree to the point having one template for an application. Since it could be a use case that different users attached to same database with different privileges, we should be able to create them IMHO On Nov 4, 2014 9:24 AM, Amalka Subasinghe ama...@wso2.com wrote: Hi Janaka, see my

Re: [Architecture] Making appfactory installation in a single node using ppuppet

2014-11-03 Thread Udara Liyanage
Hi, The advantage of having puppet is you can do configurations easilly and you can create a single base image and use for all cartridges. WSO2 AS, PHP puppet scripts are already written, you can reuse them On Tue, Nov 4, 2014 at 10:51 AM, Anuruddha Premalal anurud...@wso2.com wrote: Hi All,

Re: [Architecture] Making appfactory installation in a single node using ppuppet

2014-11-03 Thread Harsha Thirimanna
​Hi Udara, We have written our own AS puppet scripts for the cartridges. *Harsha Thirimanna* Senior Software Engineer; WSO2, Inc.; http://wso2.com * http://www.apache.org/* *email: **hars...@wso2.com* az...@wso2.com* cell: +94 71 5186770 , +94 * *774617784twitter: **http://twitter.com/

Re: [Architecture] Changes in road traffic extractor for CEP from Twitter feed

2014-11-03 Thread Madhawa Gunasekara
Hi All, We cannot use existing NLP toolbox for our use case since it was implemented using Stanford NLP. Plus it cannot be used for loading custom trained models. We have already implemented most of the NLP parts using Apache OpenNLP. Therefore we are planning to write a custom adapter for NLP

Re: [Architecture] ESB Connector for BAM CEP

2014-11-03 Thread Maninda Edirisooriya
On Mon, Nov 3, 2014 at 9:27 PM, Sriskandarajah Suhothayan s...@wso2.com wrote: On Mon, Nov 3, 2014 at 6:49 AM, Vijitha Ekanayake vijit...@wso2.com wrote: Hi All, Following is the mediator xml format we are going to use. publishEvent eventSinkbam_event_sink/eventSink

Re: [Architecture] Changes in road traffic extractor for CEP from Twitter feed

2014-11-03 Thread Malithi Edirisinghe
Hi Madhawa, I agree with you on above. We moved to the Stanford NLP library due to some limitations we had in implementing the queries we planned using Open NLP lib. This was discussed at architecture@ under [Architecture][CEP] NLP Toolbox. AFAIK Stanford NLP lib also can be used with custom

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Lasantha Fernando
Hi Tishan, On 4 November 2014 09:58, Tishan Dahanayakage tis...@wso2.com wrote: On Tue, Nov 4, 2014 at 9:45 AM, Srinath Perera srin...@wso2.com wrote: Big picture is CEP retain events within Windows, Windows with Join, and for patterns and sequence matching. When those windows (or data

Re: [Architecture] ESB Connector for BAM CEP

2014-11-03 Thread Lahiru Chandima
Hi All, How about using an ESB local entry for storing eventSink config? We asked ESB team and they told it supports MT and also it is a deployable artifact. Thanks. On Tue, Nov 4, 2014 at 12:00 PM, Maninda Edirisooriya mani...@wso2.com wrote: On Mon, Nov 3, 2014 at 9:27 PM, Sriskandarajah

Re: [Architecture] [CEP][Siddhi]Draft interface for Siddhi window data structure implementations

2014-11-03 Thread Tishan Dahanayakage
Lasantha, On Tue, Nov 4, 2014 at 12:18 PM, Lasantha Fernando lasan...@wso2.com wrote: Hi Tishan, On 4 November 2014 09:58, Tishan Dahanayakage tis...@wso2.com wrote: On Tue, Nov 4, 2014 at 9:45 AM, Srinath Perera srin...@wso2.com wrote: Big picture is CEP retain events within Windows,