Re: [Dev] Request to upgrade the carbon-identity version in carbon-store and product-es

[Megala Uthayakumar]

Hi Chandana and Sameera,

Thanks for the quick responses. For the testing purposes we will try the
work around mentioned by Sameera.

Thanks.

Regards,
Megala

On Wed, Jun 22, 2016 at 6:45 PM, Sameera Medagammaddegedara <
samee...@wso2.com> wrote:

> Hi,
>
> I have created a JIRA to track this issue:
> https://wso2.org/jira/browse/CIDENTITY-15
>
> Please note that I have severity to Blocker as it breaks Out of the Box
> SSO functionality in the ES.
>
> Thank You,
> Sameera
>
> On Wed, Jun 22, 2016 at 6:01 PM, Sameera Medagammaddegedara <
> samee...@wso2.com> wrote:
>
>> Hi Chandana and Megala,
>>
>> *Note:* Adding Pulasthi and Hasintha
>>
>> There is a small issue with upgrading to 5.1.0.It is caused when the
>> HostName element is commented out in the carbon.xml (which is the case in
>> ES and G-Reg).The issue occurs when attempting to validate the Home Realm
>> Id [1]. The root cause is the hostname been resolved to NULL here[2]. As a
>> work around for local testing we can set the HostName in the carbon.xml to
>> localhost. The IS team will be including the fix in the next
>> identity-framework release.
>>
>> *Reference*
>> [1]
>> https://github.com/wso2/carbon-identity-framework/blob/master/components/idp-mgt/org.wso2.carbon.idp.mgt/src/main/java/org/wso2/carbon/idp/mgt/listener/IdPMgtValidationListener.java#L124
>> [2]
>> https://github.com/wso2/carbon-identity-framework/blob/master/components/idp-mgt/org.wso2.carbon.idp.mgt/src/main/java/org/wso2/carbon/idp/mgt/internal/IdPManagementServiceComponent.java#L340
>>
>> On Wed, Jun 22, 2016 at 3:45 PM, Chandana Napagoda 
>> wrote:
>>
>>> Hi Megala,
>>>
>>> SameeraM found an issue in IS side while upgrading the Jaggery version.
>>> I hope SameeraM has more insight about that.
>>>
>>> Regards,
>>> Chandana
>>>
>>> On Wed, Jun 22, 2016 at 3:35 PM, Megala Uthayakumar 
>>> wrote:
>>>
 +Chandana

 On Wed, Jun 22, 2016 at 3:33 PM, Megala Uthayakumar 
 wrote:

> Hi All,
>
> We are working on a DS and ES integration in which we have a use case
> when a user changes some configuration in a gadget configuration file, we
> need to unzip the gadget zip file and change the relevant file and zip it
> again and send it to the DS side.
>
> Since unzip and zip functionality are not currently available in
> Jaggery, we have implemented those in jaggery level and it will be 
> included
> in Jaggery 0.12.6. But Jaggery 0.12.6 requires carbon-identity version
> 5.1.0, But carbon-store still uses the carbon-identity version 5.0.8. So 
> is
> it possible to upgrade the carbon-identity version to newer one in both
>  carbon-store and product-es?
>
> Thanks.
>
> Regards,
> Megala
>
> --
> Megala Uthayakumar
>
> Software Engineer
> Mobile : 0779967122
>



 --
 Megala Uthayakumar

 Software Engineer
 Mobile : 0779967122

>>>
>>>
>>>
>>> --
>>> *Chandana Napagoda*
>>> Senior Software Engineer
>>> WSO2 Inc. - http://wso2.org
>>>
>>> *Email  :  chand...@wso2.com **Mobile : +94718169299
>>> <%2B94718169299>*
>>>
>>> *Blog  :http://cnapagoda.blogspot.com
>>> *
>>>
>>>
>>
>>
>> --
>> Sameera Medagammaddegedara
>> Software Engineer
>>
>> Contact:
>> Email: samee...@wso2.com
>> Mobile: + 94 077 255 3005
>>
>
>
>
> --
> Sameera Medagammaddegedara
> Software Engineer
>
> Contact:
> Email: samee...@wso2.com
> Mobile: + 94 077 255 3005
>



-- 
Megala Uthayakumar

Software Engineer
Mobile : 0779967122
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] WSO2 Docker images layered composition

[Isuru Haththotuwa]

Hi Akila,

On Tue, Jun 21, 2016 at 6:54 PM, Akila Ravihansa Perera 
wrote:

> Hi Isuru,
>
> One drawback of not having a wso2base is that in a restricted environment
> where Internet connectivity is not available, a private build server will
> not be able to build the images using Puppet provisioning if there are any
> additional packages to be installed. But if there was a wso2base image,
> those packages could have been installed to that and manually loaded into
> the build server as a one time task.
>
Yes this is true. However, still there is a possibility of this occurring
even at a base image building time, isn't it?

>
> Thanks.
>
I'm not against having a base image for the WSO2 Docker images. But, IMHO
the advantages should be significant for doing so. AFAIU there is no
significant advantage of doing so currently. But, this is my take only.
Therefore lets get the input from the community on this matter.

@Imesh: WDYT?


-- 
Thanks and Regards,

Isuru H.
+94 716 358 048* *
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [DEV][APPM] Rest API support for Mobile App Installation/Download options

[Thilini Shanika]

Hi all,

We have few concerns regarding mobile app installing REST API support in
APPM.

In the new JAX-RS Rest API model, we have provided following API to install
a mobile application via MDM.

/api/appm/store/v1.1/apps/download

Apart from that, below app installation options have to be supported by new
REST APIs.

   - In App Manager, there is an option to enabling app binary direct
   download ( config in app-manager.xml). Once direct
   download is enabled, authorized and subscribed users should be able to
   download the app binaries directly without having MDM integrated. This
   particular requirement is not satisfied by currently available REST APIs.
   - Subscribed users should be able to obtain one-time download link for
   enterprise andrioid app binaries and generated plist config link for
   enterprise ios apps, so that the link can be shared via email, SMS etc.


As per the discussion we had with the team, below are the alterations and
additions to current API model in order to fulfill above requirements.

   1. Adding new API to make mobile app subscriptions/download. This
   particular install won't have any interaction with MDM and it is dedicated
   to make subscription and return app url for users. This API will return
   generated one-time download link for enterprise android apps and one-time
   download link included plist config link for enterprise IOS apps. For
   mobile webapps and public android/IOS, this will return the app url.
   2. In 1.2.0 Beta release, we already have a mobile binary retrieving
   API. That API has to be deprecated or removed, since we have a one-time
   download API.
   3. Renaming the currently available API path (/api/appm/store/v1.1/apps/
   download) in order to indicate the actual purpose of it.


Your suggestions and comments are highly appreciated.

Thanks
Thilini

-- 
Thilini Shanika
Senior Software Engineer
WSO2, Inc.; http://wso2.com
20, Palmgrove Avenue, Colombo 3

E-mail: tgtshan...@gmail.com
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

[Tharindu Edirisinghe]

Good work Asantha... Meanwhile let's look at getting your research work
published as well. I will provide feedback for the work so far in couple of
days time. I have also completed the Mid Review based on your current work
where you are already ahead of schedule.

Regards,
TharinduE

On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> following is the summary of operations i have implemented up to now and
> yet to implement
>
> 1. Add new MongoDB User Store - done both case sensitive and intensensitive
> 2. Add new users to MongoDB user store - done both case sensitive and
> intensensitive
> 3. Add new roles to MongoDB user store - done both case sensitive and
> intensensitive
> 4. Search users and roles - done both case sensitive and intensensitive
> 5. Assign roles to mongodb user store users - done both case sensitive and
> intensensitive
> 6. Assign users to mongodb user store roles - done both case sensitive and
> intensensitive
> 7. Edit claim values of user profiles  - done both case sensitive and
> intensensitive
> for those implemented user operations i have added selenium scripts also
> to my repo[1] and also i have prepared user guide[2] and administrator
> guide[3] also and also i have updated my blog[4] with all my tasks what i
> have done and following are the tasks yet to complete
>
> 1. implement delete operations
> 2. implement new profiles adding
> 3. check for injections possibilities and improve the security of all the
> functions
> 4. prepare full test scripts for all the functions
> 5. prepare developer guide and database architecture diagrams
>
> expect your feedback
>
> [1]  https://github.com/asanthamax/mongodbuserstore
> [2]
> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
> [3]
> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
> [4]  http://asanthamax.blogspot.com
>
> Thanks,
> Asantha
>
> On Wed, Jun 22, 2016 at 12:29 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> I have finished the case insensitive user operations as well and i added
>> selenium test scripts for those implemented functions to my repo[1] except
>> delete function all the other functions with test script added to my repo[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jun 17, 2016 at 2:28 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sure i'll be look forward for the hangout
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Fri, Jun 17, 2016 at 2:22 AM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Hi Asantha,

 I will go through the docs and provide feedback soon. Let's have a
 hangout session to discuss the pending issues.

 I'm available today 9.00 P.M IST for a google hangout.

 Thanks,
 TharinduE

 On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I have prepared the user guide[1] and administrator guide[2] in google
> doc since all tasks are not finished yet i have only added the tasks i 
> have
> already done and there is still the developer guide has to be prepare i
> will prepare it as sooner as well
>
> [1]
> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
> [2]
> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
>
> Thanks,
> Asantha
>
> On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> sure i will prepare those documents sooner
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Excellent work Asantha !
>>>
>>> Meanwhile you can prepare a document also adding the screenshots you
>>> have got. Basically we will need following documentation.
>>>
>>> 1. Developer Guide ( The architecture of the userstoremanager,
>>> diagrams of all the collections, how they are related to each other 
>>> etc.)
>>>
>>> 2. Administrator Guide (How to guide a server administrator to setup
>>> a secondary userstore with mongodb)
>>>
>>> 3. User Guide (All the functionality of the userstoremanager, i.e
>>> each function in RemoteUserStoreManager with sample SOAP requests and
>>> responses)
>>>
>>> We will need to look at the QA aspect of the project also.. but
>>> let's keep aside for the moment until we get all the functionality 
>>> working.
>>>
>>> Thanks for all the hard work !
>>>
>>> Best Regards,
>>> Tharindu Edirisinghe
>>>
>>> On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
>>> 

Re: [Dev] [Carbon Netty ] Default value for "executor.workerpool.size"

[Sagara Gunathunga]

On Wed, Jun 22, 2016 at 10:38 PM, Isuru Udana  wrote:

> Hi Sagara,
>
> Yes, we are working on setting sensible default values from the code,
> which will be available in next transport release.
>

Great ! Please let us know once you update the SNAPSHOTs so that we can
remove some unwanted code from MSF4J code.

Thanks !

>
> Thanks.
>
> On Wed, Jun 22, 2016 at 10:36 PM, Sagara Gunathunga 
> wrote:
>
>>
>> It seems there is no default value available for
>>  "executor.workerpool.size" setting, when explicitly not set  transport
>> fail with NPE, can we have a sensible default value here ?
>>
>> Thanks !
>> --
>> Sagara Gunathunga
>>
>> Architect; WSO2, Inc.;  http://wso2.com
>> V.P Apache Web Services;http://ws.apache.org/
>> Linkedin; http://www.linkedin.com/in/ssagara
>> Blog ;  http://ssagara.blogspot.com
>>
>>
>
>
> --
> *Isuru Udana*
> Technical Lead
> WSO2 Inc.; http://wso2.com
> email: isu...@wso2.com cell: +94 77 3791887
> blog: http://mytecheye.blogspot.com/
>



-- 
Sagara Gunathunga

Architect; WSO2, Inc.;  http://wso2.com
V.P Apache Web Services;http://ws.apache.org/
Linkedin; http://www.linkedin.com/in/ssagara
Blog ;  http://ssagara.blogspot.com
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [Carbon Netty ] Default value for "executor.workerpool.size"

[Sagara Gunathunga]

It seems there is no default value available for
 "executor.workerpool.size" setting, when explicitly not set  transport
fail with NPE, can we have a sensible default value here ?

Thanks !
-- 
Sagara Gunathunga

Architect; WSO2, Inc.;  http://wso2.com
V.P Apache Web Services;http://ws.apache.org/
Linkedin; http://www.linkedin.com/in/ssagara
Blog ;  http://ssagara.blogspot.com
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Carbon Netty ] Default value for "executor.workerpool.size"

[Isuru Udana]

Hi Sagara,

Yes, we are working on setting sensible default values from the code, which
will be available in next transport release.

Thanks.

On Wed, Jun 22, 2016 at 10:36 PM, Sagara Gunathunga  wrote:

>
> It seems there is no default value available for
>  "executor.workerpool.size" setting, when explicitly not set  transport
> fail with NPE, can we have a sensible default value here ?
>
> Thanks !
> --
> Sagara Gunathunga
>
> Architect; WSO2, Inc.;  http://wso2.com
> V.P Apache Web Services;http://ws.apache.org/
> Linkedin; http://www.linkedin.com/in/ssagara
> Blog ;  http://ssagara.blogspot.com
>
>


-- 
*Isuru Udana*
Technical Lead
WSO2 Inc.; http://wso2.com
email: isu...@wso2.com cell: +94 77 3791887
blog: http://mytecheye.blogspot.com/
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

[Asantha Thilina]

Hi Tharindu,

following is the summary of operations i have implemented up to now and yet
to implement

1. Add new MongoDB User Store - done both case sensitive and intensensitive
2. Add new users to MongoDB user store - done both case sensitive and
intensensitive
3. Add new roles to MongoDB user store - done both case sensitive and
intensensitive
4. Search users and roles - done both case sensitive and intensensitive
5. Assign roles to mongodb user store users - done both case sensitive and
intensensitive
6. Assign users to mongodb user store roles - done both case sensitive and
intensensitive
7. Edit claim values of user profiles  - done both case sensitive and
intensensitive
for those implemented user operations i have added selenium scripts also to
my repo[1] and also i have prepared user guide[2] and administrator
guide[3] also and also i have updated my blog[4] with all my tasks what i
have done and following are the tasks yet to complete

1. implement delete operations
2. implement new profiles adding
3. check for injections possibilities and improve the security of all the
functions
4. prepare full test scripts for all the functions
5. prepare developer guide and database architecture diagrams

expect your feedback

[1]  https://github.com/asanthamax/mongodbuserstore
[2]
https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
[3]
https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
[4]  http://asanthamax.blogspot.com

Thanks,
Asantha

On Wed, Jun 22, 2016 at 12:29 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> I have finished the case insensitive user operations as well and i added
> selenium test scripts for those implemented functions to my repo[1] except
> delete function all the other functions with test script added to my repo[1]
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Fri, Jun 17, 2016 at 2:28 AM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> sure i'll be look forward for the hangout
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jun 17, 2016 at 2:22 AM, Tharindu Edirisinghe > > wrote:
>>
>>> Hi Asantha,
>>>
>>> I will go through the docs and provide feedback soon. Let's have a
>>> hangout session to discuss the pending issues.
>>>
>>> I'm available today 9.00 P.M IST for a google hangout.
>>>
>>> Thanks,
>>> TharinduE
>>>
>>> On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I have prepared the user guide[1] and administrator guide[2] in google
 doc since all tasks are not finished yet i have only added the tasks i have
 already done and there is still the developer guide has to be prepare i
 will prepare it as sooner as well

 [1]
 https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
 [2]
 https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing

 Thanks,
 Asantha

 On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> sure i will prepare those documents sooner
>
> Thanks,
> Asantha
>
> On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> Excellent work Asantha !
>>
>> Meanwhile you can prepare a document also adding the screenshots you
>> have got. Basically we will need following documentation.
>>
>> 1. Developer Guide ( The architecture of the userstoremanager,
>> diagrams of all the collections, how they are related to each other etc.)
>>
>> 2. Administrator Guide (How to guide a server administrator to setup
>> a secondary userstore with mongodb)
>>
>> 3. User Guide (All the functionality of the userstoremanager, i.e
>> each function in RemoteUserStoreManager with sample SOAP requests and
>> responses)
>>
>> We will need to look at the QA aspect of the project also.. but let's
>> keep aside for the moment until we get all the functionality working.
>>
>> Thanks for all the hard work !
>>
>> Best Regards,
>> Tharindu Edirisinghe
>>
>> On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> as you advice me i added soap ui screen shots of test result and
>>> selenium script for implemented functions into my repository[1]
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 i updated my blog[1] with all the works i have done so far there i
 added all the methods and their 

Re: [Dev] Request to upgrade the carbon-identity version in carbon-store and product-es

[Sameera Medagammaddegedara]

Hi,

I have created a JIRA to track this issue:
https://wso2.org/jira/browse/CIDENTITY-15

Please note that I have severity to Blocker as it breaks Out of the Box SSO
functionality in the ES.

Thank You,
Sameera

On Wed, Jun 22, 2016 at 6:01 PM, Sameera Medagammaddegedara <
samee...@wso2.com> wrote:

> Hi Chandana and Megala,
>
> *Note:* Adding Pulasthi and Hasintha
>
> There is a small issue with upgrading to 5.1.0.It is caused when the
> HostName element is commented out in the carbon.xml (which is the case in
> ES and G-Reg).The issue occurs when attempting to validate the Home Realm
> Id [1]. The root cause is the hostname been resolved to NULL here[2]. As a
> work around for local testing we can set the HostName in the carbon.xml to
> localhost. The IS team will be including the fix in the next
> identity-framework release.
>
> *Reference*
> [1]
> https://github.com/wso2/carbon-identity-framework/blob/master/components/idp-mgt/org.wso2.carbon.idp.mgt/src/main/java/org/wso2/carbon/idp/mgt/listener/IdPMgtValidationListener.java#L124
> [2]
> https://github.com/wso2/carbon-identity-framework/blob/master/components/idp-mgt/org.wso2.carbon.idp.mgt/src/main/java/org/wso2/carbon/idp/mgt/internal/IdPManagementServiceComponent.java#L340
>
> On Wed, Jun 22, 2016 at 3:45 PM, Chandana Napagoda 
> wrote:
>
>> Hi Megala,
>>
>> SameeraM found an issue in IS side while upgrading the Jaggery version. I
>> hope SameeraM has more insight about that.
>>
>> Regards,
>> Chandana
>>
>> On Wed, Jun 22, 2016 at 3:35 PM, Megala Uthayakumar 
>> wrote:
>>
>>> +Chandana
>>>
>>> On Wed, Jun 22, 2016 at 3:33 PM, Megala Uthayakumar 
>>> wrote:
>>>
 Hi All,

 We are working on a DS and ES integration in which we have a use case
 when a user changes some configuration in a gadget configuration file, we
 need to unzip the gadget zip file and change the relevant file and zip it
 again and send it to the DS side.

 Since unzip and zip functionality are not currently available in
 Jaggery, we have implemented those in jaggery level and it will be included
 in Jaggery 0.12.6. But Jaggery 0.12.6 requires carbon-identity version
 5.1.0, But carbon-store still uses the carbon-identity version 5.0.8. So is
 it possible to upgrade the carbon-identity version to newer one in both
  carbon-store and product-es?

 Thanks.

 Regards,
 Megala

 --
 Megala Uthayakumar

 Software Engineer
 Mobile : 0779967122

>>>
>>>
>>>
>>> --
>>> Megala Uthayakumar
>>>
>>> Software Engineer
>>> Mobile : 0779967122
>>>
>>
>>
>>
>> --
>> *Chandana Napagoda*
>> Senior Software Engineer
>> WSO2 Inc. - http://wso2.org
>>
>> *Email  :  chand...@wso2.com **Mobile : +94718169299
>> <%2B94718169299>*
>>
>> *Blog  :http://cnapagoda.blogspot.com *
>>
>>
>
>
> --
> Sameera Medagammaddegedara
> Software Engineer
>
> Contact:
> Email: samee...@wso2.com
> Mobile: + 94 077 255 3005
>



-- 
Sameera Medagammaddegedara
Software Engineer

Contact:
Email: samee...@wso2.com
Mobile: + 94 077 255 3005
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Request to upgrade the carbon-identity version in carbon-store and product-es

[Sameera Medagammaddegedara]

Hi Chandana and Megala,

*Note:* Adding Pulasthi and Hasintha

There is a small issue with upgrading to 5.1.0.It is caused when the
HostName element is commented out in the carbon.xml (which is the case in
ES and G-Reg).The issue occurs when attempting to validate the Home Realm
Id [1]. The root cause is the hostname been resolved to NULL here[2]. As a
work around for local testing we can set the HostName in the carbon.xml to
localhost. The IS team will be including the fix in the next
identity-framework release.

*Reference*
[1]
https://github.com/wso2/carbon-identity-framework/blob/master/components/idp-mgt/org.wso2.carbon.idp.mgt/src/main/java/org/wso2/carbon/idp/mgt/listener/IdPMgtValidationListener.java#L124
[2]
https://github.com/wso2/carbon-identity-framework/blob/master/components/idp-mgt/org.wso2.carbon.idp.mgt/src/main/java/org/wso2/carbon/idp/mgt/internal/IdPManagementServiceComponent.java#L340

On Wed, Jun 22, 2016 at 3:45 PM, Chandana Napagoda 
wrote:

> Hi Megala,
>
> SameeraM found an issue in IS side while upgrading the Jaggery version. I
> hope SameeraM has more insight about that.
>
> Regards,
> Chandana
>
> On Wed, Jun 22, 2016 at 3:35 PM, Megala Uthayakumar 
> wrote:
>
>> +Chandana
>>
>> On Wed, Jun 22, 2016 at 3:33 PM, Megala Uthayakumar 
>> wrote:
>>
>>> Hi All,
>>>
>>> We are working on a DS and ES integration in which we have a use case
>>> when a user changes some configuration in a gadget configuration file, we
>>> need to unzip the gadget zip file and change the relevant file and zip it
>>> again and send it to the DS side.
>>>
>>> Since unzip and zip functionality are not currently available in
>>> Jaggery, we have implemented those in jaggery level and it will be included
>>> in Jaggery 0.12.6. But Jaggery 0.12.6 requires carbon-identity version
>>> 5.1.0, But carbon-store still uses the carbon-identity version 5.0.8. So is
>>> it possible to upgrade the carbon-identity version to newer one in both
>>>  carbon-store and product-es?
>>>
>>> Thanks.
>>>
>>> Regards,
>>> Megala
>>>
>>> --
>>> Megala Uthayakumar
>>>
>>> Software Engineer
>>> Mobile : 0779967122
>>>
>>
>>
>>
>> --
>> Megala Uthayakumar
>>
>> Software Engineer
>> Mobile : 0779967122
>>
>
>
>
> --
> *Chandana Napagoda*
> Senior Software Engineer
> WSO2 Inc. - http://wso2.org
>
> *Email  :  chand...@wso2.com **Mobile : +94718169299
> <%2B94718169299>*
>
> *Blog  :http://cnapagoda.blogspot.com *
>
>


-- 
Sameera Medagammaddegedara
Software Engineer

Contact:
Email: samee...@wso2.com
Mobile: + 94 077 255 3005
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Siddhi Query : group by results

[Ashen Weerathunga]

Hi Aneela,

As Charini mentioned above this is the expected output as for your query. There
will be an output for each and every incoming event since you haven't
included any window for your intermediateStream. But you can get your
expected output by adding a batch window[1] to your query. As an example if
you knew the event count you can simply add a lengthBatch[2] window as
below,

from intermediateStream#window.lengthBatch(3)
select ts, count(ts) as ssh_logins
group by ts
insert into SSHOutStream;

Then it will hold events as a batch of 3 events and return an output as below,

ts ssh_logins
2016-05-08 08:59   1
2016-05-08 09:00   2

Similarly you can use other windows such as timeBatch, cron etc. as for
your requirment.

[1]https://docs.wso2.com/display/CEP410/SiddhiQL+Guide+3.0#SiddhiQLGuide3.0-InbuiltWindows
[2]https://docs.wso2.com/display/CEP410/Inbuilt+Windows#InbuiltWindows-lengthBatch


Best regards,
Ashen


On Wed, Jun 22, 2016 at 5:00 PM, Charini Nanayakkara 
wrote:

> Hi Aneela,
>
> The siddhi query you have specified processes each and every incoming
> event. Since processing is done in real time, when the first event for ts= 
> 2016-05-08
> 09:00 arrives it gives count = 1 (due to no events with ts = 2016-05-08
> 09:00 having arrived earlier). When second event with ts = 2016-05-08
> 09:00 comes, we get count as 2 since an event with same ts arrived earlier
> as well.
>
> Best Regards,
> Charini
>
> On Wed, Jun 22, 2016 at 4:40 PM, Aneela Safdar 
> wrote:
>
>> Hi all,
>>
>> I am having a trouble in digesting results of my group by query. My
>> source stream named intermediateStream has data
>>
>>  ts   uid id_resp_h
>> 2016-05-08 08:59  CLuCgz3HHzG7LpLwH9172.30.26.119
>> 2016-05-08 09:00  C3WnnK3TgUf2cSzxVa172.30.26.127
>> 2016-05-08 09:00  C3WnnK3TgUf2cSzxff172.30.26.119
>>
>> SIDDHI query is
>>
>> from intermediateStream
>> select ts, count(ts) as ssh_logins
>> group by ts
>> insert into SSHOutStream;
>>
>> I am expecting output to be like
>>
>> ts ssh_logins
>> 2016-05-08 08:59   1
>> 2016-05-08 09:00   2
>>
>> But instead it returns
>>
>> ts ssh_logins
>> 2016-05-08 08:59   1
>> 2016-05-08 09:00   1
>> 2016-05-08 09:00   2
>>
>> Any suggestions?
>>
>> Regards, Aneela Safdar
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> Charini Vimansha Nanayakkara
> Software Engineer at WSO2
> Mobile: 0714126293
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*Ashen Weerathunga*
Software Engineer
WSO2 Inc.: http://wso2.com
lean.enterprise.middleware

Email: as...@wso2.com
Mobile: +94 716042995 <94716042995>
LinkedIn: *http://lk.linkedin.com/in/ashenweerathunga
*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] APIM 2.0.0-SNAPSHOT Nightly build - 17/06/2016

[Nirmal Fernando]

When you do perf test on analytics, please make sure to add the following
properties to my.cnf file of your MySQL server. Change the values
appropriately.


innodb_buffer_pool_instances = 4

innodb_use_native_aio = false

innodb_flush_method = O_DIRECT

innodb_write_io_threads = 10

innodb_read_io_threads = 10

#innodb_additional_mem_pool_size = 20M

*innodb_buffer_pool_size = 2G*

innodb_log_files_in_group = 2

innodb_log_buffer_size = 10M

innodb_log_file_size = 200M

innodb_flush_log_at_trx_commit = 2

innodb_lock_wait_timeout = 50

innodb_file_per_table=1

#innodb_compression_algorithm=2

#innodb_compression_punch_hole = 1

#innodb_compression_level = 4

innodb_file_format=barracuda

innodb_file_format_max=barracuda

On Wed, Jun 22, 2016 at 11:57 AM, Fazlan Nazeem  wrote:

> Hi Shavantha,
>
> Noted. We will remove the stat dbscripts from the pack, so that there will
> be less confusion.
>
> On Wed, Jun 22, 2016 at 11:45 AM, Shavantha Weerasinghe <
> shavan...@wso2.com> wrote:
>
>> Hi All
>>
>> The  scripts related to the stat db for the analytic server for which
>> until the 17th June release we had to manually source the script. However,
>> upon manually sourcing we came across[1]. We were lated updated that the
>> script will be sourced when -Dsetup is run and manual sourcing is not
>> necessary.
>>
>> We were unable to find any details on the read-me file as well
>>
>> Appreciate if this type changes can be communicated with the release pack
>> in future to avoid delays in setup
>>
>> [1]https://wso2.org/jira/browse/ANLYAPIM-71
>>
>> regards,
>> Shavantha Weerasinghe
>> Senior Software Engineer QA
>> WSO2, Inc.
>> lean.enterprise.middleware.
>> http://wso2.com
>> http://wso2.org
>> Tel : 94 11 214 5345
>> Fax :94 11 2145300
>>
>>
>> On Fri, Jun 17, 2016 at 10:20 PM, Nirmal Fernando 
>> wrote:
>>
>>> Please find the API-M analytics pack
>>> https://wso2.org/jenkins/job/analytics-apim/173/org.wso2.analytics.apim$wso2analytics-apim/artifact/org.wso2.analytics.apim/wso2analytics-apim/1.0.0-SNAPSHOT/wso2analytics-apim-1.0.0-SNAPSHOT.zip
>>>
>>> On Fri, Jun 17, 2016 at 10:07 PM, Bhathiya Jayasekara >> > wrote:
>>>

 Hi all,

 Please find today's nightly builds.

 APIM 2.0.0 SNAPSHOT[1], P2 repo[2] and IS 5.2.0 SNAPSHOT[3].

 [1]
 https://svn.wso2.org/repos/wso2/scratch/2016/apim-2.0.0/wso2am-2.0.0-SNAPSHOT-17-06-2016.zip
 [2]
 https://svn.wso2.org/repos/wso2/scratch/2016/apim-2.0.0/p2-repos/17-06-2016/p2-repo.zip
 [3]
 http://maven.wso2.org/nexus/content/repositories/snapshots/org/wso2/is/wso2is/5.2.0-SNAPSHOT/wso2is-5.2.0-20160617.023441-125.zip

 Thanks,

 --
 *Bhathiya Jayasekara*
 *Senior Software Engineer,*
 *WSO2 inc., http://wso2.com *

 *Phone: +94715478185 <%2B94715478185>*
 *LinkedIn: http://www.linkedin.com/in/bhathiyaj
 *
 *Twitter: https://twitter.com/bhathiyax *
 *Blog: http://movingaheadblog.blogspot.com
 *

 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev


>>>
>>>
>>> --
>>>
>>> Thanks & regards,
>>> Nirmal
>>>
>>> Team Lead - WSO2 Machine Learner
>>> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
>>> Mobile: +94715779733
>>> Blog: http://nirmalfdo.blogspot.com/
>>>
>>>
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>
>
> --
> Thanks & Regards,
>
> Fazlan Nazeem
>
> *Software Engineer*
>
> *WSO2 Inc*
> Mobile : +94772338839
> <%2B94%20%280%29%20773%20451194>
> fazl...@wso2.com
>



-- 

Thanks & regards,
Nirmal

Team Lead - WSO2 Machine Learner
Associate Technical Lead - Data Technologies Team, WSO2 Inc.
Mobile: +94715779733
Blog: http://nirmalfdo.blogspot.com/
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [ESB Tooling] Can we activate "event statistics" on global level?

[Iranga Muthuthanthri]

Created JIRA https://wso2.org/jira/browse/DEVTOOLESB-448


On Wed, Jun 22, 2016 at 2:15 PM, Chanaka Fernando  wrote:

> Agreed with you Isuru.
>
> Tool will only provide a short cut to enable disable stat/tracing per
> CAPP. Basically, it will enable stat/tracing for each and every artifacts
> (applicable).
>
> Setting a global parameter should not be possible through a CAPP.
>
> On Wed, Jun 22, 2016 at 1:54 PM, Isuru Udana  wrote:
>
>> Hi,
>>
>>
>> On Wed, Jun 22, 2016 at 1:45 PM, Chanaka Fernando 
>> wrote:
>>
>>> Hi Viraj,
>>>
>>> The configuration we have in the synapse.properties file is to globally
>>> enable/disable the statistics/tracing for the server. By enabling that, we
>>> prepare the server to publish events to DAS server. But, if you need to
>>> publish real events, you need to enable them in individual artifacts
>>> (proxy, api, sequence, etc). Iranga's suggestion is to provide a global
>>> parameter to enable/disable them all at once (per CAPP or at global level).
>>> This is a valid requirement which a particular user might have.
>>>
>>> Enable/disable statistics per CAR from the tool is ok, but should we do
>> the global level controlling at the tool level ?
>> Enabling statics globally is a management task.
>> CARs are for packaging and deployable artifacts.
>> Using CARs to control global level parameters doesn't sound nice to me.
>>
>>
>>> This will require a considerable effort to support in the current model
>>> and we will not be able to support in the upcoming ESB 5.0.0 version.
>>>
>>> @Iranga: Please create a public JIRA and we will fix this in a future
>>> release.
>>>
>>> Thanks,
>>> Chanaka
>>>
>>> On Wed, Jun 22, 2016 at 12:38 PM, Viraj Rajaguru  wrote:
>>>
 Hi Iranga,

 IIUC, requirement is to setting a global level setting with CAR files
 to enable event statistics publishing. As per this document[1], we need to
 set a property in synapse.properties file + relevant config changes in
 artifact files to enable statistics publishing. With CAR files we are not
 modifying config files such as synapse.properties. So how can we achieve
 this?

 Thanks,
 Viraj.

 [1] -
 https://docs.wso2.com/display/ESB500/Prerequisites+to+Publish+Statistics

 On Fri, Apr 29, 2016 at 12:12 PM, Iranga Muthuthanthri  wrote:

>
>
> On Fri, Apr 29, 2016 at 11:35 AM, Malaka Silva 
> wrote:
>
>> +1 and it make sense to do it since we are having the
>> a separate analytics server for ESB.
>>
>> Iranga when you say global do you mean for a CAPP or for the complete
>> deployment? I think you are referring to the second option.
>>
>
> Global setting -Having it at complete deployment  , having it at the
> C-App level  would also be a useful option as well IMO
>
>>
>> On Fri, Apr 29, 2016 at 11:20 AM, Iranga Muthuthanthri <
>> ira...@wso2.com> wrote:
>>
>>> Hi All,
>>>
>>> When creating a C-App to publish event statistics to ESB Analytics
>>> we have to enable event statistics for each configuration ( proxy 
>>> service,
>>> API,) , would there be an option to set this at a global level?
>>>
>>> --
>>> Thanks & Regards
>>>
>>> Iranga Muthuthanthri
>>> (M) -0777-255773
>>> Team Product Management
>>>
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>>
>> Best Regards,
>>
>> Malaka Silva
>> Senior Tech Lead
>> M: +94 777 219 791
>> Tel : 94 11 214 5345
>> Fax :94 11 2145300
>> Skype : malaka.sampath.silva
>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
>> Blog : http://mrmalakasilva.blogspot.com/
>>
>> WSO2, Inc.
>> lean . enterprise . middleware
>> http://www.wso2.com/
>> http://www.wso2.com/about/team/malaka-silva/
>> 
>> https://store.wso2.com/store/
>>
>> Save a tree -Conserve nature & Save the world for your future. Print
>> this email only if it is absolutely necessary.
>>
>
>
>
> --
> Thanks & Regards
>
> Iranga Muthuthanthri
> (M) -0777-255773
> Team Product Management
>
>


 --
 Viraj Rajaguru
 Associate Technical Lead
 WSO2 Inc. : http://wso2.com

 Mobile: +94 77 3683068




>>>
>>>
>>> --
>>> Thank you and Best Regards,
>>> Chanaka Fernando
>>> Senior Technical Lead
>>> WSO2, Inc.; http://wso2.com
>>> lean.enterprise.middleware
>>>
>>> mobile: +94 773337238
>>> Blog : http://soatutorials.blogspot.com
>>> LinkedIn:http://www.linkedin.com/pub/chanaka-fernando/19/a20/5b0
>>> 

Re: [Dev] Siddhi Query : group by results

[Charini Nanayakkara]

Hi Aneela,

The siddhi query you have specified processes each and every incoming
event. Since processing is done in real time, when the first event for
ts= 2016-05-08
09:00 arrives it gives count = 1 (due to no events with ts = 2016-05-08
09:00 having arrived earlier). When second event with ts = 2016-05-08 09:00
comes, we get count as 2 since an event with same ts arrived earlier as
well.

Best Regards,
Charini

On Wed, Jun 22, 2016 at 4:40 PM, Aneela Safdar  wrote:

> Hi all,
>
> I am having a trouble in digesting results of my group by query. My source
> stream named intermediateStream has data
>
>  ts   uid id_resp_h
> 2016-05-08 08:59  CLuCgz3HHzG7LpLwH9172.30.26.119
> 2016-05-08 09:00  C3WnnK3TgUf2cSzxVa172.30.26.127
> 2016-05-08 09:00  C3WnnK3TgUf2cSzxff172.30.26.119
>
> SIDDHI query is
>
> from intermediateStream
> select ts, count(ts) as ssh_logins
> group by ts
> insert into SSHOutStream;
>
> I am expecting output to be like
>
> ts ssh_logins
> 2016-05-08 08:59   1
> 2016-05-08 09:00   2
>
> But instead it returns
>
> ts ssh_logins
> 2016-05-08 08:59   1
> 2016-05-08 09:00   1
> 2016-05-08 09:00   2
>
> Any suggestions?
>
> Regards, Aneela Safdar
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
Charini Vimansha Nanayakkara
Software Engineer at WSO2
Mobile: 0714126293
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Siddhi Query : group by results

[Aneela Safdar]

Hi all,
  I am having a trouble in digesting results of my group by query. My source 
stream named intermediateStream has data ts   uid   
  id_resp_h
2016-05-08 08:59  CLuCgz3HHzG7LpLwH9172.30.26.119
2016-05-08 09:00  C3WnnK3TgUf2cSzxVa172.30.26.127 
2016-05-08 09:00  C3WnnK3TgUf2cSzxff172.30.26.119
SIDDHI query is from intermediateStream
select ts, count(ts) as ssh_logins
group by ts
insert into SSHOutStream;
I am expecting output to be likets ssh_logins
2016-05-08 08:59   1
2016-05-08 09:00   2  
But instead it returns ts ssh_logins
2016-05-08 08:59   1
2016-05-08 09:00   1
2016-05-08 09:00   2
Any suggestions?  Regards, Aneela Safdar___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] ESB is not handling the invalid response type

[Hariprasath Thanarajah]

Hi All,

I got the same error when I try with billiving connector create client
operation. You can find the wire log[1]

[1]

[2016-06-22 15:35:02,794]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,794] DEBUG - wire << "Action: urn:createClient[\r][\n]"
[2016-06-22 15:35:02,794]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,794] DEBUG - wire << "Accept-Charset: UTF-8[\r][\n]"
[2016-06-22 15:35:02,794]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,794] DEBUG - wire << "Content-Type: application/json;
charset=UTF-8[\r][\n]"
[2016-06-22 15:35:02,794]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,794] DEBUG - wire << "Accept: text/html, image/gif,
image/jpeg, *; q=.2, */*; q=.2[\r][\n]"
[2016-06-22 15:35:02,794]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,794] DEBUG - wire << "Content-Length: 26[\r][\n]"
[2016-06-22 15:35:02,794]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,794] DEBUG - wire << "Host: www.billiving.com:443
[\r][\n]"
[2016-06-22 15:35:02,794]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,794] DEBUG - wire << "Connection: Keep-Alive[\r][\n]"
[2016-06-22 15:35:02,794]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,794] DEBUG - wire << "User-Agent:
Synapse-PT-HttpComponents-NIO[\r][\n]"
[2016-06-22 15:35:02,795]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,795] DEBUG - wire << "[\r][\n]"
[2016-06-22 15:35:02,795]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:02,795] DEBUG - wire << "{"Email":"1...@gmail.com"}"
[2016-06-22 15:35:03,476]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,476] DEBUG - wire >> "HTTP/1.1 400 Bad Request[\r][\n]"
[2016-06-22 15:35:03,476]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,476] DEBUG - wire >> "Cache-Control: no-cache[\r][\n]"
[2016-06-22 15:35:03,476]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,476] DEBUG - wire >> "Pragma: no-cache[\r][\n]"
[2016-06-22 15:35:03,476]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,476] DEBUG - wire >> "Content-Length: 110[\r][\n]"
[2016-06-22 15:35:03,476]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,476] DEBUG - wire >> "Content-Type: application/json;
charset=utf-8[\r][\n]"
[2016-06-22 15:35:03,477]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,476] DEBUG - wire >> "Expires: -1[\r][\n]"
[2016-06-22 15:35:03,477]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,477] DEBUG - wire >> "Server:
Microsoft-IIS/8.0[\r][\n]"
[2016-06-22 15:35:03,477]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,477] DEBUG - wire >> "X-AspNet-Version:
4.0.30319[\r][\n]"
[2016-06-22 15:35:03,477]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,477] DEBUG - wire >> "X-Powered-By: ASP.NET[\r][\n]"
[2016-06-22 15:35:03,477]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,477] DEBUG - wire >> "Set-Cookie:
ARRAffinity=87810450b90c9a83023a6768742c17e54dbf87a7a858516e54cad2c06cbddacf;Path=/;Domain=www.billiving.com:443
[\r][\n]"
[2016-06-22 15:35:03,477]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,477] DEBUG - wire >> "Date: Wed, 22 Jun 2016 10:05:02
GMT[\r][\n]"
[2016-06-22 15:35:03,477]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,477] DEBUG - wire >> "[\r][\n]"
[2016-06-22 15:35:03,477]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,477] DEBUG - wire >> "*"Your current plan is limited
to 5 clients. Please visit our account upgrade page to explore available
plans."*"
[2016-06-22 15:35:03,485]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,485] *ERROR - JsonUtil #newJsonPayload. Could not save
JSON payload. Invalid input stream found.* MessageID:
urn:uuid:687c4ba7-71e0-4ce8-8600-d2f474509ae4
[2016-06-22 15:35:03,488]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
[2016-06-22 15:35:03,487] ERROR - DeferredMessageBuilder Error building
message
[2016-06-22 15:35:03,488]  INFO

Re: [Dev] Request to upgrade the carbon-identity version in carbon-store and product-es

[Chandana Napagoda]

Hi Megala,

SameeraM found an issue in IS side while upgrading the Jaggery version. I
hope SameeraM has more insight about that.

Regards,
Chandana

On Wed, Jun 22, 2016 at 3:35 PM, Megala Uthayakumar  wrote:

> +Chandana
>
> On Wed, Jun 22, 2016 at 3:33 PM, Megala Uthayakumar 
> wrote:
>
>> Hi All,
>>
>> We are working on a DS and ES integration in which we have a use case
>> when a user changes some configuration in a gadget configuration file, we
>> need to unzip the gadget zip file and change the relevant file and zip it
>> again and send it to the DS side.
>>
>> Since unzip and zip functionality are not currently available in Jaggery,
>> we have implemented those in jaggery level and it will be included in
>> Jaggery 0.12.6. But Jaggery 0.12.6 requires carbon-identity version 5.1.0,
>> But carbon-store still uses the carbon-identity version 5.0.8. So is it
>> possible to upgrade the carbon-identity version to newer one in both
>>  carbon-store and product-es?
>>
>> Thanks.
>>
>> Regards,
>> Megala
>>
>> --
>> Megala Uthayakumar
>>
>> Software Engineer
>> Mobile : 0779967122
>>
>
>
>
> --
> Megala Uthayakumar
>
> Software Engineer
> Mobile : 0779967122
>



-- 
*Chandana Napagoda*
Senior Software Engineer
WSO2 Inc. - http://wso2.org

*Email  :  chand...@wso2.com **Mobile : +94718169299*

*Blog  :http://cnapagoda.blogspot.com *
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] ESB Analytics for MT scenarios?

[Anjana Fernando]

Hi,

On Wed, Jun 22, 2016 at 3:25 PM, Isabelle Mauny  wrote:

> Great! So that's for Spark.. You mentioned CEP as a big issue as well. Any
> hope to fix in CEP too ??
>

As per Suho's reply in this thread, it wouldn't be an issue, it just
consumed a little bit of extra memory, but performance wise, there
shouldn't be a problem.

Cheers,
Anjana.


>
>
> -
> *Isabelle Mauny*
> VP, Product Strategy - WSO2, Inc. - http://wso2.com/
> email: isabe...@wso2.com - mobile (Spain) : +34 616050684 - mobile (Sri
> Lanka) +94 (0)774777663
> Landline:  +1 (650) 745 4499  (USA)  or +94 (11) 214 534 (Sri Lanka)
> Extension : 7302
>
> On Wed, Jun 22, 2016 at 11:50 AM, Srinath Perera 
> wrote:
>
>> Perfect!!
>>
>> On Wed, Jun 22, 2016 at 1:58 PM, Anjana Fernando  wrote:
>>
>>> Hi,
>>>
>>> I've updated the thread "Cross Tenant Data Reading from Spark Queries in
>>> DAS", where I've done the implementation on writing back to the tenant
>>> space also from the super tenant space as well. This basically just
>>> eliminates the current requirement of executing identical Spark scripts in
>>> all the tenants, which would not be desirable performance wise, and now, we
>>> can just use super tenant's single script to process all the tenant's data
>>> and write back the results to their space. Of course, we've to now change
>>> the current ESB analytics scripts to use this feature, but it shouldn't be
>>> a big change. @Gihan/Supun, can we please check on this and get it done.
>>>
>>> Cheers,
>>> Anjana.
>>>
>>> On Tue, Jun 21, 2016 at 12:35 PM, Anjana Fernando 
>>> wrote:
>>>
 Hi,

 Yeah, as Srinath mentioned, we do have MT support there, where each ESB
 analytics data/queryeis/dashboards would be fully isolated. This is the
 usual desirable mode, when different tenants deploy their own analytics
 scripts and all, and there is no connection at all with other tenants, and
 obviously there shouldn't be. But in our solutions like this, where we
 would deploy the exact same solution in each tenant, we can potentially
 optimize the scenario by, only doing the processing in one place. This is
 actually how APIM batch queries are written at the moment. Where they
 altogether stores all the tenant's data in super tenant space and process
 and put the summarized there itself. This model works, but then, if the
 tenant itself wants to do their own processing it doesn't have access to
 the data, that was suppose to be in his space. So a solution for this is
 done, which is explained in detail in the mail "Cross Tenant Data Reading
 from Spark Queries in DAS", where optionally the super tenant can read
 tenant's data which creates a single virtual table view which contains data
 from all the tenants. From this, you can read the data, do the processing
 and store it in a table in super tenant space. In this approach, you will
 still have to have the dashboard in the super tenant space, since the data
 resides in the super tenant space. I will be doing some experiments to see
 on the feasibility of storing back summarized data in tenant space soon.

 Even though we can get the batch scenario working efficiently, there
 would be a problem in the CEP side, which we now use heavily in the product
 analytics scenario processing. At the moment, there is no concept of having
 a single CEP execution plan for all the tenants. When data is published to
 receivers, they will be dispatched to their own streams and execution
 plans, so we will need to find an approach for this, to optimize the
 processing of the CEP side of things. Or else, I'm not sure, since these
 are in-memory processing constructs, if having copies of the same execution
 plans will actually be okay, compared to having a single one, since the
 traffic is anyway split between them.

 Cheers,
 Anjana.

 On Tue, Jun 21, 2016 at 9:35 AM, Srinath Perera 
 wrote:

> We had a chat about this.
>
> This is supported, however, current implementation will run spark jobs
> per each tenant. So it will have performance concerns with a large number
> of tenants.
>
> Anjana, can you give the details and potential solutions? DAS team has
> implemented the support for reading tenant data from super tenant so we 
> can
> run a one Spark Job for all tenants. But we will need to change the 
> queries
> and figure out how tenant dashboards can get access to results in super
> tenant's space.
>
> Can we do a 5.1 addressing this?
>
> --Srinath
>
> On Tue, Jun 21, 2016 at 9:15 AM, Kasun Indrasiri 
> wrote:
>
>> Please note that this will be an essential feature for our
>> 

Re: [Dev] Request to upgrade the carbon-identity version in carbon-store and product-es

[Megala Uthayakumar]

+Chandana

On Wed, Jun 22, 2016 at 3:33 PM, Megala Uthayakumar  wrote:

> Hi All,
>
> We are working on a DS and ES integration in which we have a use case when
> a user changes some configuration in a gadget configuration file, we need
> to unzip the gadget zip file and change the relevant file and zip it again
> and send it to the DS side.
>
> Since unzip and zip functionality are not currently available in Jaggery,
> we have implemented those in jaggery level and it will be included in
> Jaggery 0.12.6. But Jaggery 0.12.6 requires carbon-identity version 5.1.0,
> But carbon-store still uses the carbon-identity version 5.0.8. So is it
> possible to upgrade the carbon-identity version to newer one in both
>  carbon-store and product-es?
>
> Thanks.
>
> Regards,
> Megala
>
> --
> Megala Uthayakumar
>
> Software Engineer
> Mobile : 0779967122
>



-- 
Megala Uthayakumar

Software Engineer
Mobile : 0779967122
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Request to upgrade the carbon-identity version in carbon-store and product-es

[Megala Uthayakumar]

Hi All,

We are working on a DS and ES integration in which we have a use case when
a user changes some configuration in a gadget configuration file, we need
to unzip the gadget zip file and change the relevant file and zip it again
and send it to the DS side.

Since unzip and zip functionality are not currently available in Jaggery,
we have implemented those in jaggery level and it will be included in
Jaggery 0.12.6. But Jaggery 0.12.6 requires carbon-identity version 5.1.0,
But carbon-store still uses the carbon-identity version 5.0.8. So is it
possible to upgrade the carbon-identity version to newer one in both
 carbon-store and product-es?

Thanks.

Regards,
Megala

-- 
Megala Uthayakumar

Software Engineer
Mobile : 0779967122
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] ESB Analytics for MT scenarios?

[Isabelle Mauny]

Great! So that's for Spark.. You mentioned CEP as a big issue as well. Any
hope to fix in CEP too ??

-
*Isabelle Mauny*
VP, Product Strategy - WSO2, Inc. - http://wso2.com/
email: isabe...@wso2.com - mobile (Spain) : +34 616050684 - mobile (Sri
Lanka) +94 (0)774777663
Landline:  +1 (650) 745 4499  (USA)  or +94 (11) 214 534 (Sri Lanka)
Extension : 7302

On Wed, Jun 22, 2016 at 11:50 AM, Srinath Perera  wrote:

> Perfect!!
>
> On Wed, Jun 22, 2016 at 1:58 PM, Anjana Fernando  wrote:
>
>> Hi,
>>
>> I've updated the thread "Cross Tenant Data Reading from Spark Queries in
>> DAS", where I've done the implementation on writing back to the tenant
>> space also from the super tenant space as well. This basically just
>> eliminates the current requirement of executing identical Spark scripts in
>> all the tenants, which would not be desirable performance wise, and now, we
>> can just use super tenant's single script to process all the tenant's data
>> and write back the results to their space. Of course, we've to now change
>> the current ESB analytics scripts to use this feature, but it shouldn't be
>> a big change. @Gihan/Supun, can we please check on this and get it done.
>>
>> Cheers,
>> Anjana.
>>
>> On Tue, Jun 21, 2016 at 12:35 PM, Anjana Fernando 
>> wrote:
>>
>>> Hi,
>>>
>>> Yeah, as Srinath mentioned, we do have MT support there, where each ESB
>>> analytics data/queryeis/dashboards would be fully isolated. This is the
>>> usual desirable mode, when different tenants deploy their own analytics
>>> scripts and all, and there is no connection at all with other tenants, and
>>> obviously there shouldn't be. But in our solutions like this, where we
>>> would deploy the exact same solution in each tenant, we can potentially
>>> optimize the scenario by, only doing the processing in one place. This is
>>> actually how APIM batch queries are written at the moment. Where they
>>> altogether stores all the tenant's data in super tenant space and process
>>> and put the summarized there itself. This model works, but then, if the
>>> tenant itself wants to do their own processing it doesn't have access to
>>> the data, that was suppose to be in his space. So a solution for this is
>>> done, which is explained in detail in the mail "Cross Tenant Data Reading
>>> from Spark Queries in DAS", where optionally the super tenant can read
>>> tenant's data which creates a single virtual table view which contains data
>>> from all the tenants. From this, you can read the data, do the processing
>>> and store it in a table in super tenant space. In this approach, you will
>>> still have to have the dashboard in the super tenant space, since the data
>>> resides in the super tenant space. I will be doing some experiments to see
>>> on the feasibility of storing back summarized data in tenant space soon.
>>>
>>> Even though we can get the batch scenario working efficiently, there
>>> would be a problem in the CEP side, which we now use heavily in the product
>>> analytics scenario processing. At the moment, there is no concept of having
>>> a single CEP execution plan for all the tenants. When data is published to
>>> receivers, they will be dispatched to their own streams and execution
>>> plans, so we will need to find an approach for this, to optimize the
>>> processing of the CEP side of things. Or else, I'm not sure, since these
>>> are in-memory processing constructs, if having copies of the same execution
>>> plans will actually be okay, compared to having a single one, since the
>>> traffic is anyway split between them.
>>>
>>> Cheers,
>>> Anjana.
>>>
>>> On Tue, Jun 21, 2016 at 9:35 AM, Srinath Perera 
>>> wrote:
>>>
 We had a chat about this.

 This is supported, however, current implementation will run spark jobs
 per each tenant. So it will have performance concerns with a large number
 of tenants.

 Anjana, can you give the details and potential solutions? DAS team has
 implemented the support for reading tenant data from super tenant so we can
 run a one Spark Job for all tenants. But we will need to change the queries
 and figure out how tenant dashboards can get access to results in super
 tenant's space.

 Can we do a 5.1 addressing this?

 --Srinath

 On Tue, Jun 21, 2016 at 9:15 AM, Kasun Indrasiri 
 wrote:

> Please note that this will be an essential feature for our integration
> cloud. So, we need to decide how should we proceed with this soon.
>
> On Fri, Jun 17, 2016 at 1:57 AM, Kasun Indrasiri 
> wrote:
>
>> How about the $subject? I don't think there's no any limitation from
>> the mediation engine side on collecting these stats. We need to have this
>> for ESB 5.
>>
>> --
>> Kasun Indrasiri

Re: [Dev] [GSOC 16] Initial Project Progress

[Osura Rathnayake]

Hi Mentors,

I have handled the exceptions and pushed the changes to my repository [1].
Please have a look



[1] https://github.com/osuran/azure-membership-scheme

thanks,

On Wed, Jun 22, 2016 at 11:42 AM, Osura Rathnayake 
wrote:

> Hi Isuru,
>
> Thank you very much for the feedback.
> I updated the snapshot dependency with a released version. Also I made it
> use Jackson to parse the API responses using bean classes. And I properly
> formatted the code as well. Exceptions handling is still on the way.
> Sure will have a code review this week.
>
>
> On Tue, Jun 21, 2016 at 10:18 AM, Isuru Haththotuwa 
> wrote:
>
>> Hi Osura,
>>
>> I went through the code at [1] briefly. Some general comments:
>>
>>- The code is not properly formatted
>>- The code has a SNAPSHOT dependency for org.wso2.carbon.utils. If
>>you do not have a specific reason to do so, its better to use a released
>>version.
>>- To parse the responses from the rest API, you are directly
>>manipulating JSON objects. Have a look at the Kubernetes Membership 
>> Scheme.
>>Its using Jackson to parse the API responses using bean classes. This 
>> would
>>be much easier than directly interacting with JSON structures. Or else, 
>> you
>>can use Netflix Feign as a REST API client [2], in which the amount of 
>> code
>>you have to write is very less.
>>- System.exit(1) is used in few places to handle error scenarios,
>>which is wrong. Please use a proper Exception for the purpose
>>
>> Noted that you have updated the README file, which is great. Lets have a
>> code review this week to go through the functional aspects at a more fine
>> grained level.
>>
>> [1]. https://github.com/osuran/azure-membership-scheme.git
>>
>> [2]. https://github.com/Netflix/feign
>>
>> On Thu, Jun 16, 2016 at 11:23 AM, Osura Rathnayake 
>> wrote:
>>
>>> Hi Isuru,
>>>
>>> That's great, will do the demo at 3 o'clock in the evening today.
>>> thanks
>>>
>>> On Thu, Jun 16, 2016 at 11:21 AM, Isuru Haththotuwa 
>>> wrote:
>>>


 On Thu, Jun 16, 2016 at 11:10 AM, Osura Rathnayake 
 wrote:

> Hi Mentors,
>
> Thank you for the update.
> Yes I can demonstrate it anytime today.
>
 Great! Shall we have a hangout at 3.00 PM? The main purpose would be to
 demonstrate the membership scheme functionality with a carbon cluster
 deployed in Azure.

>
>
> thanks
>
> On Thu, Jun 16, 2016 at 10:11 AM, Isuru Haththotuwa 
> wrote:
>
>> Hi Osura,
>>
>> Would you be able to demonstrate the functionality of the membership
>> scheme today?
>>
>> Also, please keep an eye on the timeline for the project [1], as the
>> midterm evaluations will be starting on 20th.
>>
>> [1]. https://developers.google.com/open-source/gsoc/timeline
>>
>> On Thu, Jun 16, 2016 at 6:46 AM, Imesh Gunaratne 
>> wrote:
>>
>>>
>>>
>>> On Wed, Jun 15, 2016 at 2:46 PM, Osura Rathnayake <
>>> osura...@gmail.com> wrote:
>>>
 Hi Mentors,

 As we discussed at the very beginning, next in line is to see how
 each of the following can be setup on Azure using native features:

- Auto healing
- Autoscaling
- Dynamic load balancing
- Centralized logging
- Monitoring
- Metering

 For auto healing, we can implement it in both VM level and
 application level. In VM level, we can poll for VM statuses and check 
 if a
 given VM is down or not. And then we can up them if they have gone 
 down,
 using api calls. for application level of course we will have to run a
 shell script to determine the status of a given application and will 
 have
 to up it accordingly. I'm looking forward to hear from you regarding 
 this.

>>>
>>> ​No, auto healing and autoscaling should be handled by Azure. We
>>> might not need to write code to handle that.
>>>
>>> Thanks​
>>>
>>>

 thanks,

 On Mon, Jun 13, 2016 at 10:53 AM, Osura Rathnayake <
 osura...@gmail.com> wrote:

> Hi Isuru,
>
> Can you please tell me when you would be free to have a hangout to
> do a code review and discuss next project goals?
>
> Thanks,
>
> On Saturday, June 11, 2016, Osura Rathnayake 
> wrote:
>
>> Hi Isuru,
>>
>> Thank you very much.
>> Yes there was a misconfiguration in registry mounts and now it
>> works properly.
>> Okay will have a code review next week.
>>
>>
>> On Fri, Jun 10, 2016 at 9:45 AM, Isuru 

Re: [Dev] Kerberos communication fails with java server to C# client

[Hasanthi Purnima Dissanayake]

Hi All,
The name-formats used in GSS-API are somewhat different than the
name-formats used in SSPI.  So the C# client could not identify the   SPN,
as the SPN name of the Java server is not windows compatible. After
providing the SPN name without realm when creating the client credentials
in C# client side the above problem solved.

Thanks Fara and Shazni for the suggestions and all the help. :)

Hasanthi Dissanayake

Software Engineer | WSO2

E: hasan...@wso2.com
M :0718407133| http://wso2.com 

On Tue, Jun 21, 2016 at 4:36 PM, Farasath Ahamed  wrote:

> Hi Hasanthi,
>
>
> On Tue, Jun 21, 2016 at 3:01 PM, Hasanthi Purnima Dissanayake <
> hasan...@wso2.com> wrote:
>
>> Hi Fara/Shazni,
>>
>> Thanks for the feedback. Here I'm using a sample standalone Java server
>> and C# client which communicates through a socket. And I'm using the fully
>> qualified name as you suggested.
>>
>> As this error comes when validating the server token the the issue should
>> be with the SPN of java server. Following is the code snippet which I'm
>> using generate the server token.
>>
>> GSSName serviceName =
>> manager.createName("wso2@IS.LOCAL", GSSName.NT_USER_NAME);
>>
>
> You seem to be using the service account here. Can you try using the
> Service Principal name under which you registered the java sever (that will
> be something like HTTP/server.is.local@IS.LOCAL) instead. As Shazni has
> pointed out use the SPN name along with realm at all places. I faced a
> similar situation during implementing IWA using Kerberos, and giving the
> SPN name along with the domain did the trick for me.
>
>
>
>> GSSCredential serviceCredentials =
>> manager.createCredential(serviceName,
>> GSSCredential.INDEFINITE_LIFETIME, spnegoOid,
>> GSSCredential.ACCEPT_ONLY);
>> GSSContext context =
>> manager.createContext(serviceCredentials);
>> serverToken = context.acceptSecContext(serviceTicket,
>> 0, serviceTicket.length);
>>
>> Here IS.LOCAL is the realm name and wso2 is the account name. When
>> executing this I got a value for 'serverToken' and the exception occurs
>> when the client uses this 'serverToken' to validate.
>>
>> Thanks,
>>
>> Hasanthi Dissanayake
>>
>> Software Engineer | WSO2
>>
>> E: hasan...@wso2.com
>> M :0718407133| http://wso2.com 
>>
>> On Tue, Jun 21, 2016 at 2:32 PM, Shazni Nazir  wrote:
>>
>>> HI Hasanthi,
>>>
>>> I've one question. What's this Java Server? Is it a standalone server
>>> you have custom written or is it a WSO2 server?
>>>
>>> When it comes to Kerberos related work for SOAP, we faced a couple of
>>> issues with related to service principal (SPN) name. In that discrepancies
>>> were noticed when using service principal name without a realm. For
>>> example, if the service principal name is, esb/localhost and the realm is
>>> WSO2.ORG, you have to specify the SPN as a fully qualified name; like
>>> esb/localh...@wso2.org. I'm not sure whether your issue is related to
>>> this. Maybe you can check if that's the case.
>>>
>>> Shazni Nazeer
>>> Mob : +94 37331
>>> LinkedIn : http://lk.linkedin.com/in/shazninazeer
>>> Blog : http://shazninazeer.blogspot.com
>>>
>>> On Tue, Jun 21, 2016 at 2:20 PM, Farasath Ahamed 
>>> wrote:
>>>
 Hi Hasanthi,

 Assuming that you are using an AD as the Kerberos Server, Have you
 registered a Service Principal for both the C# client and Java Server in
 the AD?

 You can do this using the setspn.exe. Also, when you registering the
 SPN register all possible value that principal can take.
 For eg: Let's say the hostname of your java server is *server.is.local*,
 you can do

 setspn -A HTTP/server.is.local 
 setspn -A HTTP/server 

 to add your java server as a service principal in the Kerberos Server.
 You can do the same for the C# client as well. Can you check whether you
 have already registered the Service Principals by listing them out using
 commands specified in [1]

 [1]
 https://blogs.msdn.microsoft.com/psssql/2009/02/13/searching-for-duplicate-spns-got-a-little-easier/

 Thanks,

 Farasath Ahamed
 Software Engineer,
 WSO2 Inc.; http://wso2.com
 lean.enterprise.middleware


 Email: farasa...@wso2.com
 Mobile: +94777603866
 Blog: blog.farazath.com
 Twitter: @farazath619 

 On Tue, Jun 21, 2016 at 2:03 PM, Hasanthi Purnima Dissanayake <
 hasan...@wso2.com> wrote:

> Hi I'm implementing Kerberos communication between java (GSSAPI) to
> C#(SSPI).
>
> The KDC is an Active Directory. When it comes to Java client vs Java
> server and C# client vs C# Server, for both the scenarios this works fine.
>
> When using Java client - server the process happens as below and 

[Dev] [APIM 2.0] Revoked access and revoked refresh tokens returning with http response header

[Kavitha Subramaniyam]

Hi team,

I observed that both revoked access and revoked refresh tokens were
returning in http response header [3].
setup : IS as KM
 - apim 2.0.0 17th nightly build
 - IS 5.2.0 19th build
 - Token encryption enabled

Could you please confirm that this behavior is not resolved purposely in
apim 2.0.0 due to the reasons discussed in mail thread [1], or it has been
solved?
Find an identity jira was raised for IS issue [2]

[1] Revoked Access Token and Revoked Refresh Token returned back in token
revoke endpoint response

[2] https://wso2.org/jira/browse/IDENTITY-4112

[3]

[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 << HTTP/1.1 200
OK
[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 <<
AuthorizedUser: WSO2.ORG/admin@carbon.super
[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 <<
Cache-Control: no-store
[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 << Date: Wed, 22
Jun 2016 08:39:00 GMT
[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 << Pragma:
no-cache
[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 <<
RevokedAccessToken: 030415a3-7b8a-39e7-b154-28cec1aeaf89
[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 <<
RevokedRefreshToken:
h56lM3zcJNCBbPHJfGnbQpUcI/ocp6CzGaE+r53nYDM021ItoJP4T/tN8fYGkQq6vvke4PwfkMQEt1zP7HNHJwgynI6Ch86C1tNCthxsG2CKsthHvjsGXvOzktURrNUGxJboj+U/r9arQc/mEt/J0skFQm1R76IC9Zlgh/5irBU=
[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 << Content-Type:
text/html
[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 <<
Content-Length: 0
[2016-06-22 14:09:00,745] DEBUG - headers http-outgoing-10 << Server: WSO2
Carbon Server
[2016-06-22 14:09:00,747] DEBUG - headers http-incoming-13 << HTTP/1.1 200
OK
[2016-06-22 14:09:00,747] DEBUG - headers http-incoming-13 <<
RevokedAccessToken: 030415a3-7b8a-39e7-b154-28cec1aeaf89
[2016-06-22 14:09:00,747] DEBUG - headers http-incoming-13 <<
AuthorizedUser: WSO2.ORG/admin@carbon.super
[2016-06-22 14:09:00,748] DEBUG - headers http-incoming-13 <<
RevokedRefreshToken:
h56lM3zcJNCBbPHJfGnbQpUcI/ocp6CzGaE+r53nYDM021ItoJP4T/tN8fYGkQq6vvke4PwfkMQEt1zP7HNHJwgynI6Ch86C1tNCthxsG2CKsthHvjsGXvOzktURrNUGxJboj+U/r9arQc/mEt/J0skFQm1R76IC9Zlgh/5irBU=
[2016-06-22 14:09:00,748] DEBUG - headers http-incoming-13 << Content-Type:
text/html
[2016-06-22 14:09:00,748] DEBUG - headers http-incoming-13 << Pragma:
no-cache
[2016-06-22 14:09:00,748] DEBUG - headers http-incoming-13 <<
Cache-Control: no-store
[2016-06-22 14:09:00,748] DEBUG - headers http-incoming-13 << Date: Wed, 22
Jun 2016 08:39:00 GMT
[2016-06-22 14:09:00,748] DEBUG - headers http-incoming-13 <<
Transfer-Encoding: chunked





Thanks,

-- 
Kavitha.S
*Software Engineer -QA*
Mobile : +94 (0) 771538811 <%2B94%20%280%29%20773%20451194>
kavi...@wso2.com 
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] ESB is not handling the invalid response type

[Shakila Sivagnanarajah]

Hi,

ESB is not handling the string response If the Content-Type is
application/json. Apparently this is the fault on API response. Please find
the wire log [1]. How can we handle this?

[1] - [2016-06-21 16:13:53,915]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:53,915] DEBUG - wire << "GET
/devices/smoke_co_alarms/VhVmm7HOhEcL5sSzblcDOMMSoJ03t2br/co_alarm_state?auth=c.fRDyCBmlbBmwvpmODrw7qMIuJkbwZAtROf53kM9cwHDPEYdasapWaV284w4GnSohzgMuzJM8HEt9Bex3ommjCCoKaFuXFxAX9ZMyb5ckwNDpYWAMepcvbTtm37PRy3vFvARFYhWxOAgvFEEh
HTTP/1.1[\r][\n]"
[2016-06-21 16:13:53,915]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:53,915] DEBUG - wire << "Accept-Charset: UTF-8[\r][\n]"
[2016-06-21 16:13:53,915]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:53,915] DEBUG - wire << "Content-Type:
application/json[\r][\n]"
[2016-06-21 16:13:53,915]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:53,915] DEBUG - wire << "Accept: text/html, image/gif,
image/jpeg, *; q=.2, */*; q=.2[\r][\n]"
[2016-06-21 16:13:53,915]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:53,915] DEBUG - wire << "Host:
firebase-apiserver10-tah01-iad01.dapi.production.nest.com:9553[\r][\n]"
[2016-06-21 16:13:53,916]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:53,915] DEBUG - wire << "Connection: Keep-Alive[\r][\n]"
[2016-06-21 16:13:53,916]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:53,916] DEBUG - wire << "User-Agent:
Synapse-PT-HttpComponents-NIO[\r][\n]"
[2016-06-21 16:13:53,916]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:53,916] DEBUG - wire << "[\r][\n]"
[2016-06-21 16:13:54,237]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,237] DEBUG - wire >> "HTTP/1.1 200 OK[\r][\n]"
[2016-06-21 16:13:54,237]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,237] DEBUG - wire >> "*Content-Type:
application/json; charset=UTF-8*[\r][\n]"
[2016-06-21 16:13:54,237]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,237] DEBUG - wire >> "Access-Control-Allow-Origin:
*[\r][\n]"
[2016-06-21 16:13:54,238]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,237] DEBUG - wire >> "Cache-Control: private,
no-cache, max-age=0[\r][\n]"
[2016-06-21 16:13:54,238]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,238] DEBUG - wire >> "Connection: close[\r][\n]"
[2016-06-21 16:13:54,238]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,238] DEBUG - wire >> "Content-Length: 4[\r][\n]"
[2016-06-21 16:13:54,238]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,238] DEBUG - wire >> "[\r][\n]"
[2016-06-21 16:13:54,238]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,238] DEBUG - wire >> "*"ok"*"
[2016-06-21 16:13:54,241]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,241] ERROR - JsonUtil #newJsonPayload. *Could not
save JSON payload. Invalid input stream found.* MessageID:
urn:uuid:84033421-f5c1-47a3-a3c7-9764c6cd087d
[2016-06-21 16:13:54,242]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-21 16:13:54,241] ERROR - DeferredMessageBuilder Error building
message
[2016-06-21 16:13:54,242]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 org.apache.axis2.AxisFault: No JSON payload provided.
[2016-06-21 16:13:54,242]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -   at
org.apache.synapse.commons.json.JsonStreamBuilder.processDocument(JsonStreamBuilder.java:52)
[2016-06-21 16:13:54,242]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -   at
org.apache.synapse.transport.passthru.util.DeferredMessageBuilder.getDocument(DeferredMessageBuilder.java:138)
[2016-06-21 16:13:54,242]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -   at
org.apache.synapse.transport.passthru.util.RelayUtils.builldMessage(RelayUtils.java:133)
[2016-06-21 16:13:54,242]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -   at
org.apache.synapse.transport.passthru.util.RelayUtils.buildMessage(RelayUtils.java:98)
[2016-06-21 16:13:54,243]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -   at
org.apache.synapse.mediators.AbstractListMediator.mediate(AbstractListMediator.java:72)
[2016-06-21 

Re: [Dev] [ESB Tooling] Can we activate "event statistics" on global level?

[Chanaka Fernando]

Agreed with you Isuru.

Tool will only provide a short cut to enable disable stat/tracing per CAPP.
Basically, it will enable stat/tracing for each and every artifacts
(applicable).

Setting a global parameter should not be possible through a CAPP.

On Wed, Jun 22, 2016 at 1:54 PM, Isuru Udana  wrote:

> Hi,
>
>
> On Wed, Jun 22, 2016 at 1:45 PM, Chanaka Fernando 
> wrote:
>
>> Hi Viraj,
>>
>> The configuration we have in the synapse.properties file is to globally
>> enable/disable the statistics/tracing for the server. By enabling that, we
>> prepare the server to publish events to DAS server. But, if you need to
>> publish real events, you need to enable them in individual artifacts
>> (proxy, api, sequence, etc). Iranga's suggestion is to provide a global
>> parameter to enable/disable them all at once (per CAPP or at global level).
>> This is a valid requirement which a particular user might have.
>>
>> Enable/disable statistics per CAR from the tool is ok, but should we do
> the global level controlling at the tool level ?
> Enabling statics globally is a management task.
> CARs are for packaging and deployable artifacts.
> Using CARs to control global level parameters doesn't sound nice to me.
>
>
>> This will require a considerable effort to support in the current model
>> and we will not be able to support in the upcoming ESB 5.0.0 version.
>>
>> @Iranga: Please create a public JIRA and we will fix this in a future
>> release.
>>
>> Thanks,
>> Chanaka
>>
>> On Wed, Jun 22, 2016 at 12:38 PM, Viraj Rajaguru  wrote:
>>
>>> Hi Iranga,
>>>
>>> IIUC, requirement is to setting a global level setting with CAR files to
>>> enable event statistics publishing. As per this document[1], we need to set
>>> a property in synapse.properties file + relevant config changes in artifact
>>> files to enable statistics publishing. With CAR files we are not modifying
>>> config files such as synapse.properties. So how can we achieve this?
>>>
>>> Thanks,
>>> Viraj.
>>>
>>> [1] -
>>> https://docs.wso2.com/display/ESB500/Prerequisites+to+Publish+Statistics
>>>
>>> On Fri, Apr 29, 2016 at 12:12 PM, Iranga Muthuthanthri 
>>> wrote:
>>>


 On Fri, Apr 29, 2016 at 11:35 AM, Malaka Silva  wrote:

> +1 and it make sense to do it since we are having the
> a separate analytics server for ESB.
>
> Iranga when you say global do you mean for a CAPP or for the complete
> deployment? I think you are referring to the second option.
>

 Global setting -Having it at complete deployment  , having it at the
 C-App level  would also be a useful option as well IMO

>
> On Fri, Apr 29, 2016 at 11:20 AM, Iranga Muthuthanthri <
> ira...@wso2.com> wrote:
>
>> Hi All,
>>
>> When creating a C-App to publish event statistics to ESB Analytics we
>> have to enable event statistics for each configuration ( proxy service,
>> API,) , would there be an option to set this at a global level?
>>
>> --
>> Thanks & Regards
>>
>> Iranga Muthuthanthri
>> (M) -0777-255773
>> Team Product Management
>>
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
>
> Best Regards,
>
> Malaka Silva
> Senior Tech Lead
> M: +94 777 219 791
> Tel : 94 11 214 5345
> Fax :94 11 2145300
> Skype : malaka.sampath.silva
> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
> Blog : http://mrmalakasilva.blogspot.com/
>
> WSO2, Inc.
> lean . enterprise . middleware
> http://www.wso2.com/
> http://www.wso2.com/about/team/malaka-silva/
> 
> https://store.wso2.com/store/
>
> Save a tree -Conserve nature & Save the world for your future. Print
> this email only if it is absolutely necessary.
>



 --
 Thanks & Regards

 Iranga Muthuthanthri
 (M) -0777-255773
 Team Product Management


>>>
>>>
>>> --
>>> Viraj Rajaguru
>>> Associate Technical Lead
>>> WSO2 Inc. : http://wso2.com
>>>
>>> Mobile: +94 77 3683068
>>>
>>>
>>>
>>>
>>
>>
>> --
>> Thank you and Best Regards,
>> Chanaka Fernando
>> Senior Technical Lead
>> WSO2, Inc.; http://wso2.com
>> lean.enterprise.middleware
>>
>> mobile: +94 773337238
>> Blog : http://soatutorials.blogspot.com
>> LinkedIn:http://www.linkedin.com/pub/chanaka-fernando/19/a20/5b0
>> Twitter:https://twitter.com/chanakaudaya
>>
>>
>>
>>
>>
>
>
> --
> *Isuru Udana*
> Technical Lead
> WSO2 Inc.; http://wso2.com
> email: isu...@wso2.com cell: +94 77 3791887
> blog: http://mytecheye.blogspot.com/
>



-- 
Thank you and Best Regards,
Chanaka Fernando
Senior Technical Lead
WSO2, Inc.; http://wso2.com
lean.enterprise.middleware

mobile: +94 

Re: [Dev] ESB Analytics for MT scenarios?

[Anjana Fernando]

Hi,

On Wed, Jun 22, 2016 at 11:38 AM, Selvaratnam Uthaiyashankar <
shan...@wso2.com> wrote:

>
>
> On Tue, Jun 21, 2016 at 11:31 AM, Buddhima Wijeweera 
> wrote:
>
>> Hi,
>>
>> At the moment ESB can publish tenant-wise. I tried it with a latest ESB
>> and following are the steps need to follow:
>> 1. Enable statistics for global level.
>> 2. Add eventpublisher & eventstream files to tenant's deployment folder
>>
>
> Who has to deploy this? Tenant or Super tenant? how do we deploy this in
> cloud setup? Do we have UI for this?
>

Event stream can come from our CApp itself, the event publisher, the tenant
user has to deploy, and yes, it has an UI.


>
>
>
>
>
>> 3. Create a proxy (or API, inbound EP) and Enable Statistics.
>> 4. Send messages to proxy
>>
>> Depending on the tenant credentials in eventpublisher files(at point 2
>> above), statistics  get published to analytics-esb server. (for this
>> testing I published to super-tenant of analytics-esb).
>>
>
> Also, if point 2 above has to be done by the tenant, tenant will not know
> super tenant credentials to send events.
>

The tenant user should use a tenant user's credentials to send events, not
super tenant, since with our tenant isolation, the data should go to the
tenant's space.

Cheers,
Anjana.


>
>
>
>>
>> Thanks,
>>
>> On Tue, Jun 21, 2016 at 9:37 AM, Srinath Perera  wrote:
>>
>>> We had a chat about this.
>>>
>>> This is supported. However, current implementation will run spark jobs
>>> per each tenant. So it will have performance concerns with a large number
>>> of tenants.
>>>
>>> Anjana, can you give the details and potential solutions?
>>>
>>> Summary is that DAS team has implemented the support for reading tenant
>>> data from super tenant so we can run a one Spark Job for all tenants. But
>>> we will need to change the queries and figure out how tenant dashboards can
>>> get access to results in super tenant's space.
>>>
>>> Can we do a 5.1 addressing this?
>>>
>>> --Srinath
>>>
>>> On Tue, Jun 21, 2016 at 9:15 AM, Kasun Indrasiri  wrote:
>>>
 Please note that this will be an essential feature for our integration
 cloud. So, we need to decide how should we proceed with this soon.

 On Fri, Jun 17, 2016 at 1:57 AM, Kasun Indrasiri 
 wrote:

> How about the $subject? I don't think there's no any limitation from
> the mediation engine side on collecting these stats. We need to have this
> for ESB 5.
>
> --
> Kasun Indrasiri
> Software Architect
> WSO2, Inc.; http://wso2.com
> lean.enterprise.middleware
>
> cell: +94 77 556 5206
> Blog : http://kasunpanorama.blogspot.com/
>



 --
 Kasun Indrasiri
 Software Architect
 WSO2, Inc.; http://wso2.com
 lean.enterprise.middleware

 cell: +94 77 556 5206
 Blog : http://kasunpanorama.blogspot.com/

>>>
>>>
>>>
>>> --
>>> 
>>> Srinath Perera, Ph.D.
>>>http://people.apache.org/~hemapani/
>>>http://srinathsview.blogspot.com/
>>>
>>
>>
>>
>> --
>> Buddhima Wijeweera
>> Software Engineer; WSO2 Inc.; http://wso2.com ,
>>
>> Mobile: +94 71 427 9966
>> Email: buddh...@wso2.com
>> Blog:   https://buddhimawijeweera.wordpress.com
>> GitHub Profile: https://github.com/Buddhima
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> S.Uthaiyashankar
> VP Engineering
> WSO2 Inc.
> http://wso2.com/ - "lean . enterprise . middleware"
>
> Phone: +94 714897591
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*Anjana Fernando*
Senior Technical Lead
WSO2 Inc. | http://wso2.com
lean . enterprise . middleware
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] ESB Analytics for MT scenarios?

[Anjana Fernando]

Hi,

I've updated the thread "Cross Tenant Data Reading from Spark Queries in
DAS", where I've done the implementation on writing back to the tenant
space also from the super tenant space as well. This basically just
eliminates the current requirement of executing identical Spark scripts in
all the tenants, which would not be desirable performance wise, and now, we
can just use super tenant's single script to process all the tenant's data
and write back the results to their space. Of course, we've to now change
the current ESB analytics scripts to use this feature, but it shouldn't be
a big change. @Gihan/Supun, can we please check on this and get it done.

Cheers,
Anjana.

On Tue, Jun 21, 2016 at 12:35 PM, Anjana Fernando  wrote:

> Hi,
>
> Yeah, as Srinath mentioned, we do have MT support there, where each ESB
> analytics data/queryeis/dashboards would be fully isolated. This is the
> usual desirable mode, when different tenants deploy their own analytics
> scripts and all, and there is no connection at all with other tenants, and
> obviously there shouldn't be. But in our solutions like this, where we
> would deploy the exact same solution in each tenant, we can potentially
> optimize the scenario by, only doing the processing in one place. This is
> actually how APIM batch queries are written at the moment. Where they
> altogether stores all the tenant's data in super tenant space and process
> and put the summarized there itself. This model works, but then, if the
> tenant itself wants to do their own processing it doesn't have access to
> the data, that was suppose to be in his space. So a solution for this is
> done, which is explained in detail in the mail "Cross Tenant Data Reading
> from Spark Queries in DAS", where optionally the super tenant can read
> tenant's data which creates a single virtual table view which contains data
> from all the tenants. From this, you can read the data, do the processing
> and store it in a table in super tenant space. In this approach, you will
> still have to have the dashboard in the super tenant space, since the data
> resides in the super tenant space. I will be doing some experiments to see
> on the feasibility of storing back summarized data in tenant space soon.
>
> Even though we can get the batch scenario working efficiently, there would
> be a problem in the CEP side, which we now use heavily in the product
> analytics scenario processing. At the moment, there is no concept of having
> a single CEP execution plan for all the tenants. When data is published to
> receivers, they will be dispatched to their own streams and execution
> plans, so we will need to find an approach for this, to optimize the
> processing of the CEP side of things. Or else, I'm not sure, since these
> are in-memory processing constructs, if having copies of the same execution
> plans will actually be okay, compared to having a single one, since the
> traffic is anyway split between them.
>
> Cheers,
> Anjana.
>
> On Tue, Jun 21, 2016 at 9:35 AM, Srinath Perera 
> wrote:
>
>> We had a chat about this.
>>
>> This is supported, however, current implementation will run spark jobs
>> per each tenant. So it will have performance concerns with a large number
>> of tenants.
>>
>> Anjana, can you give the details and potential solutions? DAS team has
>> implemented the support for reading tenant data from super tenant so we can
>> run a one Spark Job for all tenants. But we will need to change the queries
>> and figure out how tenant dashboards can get access to results in super
>> tenant's space.
>>
>> Can we do a 5.1 addressing this?
>>
>> --Srinath
>>
>> On Tue, Jun 21, 2016 at 9:15 AM, Kasun Indrasiri  wrote:
>>
>>> Please note that this will be an essential feature for our integration
>>> cloud. So, we need to decide how should we proceed with this soon.
>>>
>>> On Fri, Jun 17, 2016 at 1:57 AM, Kasun Indrasiri  wrote:
>>>
 How about the $subject? I don't think there's no any limitation from
 the mediation engine side on collecting these stats. We need to have this
 for ESB 5.

 --
 Kasun Indrasiri
 Software Architect
 WSO2, Inc.; http://wso2.com
 lean.enterprise.middleware

 cell: +94 77 556 5206
 Blog : http://kasunpanorama.blogspot.com/

>>>
>>>
>>>
>>> --
>>> Kasun Indrasiri
>>> Software Architect
>>> WSO2, Inc.; http://wso2.com
>>> lean.enterprise.middleware
>>>
>>> cell: +94 77 556 5206
>>> Blog : http://kasunpanorama.blogspot.com/
>>>
>>
>>
>>
>> --
>> 
>>WSO2 Inc. http://wso2.com
>>Blog: http://srinathsview.blogspot.com/
>>Photos: http://www.flickr.com/photos/hemapani/ twitter:@srinath_perera
>>Site: http://people.apache.org/~hemapani/
>>
>
>
>
> --
> *Anjana Fernando*
> Senior Technical Lead
> WSO2 Inc. | http://wso2.com
> lean . enterprise . middleware
>



-- 
*Anjana Fernando*
Senior Technical Lead
WSO2 Inc. | 

Re: [Dev] [ESB Tooling] Can we activate "event statistics" on global level?

[Isuru Udana]

Hi,


On Wed, Jun 22, 2016 at 1:45 PM, Chanaka Fernando  wrote:

> Hi Viraj,
>
> The configuration we have in the synapse.properties file is to globally
> enable/disable the statistics/tracing for the server. By enabling that, we
> prepare the server to publish events to DAS server. But, if you need to
> publish real events, you need to enable them in individual artifacts
> (proxy, api, sequence, etc). Iranga's suggestion is to provide a global
> parameter to enable/disable them all at once (per CAPP or at global level).
> This is a valid requirement which a particular user might have.
>
> Enable/disable statistics per CAR from the tool is ok, but should we do
the global level controlling at the tool level ?
Enabling statics globally is a management task.
CARs are for packaging and deployable artifacts.
Using CARs to control global level parameters doesn't sound nice to me.


> This will require a considerable effort to support in the current model
> and we will not be able to support in the upcoming ESB 5.0.0 version.
>
> @Iranga: Please create a public JIRA and we will fix this in a future
> release.
>
> Thanks,
> Chanaka
>
> On Wed, Jun 22, 2016 at 12:38 PM, Viraj Rajaguru  wrote:
>
>> Hi Iranga,
>>
>> IIUC, requirement is to setting a global level setting with CAR files to
>> enable event statistics publishing. As per this document[1], we need to set
>> a property in synapse.properties file + relevant config changes in artifact
>> files to enable statistics publishing. With CAR files we are not modifying
>> config files such as synapse.properties. So how can we achieve this?
>>
>> Thanks,
>> Viraj.
>>
>> [1] -
>> https://docs.wso2.com/display/ESB500/Prerequisites+to+Publish+Statistics
>>
>> On Fri, Apr 29, 2016 at 12:12 PM, Iranga Muthuthanthri 
>> wrote:
>>
>>>
>>>
>>> On Fri, Apr 29, 2016 at 11:35 AM, Malaka Silva  wrote:
>>>
 +1 and it make sense to do it since we are having the
 a separate analytics server for ESB.

 Iranga when you say global do you mean for a CAPP or for the complete
 deployment? I think you are referring to the second option.

>>>
>>> Global setting -Having it at complete deployment  , having it at the
>>> C-App level  would also be a useful option as well IMO
>>>

 On Fri, Apr 29, 2016 at 11:20 AM, Iranga Muthuthanthri  wrote:

> Hi All,
>
> When creating a C-App to publish event statistics to ESB Analytics we
> have to enable event statistics for each configuration ( proxy service,
> API,) , would there be an option to set this at a global level?
>
> --
> Thanks & Regards
>
> Iranga Muthuthanthri
> (M) -0777-255773
> Team Product Management
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


 --

 Best Regards,

 Malaka Silva
 Senior Tech Lead
 M: +94 777 219 791
 Tel : 94 11 214 5345
 Fax :94 11 2145300
 Skype : malaka.sampath.silva
 LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
 Blog : http://mrmalakasilva.blogspot.com/

 WSO2, Inc.
 lean . enterprise . middleware
 http://www.wso2.com/
 http://www.wso2.com/about/team/malaka-silva/
 
 https://store.wso2.com/store/

 Save a tree -Conserve nature & Save the world for your future. Print
 this email only if it is absolutely necessary.

>>>
>>>
>>>
>>> --
>>> Thanks & Regards
>>>
>>> Iranga Muthuthanthri
>>> (M) -0777-255773
>>> Team Product Management
>>>
>>>
>>
>>
>> --
>> Viraj Rajaguru
>> Associate Technical Lead
>> WSO2 Inc. : http://wso2.com
>>
>> Mobile: +94 77 3683068
>>
>>
>>
>>
>
>
> --
> Thank you and Best Regards,
> Chanaka Fernando
> Senior Technical Lead
> WSO2, Inc.; http://wso2.com
> lean.enterprise.middleware
>
> mobile: +94 773337238
> Blog : http://soatutorials.blogspot.com
> LinkedIn:http://www.linkedin.com/pub/chanaka-fernando/19/a20/5b0
> Twitter:https://twitter.com/chanakaudaya
>
>
>
>
>


-- 
*Isuru Udana*
Technical Lead
WSO2 Inc.; http://wso2.com
email: isu...@wso2.com cell: +94 77 3791887
blog: http://mytecheye.blogspot.com/
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [ESB Tooling] Can we activate "event statistics" on global level?

[Chanaka Fernando]

Hi Viraj,

The configuration we have in the synapse.properties file is to globally
enable/disable the statistics/tracing for the server. By enabling that, we
prepare the server to publish events to DAS server. But, if you need to
publish real events, you need to enable them in individual artifacts
(proxy, api, sequence, etc). Iranga's suggestion is to provide a global
parameter to enable/disable them all at once (per CAPP or at global level).
This is a valid requirement which a particular user might have.

This will require a considerable effort to support in the current model and
we will not be able to support in the upcoming ESB 5.0.0 version.

@Iranga: Please create a public JIRA and we will fix this in a future
release.

Thanks,
Chanaka

On Wed, Jun 22, 2016 at 12:38 PM, Viraj Rajaguru  wrote:

> Hi Iranga,
>
> IIUC, requirement is to setting a global level setting with CAR files to
> enable event statistics publishing. As per this document[1], we need to set
> a property in synapse.properties file + relevant config changes in artifact
> files to enable statistics publishing. With CAR files we are not modifying
> config files such as synapse.properties. So how can we achieve this?
>
> Thanks,
> Viraj.
>
> [1] -
> https://docs.wso2.com/display/ESB500/Prerequisites+to+Publish+Statistics
>
> On Fri, Apr 29, 2016 at 12:12 PM, Iranga Muthuthanthri 
> wrote:
>
>>
>>
>> On Fri, Apr 29, 2016 at 11:35 AM, Malaka Silva  wrote:
>>
>>> +1 and it make sense to do it since we are having the
>>> a separate analytics server for ESB.
>>>
>>> Iranga when you say global do you mean for a CAPP or for the complete
>>> deployment? I think you are referring to the second option.
>>>
>>
>> Global setting -Having it at complete deployment  , having it at the
>> C-App level  would also be a useful option as well IMO
>>
>>>
>>> On Fri, Apr 29, 2016 at 11:20 AM, Iranga Muthuthanthri 
>>> wrote:
>>>
 Hi All,

 When creating a C-App to publish event statistics to ESB Analytics we
 have to enable event statistics for each configuration ( proxy service,
 API,) , would there be an option to set this at a global level?

 --
 Thanks & Regards

 Iranga Muthuthanthri
 (M) -0777-255773
 Team Product Management


 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev


>>>
>>>
>>> --
>>>
>>> Best Regards,
>>>
>>> Malaka Silva
>>> Senior Tech Lead
>>> M: +94 777 219 791
>>> Tel : 94 11 214 5345
>>> Fax :94 11 2145300
>>> Skype : malaka.sampath.silva
>>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
>>> Blog : http://mrmalakasilva.blogspot.com/
>>>
>>> WSO2, Inc.
>>> lean . enterprise . middleware
>>> http://www.wso2.com/
>>> http://www.wso2.com/about/team/malaka-silva/
>>> 
>>> https://store.wso2.com/store/
>>>
>>> Save a tree -Conserve nature & Save the world for your future. Print
>>> this email only if it is absolutely necessary.
>>>
>>
>>
>>
>> --
>> Thanks & Regards
>>
>> Iranga Muthuthanthri
>> (M) -0777-255773
>> Team Product Management
>>
>>
>
>
> --
> Viraj Rajaguru
> Associate Technical Lead
> WSO2 Inc. : http://wso2.com
>
> Mobile: +94 77 3683068
>
>
>
>


-- 
Thank you and Best Regards,
Chanaka Fernando
Senior Technical Lead
WSO2, Inc.; http://wso2.com
lean.enterprise.middleware

mobile: +94 773337238
Blog : http://soatutorials.blogspot.com
LinkedIn:http://www.linkedin.com/pub/chanaka-fernando/19/a20/5b0
Twitter:https://twitter.com/chanakaudaya
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

[Asantha Thilina]

Hi Tharindu,

I have finished the case insensitive user operations as well and i added
selenium test scripts for those implemented functions to my repo[1] except
delete function all the other functions with test script added to my repo[1]

[1] https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Fri, Jun 17, 2016 at 2:28 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> sure i'll be look forward for the hangout
>
> Thanks,
> Asantha
>
> On Fri, Jun 17, 2016 at 2:22 AM, Tharindu Edirisinghe 
> wrote:
>
>> Hi Asantha,
>>
>> I will go through the docs and provide feedback soon. Let's have a
>> hangout session to discuss the pending issues.
>>
>> I'm available today 9.00 P.M IST for a google hangout.
>>
>> Thanks,
>> TharinduE
>>
>> On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have prepared the user guide[1] and administrator guide[2] in google
>>> doc since all tasks are not finished yet i have only added the tasks i have
>>> already done and there is still the developer guide has to be prepare i
>>> will prepare it as sooner as well
>>>
>>> [1]
>>> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
>>> [2]
>>> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 sure i will prepare those documents sooner

 Thanks,
 Asantha

 On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Excellent work Asantha !
>
> Meanwhile you can prepare a document also adding the screenshots you
> have got. Basically we will need following documentation.
>
> 1. Developer Guide ( The architecture of the userstoremanager,
> diagrams of all the collections, how they are related to each other etc.)
>
> 2. Administrator Guide (How to guide a server administrator to setup a
> secondary userstore with mongodb)
>
> 3. User Guide (All the functionality of the userstoremanager, i.e each
> function in RemoteUserStoreManager with sample SOAP requests and 
> responses)
>
> We will need to look at the QA aspect of the project also.. but let's
> keep aside for the moment until we get all the functionality working.
>
> Thanks for all the hard work !
>
> Best Regards,
> Tharindu Edirisinghe
>
> On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> as you advice me i added soap ui screen shots of test result and
>> selenium script for implemented functions into my repository[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> i updated my blog[1] with all the works i have done so far there i
>>> added all the methods and their use in MongoDBUserStoreManager ,
>>> hopes your feedback
>>> [1] http://asanthamax.blogspot.com/
>>> Thanks,
>>> Asantha
>>>
>>> On Sun, Jun 12, 2016 at 2:11 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 i have solved the login issue for registered users in my mongodb
 user store. after compare my implementation with JDBCUserStoreManager i
 realized that i would gone through the wrong path by implementing
 UserStoreManager so i changed it by extending AbstractUserStoreManager
 instead of UserStoreManager thereafter most of the issues i have faced
 being resolved now it can add new users,roles and assign users to roles
 ,roles to users can change user profile claim values and also 
 registered
 users can successfully logged into IS still the delete part has to be
 implemented and i will prepare a test scripts for my already 
 implemented
 working parts sooner and from implemented modules only issue i'm 
 facing at
 the moment is i can't decrypt the salted password of MongoDB server
 configuration in user store property xml file
 And also I need some advice from you to how i can improve the
 security of my query parameters in MongoDB
 i updated all my works in my repository[1]

 [1]https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> sorry for the delay i have updated my blog today and i'm 

Re: [Dev] [ESB Tooling] Can we activate "event statistics" on global level?

[Viraj Rajaguru]

Hi Iranga,

IIUC, requirement is to setting a global level setting with CAR files to
enable event statistics publishing. As per this document[1], we need to set
a property in synapse.properties file + relevant config changes in artifact
files to enable statistics publishing. With CAR files we are not modifying
config files such as synapse.properties. So how can we achieve this?

Thanks,
Viraj.

[1] -
https://docs.wso2.com/display/ESB500/Prerequisites+to+Publish+Statistics

On Fri, Apr 29, 2016 at 12:12 PM, Iranga Muthuthanthri 
wrote:

>
>
> On Fri, Apr 29, 2016 at 11:35 AM, Malaka Silva  wrote:
>
>> +1 and it make sense to do it since we are having the
>> a separate analytics server for ESB.
>>
>> Iranga when you say global do you mean for a CAPP or for the complete
>> deployment? I think you are referring to the second option.
>>
>
> Global setting -Having it at complete deployment  , having it at the C-App
> level  would also be a useful option as well IMO
>
>>
>> On Fri, Apr 29, 2016 at 11:20 AM, Iranga Muthuthanthri 
>> wrote:
>>
>>> Hi All,
>>>
>>> When creating a C-App to publish event statistics to ESB Analytics we
>>> have to enable event statistics for each configuration ( proxy service,
>>> API,) , would there be an option to set this at a global level?
>>>
>>> --
>>> Thanks & Regards
>>>
>>> Iranga Muthuthanthri
>>> (M) -0777-255773
>>> Team Product Management
>>>
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>>
>> Best Regards,
>>
>> Malaka Silva
>> Senior Tech Lead
>> M: +94 777 219 791
>> Tel : 94 11 214 5345
>> Fax :94 11 2145300
>> Skype : malaka.sampath.silva
>> LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77
>> Blog : http://mrmalakasilva.blogspot.com/
>>
>> WSO2, Inc.
>> lean . enterprise . middleware
>> http://www.wso2.com/
>> http://www.wso2.com/about/team/malaka-silva/
>> 
>> https://store.wso2.com/store/
>>
>> Save a tree -Conserve nature & Save the world for your future. Print this
>> email only if it is absolutely necessary.
>>
>
>
>
> --
> Thanks & Regards
>
> Iranga Muthuthanthri
> (M) -0777-255773
> Team Product Management
>
>


-- 
Viraj Rajaguru
Associate Technical Lead
WSO2 Inc. : http://wso2.com

Mobile: +94 77 3683068
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] APIM 2.0.0-SNAPSHOT Nightly build - 17/06/2016

[Fazlan Nazeem]

Hi Shavantha,

Noted. We will remove the stat dbscripts from the pack, so that there will
be less confusion.

On Wed, Jun 22, 2016 at 11:45 AM, Shavantha Weerasinghe 
wrote:

> Hi All
>
> The  scripts related to the stat db for the analytic server for which
> until the 17th June release we had to manually source the script. However,
> upon manually sourcing we came across[1]. We were lated updated that the
> script will be sourced when -Dsetup is run and manual sourcing is not
> necessary.
>
> We were unable to find any details on the read-me file as well
>
> Appreciate if this type changes can be communicated with the release pack
> in future to avoid delays in setup
>
> [1]https://wso2.org/jira/browse/ANLYAPIM-71
>
> regards,
> Shavantha Weerasinghe
> Senior Software Engineer QA
> WSO2, Inc.
> lean.enterprise.middleware.
> http://wso2.com
> http://wso2.org
> Tel : 94 11 214 5345
> Fax :94 11 2145300
>
>
> On Fri, Jun 17, 2016 at 10:20 PM, Nirmal Fernando  wrote:
>
>> Please find the API-M analytics pack
>> https://wso2.org/jenkins/job/analytics-apim/173/org.wso2.analytics.apim$wso2analytics-apim/artifact/org.wso2.analytics.apim/wso2analytics-apim/1.0.0-SNAPSHOT/wso2analytics-apim-1.0.0-SNAPSHOT.zip
>>
>> On Fri, Jun 17, 2016 at 10:07 PM, Bhathiya Jayasekara 
>> wrote:
>>
>>>
>>> Hi all,
>>>
>>> Please find today's nightly builds.
>>>
>>> APIM 2.0.0 SNAPSHOT[1], P2 repo[2] and IS 5.2.0 SNAPSHOT[3].
>>>
>>> [1]
>>> https://svn.wso2.org/repos/wso2/scratch/2016/apim-2.0.0/wso2am-2.0.0-SNAPSHOT-17-06-2016.zip
>>> [2]
>>> https://svn.wso2.org/repos/wso2/scratch/2016/apim-2.0.0/p2-repos/17-06-2016/p2-repo.zip
>>> [3]
>>> http://maven.wso2.org/nexus/content/repositories/snapshots/org/wso2/is/wso2is/5.2.0-SNAPSHOT/wso2is-5.2.0-20160617.023441-125.zip
>>>
>>> Thanks,
>>>
>>> --
>>> *Bhathiya Jayasekara*
>>> *Senior Software Engineer,*
>>> *WSO2 inc., http://wso2.com *
>>>
>>> *Phone: +94715478185 <%2B94715478185>*
>>> *LinkedIn: http://www.linkedin.com/in/bhathiyaj
>>> *
>>> *Twitter: https://twitter.com/bhathiyax *
>>> *Blog: http://movingaheadblog.blogspot.com
>>> *
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>>
>> Thanks & regards,
>> Nirmal
>>
>> Team Lead - WSO2 Machine Learner
>> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
>> Mobile: +94715779733
>> Blog: http://nirmalfdo.blogspot.com/
>>
>>
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>


-- 
Thanks & Regards,

Fazlan Nazeem

*Software Engineer*

*WSO2 Inc*
Mobile : +94772338839
<%2B94%20%280%29%20773%20451194>
fazl...@wso2.com
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Fwd: GSOC2016: [ML][CEP] Predictive analytic with online data for WSO2 Machine Learner

[Mahesh Dananjaya]

Hi Maheshakya,
can i give external data sources like data from database , data from HDFS
to generate events in the cep event simulator rather than giving a file. i
saw "Switch to upload file for simulation" in the input Data By Data Source
in  the event simulator. How can i feed data real time from other sources
or directly as data generating from remote server as JSON or etc... What
format the database should be.This is just for my knowledge.thank you.
regards,
Mahesh.

On Wed, Jun 22, 2016 at 10:59 AM, Mahesh Dananjaya <
dananjayamah...@gmail.com> wrote:

> Hi Nirmal,
> *This is what i have done so far in the GSOC2016,*
>
>- prior research before SGD (Stochastic Gradient Descent) optimization
>techniques and mini-batch processing
>- Getting familiar and writing extensions to siddhi
>- Wrote a Stream Processor extensions for streaming application and
>machine learning algorithms (Linear Regression,KMeans & Logistic 
> Regression)
>- Developed a Streaming Linear Regression class for periodically
>retrain models as mini batch processing with SGD
>- Extend the functionality for Moving Window Mini Batch Processing
>with SGD providing windowShift which control data horizon and data
>obsolescences
>- Performance evaluation of the implementation
>- Adding Streaming Linear Regression class and Stream Processor
>extension to carbon-ml
>
>
> *As a next step,*
>
>- Adding Persisting temporal models for applications such as prediction
>- complete Streaming Kmeans clustering and Logistic Regression classes
>- Improve batching and streaming mechanisms
>- improve visualization(optional)
>- and writing examples and documentation
>
> regards,
>
> Mahesh.
>
> On Wed, Jun 22, 2016 at 10:28 AM, Maheshakya Wijewardena <
> mahesha...@wso2.com> wrote:
>
>> Sorry, you need to put the returned values of the function into the
>> output stream
>>
>> from LinRegInput#ml:streamlinreg(1, 2, 4, 100, 0.0001, 1.0, 0.95,
>> salary, rbi, walks, strikeouts, errors)
>>
>>
>>
>> *select mseinsert into LinregOutput;*
>> or
>>
>> from LinRegInput#ml:streamlinreg(1, 2, 4, 100, 0.0001, 1.0, 0.95,
>> salary, rbi, walks, strikeouts, errors)
>> select *
>> insert into LinregOutput;
>>
>> where LinregOutput stream definition contains all attributes: mse,
>> intercept, beta1, 
>>
>> On Wed, Jun 22, 2016 at 10:24 AM, Maheshakya Wijewardena <
>> mahesha...@wso2.com> wrote:
>>
>>> Hi Mahesh,
>>>
>>> In your output stream, you need to list all the attributes that are
>>> returned from the streamlinreg function: mse, intercept, beta1, 
>>> Can you try that?
>>>
>>> On Wed, Jun 22, 2016 at 10:06 AM, Mahesh Dananjaya <
>>> dananjayamah...@gmail.com> wrote:
>>>
 Hi Maheshakya,
 This is the full query i used.

 @Import('LinRegInput:1.0.0')

 define stream LinRegInput (salary double, rbi double, walks double,
 strikeouts double, errors double);

 @Export('LinRegOutput:1.0.0')

 define stream LinregOutput (mse double);

 from LinRegInput#ml:streamlinreg(1, 2, 4, 100, 0.0001, 1.0, 0.95,
 salary, rbi, walks, strikeouts, errors)

 select *
 insert into mse;

 but i am sending [mse,intercept,beta1betap] as a outputData
 Object[]. SO how can i publish all these infomation on event publisher.
 regards,
 Mahesh.

 On Tue, Jun 21, 2016 at 6:10 PM, Nirmal Fernando 
 wrote:

> Hi Mahesh,
>
> Can you summarize the work we have done so far and the remaining work
> items please?
>
> Thanks.
>
> On Tue, Jun 21, 2016 at 5:56 PM, Mahesh Dananjaya <
> dananjayamah...@gmail.com> wrote:
>
>> Hi Maheshakya,
>> I have updated the repo [2] and upto date documents can be found at
>> [1].thank you.
>> regards,
>> Mahesh.
>> [1]
>> https://github.com/dananjayamahesh/GSOC2016/tree/master/gsoc/siddhi/extension/streaming
>> [2]
>> https://github.com/dananjayamahesh/carbon-ml/tree/wso2_gsoc_ml6_cml
>>
>>
>> On Tue, Jun 21, 2016 at 5:08 PM, Mahesh Dananjaya <
>> dananjayamah...@gmail.com> wrote:
>>
>>>
>>> -- Forwarded message --
>>> From: Mahesh Dananjaya 
>>> Date: Tue, Jun 21, 2016 at 5:08 PM
>>> Subject: Re: [Dev] Fwd: GSOC2016: [ML][CEP] Predictive analytic with
>>> online data for WSO2 Machine Learner
>>> To: Maheshakya Wijewardena 
>>>
>>>
>>> Hi Maheshakya,
>>> new query is like this adding spport for moving window methods.
>>>
>>>
>>> @Import('LinRegInput:1.0.1')
>>> define stream LinRegInput (salary double, rbi double, walks double,
>>> strikeouts double, errors double);
>>>
>>> @Export('LinRegOutput:1.0.1')
>>> define stream LinRegOutput (mse double);
>>>
>>> from LinRegInput#ml:streamlinreg(1, 2, 4, 100, 0.0001, 1.0,

[Dev] [GSoC Dockerfiles]

[Abhishek Tiwari]

Dear Mentors,

Following is the github repository for Dockerfiles integration test
framework. Comments/Thoughts/Scolds are always welcome.

https://github.com/abhishek0198/test-framework

Thanks,
Abhishek
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] APIM 2.0.0-SNAPSHOT Nightly build - 17/06/2016

[Shavantha Weerasinghe]

Hi All

The  scripts related to the stat db for the analytic server for which until
the 17th June release we had to manually source the script. However, upon
manually sourcing we came across[1]. We were lated updated that the script
will be sourced when -Dsetup is run and manual sourcing is not necessary.

We were unable to find any details on the read-me file as well

Appreciate if this type changes can be communicated with the release pack
in future to avoid delays in setup

[1]https://wso2.org/jira/browse/ANLYAPIM-71

regards,
Shavantha Weerasinghe
Senior Software Engineer QA
WSO2, Inc.
lean.enterprise.middleware.
http://wso2.com
http://wso2.org
Tel : 94 11 214 5345
Fax :94 11 2145300


On Fri, Jun 17, 2016 at 10:20 PM, Nirmal Fernando  wrote:

> Please find the API-M analytics pack
> https://wso2.org/jenkins/job/analytics-apim/173/org.wso2.analytics.apim$wso2analytics-apim/artifact/org.wso2.analytics.apim/wso2analytics-apim/1.0.0-SNAPSHOT/wso2analytics-apim-1.0.0-SNAPSHOT.zip
>
> On Fri, Jun 17, 2016 at 10:07 PM, Bhathiya Jayasekara 
> wrote:
>
>>
>> Hi all,
>>
>> Please find today's nightly builds.
>>
>> APIM 2.0.0 SNAPSHOT[1], P2 repo[2] and IS 5.2.0 SNAPSHOT[3].
>>
>> [1]
>> https://svn.wso2.org/repos/wso2/scratch/2016/apim-2.0.0/wso2am-2.0.0-SNAPSHOT-17-06-2016.zip
>> [2]
>> https://svn.wso2.org/repos/wso2/scratch/2016/apim-2.0.0/p2-repos/17-06-2016/p2-repo.zip
>> [3]
>> http://maven.wso2.org/nexus/content/repositories/snapshots/org/wso2/is/wso2is/5.2.0-SNAPSHOT/wso2is-5.2.0-20160617.023441-125.zip
>>
>> Thanks,
>>
>> --
>> *Bhathiya Jayasekara*
>> *Senior Software Engineer,*
>> *WSO2 inc., http://wso2.com *
>>
>> *Phone: +94715478185 <%2B94715478185>*
>> *LinkedIn: http://www.linkedin.com/in/bhathiyaj
>> *
>> *Twitter: https://twitter.com/bhathiyax *
>> *Blog: http://movingaheadblog.blogspot.com
>> *
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
>
> Thanks & regards,
> Nirmal
>
> Team Lead - WSO2 Machine Learner
> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
> Mobile: +94715779733
> Blog: http://nirmalfdo.blogspot.com/
>
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [GSOC 16] Initial Project Progress

[Osura Rathnayake]

Hi Isuru,

Thank you very much for the feedback.
I updated the snapshot dependency with a released version. Also I made it
use Jackson to parse the API responses using bean classes. And I properly
formatted the code as well. Exceptions handling is still on the way.
Sure will have a code review this week.


On Tue, Jun 21, 2016 at 10:18 AM, Isuru Haththotuwa  wrote:

> Hi Osura,
>
> I went through the code at [1] briefly. Some general comments:
>
>- The code is not properly formatted
>- The code has a SNAPSHOT dependency for org.wso2.carbon.utils. If you
>do not have a specific reason to do so, its better to use a released
>version.
>- To parse the responses from the rest API, you are directly
>manipulating JSON objects. Have a look at the Kubernetes Membership Scheme.
>Its using Jackson to parse the API responses using bean classes. This would
>be much easier than directly interacting with JSON structures. Or else, you
>can use Netflix Feign as a REST API client [2], in which the amount of code
>you have to write is very less.
>- System.exit(1) is used in few places to handle error scenarios,
>which is wrong. Please use a proper Exception for the purpose
>
> Noted that you have updated the README file, which is great. Lets have a
> code review this week to go through the functional aspects at a more fine
> grained level.
>
> [1]. https://github.com/osuran/azure-membership-scheme.git
>
> [2]. https://github.com/Netflix/feign
>
> On Thu, Jun 16, 2016 at 11:23 AM, Osura Rathnayake 
> wrote:
>
>> Hi Isuru,
>>
>> That's great, will do the demo at 3 o'clock in the evening today.
>> thanks
>>
>> On Thu, Jun 16, 2016 at 11:21 AM, Isuru Haththotuwa 
>> wrote:
>>
>>>
>>>
>>> On Thu, Jun 16, 2016 at 11:10 AM, Osura Rathnayake 
>>> wrote:
>>>
 Hi Mentors,

 Thank you for the update.
 Yes I can demonstrate it anytime today.

>>> Great! Shall we have a hangout at 3.00 PM? The main purpose would be to
>>> demonstrate the membership scheme functionality with a carbon cluster
>>> deployed in Azure.
>>>


 thanks

 On Thu, Jun 16, 2016 at 10:11 AM, Isuru Haththotuwa 
 wrote:

> Hi Osura,
>
> Would you be able to demonstrate the functionality of the membership
> scheme today?
>
> Also, please keep an eye on the timeline for the project [1], as the
> midterm evaluations will be starting on 20th.
>
> [1]. https://developers.google.com/open-source/gsoc/timeline
>
> On Thu, Jun 16, 2016 at 6:46 AM, Imesh Gunaratne 
> wrote:
>
>>
>>
>> On Wed, Jun 15, 2016 at 2:46 PM, Osura Rathnayake > > wrote:
>>
>>> Hi Mentors,
>>>
>>> As we discussed at the very beginning, next in line is to see how
>>> each of the following can be setup on Azure using native features:
>>>
>>>- Auto healing
>>>- Autoscaling
>>>- Dynamic load balancing
>>>- Centralized logging
>>>- Monitoring
>>>- Metering
>>>
>>> For auto healing, we can implement it in both VM level and
>>> application level. In VM level, we can poll for VM statuses and check 
>>> if a
>>> given VM is down or not. And then we can up them if they have gone down,
>>> using api calls. for application level of course we will have to run a
>>> shell script to determine the status of a given application and will 
>>> have
>>> to up it accordingly. I'm looking forward to hear from you regarding 
>>> this.
>>>
>>
>> ​No, auto healing and autoscaling should be handled by Azure. We
>> might not need to write code to handle that.
>>
>> Thanks​
>>
>>
>>>
>>> thanks,
>>>
>>> On Mon, Jun 13, 2016 at 10:53 AM, Osura Rathnayake <
>>> osura...@gmail.com> wrote:
>>>
 Hi Isuru,

 Can you please tell me when you would be free to have a hangout to
 do a code review and discuss next project goals?

 Thanks,

 On Saturday, June 11, 2016, Osura Rathnayake 
 wrote:

> Hi Isuru,
>
> Thank you very much.
> Yes there was a misconfiguration in registry mounts and now it
> works properly.
> Okay will have a code review next week.
>
>
> On Fri, Jun 10, 2016 at 9:45 AM, Isuru Haththotuwa <
> isu...@wso2.com> wrote:
>
>> Hi Osura,
>>
>> This is great progress! This shows that a clustered deployment of
>> WSO2 products on Azure is possible with this membership scheme.
>>
>> About the error, what is says is that a particular resource that
>> the first node is expecting to find in the config registry is not 
>> found.

Re: [Dev] ESB Analytics for MT scenarios?

[Selvaratnam Uthaiyashankar]

On Tue, Jun 21, 2016 at 11:31 AM, Buddhima Wijeweera 
wrote:

> Hi,
>
> At the moment ESB can publish tenant-wise. I tried it with a latest ESB
> and following are the steps need to follow:
> 1. Enable statistics for global level.
> 2. Add eventpublisher & eventstream files to tenant's deployment folder
>

Who has to deploy this? Tenant or Super tenant? how do we deploy this in
cloud setup? Do we have UI for this?





> 3. Create a proxy (or API, inbound EP) and Enable Statistics.
> 4. Send messages to proxy
>
> Depending on the tenant credentials in eventpublisher files(at point 2
> above), statistics  get published to analytics-esb server. (for this
> testing I published to super-tenant of analytics-esb).
>

Also, if point 2 above has to be done by the tenant, tenant will not know
super tenant credentials to send events.



>
> Thanks,
>
> On Tue, Jun 21, 2016 at 9:37 AM, Srinath Perera  wrote:
>
>> We had a chat about this.
>>
>> This is supported. However, current implementation will run spark jobs
>> per each tenant. So it will have performance concerns with a large number
>> of tenants.
>>
>> Anjana, can you give the details and potential solutions?
>>
>> Summary is that DAS team has implemented the support for reading tenant
>> data from super tenant so we can run a one Spark Job for all tenants. But
>> we will need to change the queries and figure out how tenant dashboards can
>> get access to results in super tenant's space.
>>
>> Can we do a 5.1 addressing this?
>>
>> --Srinath
>>
>> On Tue, Jun 21, 2016 at 9:15 AM, Kasun Indrasiri  wrote:
>>
>>> Please note that this will be an essential feature for our integration
>>> cloud. So, we need to decide how should we proceed with this soon.
>>>
>>> On Fri, Jun 17, 2016 at 1:57 AM, Kasun Indrasiri  wrote:
>>>
 How about the $subject? I don't think there's no any limitation from
 the mediation engine side on collecting these stats. We need to have this
 for ESB 5.

 --
 Kasun Indrasiri
 Software Architect
 WSO2, Inc.; http://wso2.com
 lean.enterprise.middleware

 cell: +94 77 556 5206
 Blog : http://kasunpanorama.blogspot.com/

>>>
>>>
>>>
>>> --
>>> Kasun Indrasiri
>>> Software Architect
>>> WSO2, Inc.; http://wso2.com
>>> lean.enterprise.middleware
>>>
>>> cell: +94 77 556 5206
>>> Blog : http://kasunpanorama.blogspot.com/
>>>
>>
>>
>>
>> --
>> 
>> Srinath Perera, Ph.D.
>>http://people.apache.org/~hemapani/
>>http://srinathsview.blogspot.com/
>>
>
>
>
> --
> Buddhima Wijeweera
> Software Engineer; WSO2 Inc.; http://wso2.com ,
>
> Mobile: +94 71 427 9966
> Email: buddh...@wso2.com
> Blog:   https://buddhimawijeweera.wordpress.com
> GitHub Profile: https://github.com/Buddhima
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
S.Uthaiyashankar
VP Engineering
WSO2 Inc.
http://wso2.com/ - "lean . enterprise . middleware"

Phone: +94 714897591
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [PET] [ESB] Empty body in response causes error with ESB 5.0.0-BETA

[Vivekananthan Sivanayagam]

Hi,

I am also getting the same error while running integration test for
outlookMail connector. please find the log in [1].

[1]

[2016-06-22 11:25:14,837]  INFO
{org.wso2.carbon.automation.core.PlatformTestManager} -  Running the test
method ---
org.wso2.carbon.connector.integration.test.outlookmail.OutLookMailConnectorIntegrationTest.testGetFolderWithNegativeCase

[2016-06-22 11:25:14,869]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,869] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"POST /services/outlookmail HTTP/1.1[\r][\n]"
[2016-06-22 11:25:14,869]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,869] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"Action: urn:getFolder[\r][\n]"
[2016-06-22 11:25:14,869]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,869] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"Accept-Charset: UTF-8[\r][\n]"
[2016-06-22 11:25:14,869]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,869] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"Accept: application/json[\r][\n]"
[2016-06-22 11:25:14,870]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,869] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"Content-Type: application/json[\r][\n]"
[2016-06-22 11:25:14,870]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,870] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"User-Agent: Java/1.7.0_79[\r][\n]"
[2016-06-22 11:25:14,870]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,870] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"Host: localhost:8280[\r][\n]"
[2016-06-22 11:25:14,870]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,870] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"Connection: keep-alive[\r][\n]"
[2016-06-22 11:25:14,870]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,870] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"Content-Length: 1068[\r][\n]"
[2016-06-22 11:25:14,870]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,870] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"[\r][\n]"
[2016-06-22 11:25:14,870]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,870] DEBUG - wire HTTP-Listener I/O dispatcher-1 >>
"{[\n]"
[2016-06-22 11:25:14,870]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,870] DEBUG - wire HTTP-Listener I/O dispatcher-1 >> "
 "apiUrl":"https://outlook.office.com/api",[\n];
[2016-06-22 11:25:14,871]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,871] DEBUG - wire HTTP-Listener I/O dispatcher-1 >> "
 
"refreshToken":"AAABiL9Kn2Z27UubvWFPbm0gLY_U_UGIN46r7zSSoqXcjmlZ_TjD8u_NSBxtEfBf2hya6XKqTuqMh9UO2DN72KK7wy4dUmKfOgFjJHS9Mc7drpqhfdMfdXTLs-Np_3yf0SXRzBg5m2ZA8Lx14pfq44IIugJepF5VQCrqZkA4AXqjoofIsKMI5x_yrx9STeWJDavLlErlHlFRzpJiO-JQYIVZG-z_vcuwjtZ1C4C-k42erDgeffSJA_SvFVAaTyLOgzFPnDEvYCLz5uIekaCQ9_xdsuORl76x0gVHEvQ3fyyeGDudPD6AHXiXQ3jIC3t6TPIAuszR3ut_8tf4Sn9d3eHbGKeLQe8S-oUko_aZGdtX_eDAR4o0YfLlluQr4WMKyl-6pKzplC9tZigxH1M6MXkfDubT6D8-GYDhSbfgH7oK_TGAJKkoiWcwS0gUpQ9_HpCpUJgpe6c-9nzjdaMIF_EBrZzVdKio3smKM4RMMV4T1cGR6Ev4zdvNE3PWAQzLjq8gX8D3qzm--NV97yFbA04TqENmNAg-wc4iT5P4Y06vhHrpXFHc9-zg1qzBNhUSXmFkTKhGiPhv3_QnGWerGgW1CTGdUnPAkA5KyWoGB4G5MN7EB0n5hzQ90OpNkrFxziIRs1_69poJtSETPXsd7cW0GI1TwNnAOuGD9fzEtsmW9TkgAA",[\n]"
[2016-06-22 11:25:14,871]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,871] DEBUG - wire HTTP-Listener I/O dispatcher-1 >> "
 "clientSecret":"w5BaTTc9FqpcUVvIhRhFkRQTVNN2YLWf+mwj3Mh86aI=",[\n]"
[2016-06-22 11:25:14,871]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,871] DEBUG - wire HTTP-Listener I/O dispatcher-1 >> "
 "clientId":"D42620b8-6d8a-47cb-843d-e798f193535f",[\n]"
[2016-06-22 11:25:14,871]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,871] DEBUG - wire HTTP-Listener I/O dispatcher-1 >> "
 "resource":"https://outlook.office.com/",[\n];
[2016-06-22 11:25:14,871]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,871] DEBUG - wire HTTP-Listener I/O dispatcher-1 >> "
 "redirectUri":"https://www.vive.viveSL.onmicrosoft.com",[\n];
[2016-06-22 11:25:14,871]  INFO
{org.wso2.carbon.automation.core.utils.coreutils.InputStreamHandler} -
 [2016-06-22 11:25:14,871] DEBUG - wire HTTP-Listener I/O dispatcher-1 >> "
 "registryPath":"",[\n]"
[2016-06-22 11:25:14,871]  INFO

Re: [Dev] Upgrading the guava version of carbon-commons

[Niranda Perera]

Hi Rasika,

I'm afraid we have exhausted all of the OSGI options before coming into
this conclusion. We are unable to limit this by the OSGI version ranges,
because the tomcat bundle has dynamic imports by default, and therefore, we
can not predict to which version, the tomcat bundle would get wired to.

Hence we have decided to remove all the other versions of guava and bump
all the dependencies to the latest.

Best

On Wed, Jun 22, 2016 at 11:00 AM, Rasika Perera  wrote:

> Hi Niranda,
>
> So, it was decided to bring all the guava versions to a common version,
>> platform wide
>
> IMO making a library version, a platform common version is not practical.
> Can't we use OSGi version ranges to solve this problem?
>
> 
> com.google.common.*;version="[13.0, 19)"
> 
>
> I have created a JIRA to upgrade the guava versions in carbon-commons from
>> 13.0.1 to v19 which is the latest.
>
> ​+1 for upgrading into latest.
>
> Thanks​
>
> On Tue, Jun 21, 2016 at 5:40 PM, Niranda Perera  wrote:
>
>> Hi all,
>>
>> In the current carbon server runtime, there are multiple guava versions.
>> But this creates some issues, expecially when using a guava library is
>> accessed in webapps (directly/ indirectly) [1], [2]
>>
>> So, it was decided to bring all the guava versions to a common version,
>> platform wide. I have created a JIRA to upgrade the guava versions in
>> carbon-commons from 13.0.1 to v19 which is the latest. [3]. Please find the
>> PR here [4]
>>
>> Could you please review the PR and merge it?
>>
>> Best
>>
>> [1] [Dev] [OSGI] 'Package uses conflict' when using multiple versions of
>> the same bundle
>> [2] [Dev] Integrating ML features in DAS
>> [3] https://wso2.org/jira/browse/CCOMMONS-17
>> [4] https://github.com/wso2/carbon-commons/pull/227
>>
>> --
>> *Niranda Perera*
>> Software Engineer, WSO2 Inc.
>> Mobile: +94-71-554-8430
>> Twitter: @n1r44 
>> https://pythagoreanscript.wordpress.com/
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> With Regards,
>
> *Rasika Perera*
> Software Engineer
> M: +94 71 680 9060 E: rasi...@wso2.com
> LinkedIn: http://lk.linkedin.com/in/rasika90
>
> WSO2 Inc. www.wso2.com
> lean.enterprise.middleware
>



-- 
*Niranda Perera*
Software Engineer, WSO2 Inc.
Mobile: +94-71-554-8430
Twitter: @n1r44 
https://pythagoreanscript.wordpress.com/
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev