Re: [Dev] [Architecture] Binding access token to the browser for new IAM Portal Applications

[Dinali Dabarera]

Hi Thanuja,

Thank you for the quick update.



On Wed, Mar 25, 2020 at 12:03 PM Thanuja Jayasinghe 
wrote:

> Hi Dinali,
>
> Please refer "Access Token Binding Type" row in [1].
>
> [1]
> https://is.docs.wso2.com/en/5.10.0/learn/configuring-oauth2-openid-connect-single-sign-on/
>
> Thanks,
> Thanuja
>
> On Tue, Mar 24, 2020 at 8:40 PM Dinali Dabarera  wrote:
>
>> Hi all,
>>
>> Do we have an official public documents related to this approach,  the
>> token binding mechanism used and other information?
>>
>> Thank you!
>> Dinali
>>
>> On Wed, Nov 20, 2019 at 7:55 PM Janak Amarasena  wrote:
>>
>>> Hi All,
>>>
>>> Currently, there is an OAuth2 Spec[1] under development with the key
>>> intention of sender-constraining OAuth 2.0 tokens via a proof-of-possession
>>> mechanism. Few takeaways from that which we could also use.
>>> We could introduce a new *token_type*[2] (like
>>> token_type=bound+cookie) for the cookie bound access token instead of the
>>> current bearer token as these tokens should be processed in a different way
>>> than the normal bearer tokens.
>>> Also if the service provider supports multiple token types we can let
>>> the application request a token type it wants by indicating it in some
>>> parameter when the application initiates a token requesting flow.
>>>
>>> [1] - https://tools.ietf.org/html/draft-fett-oauth-dpop
>>> [2] - https://tools.ietf.org/html/rfc6749#section-7.1
>>>
>>> Best Regards,
>>> Janak
>>>
>>> On Thu, Oct 31, 2019 at 9:42 AM Johann Nallathamby 
>>> wrote:
>>>
>>>> Hi Darshana,
>>>>
>>>> On Sat, Sep 28, 2019 at 8:29 PM Darshana Gunawardana 
>>>> wrote:
>>>>
>>>>> Hi Johann,
>>>>>
>>>>> On Sat, Sep 21, 2019 at 10:43 AM Johann Nallathamby 
>>>>> wrote:
>>>>>
>>>>>> Hi Thanuja,
>>>>>>
>>>>>> Did we consider sending the access token itself as a secure,
>>>>>> http-only cookie to the browser instead of binding it to a separate 
>>>>>> cookie?
>>>>>> This will also simplify the development on the client side, in case 
>>>>>> someone
>>>>>> wants to build their own SPA.
>>>>>>
>>>>>
>>>>> Here which domain you assumed that the cookie will be set to?
>>>>>
>>>>
>>>> I meant to the IS server domain which is the domain where the APIs are
>>>> hosted.
>>>>
>>>>
>>>>>
>>>>> Assuming it the client's domain, there are two limitations.
>>>>>
>>>>>1. Setting the token as a cookie is an additional task that client
>>>>>had to do since OP (in this case IS) cannot set cookies for some 
>>>>> external
>>>>>client domain.
>>>>>2. Having the token stored in http-only cookie block accessing
>>>>>it's from client-side scripts, which is a main blocker for SPAs.
>>>>>
>>>>>
>>>> Not client domain.
>>>>
>>>>
>>>>>
>>>>> Assuming it the server-side domain and assuming you want to
>>>>> automatically handle authorization for the API based on the access token
>>>>> that already present in the cookie, there are two concerns,
>>>>>
>>>>>1. This will open up CSRF vulnerability as any malicious client
>>>>>running on the same browser can also access APIs successfully.
>>>>>
>>>>> Yes, your approach will prevent CSRF as well. +1.
>>>>
>>>>>
>>>>>1. If the API gateway handling authorization in back-channel mode,
>>>>>   1. The cookie has to set to the API gateway's domain
>>>>>   2. API gateway has to do an additional non-standard way of
>>>>>   handing this cookie and attach it to the authorization header.
>>>>>
>>>>> Yes, this is a possibility. But I wasn't proposing it in this case.
>>>>
>>>> Thanks for the clarification.
>>>>
>>>> Regards,
>>>> Johann.
>>>>
>>>>
>>>>>
>>>>> Thanks,
>>>>>
>>>>>>
>>>>>> Regards,
>>>>>> Johann.
>

Re: [Dev] [Architecture] Binding access token to the browser for new IAM Portal Applications

[Dinali Dabarera]

Hi all,

Do we have an official public documents related to this approach,  the
token binding mechanism used and other information?

Thank you!
Dinali

On Wed, Nov 20, 2019 at 7:55 PM Janak Amarasena  wrote:

> Hi All,
>
> Currently, there is an OAuth2 Spec[1] under development with the key
> intention of sender-constraining OAuth 2.0 tokens via a proof-of-possession
> mechanism. Few takeaways from that which we could also use.
> We could introduce a new *token_type*[2] (like
> token_type=bound+cookie) for the cookie bound access token instead of the
> current bearer token as these tokens should be processed in a different way
> than the normal bearer tokens.
> Also if the service provider supports multiple token types we can let the
> application request a token type it wants by indicating it in some
> parameter when the application initiates a token requesting flow.
>
> [1] - https://tools.ietf.org/html/draft-fett-oauth-dpop
> [2] - https://tools.ietf.org/html/rfc6749#section-7.1
>
> Best Regards,
> Janak
>
> On Thu, Oct 31, 2019 at 9:42 AM Johann Nallathamby 
> wrote:
>
>> Hi Darshana,
>>
>> On Sat, Sep 28, 2019 at 8:29 PM Darshana Gunawardana 
>> wrote:
>>
>>> Hi Johann,
>>>
>>> On Sat, Sep 21, 2019 at 10:43 AM Johann Nallathamby 
>>> wrote:
>>>
 Hi Thanuja,

 Did we consider sending the access token itself as a secure, http-only
 cookie to the browser instead of binding it to a separate cookie? This will
 also simplify the development on the client side, in case someone wants to
 build their own SPA.

>>>
>>> Here which domain you assumed that the cookie will be set to?
>>>
>>
>> I meant to the IS server domain which is the domain where the APIs are
>> hosted.
>>
>>
>>>
>>> Assuming it the client's domain, there are two limitations.
>>>
>>>1. Setting the token as a cookie is an additional task that client
>>>had to do since OP (in this case IS) cannot set cookies for some external
>>>client domain.
>>>2. Having the token stored in http-only cookie block accessing it's
>>>from client-side scripts, which is a main blocker for SPAs.
>>>
>>>
>> Not client domain.
>>
>>
>>>
>>> Assuming it the server-side domain and assuming you want to
>>> automatically handle authorization for the API based on the access token
>>> that already present in the cookie, there are two concerns,
>>>
>>>1. This will open up CSRF vulnerability as any malicious client
>>>running on the same browser can also access APIs successfully.
>>>
>>> Yes, your approach will prevent CSRF as well. +1.
>>
>>>
>>>1. If the API gateway handling authorization in back-channel mode,
>>>   1. The cookie has to set to the API gateway's domain
>>>   2. API gateway has to do an additional non-standard way of
>>>   handing this cookie and attach it to the authorization header.
>>>
>>> Yes, this is a possibility. But I wasn't proposing it in this case.
>>
>> Thanks for the clarification.
>>
>> Regards,
>> Johann.
>>
>>
>>>
>>> Thanks,
>>>

 Regards,
 Johann.

 On Mon, Sep 2, 2019 at 12:26 PM Thanuja Jayasinghe 
 wrote:

> Hi All,
>
> With the introduction of new IAM portal applications, there is a
> requirement to provide additional security measures to secure these SPAs.
> We have already implemented the OAuth2 authorization code flow(public
> client) with PKCE for these applications and with this feature, it will be
> possible to bind the access token to the browser instance. So, an
> additional security measure will be enforced as the combination of the
> access token and browser token(cookie) validated while accessing the IS
> APIs.
> Support for configuring this option using OAuth2 application
> configuration and browser token persistence will be added as well.
>
> Updated request/response flow is as follows,
> [image: Blank Diagram (1).png]
>
> Thanks,
> Thanuja
>
> --
> *Thanuja Lakmal*
> Technical Lead
> WSO2 Inc. http://wso2.com/
> *lean.enterprise.middleware*
> Mobile: +94715979891
>


 --
 *Johann Dilantha Nallathamby* | Associate Director/Solutions Architect
 | WSO2 Inc.
 (m) +94 (77) 7776950 | (w) +94 (11) 2145345 | (e) joh...@wso2.com
 [image: Signature.jpg]
 ___
 Dev mailing list
 Dev@wso2.org
 http://wso2.org/cgi-bin/mailman/listinfo/dev

>>>
>>>
>>> --
>>> Regards,
>>>
>>>
>>> *Darshana Gunawardana*Technical Lead
>>> WSO2 Inc.; http://wso2.com
>>>
>>> *E-mail: darsh...@wso2.com *
>>> *Mobile: +94718566859*Lean . Enterprise . Middleware
>>>
>>
>>
>> --
>> *Johann Dilantha Nallathamby* | Associate Director/Solutions Architect |
>> WSO2 Inc.
>> (m) +94 (77) 7776950 | (w) +94 (11) 2145345 | (e) joh...@wso2.com
>> [image: Signature.jpg]
>> ___
>> Architecture mailing list
>> architect...@wso2.org
>> 

Re: [Dev] WSO2 Identity Server Entitlement API - Add Policy Question

[Dinali Dabarera]

Hi Jojo,

*addPoli*cy is a void method[1]. Hence you can expect only following
success SOAP response as the output.

http://schemas.xmlsoap.org/soap/envelope/;>
  http://org.apache.axis2/xsd;> http://www.w3.org/2001/XMLSchema-instance"/>



If this policy is not added successfully It will give an error as shown below.

Error scenario 1: Duplicate policy


http://schemas.xmlsoap.org/soap/envelope/;>
   
  
 soapenv:Server
 An Entitlement Policy with the given Id already
exists
 
http://org.apache.axis2/xsd;>
   http://org.apache.axis2/xsd;
xmlns:ax2344="http://dto.entitlement.identity.carbon.wso2.org/xsd;
xmlns:ax2346="http://entitlement.identity.carbon.wso2.org/xsd;
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;>
  An Entitlement Policy with the given
Id already exists
   

 
  
   


Error scenario 2: Invalid policy

http://schemas.xmlsoap.org/soap/envelope/;>
   
  
 soapenv:Server
 Invalid Entitlement Policy. Policy is not valid
according to XACML schema
 
http://org.apache.axis2/xsd;>
   http://org.apache.axis2/xsd;
xmlns:ax2344="http://dto.entitlement.identity.carbon.wso2.org/xsd;
xmlns:ax2346="http://entitlement.identity.carbon.wso2.org/xsd;
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;>
  Invalid Entitlement Policy. Policy
is not valid according to XACML schema
   

 
  
   


Furthermore, you can do a getPolicy to  double check if you want.
Hope this is what you are looking for. Please let me know if you need
further assistance on this


[1]
https://github.com/wso2/carbon-identity-framework/blob/326c0f808a5d64b59cf9e7489a09a935b1c7a8f1/components/entitlement/org.wso2.carbon.identity.entitlement/src/main/java/org/wso2/carbon/identity/entitlement/EntitlementPolicyAdminService.java#L75

Thank you,
Dinali



On Thu, Nov 21, 2019 at 12:00 PM Jojo Paderes 
wrote:

> Hi,
>
> I'm reading through the documentation of WSO2 Identity Server's
> Entitlement API on how to use the SOAP web service API for adding an
> entitlement policy:
>
> https://is.docs.wso2.com/en/5.9.0/develop/entitlement-with-apis/
>
> From the WSDL reosurce provided in the document, I can see that the
> addPolicy XSD element is present:
>
> 
> 
> 
>  type="ax2346:PolicyDTO"/>
> 
> 
> 
>
> but I couldn't find the schema element for the addPolicyResponse. Without
> this information the web service client is unable to understand the web
> service response for adding a policy.
>
> My question is where I can find the XSD element for the addPolicyResponse?
>
>
> Thanks!
>
> - Jojo
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>


-- 
*Dinali Rosemin Dabarera*
Senior Software Engineer
IAM Domain
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Rest API] [User Management] Profile support for user management Rest API

[Dinali Dabarera]

Hi Ruwan,

Multiple user profiles are only supported in JDBC user stores.

If a user needs to manage his user details for public and private he can
have two different profiles. For example, home profile which store personal
data (home email, home mobile, home address, etc)and wso2 profiles which
store wso2 details wso2 email, wso2 mobile, etc. We can view all the user
profile names of a user and We can view user details based on the user
profile.

They are no many customers who use this multiple profile at the moment. One
of our leading customer too uses different profiles for tenants when a
tenant is created. Also applications like uber can have many profiles,
hence this can be a valid reason as well.

As per my findings, the main target of having profiles is to support
multi-profile requirement of a user.

Thanks and regards,
Dinali








On Thu, Aug 15, 2019 at 12:30 PM Ruwan Abeykoon  wrote:

> Hi Dinali,
> Can we list down the functionalities of the "user profile", and what it is
> used for at current product versions. Then we can see what are our options.
>
> Cheers,
> Ruwan A
>
> On Thu, Aug 15, 2019 at 11:49 AM Dinali Dabarera  wrote:
>
>> Hi all,
>>
>> Currently, we have RemoteUserStoreManagerService for user management
>> purposes as a SOAP service. As a REST API, we use SCIM API for the user
>> management applications. We do support multiple profiles per user.
>>
>> But in RemoteUserStoreManagement Service we have a method   called
>> "getAllProfileNames" which return all authenticated users'  profile names.
>> Furthermore, below API methods too use *profile* as an optional
>> parameter.
>> getUserClaimValues(String userName, String profileName)
>> getUserClaimValue(String userName, String claim, String profileName)
>> getUserList(String claimUri, String claimValue, String profile)
>> getUserClaimValuesForClaims(String userName, String[] claims, String
>> profileName)
>>
>>
>> But if we are planing to deprecate this *RemoteUserStoreManagerService *in
>> our future releases we can only use SCIM as the Rest API for user
>> management applucations. We can do almost all the actions in
>> RemoteUserStoreManagerService using SCIM API, except Profile details. SCIM
>> does not support user profiles at the moment.
>>
>> We have below concerns regarding "user profiles", in our future releases.
>>
>>- Are we still support user profiles in our future releases?
>>- If we are not supporting, what do we do to customers who will
>>migrate to our future releases? Are we thinking of any other alternative
>>for profiles?
>>-  If we support profiles, Shall we create a new Rest API for profile
>>management? or Shall we introduce new meta data for the current SCIM API
>>request and responses?
>>
>>
>> Your  feedback on this is highly appreciated?
>>
>> Thank you!
>> Dinali
>>
>> --
>> *Dinali Rosemin Dabarera*
>> Senior Software Engineer
>> IAM Domain
>> WSO2 Lanka (pvt) Ltd.
>> Web: http://wso2.com/
>> Email : gdrdabar...@gmail.com
>> LinkedIn <https://lk.linkedin.com/in/dinalidabarera>
>> Mobile: +94770198933
>>
>>
>>
>>
>> <https://lk.linkedin.com/in/dinalidabarera>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>
> --
> Ruwan Abeykoon | Director/Architect | WSO2 Inc.
> (w) +947435800  | Email: ruw...@wso2.com
>
>

-- 
*Dinali Rosemin Dabarera*
Senior Software Engineer
IAM Domain
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn <https://lk.linkedin.com/in/dinalidabarera>
Mobile: +94770198933




<https://lk.linkedin.com/in/dinalidabarera>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [Rest API] [User Management] Profile support for user management Rest API

[Dinali Dabarera]

Hi all,

Currently, we have RemoteUserStoreManagerService for user management
purposes as a SOAP service. As a REST API, we use SCIM API for the user
management applications. We do support multiple profiles per user.

But in RemoteUserStoreManagement Service we have a method   called
"getAllProfileNames" which return all authenticated users'  profile names.
Furthermore, below API methods too use *profile* as an optional parameter.
getUserClaimValues(String userName, String profileName)
getUserClaimValue(String userName, String claim, String profileName)
getUserList(String claimUri, String claimValue, String profile)
getUserClaimValuesForClaims(String userName, String[] claims, String
profileName)


But if we are planing to deprecate this *RemoteUserStoreManagerService *in
our future releases we can only use SCIM as the Rest API for user
management applucations. We can do almost all the actions in
RemoteUserStoreManagerService using SCIM API, except Profile details. SCIM
does not support user profiles at the moment.

We have below concerns regarding "user profiles", in our future releases.

   - Are we still support user profiles in our future releases?
   - If we are not supporting, what do we do to customers who will migrate
   to our future releases? Are we thinking of any other alternative for
   profiles?
   -  If we support profiles, Shall we create a new Rest API for profile
   management? or Shall we introduce new meta data for the current SCIM API
   request and responses?


Your  feedback on this is highly appreciated?

Thank you!
Dinali

-- 
*Dinali Rosemin Dabarera*
Senior Software Engineer
IAM Domain
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] XACML regex function usage.

[Dinali Dabarera]

Yes, the regex should be as follows,

This is a sample condition i did. Your curly brackets cause the issue. It's
good you figure it out.


 
http://www.w3.org/2001/XMLSchema#string;>^([a-zA-Z0-9_.-])+@test.nihr.ac.uk

   http://wso2.org/identity/user/username;
Category="http://wso2.org/identity/user;
DataType="http://www.w3.org/2001/XMLSchema#string;
MustBePresent="true">

 
  



On Fri, Sep 28, 2018 at 7:21 AM Rajith Siriwardena  wrote:

> I was able to fix this by writing the condition as follows
>
>
>   
>  
>  FunctionId="urn:oasis:names:tc:xacml:1.0:function:string-regexp-match">
> http://www.w3.org/2001/XMLSchema#string;>^manager_.*$
> http://wso2.org/claims/role;
> Category="urn:oasis:names:tc:xacml:1.0:subject-category:access-subject"
> DataType="http://www.w3.org/2001/XMLSchema#string;
> MustBePresent="true">
>  
>   
>
>
> Thanks @Godwin Shrimal 
>
> [1] http://xacmlinfo.org/2013/09/02/how-write-xacml-policies-1/
>
> On Fri, Sep 28, 2018 at 10:05 AM Rajith Siriwardena 
> wrote:
>
>> + Dev
>>
>> On Fri, Sep 28, 2018 at 9:41 AM Rajith Siriwardena 
>> wrote:
>>
>>> Hi
>>>
>>> I'm getting the following error when I try to apply a regex function to
>>> an XACML policy.
>>>
>>> Policy
>>>
>>> -
>>> *>> PolicyId="authn_bank_admin_role_based_policy_template"
>>> RuleCombiningAlgId="urn:oasis:names:tc:xacml:1.0:rule-combining-algorithm:first-applicable"
>>> Version="1.0">*
>>> *   This policy is for role based authentication for
>>> managers*
>>> *   *
>>> *  *
>>> * *
>>> *>> MatchId="urn:oasis:names:tc:xacml:1.0:function:string-equal">*
>>> *   >> DataType="http://www.w3.org/2001/XMLSchema#string
>>> ">saml2-web-app-dispatch.com
>>> *
>>> *   >> AttributeId="http://wso2.org/identity/sp/sp-name
>>> "
>>> Category="http://wso2.org/identity/sp "
>>> DataType="http://www.w3.org/2001/XMLSchema#string
>>> "
>>> MustBePresent="false">*
>>> **
>>> *>> MatchId="urn:oasis:names:tc:xacml:1.0:function:string-equal">*
>>> *   >> DataType="http://www.w3.org/2001/XMLSchema#string
>>> ">authenticate*
>>> *   >> AttributeId="http://wso2.org/identity/identity-action/action-name
>>> "
>>> Category="http://wso2.org/identity/identity-action
>>> "
>>> DataType="http://www.w3.org/2001/XMLSchema#string
>>> "
>>> MustBePresent="false">*
>>> **
>>> * *
>>> *  *
>>> *   *
>>> *   *
>>> *  *
>>> * >> FunctionId="urn:oasis:names:tc:xacml:1.0:function:string-regexp-match">*
>>> *>> DataType="http://www.w3.org/2001/XMLSchema#string
>>> ">{ ^manager_.*$
>>> }*
>>> *>> AttributeId="http://wso2.org/claims/role "
>>> Category="urn:oasis:names:tc:xacml:1.0:subject-category:access-subject"
>>> DataType="http://www.w3.org/2001/XMLSchema#string
>>> "
>>> MustBePresent="true">*
>>> * *
>>> *  *
>>> *   *
>>> *   *
>>> * *
>>>
>>> --
>>>
>>> Error log
>>>
>>> [2018-09-28 09:32:20,260] ERROR
>>> {org.wso2.carbon.identity.entitlement.pap.PAPPolicyReader} -  Error while
>>> parsing the policy
>>> java.lang.IllegalArgumentException: illegal parameter
>>> at org.wso2.balana.cond.FunctionBase.checkInputs(FunctionBase.java:380)
>>> at org.wso2.balana.cond.Apply.(Apply.java:89)
>>> at org.wso2.balana.cond.Apply.getInstance(Apply.java:227)
>>> at org.wso2.balana.cond.Apply.getInstance(Apply.java:188)
>>> at
>>> org.wso2.balana.cond.ExpressionHandler.parseExpression(ExpressionHandler.java:53)
>>> at org.wso2.balana.cond.Condition.getInstance(Condition.java:177)
>>> at org.wso2.balana.Rule.getInstance(Rule.java:237)
>>> at org.wso2.balana.Policy.(Policy.java:303)
>>> at org.wso2.balana.Policy.getInstance(Policy.java:382)
>>> at
>>> org.wso2.carbon.identity.entitlement.pap.PAPPolicyReader.handleDocument(PAPPolicyReader.java:158)
>>> at
>>> org.wso2.carbon.identity.entitlement.pap.PAPPolicyReader.getPolicy(PAPPolicyReader.java:119)
>>> at
>>> org.wso2.carbon.identity.entitlement.EntitlementPolicyAdminService.addOrUpdatePolicy(EntitlementPolicyAdminService.java:741)
>>> at
>>> org.wso2.carbon.identity.entitlement.EntitlementPolicyAdminService.updatePolicy(EntitlementPolicyAdminService.java:170)
>>> at sun.reflect.GeneratedMethodAccessor254.invoke(Unknown Source)
>>> at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at 

[Dev] WSO2 Identity Server Samples 2.0.0 Released!

[Dinali Dabarera]

Hi all,


We are pleased to announce the release of WSO2 Identity Server Samples 2.0.0


The IS-QSG will demonstrate the key functionalities of the identity server
that are mentioned below.


   -   Configuring Single-Sign-On with SAML2
   -   Configuring Single-Sign-On with OIDC
   -   Configuring Multi-Factor Authentication
   -   Configuring Twitter as a Federated Authenticator
   -   Setting up Self-Signup
   -   Creating a workflow

Quick Start Guide now available at
*https://docs.wso2.com/display/IS570/Quick+Start+Guide
*


This also contains new SSO samples for SAML and OIDC with new UI.





*Implementation: - https://github.com/wso2/samples-is/tree/master
*
*Artifacts:*

*Please find the artifacts required to run the quick start guide in the
links given below.*

   -  IAM Quick Start Guide -
   https://github.com/wso2/samples-is/releases/tag/v2.0.0


*This release fixes the following issues:*

   -

   2.0.0-GA fixes
   
   -

   *2.0.0-M3 fixes
   *
   -

   2.0.0-M2 fixes
   

   -

   2.0.0-M1 fixes 


*Reporting Issues:*
We encourage you to report issues, improvements, and feature requests
regarding
Samples-IS
through our public
Samples-IS-GIT Issues .


~ The WSO2 Identity and Access Management Team ~

-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [VOTE] Release WSO2 Identity Server 5.7.0 RC3

[Dinali Dabarera]

Hi all,

I have tested the below in H2 DB and no issues were found.

   - XACML multi-decision profile (JSON/XML format)
   - Add a policy, update policy, publish policy, publish again by updating.
   - Add email templates.
   - Adding consent purposes and Consent management during JIT provisioning.
   - Add user, role, update permissions like basic user management
   scenarios.

[+] Stable - Go ahead and release

Thanks,
Dinali

On Thu, Sep 13, 2018 at 7:09 PM Senthalan Kanagalingam 
wrote:

> Hi all,
>
>
> We are pleased to announce the third release candidate of WSO2 Identity
> Server 5.7.0.
>
>
> This release fixes the following issues,
>
>-
>
>5.7.0-RC2 fixes
>
>-
>
>5.7.0-RC1 fixes
>
>-
>
>5.7.0-Beta2 fixes
>
>-
>
>5.7.0-Beta fixes
>
>-
>
>5.7.0-Alpha3 fixes
>
>-
>
>5.7.0-Alpha2 fixes
>
>-
>
>5.7.0-Alpha fixes
>
>-
>
>5.7.0-M5 fixes
>
>-
>
>5.7.0-M4 fixes
>
>-
>
>5.7.0-M3 fixes
>
>-
>
>5.7.0-M2 fixes
>
>-
>
>5.7.0-M1 fixes
>
>
>
> Source and distribution,
>
>
>Runtime - https://github.com/wso2/product-is/releases/v5.7.0-rc3
>
>
>
> Please download, test the product and vote.
>
>
>[+] Stable - go ahead and release
>
>[-] Broken - do not release (explain why)
>
>
>
> Thanks,
>
> - WSO2 Identity and Access Management Team -
> --
>
> *Senthalan Kanagalingam*
> *Software Engineer - WSO2 Inc.*
> *Mobile : +94 (0) 77 18 77 466*
> 
>


-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [VOTE] Release WSO2 Identity Server 5.7.0 RC2

[Dinali Dabarera]

Hi,

I have tested the following in H2 DB and no issues were found.

   - XACML multi-decision profile JSON/XML format
   - Add a policy, update policy, publish policy, publish again by updating.
   - Add email templates.
   - Adding consent purposes and Consent management during JIT provisioning.

[+] Stable - Go ahead and release

Thanks,
Dinali

On Wed, Sep 12, 2018 at 7:49 PM Maduranga Siriwardena 
wrote:

> Hi,
>
> I have tested following and no issues were found.
>
>- Import and export service provider.
>- Adaptive authentication with,
>- role based template.
>   - user age based template.
>
> [+] Stable - go ahead and release
>
> Thanks,
> Maduranga.
>
> On Wed, Sep 12, 2018 at 4:23 PM Senthalan Kanagalingam 
> wrote:
>
>> Hi all,
>>
>>
>> We are pleased to announce the second release candidate of WSO2 Identity
>> Server 5.7.0.
>>
>>
>> This release fixes the following issues,
>>
>>-
>>
>>5.7.0-RC2 fixes
>>
>>-
>>
>>5.7.0-RC1 fixes
>>
>>-
>>
>>5.7.0-Beta2 fixes
>>
>>-
>>
>>5.7.0-Beta fixes
>>
>>-
>>
>>5.7.0-Alpha3 fixes
>>
>>-
>>
>>5.7.0-Alpha2 fixes
>>
>>-
>>
>>5.7.0-Alpha fixes
>>
>>-
>>
>>5.7.0-M5 fixes
>>
>>-
>>
>>5.7.0-M4 fixes
>>
>>-
>>
>>5.7.0-M3 fixes
>>
>>-
>>
>>5.7.0-M2 fixes
>>
>>-
>>
>>5.7.0-M1 fixes
>>
>>
>>
>> Source and distribution,
>>
>>
>>Runtime - https://github.com/wso2/product-is/releases/v5.7.0-rc2
>>
>>
>>
>> Please download, test the product and vote.
>>
>>
>>[+] Stable - go ahead and release
>>
>>[-] Broken - do not release (explain why)
>>
>>
>>
>> Thanks,
>>
>> - WSO2 Identity and Access Management Team -
>> --
>>
>> *Senthalan Kanagalingam*
>> *Software Engineer - WSO2 Inc.*
>> *Mobile : +94 (0) 77 18 77 466*
>> 
>>
>
>
> --
> Maduranga Siriwardena
> Associated Technical Lead
> WSO2 Inc; http://wso2.com/
>
> Email: madura...@wso2.com
> Mobile: +94718990591
> Blog: *https://madurangasiriwardena.wordpress.com/
> *
> 
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>


-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Architecture] [VOTE] Release WSO2 Identity Server 5.5.0 RC2

[Dinali Dabarera]

Hi All,

I tested the Tested Below scenario on the IS 5.5.0-RC2 pack.

   - DCR for in carbon supper and tenant domain.
   - Authorization code grant flow using play ground
   - What happened when an un-ticked flow tried.
   - Introspection


+1 to go ahead with the release

On Thu, Mar 15, 2018 at 9:38 AM, Nipuni Bhagya  wrote:

> Hi all,
>
> I tested the IS 5.5.0-RC2 pack with IAM- Quick Start Guide which covers
> the following scenarios.
>
>
>- Configuring Single-Sign-On with SAML2
>- Configuring Single-Sign-On with OIDC
>- Configuring Multi-Factor Authentication (with Twitter as the second
>authentication factor.)
>- Configuring Twitter as a Federated Authenticator
>- Setting up Self-Signup
>- Creating a workflow
>
> +1 to go ahead and release.
>
>
> On Thu, Mar 15, 2018 at 8:16 AM, Nuwandi Wickramasinghe  > wrote:
>
>> Hi,
>>
>> Tested Below scenario on the IS 5.5.0-RC2 pack.
>>
>>- User creation in primary/secondary user stores.
>>- Saml service provider creation manually, with metadata file and
>>with url.
>>- Entitlement policy creation and publishing.
>>- Service provider access control using entitlement policy.
>>
>> +1 to go ahead and release.
>>
>> On Thu, Mar 15, 2018 at 5:19 AM, Darshana Gunawardana 
>> wrote:
>>
>>> Hi all,
>>>
>>> We are pleased to announce the second release candidate of WSO2 Identity
>>> Server 5.5.0.
>>>
>>> This release fixes the following issues,
>>>
>>>-
>>>- 5.5.0-RC2 fixes
>>>
>>> 
>>>- 5.5.0-RC1 fixes
>>>
>>> 
>>>- 5.5.0-Beta fixes
>>>
>>> 
>>>- 5.5.0-Alpha3 fixes
>>>
>>> 
>>>- 5.5.0-Alpha2 fixes
>>>
>>> 
>>>- 5.5.0-Alpha fixes
>>>
>>> 
>>>- 5.5.0-M4 fixes
>>>
>>> 
>>>- 5.5.0-M3 fixes
>>>
>>> 
>>>- 5.5.0-M2 fixes
>>>
>>> 
>>>- 5.5.0-M1 fixes
>>>
>>> 
>>>
>>>
>>> Source and distribution
>>>
>>> Runtime - https://github.com/wso2/product-is/releases/v5.5.0-rc2
>>> Analytics - https://github.com/wso2/analytics-is/releases/v5.5.0-rc2
>>>
>>>
>>> Please download, test the product and vote.
>>>
>>> [+] Stable - go ahead and release
>>> [-] Broken - do not release (explain why)
>>>
>>>
>>> Thanks,
>>> - WSO2 Identity and Access Management Team -
>>>
>>> --
>>> Regards,
>>>
>>>
>>> *Darshana Gunawardana*Technical Lead
>>> WSO2 Inc.; http://wso2.com
>>>
>>> *E-mail: darsh...@wso2.com *
>>> *Mobile: +94718566859 <+94%2071%20856%206859>*Lean . Enterprise .
>>> Middleware
>>>
>>
>>
>>
>> --
>>
>> Best Regards,
>>
>> Nuwandi Wickramasinghe
>>
>> Senior Software Engineer
>>
>> WSO2 Inc.
>>
>> Web : http://wso2.com
>>
>> Mobile : 0719214873
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
>
>
>
> *Kind Regards,Nipuni Bhagya*
>
> *Software Engineering Intern*
> *WSO2*
>
>
>
> *Mobile : +94 0779028904 <+94%2077%20767%201807>*
>
> ___
> Architecture mailing list
> architect...@wso2.org
> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
>
>


-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] WSO2 Identity Server 5.4.1 Update3 Released !!!

[Dinali Dabarera]

[+Dev]

On Thu, Feb 22, 2018 at 8:24 PM, Dinali Dabarera <din...@wso2.com> wrote:

> The WSO2 Identity and Access Management team is pleased to announce the
> release of WSO2 Identity Server 5.4.1 Update3.
> You can build the distribution from the source tag,
>
> Runtime: https://github.com/wso2/product-is/releases/tag/v5.4.1-update3
>
> follow the steps given below.
>
> *Building from the source*
>
>1. Install Java8 or above
>2. Install Apache Maven 3.x.x(https://maven.apache.org/download.cgi#)
>3. Get the source,
>   - For the Runtime: Get a clone from https://github.com/wso2/p
>   roduct-is.git and checkout to v5.4.1-update3 tag or you can
>   directly download the source for the tag from
>   https://github.com/wso2/product-is/releases/tag/v5.4.1-update3
>   <https://github.com/wso2/product-is/releases/tag/v5.4.1-update3>
>4. Run the one of the below maven commands from product-is directory,
>   - *mvn** clean install* (To build the binary and source
>   distributions with the tests)
>   - *mvn** clean install -Dmaven.test.skip=true* (To build the binary
>   and source distributions, without running any of the unit/integration 
> tests)
>5. You can find the wso2is-5.4.1-update3.zip binary distribution in
>product-is/modules/distribution/target directory.
>
> What's new in WSO2 Identity Server 5.4.1 Update3
>
> New Features & Bug Fixes: A list of new features and bug fixes shipped
> with this release can be found here
> <https://github.com/wso2/product-is/milestone/23?closed=1>.
> Download
>
> You can download WSO2 Identity Server 5.4.1 Update3 here
> <https://github.com/wso2/product-is/releases/download/v5.4.1-update3/wso2is-5.4.1-update3.zip>
> .
> Contribute to WSO2 Identity ServerMailing Lists
>
> Join our mailing lists and correspond with the developers directly. We
> also encourage you to take part in discussions related to the product in
> the architecture mailing list. If you have any questions regarding the
> product you can use our StackOverflow forum to raise them as well.
>
>-
>
>Developer List: dev@wso2.org
>-
>
>Architecture List: architect...@wso2.org
>-
>
>User Forum: StackOverflow
><http://stackoverflow.com/questions/tagged/wso2is>
>
> Reporting Issues
>
> We encourage you to report issues, improvements, and feature requests
> regarding WSO2 Identity Server through our public WSO2 Identity Server
> GIT Issues <https://github.com/wso2/product-is/issues>.
>
>
> ~ The WSO2 Identity and Access Management Team ~
>
>
> --
> *Dinali Rosemin Dabarera*
> Software Engineer
> WSO2 Lanka (pvt) Ltd.
> Web: http://wso2.com/
> Email : gdrdabar...@gmail.com
> LinkedIn <https://lk.linkedin.com/in/dinalidabarera>
> Mobile: +94770198933 <+94%2077%20019%208933>
>
>
>
>
> <https://lk.linkedin.com/in/dinalidabarera>
>
>
>
>
>
>
>
>
>
>
>
>
>
>


-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn <https://lk.linkedin.com/in/dinalidabarera>
Mobile: +94770198933




<https://lk.linkedin.com/in/dinalidabarera>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] WSO2 Identity Server 5.4.1 Update2 Released !!!

[Dinali Dabarera]

The WSO2 Identity and Access Management team is pleased to announce the
release of WSO2 Identity Server 5.4.1 Update2.
You can build the distribution from the source tag,

Runtime: https://github.com/ws 
o2/product-is/releases/tag/v5. 4.1-update2


follow the steps given below.

*Building from the source*

   1. Install Java8 or above
   2. Install Apache Maven 3.x.x(https://maven.apache.org/download.cgi#)
   3. Get the source,
  - For the Runtime: Get a clone from https://github.com/wso2/p
  roduct-is.git and checkout to v5.4.1-update2 tag or you can directly
  download the source for the tag from https://github.com/wso2/p
  
  roduct-is/releases/tag/v5.4.1-
  
  update2
  
   4. Run the one of the below maven commands from product-is directory,
  - *mvn** clean install* (To build the binary and source distributions
  with the tests)
  - *mvn** clean install -Dmaven.test.skip=true* (To build the binary
  and source distributions, without running any of the
unit/integration tests)
   5. You can find the wso2is-5.4.1-update2.zip binary distribution in
   product-is/modules/distribution/target directory.

What's new in WSO2 Identity Server 5.4.1 Update2

New Features & Bug Fixes: A list of new features and bug fixes shipped with
this release can be found here
.
Download

You can download WSO2 Identity Server 5.4.1 Update2 here

.
Contribute to WSO2 Identity ServerMailing Lists

Join our mailing lists and correspond with the developers directly. We also
encourage you to take part in discussions related to the product in the
architecture mailing list. If you have any questions regarding the product
you can use our StackOverflow forum to raise them as well.

   -

   Developer List: dev@wso2.org
   -

   Architecture List: architect...@wso2.org
   -

   User Forum: StackOverflow
   

Reporting Issues

We encourage you to report issues, improvements, and feature requests
regarding WSO2 Identity Server through our public WSO2 Identity Server GIT
Issues .


~ The WSO2 Identity and Access Management Team ~


-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933 <+94%2077%20019%208933>





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] How to send subject in a XACML request

[Dinali Dabarera]

Hi Godwin,

When we are sending the Subject in a JSON payload, I figured out it should
be "*AccessSubject*" not Subject.

This is the sample request payload I changed for JSON,

{
"Request": {
 "AccessSubject": {
 "Attribute": [
   {
  "AttributeId":
"urn:oasis:names:tc:xacml:1.0:subject:subject-id",
  "Value": "Andreas"
   }
   ]
  },
"Action": {
"Attribute": [
{
"AttributeId":
"urn:oasis:names:tc:xacml:1.0:action:action-id",
"Value": "read"
}
]
},
"Resource": {
"Attribute": [
{
"AttributeId":
"urn:oasis:names:tc:xacml:1.0:resource:resource-id",
"Value": "http://127.0.0.1/service/very_secure/;
}
]
}
}
}

I will update the doc with these details.


Thanks!

Dinali




On Thu, Nov 2, 2017 at 10:13 AM, Godwin Shrimal <god...@wso2.com> wrote:

> Hi Dinali,
>
> XML request format is clear and I guess we have enough information
> regarding that. I am referring to JSON format on how to send subject.
>
>
> Thanks
> Godwin
>
> On Tue, Oct 31, 2017 at 10:24 PM, Dinali Dabarera <din...@wso2.com> wrote:
>
>> Hi Godwin,
>>
>> As you mentioned in your offline chats, there is no mention about "how to
>> send the subject in the XACML Request" in our Docs.
>>
>> I did a small research on XACML spec and figured out we could send the
>> subject in the XACML request as follows,
>>
>> I changed the sample request on my blog [1] with the Subject attribute as
>> follows
>>
>> Request:
>>
>> > xmlns="urn:oasis:names:tc:xacml:3.0:core:schema:wd-17">
>>  > Category="urn:oasis:names:tc:xacml:3.0:subject-category:access-subject">
>>   > AttributeId="urn:oasis:names:tc:xacml:1.0:subject:subject-id">
>>  > DataType="urn:oasis:names:tc:xacml:1.0:data-type:rfc822Name">b...@simpsons.com
>>   
>>
>> > Category="urn:oasis:names:tc:xacml:3.0:attribute-category:action">
>> > AttributeId="urn:oasis:names:tc:xacml:1.0:action:action-id" 
>> IncludeInResult="false">
>> > DataType="http://www.w3.org/2001/XMLSchema#string;>read
>> 
>> 
>> > Category="urn:oasis:names:tc:xacml:3.0:attribute-category:resource">
>> > AttributeId="urn:oasis:names:tc:xacml:1.0:resource:resource-id" 
>> IncludeInResult="false">
>> > DataType="http://www.w3.org/2001/XMLSchema#string;>http://127.0.0.1/service/very_secure/
>>  
>> 
>> 
>> 
>>
>> I will update XACML docs with this information.
>> Please let me know if you have any concerns on this! I hope this is what
>> you expected.
>>
>> [1] https://medium.com/@gdrdabarera/how-entitlement-management-
>> works-with-rest-api-via-xacml-in-wso2-identity-server-5-3-0-7a60940d040c
>>
>> Thank you!
>> Dinali
>> ​
>> -
>> *Dinali Rosemin Dabarera*
>> Software Engineer
>> WSO2 Lanka (pvt) Ltd.
>> Web: http://wso2.com/
>> Email : gdrdabar...@gmail.com
>> LinkedIn <https://lk.linkedin.com/in/dinalidabarera>
>> Mobile: +94770198933 <+94%2077%20019%208933>
>>
>>
>>
>>
>> <https://lk.linkedin.com/in/dinalidabarera>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>
>
> --
> *Godwin Amila Shrimal*
> Associate Technical Lead
> WSO2 Inc.; http://wso2.com
> lean.enterprise.middleware
>
> mobile: *+94772264165*
> linkedin: *https://www.linkedin.com/in/godwin-amila-2ba26844/
> <https://www.linkedin.com/in/godwin-amila-2ba26844/>*
> twitter: https://twitter.com/godwinamila
> <http://wso2.com/signature>
>



-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn <https://lk.linkedin.com/in/dinalidabarera>
Mobile: +94770198933




<https://lk.linkedin.com/in/dinalidabarera>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] How to send subject in a XACML request

[Dinali Dabarera]

Hi Godwin,

As you mentioned in your offline chats, there is no mention about "how to
send the subject in the XACML Request" in our Docs.

I did a small research on XACML spec and figured out we could send the
subject in the XACML request as follows,

I changed the sample request on my blog [1] with the Subject attribute as
follows

Request:


 
  
 b...@simpsons.com
  
   


http://www.w3.org/2001/XMLSchema#string;>read




http://www.w3.org/2001/XMLSchema#string;>http://127.0.0.1/service/very_secure/





I will update XACML docs with this information.
Please let me know if you have any concerns on this! I hope this is what
you expected.

[1]
https://medium.com/@gdrdabarera/how-entitlement-management-works-with-rest-api-via-xacml-in-wso2-identity-server-5-3-0-7a60940d040c

Thank you!
Dinali
​
-
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] WSO2 Identity Server 5.4.0 Alpha5 Released!

[Dinali Dabarera]

The WSO2 Identity and Access Management team is pleased to announce the
release of WSO2 Identity Server 5.4.0 Alpha5. This distribution can be
downloaded from the following location.

https://github.com/wso2/product-is/releases/tag/v5.4.0-alpha5

The following list contains all the features, improvements, and bug fixes
available with the 5.4.0 Alpha5 release.

Patch

   - [IDENTITY-6482 ] - Issues
   in SCIM user update (PUT)
   - [IDENTITY-6517 ] - When
   adding more that two Destination URLs of residenti IDP in a tenant,
   Destination URLs configured in other tenants get removed from DB

Bug

   - [IDENTITY-6321 ] -
   Incorrect error messages in SCIM 2 exceptions.
   - [IDENTITY-6326 ] - Unable
   to create user with "email verification" and "request password" using SCIM
   - [IDENTITY-6479 ] - Secure
   /scim2/Me POST method by default
   - [IDENTITY-6481 ] - Fix
   issues related to SMS OTP
   - [IDENTITY-6541 ] - SCIM2
   filtering not working when the attribute value has underscore characters
   - [IDENTITY-6554 ] - SCIM2
   /Me GET with OAuth 2 token does not work
   - [IDENTITY-6556 ] -
   Accented characters are not rendered correctly in email templates
   - [IDENTITY-6602 ] - The
   facebook authenticator cannot set the subject claim from idp configuration

Task

   - [IDENTITY-6526 ] - Improve
   unit tests coverage for identity-base
   - [IDENTITY-6530 ] - Improve
   unit tests coverage for identity-local-auth-basicauth repo
   - [IDENTITY-6531 ] - Improve
   unit tests coverage for identity-local-auth-iwa-kerberos repo
   - [IDENTITY-6535 ] - Improve
   unit tests coverage for identity-outbound-auth-facebook repo

Improvement

   - [IDENTITY-5424 ] - Ability
   to Configure Regex Patterns for Callback URLs when working with OIDC
   Session Management



*How To Contribute*
Your feedback is most welcome!
Mailing Lists
Join our mailing list and correspond with the developers directly.

   - Developer List: dev@wso2.org | Subscribe  | Mail
   Archive 
   - User Forum: StackOverflow
   

Reporting Issues
We encourage you to report issues, improvements, and feature requests
regarding WSO2 Identity Server through public WSO2 Identity Server JIRA
.


*~ The WSO2 Identity and Access Management Team ~*


-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] Different token expiration times for different applications on WSO2 IS

[Dinali Dabarera]

Hi,

Currently, we will have this feature in the next milestone release of IS
5.4.0. It is basically a registry-based solution for customizing access
Token expiry time according to the application.
This feature is available in [1].

This is the public Jira for this feature [2]. Still, this is open because
we need to add this to UI

[1]
https://github.com/wso2-extensions/identity-inbound-auth-oauth/commits/v5.4.5
[2] https://wso2.org/jira/browse/IDENTITY-6038

Thank you!
Dinali

On Tue, Jun 27, 2017 at 2:55 AM, Júnior  wrote:

> Hey guys.
>
> I'm new to WSO2 IS. Is there a way to have different token expiration
> times for different applications.
>
> Let say I have a web application and a mobile one.
>
> I need the web app token to expire after a few hours and the mobile app
> token after a set number of days.
>
> Is that possible.
>
> We're using an older version of Identity Server, 5.0.0 SP1.
>
> The token mentioned here is a OAuth token. We are using IS as a OAuth
> Server.
>
> Thanks in advance,
>
> --
> Francisco Ribeiro
> *SCEA|SCJP|SCWCD|IBM Certified SOA Associate*
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Why we use timestampSkew default value as 300 seconds in identity.xml, why not 0 seconds.

[Dinali Dabarera]

Hi All,

In our identity.xml the default timeStampScrew value is used as 300
seconds. Shouldn't this be 0 seconds?

Because when we are getting a token from password grant type again and
again *without a time delay*, the expiry time of the token increases than
its accepted value because of this equation we are using.

expiry time = issuedTimeInMillis + validityPeriodMillis - (System.
currentTimeMillis() - timestampSkew);

Since timestampSkew = 300 seconds, validityPeriodMillis = 3600 seconds,
therefore, expiry time = 3644 seconds which can not be happened.

Therefore, it is better to have the default timeStampScrew value as 0
seconds in order to get correct results.


Thanks!

-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [IDENTITY-5131] A solution for the possible deadlock due to session cleanup task

[Dinali Dabarera]

Hi All,

There is a public issue reported in [3],  due to a deadlock happened in the
long-running scenario.

This deadlock occurs due the time taken by "deleteSTOREOperationsTask"
operation which is responsible for cleaning session data which is scheduled
daily.

We have currently come up with two solutions for this deadlock problem,

   1. *We can add a property like " start-time" in the identity.xml
   file, In code level we can start the cleanup task during an off-peak time.*
   2. *We can create two stored procedures to handle session data cleanup
   tasks and run them as scheduled jobs during the off-peak hours.*

Here both 1 and 2 have advantages and disadvantages.

In a cluster scenario, if we implement *1 *one server should
only run this task.. if all of them run at the same time, there is a chance
for deadlock.
 If we implement *2, *the clean-up is handled by the data
source itself, without interrupting any IS operations.

What will be the best solution, out of 1 and 2 for this deadlock scenario?
Please leave your ideas on this.

[3] https://wso2.org/jira/browse/IDENTITY-5131

Thank you.!

Regards.

-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933 <+94%2077%20019%208933>





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Fwd: [Code Review] [IAM]Username Recovery feature for IS 6.0 M3 :by - din...@wso2.com

[Dinali Dabarera]

Review Notes on username recovery feature.
-- Forwarded message --
From: Review Notes 
Date: Thu, Feb 16, 2017 at 8:47 AM
Subject: [Code Review] [IAM]Username Recovery feature for IS 6.0 M3 :by -
din...@wso2.com
To: din...@wso2.com, omi...@wso2.com, is...@wso2.com, jayan...@wso2.com,
engineer...@wso2.org, aye...@wso2.com, ruw...@wso2.com
Cc: din...@wso2.com


Project

IS 6.0.0
Type

Code Review
Code Contributor

din...@wso2.com
Review Participants

omi...@wso2.com, is...@wso2.com, jayan...@wso2.com
Component/Feature/Patch

Username Recovery feature for IS 6.0 M3
Review Notes

Implementation of NotificationBasedUsernameRecoveryManager class.
Implementation of architectural level logic of finding users that matches
given set of claims in a single domain or across domains.
Sonar/Findbugs code review status

Fix All
Reviewed Date

Tue Feb 14 2017 00:00:00 GMT+0530 (IST)
References (eg. PRs, Docs)

https://github.com/wso2/carbon-identity-mgt/pull/127



-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [Architecture] Username Recovery Feature in IS 6.0.0

[Dinali Dabarera]

Hi Isura,

Sure. We'll add that point on notifying user on different username on some
similar information

Then We'll keep,

   - A global configuration for username recovery in identity.yaml file.

Thanks,

Dina


On Sat, Jan 21, 2017 at 1:35 PM, Isura Karunaratne <is...@wso2.com> wrote:

> Hi Dinali,
>
> On Sat, Jan 21, 2017 at 12:33 PM, Dinali Dabarera <din...@wso2.com> wrote:
>
>> Hi all,
>>
>> We are working on implementing username recovery feature for IS 6.0.0
>>
>> *The admin has to enable the Username Recovery*
>>
>>
>> *When Username Recovery enabled:*
>>
>>- User portal user can click on the forget username option.
>>- The User can enter his details of the default profile.
>>- The System will match the entered details with the claims available
>>and if they matched, the relevant username will email to his email address
>>and prompt a notification saying that an email is sent to his mail.
>>- If it doesn't match, the user will notify telling that relevant
>>user is not registered in the system.
>>
>> We need to inform user, if multiple users matching to the given criteria.
> Then the user can fiill additional details to recover username.
>
>
>> *When Username Recovery is disabled:*
>>
>>- User portal user may not be able to recover his username.
>>- The User needs to contact the admin of the system to recover his
>>username.
>>
>> The admin enables the username recovery in the identity.yaml file for
>> the users in the domain.  Since we have different user stores available in
>> IS 6.0.0,
>>   *Does the admin need to enable username recovery in user store
>> wise or Does he need to configure it for the whole domain at once?*
>>
>>
> We need to have a global configuration identity.yaml file for all the
> domains. It is better to have domain/roles/group wise configuration for all
> the identity managment scenarios like account lock, password policy,
> password recovery, idle account suspenstion, force password reset, user
> onbording with ask paassword.
>
>
> Thanks
> Isura.
>
>>
>> Please provide us your comments on this point.
>>
>> Thanks,
>>
>> Dina.
>> --
>> *Dinali Rosemin Dabarera*
>> Software Engineer
>> WSO2 Lanka (pvt) Ltd.
>> Web: http://wso2.com/
>> Email : gdrdabar...@gmail.com
>> LinkedIn <https://lk.linkedin.com/in/dinalidabarera>
>> Mobile: +94770198933 <+94%2077%20019%208933>
>>
>>
>>
>>
>> <https://lk.linkedin.com/in/dinalidabarera>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> ___
>> Architecture mailing list
>> architect...@wso2.org
>> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
>>
>>
>
> ___
> Architecture mailing list
> architect...@wso2.org
> https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
>
>


-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn <https://lk.linkedin.com/in/dinalidabarera>
Mobile: +94770198933




<https://lk.linkedin.com/in/dinalidabarera>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Username Recovery Feature in IS 6.0.0

[Dinali Dabarera]

Hi all,

We are working on implementing username recovery feature for IS 6.0.0

*The admin has to enable the Username Recovery*


*When Username Recovery enabled:*

   - User portal user can click on the forget username option.
   - The User can enter his details of the default profile.
   - The System will match the entered details with the claims available
   and if they matched, the relevant username will email to his email address
   and prompt a notification saying that an email is sent to his mail.
   - If it doesn't match, the user will notify telling that relevant user
   is not registered in the system.

*When Username Recovery is disabled:*

   - User portal user may not be able to recover his username.
   - The User needs to contact the admin of the system to recover his
   username.

The admin enables the username recovery in the identity.yaml file for the
users in the domain.  Since we have different user stores available in IS
6.0.0,
  *Does the admin need to enable username recovery in user store wise
or Does he need to configure it for the whole domain at once?*


Please provide us your comments on this point.

Thanks,

Dina.
-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933 <+94%2077%20019%208933>





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Fwd: [Code Review] [IAM]Improvement :by - din...@wso2.com, madura...@wso2.com, darsh...@wso2.com, waru...@wso2.com, jayan...@wso2.com

[Dinali Dabarera]

-- Forwarded message --
From: Review Notes 
Date: Fri, Jan 13, 2017 at 9:07 AM
Subject: [Code Review] [IAM]Improvement :by - din...@wso2.com,
madura...@wso2.com,darsh...@wso2.com, waru...@wso2.com, jayan...@wso2.com
To: din...@wso2.com, madura...@wso2.com, darsh...@wso2.com, waru...@wso2.com,
jayan...@wso2.com
Cc: din...@wso2.com, madura...@wso2.com, darsh...@wso2.com, waru...@wso2.com,
jayan...@wso2.com


Project

IS 5.3.0
Type

Code Review
Code Contributor

din...@wso2.com
Review Participants

din...@wso2.com, madura...@wso2.com, darsh...@wso2.com, jayana...@wso2.com
Component/Feature/Patch

Improvement
Review Notes

Improvement for the playground app with form-post response mode
Sonar/Findbugs code review status

Fix All
Reviewed Date

Wed Jan 11 2017 00:00:00 GMT+0530 (IST)
References (eg. PRs, Docs)

https://github.com/wso2/product-is/pull/991



-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [VOTE] Release WSO2 Identity Server 5.3.0- RC3

[Dinali Dabarera]

Hi,
I tested the following on the Identity Server 5.3.0-RC3 pack,

   - Discovery
   - DCR
   - Form Post
   - Introspection
   - SCIM API
   - User Management

Worked fine without any issues.
[+] Stable - go ahead and release

On Fri, Jan 6, 2017 at 10:06 PM, Pulasthi Mahawithana 
wrote:

> Hi All,
>
> This is the 3rd Release Candidate of WSO2 Identity Server 5.3.0.
>
> Please download, test the product and vote. Vote will be open for 72 hours
> or as needed.
>
> This release fixes the following issues:
>
> Runtime : https://wso2.org/jira/issues/?filter=13612
> Analytics : https://wso2.org/jira/issues/?filter=13614
>
> Source and distribution
>
> Run-time : https://github.com/wso2/product-is/releases/tag/v5.3.0-rc3
> Analytics : https://github.com/wso2/analytics-is/releases/tag/v5.
> 3.0-rc3
>
> Please vote as follows.
> [+] Stable - go ahead and release
> [-] Broken - do not release (explain why)
>
> Thanks,
> - WSO2 Identity Server Team -
>
> --
> *Pulasthi Mahawithana*
> Senior Software Engineer
> WSO2 Inc., http://wso2.com/
> Mobile: +94-71-5179022 <+94%2071%20517%209022>
> Blog: http://blog.pulasthi.org
>
> 
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*Dinali Rosemin Dabarera*
Software Engineer
WSO2 Lanka (pvt) Ltd.
Web: http://wso2.com/
Email : gdrdabar...@gmail.com
LinkedIn 
Mobile: +94770198933





___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Fwd: DAS analyticApi gives this error

[Dinali Dabarera]

-- Forwarded message --
From: Dinali Dabarera <din...@wso2.com>
Date: Sun, Mar 13, 2016 at 12:57 PM
Subject: DAS analyticApi gives this error
To: Anjana Fernando <anj...@wso2.com>


Hi,

we get this error at das,
Can not figureout what this tells, Can you help us finding solutions for
this? Can you tell why this happens?



[2016-03-13 07:20:40,801] ERROR
{org.apache.catalina.core.StandardWrapperValve} -  Servlet.service() for
servlet [cxf] in context with path [/analytics] threw exception
java.lang.RuntimeException: org.apache.cxf.interceptor.Fault:
org/wso2/carbon/analytics/api/AnalyticsDataAPI
at
org.apache.cxf.interceptor.AbstractFaultChainInitiatorObserver.onMessage(AbstractFaultChainInitiatorObserver.java:116)
at
org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:336)
at
org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
at
org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:249)
at
org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:248)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:222)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:153)
at
org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:171)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:289)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:214)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:620)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:265)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:613)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at
org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:99)
at
org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47)
at
org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:57)
at
org.wso2.carbon.event.receiver.core.internal.tenantmgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:48)
at
org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47)
at
org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:62)
at
org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:159)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
at
org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:57)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421)
at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1074)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1739)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1698)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.cxf.interceptor.Fault:
org/wso2/carbon/analytics/api/AnalyticsDataAPI
at
org.apache.cxf.service.invoker.AbstractInvoker.createFault(AbstractInvoker.java:170)
at
org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:136)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:204)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:101)
at
org.apache.cxf.interceptor.ServiceInvokerInter

Re: [Dev] Need to use some stop word filtering with NLP

[Dinali Dabarera]

Yasara, This is the list of nouns which I suggest to remove.

realdonaldtrump
donaldtrump
trump
bernie
berniesanders
sanders
ted
tedcruz
cruz
hillary
clinton
hillaryclinton
imwithher
feelthebern
trumpforamerica
hillary2016
bernie2016
trump2016
makeamericagreatagain
election2016
uselection

On Fri, Mar 11, 2016 at 4:49 AM, Srinath Perera <srin...@wso2.com> wrote:

> Please cc a list.
>
> This is a stop words commonly removed.
>
> http://www.ranks.nl/stopwords
>
> Also you need to look at common words that does not help, and remove as
> well (words like you listed).
>
> --Srinath
>
> On Thu, Mar 10, 2016 at 9:43 PM, Yudhanjaya Wijeratne <yudhanj...@wso2.com
> > wrote:
>
>> Guys, also please look at filtering out verbs as we discussed on
>> Wednesday. Currently there are words such as 'From' 'i'M' 'Like' 'That'
>> which add no value.
>> If the Stanford NLP filter is running, please keep only nouns and
>> adjectives and see what we get.
>>
>> Thanks,
>> Yudha
>>
>> On Thu, Mar 10, 2016 at 9:40 PM, Dinali Dabarera <din...@wso2.com> wrote:
>>
>>> Ok :) Then.
>>> Thanks!
>>>
>>> On Thu, Mar 10, 2016 at 8:17 PM, Yasara Dissanayake <yas...@wso2.com>
>>> wrote:
>>>
>>>> even in DAS too :)
>>>>
>>>> On Thu, Mar 10, 2016 at 8:15 PM, Yasara Dissanayake <yas...@wso2.com>
>>>> wrote:
>>>>
>>>>> Dinaly currently NLP has stopped to find those problem in CEP and DAS
>>>>> that tread problem . so please ignore recent data :)
>>>>>
>>>>> On Thu, Mar 10, 2016 at 8:13 PM, Dinali Dabarera <din...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> Sir,
>>>>>>
>>>>>> This is the word cloud we get only after using NLP, But according to
>>>>>> my point of view there are lot of unnecessary words  such as IM, GET,
>>>>>> BERNIE, TEDCRUZ, IMWITHHER, MAKEAMERICAGREATAGAIN, WE, etc..
>>>>>> These words are common and no need to be in the word cloud.
>>>>>>
>>>>>> Therefore what i think is that we need to filter the stop words and
>>>>>> then use NLP , otherwise its useless to keep a wordCloud.
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>> --
>>>>>> Dinali Rosemin
>>>>>> University of Peradeniya (Computer Engineering)
>>>>>> WSO2 Intern
>>>>>> 077-0198933
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>> --
>>> Dinali Rosemin
>>> University of Peradeniya (Computer Engineering)
>>> WSO2 Intern
>>> 077-0198933
>>>
>>
>>
>>
>> --
>> Yudhanjaya Wijeratne
>> Marketing Officer, WSO2 Inc <http://www.wso2.com>
>> +94775496911 | @yudhanjaya
>>
>
>
>
> --
> 
> Blog: http://srinathsview.blogspot.com twitter:@srinath_perera
> Site: http://people.apache.org/~hemapani/
> Photos: http://www.flickr.com/photos/hemapani/
> Phone: 0772360902
>



-- 
Dinali Rosemin
University of Peradeniya (Computer Engineering)
WSO2 Intern
077-0198933
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] US Election 2016 Tweet Analyze System

[Dinali Dabarera]

Ok. I just changed them to console.logs() instead of alerts hoping that it
would be better than alerts.

On Mon, Mar 7, 2016 at 9:29 AM, Kavith Lokuhewage <kav...@wso2.com> wrote:

> Ok. Just one small suggestion - it would be better if we can use bootstrap
> alerts instead of pure js alert popups to display these messages - if these
> errors will be there in future as well and is meant to be displayed to the
> user. Otherwise we can simply ignore the alert popup.
>
> Thanks,
>
> On Sun, Mar 6, 2016 at 10:48 PM, Dinali Dabarera <din...@wso2.com> wrote:
>
>> Hi Kavith,
>>
>> That happens when CEP side data doesn't rendered properly.
>> I am now working on the increasing the  performance of the servers by
>> removing unnecessary data. (data increases with time,Therefore It slows)
>>
>> Thanks!
>>
>> On Mon, Mar 7, 2016 at 3:22 AM, Kavith Lokuhewage <kav...@wso2.com>
>> wrote:
>>
>>> Hi Dinali,
>>>
>>> I viewed the dashboard and kept that browser tab idle for sometime
>>> (around 30 minutes) and suddenly some HTML alert popups were triggered for
>>> that tab. Only description I could see was "error". Three similar popups
>>> were shown one by one after each one was closed.
>>>
>>> Thanks,
>>>
>>> On Fri, Mar 4, 2016 at 6:28 AM, Dinali Dabarera <din...@wso2.com> wrote:
>>>
>>>> Hi Tharik,
>>>>
>>>> Thats true. Yasara is fixing that.
>>>> Thank you for showing us defects, this is our main goal of test run.
>>>>
>>>> On Fri, Mar 4, 2016 at 4:45 PM, Tharik Kanaka <tha...@wso2.com> wrote:
>>>>
>>>>> Hi Dinali,
>>>>>
>>>>> I am talking about line chart where Trump is shown in blue colour. If
>>>>> you are not going to use blue or red, still it has to be fixed before go
>>>>> live, isn't it?
>>>>>
>>>>> Regards,
>>>>>
>>>>> On Fri, Mar 4, 2016 at 4:35 PM, Dinali Dabarera <din...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> Hi,
>>>>>> @ Nirmal,
>>>>>> It was a script scheduling problem. I fixed it.
>>>>>>
>>>>>> @Tharik
>>>>>> US Parties have only two colors red or blue. So Its hard to figure
>>>>>> out to whom this tweep tweets for most. As we want to show a clear 
>>>>>> picture
>>>>>> on how tweeps relates each other with the candidates who are in for the
>>>>>> election(who still remains in the battle) and also we are advised not to
>>>>>> take dark blue or red in our UI in our previous meeting as we are not 
>>>>>> bias
>>>>>> for any of the parties.
>>>>>>
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> On Fri, Mar 4, 2016 at 3:43 PM, Tharik Kanaka <tha...@wso2.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi All,
>>>>>>>
>>>>>>> It would be great if we consider about political party colors of the
>>>>>>> candidates. As an example in the line chart Trump is shown in blue color
>>>>>>> but it has to be red color as he is a Republican. Candidates from same
>>>>>>> party can be shown in different shade of same color.
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Mar 4, 2016 at 3:26 PM, Nirmal Fernando <nir...@wso2.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hilary Clinton isn't listed as a top tweep, but the community graph
>>>>>>>> suggests otherwise.
>>>>>>>>
>>>>>>>> On Fri, Mar 4, 2016 at 3:19 PM, Srinath Perera <srin...@wso2.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Feedback I gave is not included!
>>>>>>>>>
>>>>>>>>> Too much room between most popular links.
>>>>>>>>> When we show tweets, make the text and tweet account names same
>>>>>>>>> size ( like twitter does)
>>>>>>>>>
>>>>>>>>> Look good otherwise.
>>>>>>>>>
>>>>>&g

Re: [Dev] US Election 2016 Tweet Analyze System

[Dinali Dabarera]

Hi Kavith,

That happens when CEP side data doesn't rendered properly.
I am now working on the increasing the  performance of the servers by
removing unnecessary data. (data increases with time,Therefore It slows)

Thanks!

On Mon, Mar 7, 2016 at 3:22 AM, Kavith Lokuhewage <kav...@wso2.com> wrote:

> Hi Dinali,
>
> I viewed the dashboard and kept that browser tab idle for sometime (around
> 30 minutes) and suddenly some HTML alert popups were triggered for that
> tab. Only description I could see was "error". Three similar popups were
> shown one by one after each one was closed.
>
> Thanks,
>
> On Fri, Mar 4, 2016 at 6:28 AM, Dinali Dabarera <din...@wso2.com> wrote:
>
>> Hi Tharik,
>>
>> Thats true. Yasara is fixing that.
>> Thank you for showing us defects, this is our main goal of test run.
>>
>> On Fri, Mar 4, 2016 at 4:45 PM, Tharik Kanaka <tha...@wso2.com> wrote:
>>
>>> Hi Dinali,
>>>
>>> I am talking about line chart where Trump is shown in blue colour. If
>>> you are not going to use blue or red, still it has to be fixed before go
>>> live, isn't it?
>>>
>>> Regards,
>>>
>>> On Fri, Mar 4, 2016 at 4:35 PM, Dinali Dabarera <din...@wso2.com> wrote:
>>>
>>>> Hi,
>>>> @ Nirmal,
>>>> It was a script scheduling problem. I fixed it.
>>>>
>>>> @Tharik
>>>> US Parties have only two colors red or blue. So Its hard to figure out
>>>> to whom this tweep tweets for most. As we want to show a clear picture on
>>>> how tweeps relates each other with the candidates who are in for the
>>>> election(who still remains in the battle) and also we are advised not to
>>>> take dark blue or red in our UI in our previous meeting as we are not bias
>>>> for any of the parties.
>>>>
>>>>
>>>> Thanks.
>>>>
>>>> On Fri, Mar 4, 2016 at 3:43 PM, Tharik Kanaka <tha...@wso2.com> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> It would be great if we consider about political party colors of the
>>>>> candidates. As an example in the line chart Trump is shown in blue color
>>>>> but it has to be red color as he is a Republican. Candidates from same
>>>>> party can be shown in different shade of same color.
>>>>>
>>>>> Regards,
>>>>>
>>>>>
>>>>> On Fri, Mar 4, 2016 at 3:26 PM, Nirmal Fernando <nir...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> Hilary Clinton isn't listed as a top tweep, but the community graph
>>>>>> suggests otherwise.
>>>>>>
>>>>>> On Fri, Mar 4, 2016 at 3:19 PM, Srinath Perera <srin...@wso2.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Feedback I gave is not included!
>>>>>>>
>>>>>>> Too much room between most popular links.
>>>>>>> When we show tweets, make the text and tweet account names same size
>>>>>>> ( like twitter does)
>>>>>>>
>>>>>>> Look good otherwise.
>>>>>>>
>>>>>>> --Srinath
>>>>>>>
>>>>>>> On Fri, Mar 4, 2016 at 3:00 PM, Dinali Dabarera <din...@wso2.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi everyone,
>>>>>>>>
>>>>>>>>
>>>>>>>> This is the latest update on US Election 2016 Analytic Dashboard.
>>>>>>>> This is  running @
>>>>>>>> https://52.77.25.83:9453/twitter-analyticsV3/index.html until this
>>>>>>>> hosts.
>>>>>>>>
>>>>>>>> Thank you!
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Fri, Mar 4, 2016 at 11:29 AM, Yasara Dissanayake <
>>>>>>>> yas...@wso2.com> wrote:
>>>>>>>>
>>>>>>>>> hi ,
>>>>>>>>> adding Chehara
>>>>>>>>>
>>>>>>>>> On Mon, Feb 29, 2016 at 8:51 AM, Srinath Perera <srin...@wso2.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> We can. It will be our twitter toolbox.
>>>>>

Re: [Dev] US Election 2016 Tweet Analyze System

[Dinali Dabarera]

Hi Tharik,

Thats true. Yasara is fixing that.
Thank you for showing us defects, this is our main goal of test run.

On Fri, Mar 4, 2016 at 4:45 PM, Tharik Kanaka <tha...@wso2.com> wrote:

> Hi Dinali,
>
> I am talking about line chart where Trump is shown in blue colour. If you
> are not going to use blue or red, still it has to be fixed before go live,
> isn't it?
>
> Regards,
>
> On Fri, Mar 4, 2016 at 4:35 PM, Dinali Dabarera <din...@wso2.com> wrote:
>
>> Hi,
>> @ Nirmal,
>> It was a script scheduling problem. I fixed it.
>>
>> @Tharik
>> US Parties have only two colors red or blue. So Its hard to figure out to
>> whom this tweep tweets for most. As we want to show a clear picture on how
>> tweeps relates each other with the candidates who are in for the
>> election(who still remains in the battle) and also we are advised not to
>> take dark blue or red in our UI in our previous meeting as we are not bias
>> for any of the parties.
>>
>>
>> Thanks.
>>
>> On Fri, Mar 4, 2016 at 3:43 PM, Tharik Kanaka <tha...@wso2.com> wrote:
>>
>>> Hi All,
>>>
>>> It would be great if we consider about political party colors of the
>>> candidates. As an example in the line chart Trump is shown in blue color
>>> but it has to be red color as he is a Republican. Candidates from same
>>> party can be shown in different shade of same color.
>>>
>>> Regards,
>>>
>>>
>>> On Fri, Mar 4, 2016 at 3:26 PM, Nirmal Fernando <nir...@wso2.com> wrote:
>>>
>>>> Hilary Clinton isn't listed as a top tweep, but the community graph
>>>> suggests otherwise.
>>>>
>>>> On Fri, Mar 4, 2016 at 3:19 PM, Srinath Perera <srin...@wso2.com>
>>>> wrote:
>>>>
>>>>> Feedback I gave is not included!
>>>>>
>>>>> Too much room between most popular links.
>>>>> When we show tweets, make the text and tweet account names same size (
>>>>> like twitter does)
>>>>>
>>>>> Look good otherwise.
>>>>>
>>>>> --Srinath
>>>>>
>>>>> On Fri, Mar 4, 2016 at 3:00 PM, Dinali Dabarera <din...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> Hi everyone,
>>>>>>
>>>>>>
>>>>>> This is the latest update on US Election 2016 Analytic Dashboard.
>>>>>> This is  running @
>>>>>> https://52.77.25.83:9453/twitter-analyticsV3/index.html until this
>>>>>> hosts.
>>>>>>
>>>>>> Thank you!
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Fri, Mar 4, 2016 at 11:29 AM, Yasara Dissanayake <yas...@wso2.com>
>>>>>> wrote:
>>>>>>
>>>>>>> hi ,
>>>>>>> adding Chehara
>>>>>>>
>>>>>>> On Mon, Feb 29, 2016 at 8:51 AM, Srinath Perera <srin...@wso2.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> We can. It will be our twitter toolbox.
>>>>>>>>
>>>>>>>> --Srinath
>>>>>>>>
>>>>>>>> On Mon, Feb 29, 2016 at 8:43 AM, Sachith Withana <sach...@wso2.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Srinath and all,
>>>>>>>>>
>>>>>>>>> I'm just wondering, can't we make this a generic tool/product to
>>>>>>>>> analyze and visualize twitter data.
>>>>>>>>>
>>>>>>>>> Ex: User provides us with some keywords and our tool does the
>>>>>>>>> analyzing/visualizing. The user can add more functionality if 
>>>>>>>>> required (
>>>>>>>>> customization)
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Sachith
>>>>>>>>>
>>>>>>>>> On Mon, Jan 25, 2016 at 5:04 PM, Thusitha Kalugamage <
>>>>>>>>> thusi...@wso2.com> wrote:
>>>>>>>>>
>>>>>>>>>> Update,
>>>>>>>>>>
>>>>>>>>>>1. Added assigned colors for candidate backgrounds as
>>>>>>>

Re: [Dev] [GSoC]Proposal 3: [ML] Visual (Deep) Neural Network Builder

[dinali dabarera]

Hi,
These are some notes which I recieved by Upul and Nirmal for all the people
who are interested in this gsoc project.

Notes by Upul & Nirmal:
 Creating a drag and drop environment with a good UI to create
neural networks.
Front end: UI with elements to drag and drop
Backend : Use of  Deep learning to create the neural network.

Similar products: http://www.neurogems.org/neosim2/
http://neurosolutions.com/neurosolutions/


A sample blog post of the proposal written by Nirmal which can be used to
get a idea on writing proposals

http://nirmalfdo.blogspot.com/2011/04/apache-tuscany-develop-simple-tool-that.html

All the best!

*Dinali Rosemin Dabarera*
BSc. Computer Engineering (2016)
Faculty of Engineering
University Of Peradeniya
Mobile:+94770198933
Blog: dinalirosemindabarera.blogspot.com
LinkedIn <https://lk.linkedin.com/in/dinalidabarera>

On Mon, Feb 29, 2016 at 6:10 PM, Nirmal Fernando <nir...@wso2.com> wrote:

> Can you please send notes on what was discussed ?
>
> On Wed, Feb 24, 2016 at 9:56 PM, dinali dabarera <gdrdabar...@gmail.com>
> wrote:
>
>> Hi,
>> Thank you for the advice. I am ready to engage in this project.
>>
>> *Dinali Rosemin Dabarera*
>> BSc. Computer Engineering (2016)
>> Faculty of Engineering
>> University Of Peradeniya
>> Mobile:+94770198933
>> Blog: dinalirosemindabarera.blogspot.com
>> LinkedIn <https://lk.linkedin.com/in/dinalidabarera>
>>
>> On Wed, Feb 24, 2016 at 9:48 PM, Dinali Dabarera <din...@wso2.com> wrote:
>>
>>
>>>
>>> On Wed, Feb 24, 2016 at 11:50 AM, Upul Bandara <u...@wso2.com> wrote:
>>>
>>>> Hi Dinali,
>>>>
>>>> We can give a quick introduction to the project.
>>>>
>>>> Please come and have a chat.
>>>>
>>>> Thanks,
>>>> Upul
>>>>
>>>> On Wed, Feb 24, 2016 at 11:32 AM, Dinali Dabarera <din...@wso2.com>
>>>> wrote:
>>>>
>>>>> Can I get some more details on this project?
>>>>>
>>>>> On Wed, Feb 24, 2016 at 10:04 AM, Dinali Dabarera <din...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> Hi,
>>>>>> I am a final year Computer Engineering undergraduate of University of
>>>>>> Peradeniya. Currently I am working with wso2 products and I prefer 
>>>>>> machine
>>>>>> learning , neural networks and research stuff. I am interested in this
>>>>>> project  Neural Network Builder and I would like to proceed with this
>>>>>> project.
>>>>>> I have some hands on experience with some of the wso2 products and
>>>>>> analytic stuff such as SPARK. I would like to know what exactly I have to
>>>>>> do in this project so I study more deeper on those stuff.
>>>>>>
>>>>>> Thank you!
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Dinali Rosemin
>>>>>> University of Peradeniya (Computer Engineering)
>>>>>> WSO2 Intern
>>>>>> 077-0198933
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Dinali Rosemin
>>>>> University of Peradeniya (Computer Engineering)
>>>>> WSO2 Intern
>>>>> 077-0198933
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Upul Bandara,
>>>> Associate Technical Lead, WSO2, Inc.,
>>>> Mob: +94 715 468 345.
>>>>
>>>
>>>
>>>
>>> --
>>> Dinali Rosemin
>>> University of Peradeniya (Computer Engineering)
>>> WSO2 Intern
>>> 077-0198933
>>>
>>
>>
>
>
> --
>
> Thanks & regards,
> Nirmal
>
> Team Lead - WSO2 Machine Learner
> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
> Mobile: +94715779733
> Blog: http://nirmalfdo.blogspot.com/
>
>
>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [GSoC]Proposal 3: [ML] Visual (Deep) Neural Network Builder

[dinali dabarera]

Hi,
Thank you for the advice. I am ready to engage in this project.

*Dinali Rosemin Dabarera*
BSc. Computer Engineering (2016)
Faculty of Engineering
University Of Peradeniya
Mobile:+94770198933
Blog: dinalirosemindabarera.blogspot.com
LinkedIn <https://lk.linkedin.com/in/dinalidabarera>

On Wed, Feb 24, 2016 at 9:48 PM, Dinali Dabarera <din...@wso2.com> wrote:

>
>
> On Wed, Feb 24, 2016 at 11:50 AM, Upul Bandara <u...@wso2.com> wrote:
>
>> Hi Dinali,
>>
>> We can give a quick introduction to the project.
>>
>> Please come and have a chat.
>>
>> Thanks,
>> Upul
>>
>> On Wed, Feb 24, 2016 at 11:32 AM, Dinali Dabarera <din...@wso2.com>
>> wrote:
>>
>>> Can I get some more details on this project?
>>>
>>> On Wed, Feb 24, 2016 at 10:04 AM, Dinali Dabarera <din...@wso2.com>
>>> wrote:
>>>
>>>> Hi,
>>>> I am a final year Computer Engineering undergraduate of University of
>>>> Peradeniya. Currently I am working with wso2 products and I prefer machine
>>>> learning , neural networks and research stuff. I am interested in this
>>>> project  Neural Network Builder and I would like to proceed with this
>>>> project.
>>>> I have some hands on experience with some of the wso2 products and
>>>> analytic stuff such as SPARK. I would like to know what exactly I have to
>>>> do in this project so I study more deeper on those stuff.
>>>>
>>>> Thank you!
>>>>
>>>>
>>>> --
>>>> Dinali Rosemin
>>>> University of Peradeniya (Computer Engineering)
>>>> WSO2 Intern
>>>> 077-0198933
>>>>
>>>
>>>
>>>
>>> --
>>> Dinali Rosemin
>>> University of Peradeniya (Computer Engineering)
>>> WSO2 Intern
>>> 077-0198933
>>>
>>
>>
>>
>> --
>> Upul Bandara,
>> Associate Technical Lead, WSO2, Inc.,
>> Mob: +94 715 468 345.
>>
>
>
>
> --
> Dinali Rosemin
> University of Peradeniya (Computer Engineering)
> WSO2 Intern
> 077-0198933
>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] [GSoC]Proposal 3: [ML] Visual (Deep) Neural Network Builder

[Dinali Dabarera]

Can I get some more details on this project?

On Wed, Feb 24, 2016 at 10:04 AM, Dinali Dabarera <din...@wso2.com> wrote:

> Hi,
> I am a final year Computer Engineering undergraduate of University of
> Peradeniya. Currently I am working with wso2 products and I prefer machine
> learning , neural networks and research stuff. I am interested in this
> project  Neural Network Builder and I would like to proceed with this
> project.
> I have some hands on experience with some of the wso2 products and
> analytic stuff such as SPARK. I would like to know what exactly I have to
> do in this project so I study more deeper on those stuff.
>
> Thank you!
>
>
> --
> Dinali Rosemin
> University of Peradeniya (Computer Engineering)
> WSO2 Intern
> 077-0198933
>



-- 
Dinali Rosemin
University of Peradeniya (Computer Engineering)
WSO2 Intern
077-0198933
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] [GSoC]Proposal 3: [ML] Visual (Deep) Neural Network Builder

[Dinali Dabarera]

Hi,
I am a final year Computer Engineering undergraduate of University of
Peradeniya. Currently I am working with wso2 products and I prefer machine
learning , neural networks and research stuff. I am interested in this
project  Neural Network Builder and I would like to proceed with this
project.
I have some hands on experience with some of the wso2 products and analytic
stuff such as SPARK. I would like to know what exactly I have to do in this
project so I study more deeper on those stuff.

Thank you!


-- 
Dinali Rosemin
University of Peradeniya (Computer Engineering)
WSO2 Intern
077-0198933
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] US Election 2016 Tweet Analyze System

[Dinali Dabarera]

Sir,

I have not completed implementing the community graph of all the candidates
I will finish it by today and show you tomorrow at the meeting.

Regards!

On Wed, Dec 2, 2015 at 10:33 AM, Srinath Perera <srin...@wso2.com> wrote:

> Dinali, we want to show all tweeps in a one twitter graph with different
> colors given to different candidate as I mentioned in earlier mail. (
> instead of putting colors by number of tweets by each user).
>
>
>
>
>
>
>
>1.
>
>
> On Wed, Dec 2, 2015 at 10:27 AM, Dinali Dabarera <din...@wso2.com> wrote:
>
>> Hi,
>>
>> I hope this will give you a clear picture of GUI.
>>
>> In the community graph,
>>
>>
>>
>> On Wed, Dec 2, 2015 at 10:09 AM, Nirmal Fernando <nir...@wso2.com> wrote:
>>
>>> Hi Yasara,
>>>
>>> Please explain the UI (as the UI is at very early stages, it's not easy
>>> to grasp stuff) :-)
>>>
>>> On Wed, Dec 2, 2015 at 9:47 AM, Yasara Dissanayake <yas...@wso2.com>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> This is the snap shots of the final Integration of  the website.
>>>>
>>>> Please leave your comments.
>>>>
>>>> regards.
>>>>
>>>> On Tue, Dec 1, 2015 at 1:34 PM, Yudhanjaya Wijeratne <
>>>> yudhanj...@wso2.com> wrote:
>>>>
>>>>> +1 :)
>>>>>
>>>>> On Tue, Dec 1, 2015 at 1:10 PM, Srinath Perera <srin...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>> I might WFH. Shall we meet Thursday 11am?
>>>>>>
>>>>>> On Tue, Dec 1, 2015 at 12:20 PM, Yudhanjaya Wijeratne <
>>>>>> yudhanj...@wso2.com> wrote:
>>>>>>
>>>>>>> Hi Srinath,
>>>>>>>
>>>>>>> +1 to all. I think sentiment analysis will take the form of a x-y
>>>>>>> graph charting the ups and downs. Shall I come to Trace tomorrow 
>>>>>>> morning?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Yudha
>>>>>>>
>>>>>>> On Tue, Dec 1, 2015 at 11:21 AM, Srinath Perera <srin...@wso2.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Yudhanjaya,
>>>>>>>>
>>>>>>>> Yasara and Dinali have the basics for twitter graph and most
>>>>>>>> important tweets in place. We need to design the story around this. ( 
>>>>>>>> I am
>>>>>>>> ccing Dakshika so we can get UX feedback from him).
>>>>>>>>
>>>>>>>> Dakshika, we are trying to build a website to analyze the US
>>>>>>>> election data for twitter.
>>>>>>>>
>>>>>>>> IMO we have not figured out the story yet, although we have
>>>>>>>> individual pieces. Following are my comments.
>>>>>>>>
>>>>>>>>
>>>>>>>>1. Looking at Twitter graph, I feel showing number of tweet
>>>>>>>>each user did does not tell anything useful.
>>>>>>>>2. I feel twitter graph should include all tweeps, not tweeter
>>>>>>>>graph for one candidate. ( we can do color coding to show what are 
>>>>>>>> tweeps
>>>>>>>>for focus candidate)
>>>>>>>>3. I agree users want to know about one candidate. But I think
>>>>>>>>we need to show the data in contrast. Shall we show each 
>>>>>>>> candidate's data
>>>>>>>>in contrast to the first. ( For first we contrast with second)
>>>>>>>>
>>>>>>>> We also need to do sentimental analysis one and figure out where it
>>>>>>>> fit in.
>>>>>>>>
>>>>>>>> When you will be in Trace? We should meet and discuss.
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>> Srinath
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Fri, Nov 20, 2015 at 8:34 AM, Yudhanjaya Wijeratne <
>>>>>>>> yudhanj...@wso2.com> wrote:
>>>>>>>>
>>>>>>>>> Srinath,
>

Re: [Dev] Access DAS analytics tables through REST API

[Dinali Dabarera]

Hi Sinthuja,

i got a clue from your words "For each scenarios you can see a sample
request, and according to that you need to send the authentication headers
with your request. You can first try with curl or any other REST API tools,
and then try to incorporate with jaggery app"

Thank you very much. i confirmed the data on the database using curl, it
worked Now i will try that with jaggery. Thanks for giving a little
explanation.

Cheers!

On Sat, Nov 21, 2015 at 7:48 PM, Sinthuja Ragendran <sinth...@wso2.com>
wrote:

> Hi Dinali,
>
> Please find the documentation [1] for interacting with the data which is
> stored in DAL via REST api. For each scenarios you can see a sample
> request, and according to that you need to send the authentication headers
> with your request. You can first try with curl or any other REST API tools,
> and then try to incorporate with jaggery app.
>
> [1]
> https://docs.wso2.com/display/DAS300/Checking+if+a+Given+Table+Exists+via+REST+API
>
> Thanks,
> Sinthuja.
>
> On Sat, Nov 21, 2015 at 7:10 AM, Dinali Dabarera <din...@wso2.com> wrote:
>
>> HI,
>>
>> I am new to DAS and REST API.
>>
>> I converted normal h2 databases in to mysql as follows,
>>
>>  
>> WSO2_ANALYTICS_EVENT_STORE_DB
>> The datasource used for analytics record
>> store
>> 
>> 
>> jdbc:mysql://localhost:3306/Election
>> root
>> root
>>
>> com.mysql.jdbc.Driver
>> 80
>> 6
>> SELECT 1
>> false
>> 0
>> true
>>
>> 4000
>> 
>> 
>> 
>>
>> My intention is to store persistent data which i got from SPARK queeries
>> in to a mySQL databse/tables, so that i get retrieve them from outside
>> jaggery server/juggeryApp.
>>
>>
>> My work succeeded, I get data into databases.
>>
>> Now I tried to retrieve those data through a juggeryapp
>>
>> 
>> 
>>
>> Below is a Jaggery print
>>
>>  <%
>> config = {};
>> var db = new Database("jdbc:mysql://localhost:3306/Election",
>> "root", "root", config);
>> var q1 =" SELECT * FROM ANX___7LgTGRXo_ ";
>> var data= db.query(q1);
>> print(data);
>>
>>
>>  %>
>> 
>> 
>>
>>
>>
>> I get data but they are not in the format that I can read. MyQSL tables
>> created inside the Election database is unreadable.
>>
>> Database changed
>> mysql> show tables;
>> ++
>> | Tables_in_Election |
>> ++
>> | ANX___7LgTGRXo_|
>> | ANX___8GECxAtQ_|
>> | ANX___8GIvT7Rc_|
>> | ANX___8GMmoCp8_|
>> ++
>> 4 rows in set (0.00 sec)
>>
>>
>>
>> I found out this is because they are using rest API, But I cant find a
>> complete documentation to do what i want.
>>
>>
>> I did this,
>>
>> 
>> 
>>
>> Below is a Jaggery print
>>
>>  <%
>>
>>
>> var url  = " https://localhost:9446/api/configs/das/tables;;
>>
>>var twitterJson = get(url);
>>   print(twitterJson);
>>
>>
>>
>>
>>  %>
>>
>>
>> 
>> 
>>
>>
>>
>> But it does not work! it gives Error 500
>>
>> Can anyone give any suggestions!
>>
>> Thanks!
>>
>> Cheers!
>>
>> Dinali Rosemin
>> University of Peradeniya (Computer Engineering)
>> WSO2 Intern
>> 077-0198933
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> *Sinthuja Rajendran*
> Associate Technical Lead
> WSO2, Inc.:http://wso2.com
>
> Blog: http://sinthu-rajan.blogspot.com/
> Mobile: +94774273955
>
>
>


-- 
Dinali Rosemin
University of Peradeniya (Computer Engineering)
WSO2 Intern
077-0198933
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

[Dev] Access DAS analytics tables through REST API

[Dinali Dabarera]

HI,

I am new to DAS and REST API.

I converted normal h2 databases in to mysql as follows,

 
WSO2_ANALYTICS_EVENT_STORE_DB
The datasource used for analytics record
store


jdbc:mysql://localhost:3306/Election
root
root
com.mysql.jdbc.Driver
80
6
SELECT 1
false
0
true

4000




My intention is to store persistent data which i got from SPARK queeries in
to a mySQL databse/tables, so that i get retrieve them from outside jaggery
server/juggeryApp.


My work succeeded, I get data into databases.

Now I tried to retrieve those data through a juggeryapp




Below is a Jaggery print

 <%
config = {};
var db = new Database("jdbc:mysql://localhost:3306/Election",
"root", "root", config);
var q1 =" SELECT * FROM ANX___7LgTGRXo_ ";
var data= db.query(q1);
print(data);


 %>





I get data but they are not in the format that I can read. MyQSL tables
created inside the Election database is unreadable.

Database changed
mysql> show tables;
++
| Tables_in_Election |
++
| ANX___7LgTGRXo_|
| ANX___8GECxAtQ_|
| ANX___8GIvT7Rc_|
| ANX___8GMmoCp8_|
++
4 rows in set (0.00 sec)



I found out this is because they are using rest API, But I cant find a
complete documentation to do what i want.


I did this,




Below is a Jaggery print

 <%


var url  = " https://localhost:9446/api/configs/das/tables;;

   var twitterJson = get(url);
  print(twitterJson);




 %>







But it does not work! it gives Error 500

Can anyone give any suggestions!

Thanks!

Cheers!

Dinali Rosemin
University of Peradeniya (Computer Engineering)
WSO2 Intern
077-0198933
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] US Election 2016 Tweet Analyze System

[Dinali Dabarera]

gt;>>> Sorry for the misdirection if above replies are not helpful.
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>> On Tue, Nov 17, 2015 at 2:10 PM, Nipuna Chandradasa <
>>>>>>> nipu...@wso2.com> wrote:
>>>>>>>
>>>>>>>> Hi Yasara,
>>>>>>>>
>>>>>>>> yeah you can check the retweets using retweeted_status as retweets
>>>>>>>> contains slightly different json structure than tweets. But you have to
>>>>>>>> keep track of whether your system already analyzed the original tweets 
>>>>>>>> of
>>>>>>>> this retweets ... Because there can be a scenario where your system 
>>>>>>>> meet
>>>>>>>> the retweet before the original tweet you are going to filter out that
>>>>>>>> tweet and that data is loss..
>>>>>>>>
>>>>>>>> [1] link has some answer to this that a way you can edit the
>>>>>>>> search query to filter out retweets 
>>>>>>>>
>>>>>>>> 1.
>>>>>>>> http://stackoverflow.com/questions/21748880/exclude-retweets-in-twitter-search-api-1-1
>>>>>>>>
>>>>>>>> But the i don't know whether this solve the above scenario i
>>>>>>>> mentioned   But the above mentioned scenario is less likely to 
>>>>>>>> happen
>>>>>>>> if it is a live stream and there are no waiting periods included
>>>>>>>>
>>>>>>>> (You both replied while i'm typing the reply so ... following is
>>>>>>>> the new suggestions .. but please go through above factors. those will 
>>>>>>>> help
>>>>>>>> you understand how tweeter API's work )
>>>>>>>>
>>>>>>>> @ Dinali ...
>>>>>>>>
>>>>>>>> +1 for your idea ..
>>>>>>>>
>>>>>>>> @ Yasara ..
>>>>>>>>
>>>>>>>> I think the favorites_count is calculated based on followers and
>>>>>>>> retweets count ...
>>>>>>>>
>>>>>>>> https://dev.twitter.com/faq/finding-%26-counting-things
>>>>>>>>
>>>>>>>> Check before you do the same thing in your code.
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>>
>>>>>>>> On Tue, Nov 17, 2015 at 1:04 PM, Yasara Dissanayake <
>>>>>>>> yas...@wso2.com> wrote:
>>>>>>>>
>>>>>>>>> Hi Nipuna,
>>>>>>>>> For our part we have to analyze tweets real time. For that
>>>>>>>>> currently we are planed to filter retweets by considering presence of
>>>>>>>>> retweeted_status attribute of a json massage which send by tweet 
>>>>>>>>> object,
>>>>>>>>> within the CEP. Does it seems to be a proper method? Do you have any 
>>>>>>>>> better
>>>>>>>>> idea ?
>>>>>>>>>
>>>>>>>>> regards,
>>>>>>>>> Yasara
>>>>>>>>>
>>>>>>>>> On Tue, Nov 17, 2015 at 11:12 AM, Nipuna Chandradasa <
>>>>>>>>> nipu...@wso2.com> wrote:
>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> Is this connector the api provided by twitter?... Then there are
>>>>>>>>>> few things u have to keep in mind...
>>>>>>>>>>
>>>>>>>>>> 1. Twitter api gives each app 15 min waiting period once app
>>>>>>>>>> collect the data from api So basically you have to wait 15 min 
>>>>>>>>>> to get
>>>>>>>>>> data again
>>>>>>>>>>
>>>>>>>>>> 2. There are no filter system to filter retweets What you can
>>>>>>>>>> do is get data using search query with date periods And filter 
>>>>>

Re: [Dev] US Election 2016 Tweet Analyze System

[Dinali Dabarera]

Yes I will do sir. But I am doing some research on d3 by adding more
features and directing getting data from DAS. I hope to do this as it will
help in the future.

On Thu, Nov 19, 2015 at 9:38 AM, Srinath Perera <srin...@wso2.com> wrote:

> We must use d3 or a d3 based one, as that WSO2 platform uses.
>
> Sample I shared shows how to do it with d3.
>
> Thanks
> Srinath
>
> On Wed, Nov 18, 2015 at 3:36 PM, Dinali Dabarera <din...@wso2.com> wrote:
>
>> Hi,
>> I have created two tables on DAS which collects fresh data daily(more
>> than 1000,000) and run a script which is scheduled hourly to collect data
>> into two tables called NodeTable(nose , retweets order by retweets desc)
>> and EdgeTable(src,dest,retweets order by retweets desc).
>>
>> Now I have to create a node graph. Node size give u from NodeTable and
>> Width of edge gives u from retweet count in EdgeTable of  I have looked up
>> lot of java script libraries such as vis.js, arbor.js, D3.js,sigmajs.
>>
>> I couldn't figured out what is better (as most of them have specific to a
>> single node and takes lot of time to study all) then i moved to d3.js as
>> many have used and tried  for different purposes. Can i get any other good
>> suggestions for my graphing?
>>
>> If you have good suggestions, please feel free to post them so that it
>> will help me ..
>>
>>
>> Cheers!
>>
>> On Tue, Nov 17, 2015 at 3:17 PM, Yasara Dissanayake <yas...@wso2.com>
>> wrote:
>>
>>> @yudhanjaya
>>> Ok.Now it's working.Popular tweets are now saved to on database base on
>>> that rank from CEP. Wrote custom window for siddi to calculate that rank
>>> and sort them. Currently working with design web page using jaggery server.
>>>
>>> Regards
>>> Yasara
>>>
>>> On Tue, Nov 17, 2015 at 3:11 PM, Yudhanjaya Wijeratne <
>>> yudhanj...@wso2.com> wrote:
>>>
>>>> We'll have to talk to Srinath about that, I'm afraid. Let's get the RT
>>>> system rolling first. Whatever we come up with the replies will also have
>>>> to be displayed as part of that graph, so let's get the simpler stuff out
>>>> of the way.
>>>>
>>>> On Tue, Nov 17, 2015 at 2:54 PM, Yasara Dissanayake <yas...@wso2.com>
>>>> wrote:
>>>>
>>>>> hi,
>>>>>
>>>>> @Nipuna,
>>>>> Dinali and me both are collecting retweets in same manner which she
>>>>> explained earlier. Since I also consider the details original tweets of
>>>>> retweets. Thank you for comments and link it would be very useful. And
>>>>> about favorite count, isn't it a separate option something like like to 
>>>>> the
>>>>> post which can do even non friends? Here I mean the publicity of tweet.
>>>>> that is initially when tweet are published it will be on friends wall. But
>>>>> it has not impact as much as retweet and favorite count.
>>>>>
>>>>> @yudhanjaya
>>>>> And what about the replies? if we consider them there can be +1, 0 and
>>>>> -1 support for that tweet. do we have to consider them ? if so do we have
>>>>> to do some analysis?
>>>>>
>>>>> regards,
>>>>> Yasara
>>>>>
>>>>> On Tue, Nov 17, 2015 at 2:38 PM, Yudhanjaya Wijeratne <
>>>>> yudhanj...@wso2.com> wrote:
>>>>>
>>>>>> Hi Madhawa, Nipuna,
>>>>>>
>>>>>> We'll be doing a bit of sentiment analysis later down the line using
>>>>>> the stanford NLP implementation, but for now what we're trying to 
>>>>>> replicate
>>>>>> in real-time is to
>>>>>> a) rank tweets by freshness and popularity, which can give us some
>>>>>> clue as to opinion influence and b) to basically do this
>>>>>> https://iwringer.wordpress.com/2015/08/25/analysis-of-retweeting-patterns-in-sri-lankan-general-election/
>>>>>>
>>>>>> Best,
>>>>>> Yudha
>>>>>>
>>>>>> On Tue, Nov 17, 2015 at 2:27 PM, Nipuna Chandradasa <nipu...@wso2.com
>>>>>> > wrote:
>>>>>>
>>>>>>> HI Madhawa
>>>>>>>
>>>>>>> Context analysis in the sense we have to perform Natural language
>>>>>>> processing right? I think this require additional librar

Re: [Dev] US Election 2016 Tweet Analyze System

[Dinali Dabarera]

hi,
 Thanks for the vote.

On Tue, Nov 17, 2015 at 2:13 PM, Nipuna Chandradasa <nipu...@wso2.com>
wrote:

> Hi,
>
> I suggested above for if you are using tweeter API directly  i don't
> know whether these can be done using wso2 twitter connector.  ... i'll look
> in to it ..
> Sorry for the misdirection if above replies are not helpful.
>
> Regards,
>
> On Tue, Nov 17, 2015 at 2:10 PM, Nipuna Chandradasa <nipu...@wso2.com>
> wrote:
>
>> Hi Yasara,
>>
>> yeah you can check the retweets using retweeted_status as retweets
>> contains slightly different json structure than tweets. But you have to
>> keep track of whether your system already analyzed the original tweets of
>> this retweets ... Because there can be a scenario where your system meet
>> the retweet before the original tweet you are going to filter out that
>> tweet and that data is loss..
>>
>> [1] link has some answer to this that a way you can edit the search
>> query to filter out retweets 
>>
>> 1.
>> http://stackoverflow.com/questions/21748880/exclude-retweets-in-twitter-search-api-1-1
>>
>> But the i don't know whether this solve the above scenario i mentioned
>>   But the above mentioned scenario is less likely to happen if it is a
>> live stream and there are no waiting periods included
>>
>> (You both replied while i'm typing the reply so ... following is the new
>> suggestions .. but please go through above factors. those will help you
>> understand how tweeter API's work )
>>
>> @ Dinali ...
>>
>> +1 for your idea ..
>>
>> @ Yasara ..
>>
>> I think the favorites_count is calculated based on followers and retweets
>> count ...
>>
>> https://dev.twitter.com/faq/finding-%26-counting-things
>>
>> Check before you do the same thing in your code.
>>
>> Regards,
>>
>> On Tue, Nov 17, 2015 at 1:04 PM, Yasara Dissanayake <yas...@wso2.com>
>> wrote:
>>
>>> Hi Nipuna,
>>> For our part we have to analyze tweets real time. For that currently we
>>> are planed to filter retweets by considering presence of retweeted_status
>>> attribute of a json massage which send by tweet object, within the CEP.
>>> Does it seems to be a proper method? Do you have any better idea ?
>>>
>>> regards,
>>> Yasara
>>>
>>> On Tue, Nov 17, 2015 at 11:12 AM, Nipuna Chandradasa <nipu...@wso2.com>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> Is this connector the api provided by twitter?... Then there are few
>>>> things u have to keep in mind...
>>>>
>>>> 1. Twitter api gives each app 15 min waiting period once app collect
>>>> the data from api So basically you have to wait 15 min to get data
>>>> again
>>>>
>>>> 2. There are no filter system to filter retweets What you can do is
>>>> get data using search query with date periods And filter retweets in
>>>> your app
>>>>
>>>> Hope you find this helpful
>>>>
>>>> Regards,
>>>> On 17 Nov 2015 10:11 a.m., "Dinali Dabarera" <din...@wso2.com> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I collected tweets which has hash tag of Trump
>>>>> #trump,#donaldtrump,#trump2016,#makeamericagreatagain
>>>>> from ESB through a twitter connector  to SPARK SQL tables in DAS.
>>>>>
>>>>> The tweets are seems to be most probably retweets. Is there any issue
>>>>> with the twitter connector,is it collecting only retweets?
>>>>>
>>>>> Cheers!!
>>>>>
>>>>> On Tue, Nov 17, 2015 at 8:49 AM, Yasara Dissanayake <yas...@wso2.com>
>>>>> wrote:
>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Dinali Rosemin
>>>>> University of Peradeniya (Computer Engineering)
>>>>> WSO2 Intern
>>>>> 077-0198933
>>>>>
>>>>> ___
>>>>> Dev mailing list
>>>>> Dev@wso2.org
>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>>
>>>>>
>>>
>>
>>
>> --
>> Nipuna Marcus
>> *Software Engineer*
>> WSO2 Inc.
>> http://wso2.com/ - "lean . enterprise . middleware"
>> Mobile : +94 (0) 713 667906
>> nipu...@wso2.com
>>
>
>
>
> --
> Nipuna Marcus
> *Software Engineer*
> WSO2 Inc.
> http://wso2.com/ - "lean . enterprise . middleware"
> Mobile : +94 (0) 713 667906
> nipu...@wso2.com
>



-- 
Dinali Rosemin
University of Peradeniya (Computer Engineering)
WSO2 Intern
077-0198933
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] US Election 2016 Tweet Analyze System

[Dinali Dabarera]

Hi ,
Me and Yasara working on the same project but she is using WSO2 twitter
connector with  CEP  and I am with DAS through ESB. When I collect tweets
to the persistent tabel in DAS they are mostly retweets. I have not found
any original tweet or replies.

I am collecting all tweets on hash tags of trump and calculating no of re
tweets in order to draw a community graph. Because of this problem  i am
getting the tweet count of the parent twee, irrespective of the re-tweet as
a solution for this matter.

So does anybody have any solutions for this problems or any other comments
on my decision.?


Cheers!


On Tue, Nov 17, 2015 at 1:04 PM, Yasara Dissanayake <yas...@wso2.com> wrote:

> Hi Nipuna,
> For our part we have to analyze tweets real time. For that currently we
> are planed to filter retweets by considering presence of retweeted_status
> attribute of a json massage which send by tweet object, within the CEP.
> Does it seems to be a proper method? Do you have any better idea ?
>
> regards,
> Yasara
>
> On Tue, Nov 17, 2015 at 11:12 AM, Nipuna Chandradasa <nipu...@wso2.com>
> wrote:
>
>> Hi,
>>
>> Is this connector the api provided by twitter?... Then there are few
>> things u have to keep in mind...
>>
>> 1. Twitter api gives each app 15 min waiting period once app collect the
>> data from api So basically you have to wait 15 min to get data again
>>
>> 2. There are no filter system to filter retweets What you can do is
>> get data using search query with date periods And filter retweets in
>> your app
>>
>> Hope you find this helpful
>>
>> Regards,
>> On 17 Nov 2015 10:11 a.m., "Dinali Dabarera" <din...@wso2.com> wrote:
>>
>>> Hi,
>>>
>>> I collected tweets which has hash tag of Trump
>>> #trump,#donaldtrump,#trump2016,#makeamericagreatagain
>>> from ESB through a twitter connector  to SPARK SQL tables in DAS.
>>>
>>> The tweets are seems to be most probably retweets. Is there any issue
>>> with the twitter connector,is it collecting only retweets?
>>>
>>> Cheers!!
>>>
>>> On Tue, Nov 17, 2015 at 8:49 AM, Yasara Dissanayake <yas...@wso2.com>
>>> wrote:
>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Dinali Rosemin
>>> University of Peradeniya (Computer Engineering)
>>> WSO2 Intern
>>> 077-0198933
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>


-- 
Dinali Rosemin
University of Peradeniya (Computer Engineering)
WSO2 Intern
077-0198933
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev

Re: [Dev] US Election 2016 Tweet Analyze System

[Dinali Dabarera]

Hi,

I collected tweets which has hash tag of Trump
#trump,#donaldtrump,#trump2016,#makeamericagreatagain
from ESB through a twitter connector  to SPARK SQL tables in DAS.

The tweets are seems to be most probably retweets. Is there any issue with
the twitter connector,is it collecting only retweets?

Cheers!!

On Tue, Nov 17, 2015 at 8:49 AM, Yasara Dissanayake  wrote:

>
>


-- 
Dinali Rosemin
University of Peradeniya (Computer Engineering)
WSO2 Intern
077-0198933
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev