Re: [Dev] GSOC 2016: Proposal 7

2016-08-30 Thread Dinanjana Gunaratne
Hi all,
Thank you everyone for the guidance and support you gave through out the
period. Special thanks goes to Isuru Udana for the continuous support
provided. :)

On Aug 24, 2016 11:27 AM, "Dinanjana Gunaratne" <
dinanjanagunara...@gmail.com> wrote:

> Hello Kasun,
>
> Currently the OOM scenario is mapped to "OOM" event in the  ESB flight
> recorder. And CPU Spinning is mapped to "High CPU Usage" event in the tool.
> The requested resources for those events can be configured by the user of
> ESB Flight Recorder.
>
> Thanks,
> Dinanjana.
>
> On Tue, Aug 23, 2016 at 11:32 PM, Kasun Indrasiri  wrote:
>
>> Thanks, Dinanjana. I think it's good to have how different scenarios can
>> be handled from ESB flight recorder information.
>> - OOM
>> - CPU spinning
>> - Deadlock
>> etc.
>>
>> Thanks,
>> Kasun.
>>
>> On Mon, Aug 22, 2016 at 11:02 PM, Dinanjana Gunaratne <
>> dinanjanagunara...@gmail.com> wrote:
>>
>>> Hi all,
>>> Currently the tool supports generating jfr along with thread dumps and
>>> heap dumps. And the report template has been changed so that it reflects a
>>> lot more details on environmental details during an event. All collectibles
>>> along with thread dumps and jfrs will be bundled in to a zip archive now.
>>> This zip archive will be generated for each "event". This contains the
>>> report, thread dumps(if user requested) & jfr (if user requested). Report
>>> is a HTML file. Thread dumps are also viewable through this report.User can
>>> change the template as he wish by changing the report template HTML file
>>>
>>> On Tue, Aug 23, 2016 at 11:28 AM, Dinanjana Gunaratne <
>>> dinanjanagunara...@gmail.com> wrote:
>>>
 Dear all,
 This[1]
 
  is
 the blog post I made for final work product submission. Please have a look.
 :)
 [1]http://dinanjanagunaratne.blogspot.com/2016/08/during-pas
 t-3-months-i-was-engaged-in.html

>>>
>>>
>>> ___
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>>
>> --
>> Kasun Indrasiri
>> Director, Integration Technologies
>> WSO2, Inc.; http://wso2.com
>> lean.enterprise.middleware
>>
>> cell: +1 650 450 2293
>> Blog : http://kasunpanorama.blogspot.com/
>>
>
>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016: Proposal 7

2016-08-23 Thread Dinanjana Gunaratne
Hello Kasun,

Currently the OOM scenario is mapped to "OOM" event in the  ESB flight
recorder. And CPU Spinning is mapped to "High CPU Usage" event in the tool.
The requested resources for those events can be configured by the user of
ESB Flight Recorder.

Thanks,
Dinanjana.

On Tue, Aug 23, 2016 at 11:32 PM, Kasun Indrasiri  wrote:

> Thanks, Dinanjana. I think it's good to have how different scenarios can
> be handled from ESB flight recorder information.
> - OOM
> - CPU spinning
> - Deadlock
> etc.
>
> Thanks,
> Kasun.
>
> On Mon, Aug 22, 2016 at 11:02 PM, Dinanjana Gunaratne <
> dinanjanagunara...@gmail.com> wrote:
>
>> Hi all,
>> Currently the tool supports generating jfr along with thread dumps and
>> heap dumps. And the report template has been changed so that it reflects a
>> lot more details on environmental details during an event. All collectibles
>> along with thread dumps and jfrs will be bundled in to a zip archive now.
>> This zip archive will be generated for each "event". This contains the
>> report, thread dumps(if user requested) & jfr (if user requested). Report
>> is a HTML file. Thread dumps are also viewable through this report.User can
>> change the template as he wish by changing the report template HTML file
>>
>> On Tue, Aug 23, 2016 at 11:28 AM, Dinanjana Gunaratne <
>> dinanjanagunara...@gmail.com> wrote:
>>
>>> Dear all,
>>> This[1]
>>> 
>>>  is
>>> the blog post I made for final work product submission. Please have a look.
>>> :)
>>> [1]http://dinanjanagunaratne.blogspot.com/2016/08/during-pas
>>> t-3-months-i-was-engaged-in.html
>>>
>>
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> Kasun Indrasiri
> Director, Integration Technologies
> WSO2, Inc.; http://wso2.com
> lean.enterprise.middleware
>
> cell: +1 650 450 2293
> Blog : http://kasunpanorama.blogspot.com/
>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016: Proposal 7

2016-08-23 Thread Kasun Indrasiri
Thanks, Dinanjana. I think it's good to have how different scenarios can be
handled from ESB flight recorder information.
- OOM
- CPU spinning
- Deadlock
etc.

Thanks,
Kasun.

On Mon, Aug 22, 2016 at 11:02 PM, Dinanjana Gunaratne <
dinanjanagunara...@gmail.com> wrote:

> Hi all,
> Currently the tool supports generating jfr along with thread dumps and
> heap dumps. And the report template has been changed so that it reflects a
> lot more details on environmental details during an event. All collectibles
> along with thread dumps and jfrs will be bundled in to a zip archive now.
> This zip archive will be generated for each "event". This contains the
> report, thread dumps(if user requested) & jfr (if user requested). Report
> is a HTML file. Thread dumps are also viewable through this report.User can
> change the template as he wish by changing the report template HTML file
>
> On Tue, Aug 23, 2016 at 11:28 AM, Dinanjana Gunaratne <
> dinanjanagunara...@gmail.com> wrote:
>
>> Dear all,
>> This[1]
>> 
>>  is
>> the blog post I made for final work product submission. Please have a look.
>> :)
>> [1]http://dinanjanagunaratne.blogspot.com/2016/08/during-pas
>> t-3-months-i-was-engaged-in.html
>>
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
Kasun Indrasiri
Director, Integration Technologies
WSO2, Inc.; http://wso2.com
lean.enterprise.middleware

cell: +1 650 450 2293
Blog : http://kasunpanorama.blogspot.com/
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016: Proposal 7

2016-08-23 Thread Dinanjana Gunaratne
Hi all,
Currently the tool supports generating jfr along with thread dumps and heap
dumps. And the report template has been changed so that it reflects a lot
more details on environmental details during an event. All collectibles
along with thread dumps and jfrs will be bundled in to a zip archive now.
This zip archive will be generated for each "event". This contains the
report, thread dumps(if user requested) & jfr (if user requested). Report
is a HTML file. Thread dumps are also viewable through this report.User can
change the template as he wish by changing the report template HTML file

On Tue, Aug 23, 2016 at 11:28 AM, Dinanjana Gunaratne <
dinanjanagunara...@gmail.com> wrote:

> Dear all,
> This[1]
> 
>  is
> the blog post I made for final work product submission. Please have a look.
> :)
> [1]http://dinanjanagunaratne.blogspot.com/2016/08/during-pas
> t-3-months-i-was-engaged-in.html
>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


[Dev] GSOC 2016: Proposal 7

2016-08-22 Thread Dinanjana Gunaratne
Dear all,
This[1]

is
the blog post I made for final work product submission. Please have a look.
:)
[1]http://dinanjanagunaratne.blogspot.com/2016/08/during-
past-3-months-i-was-engaged-in.html
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-20 Thread Lakini Senanayaka
Hi,

This is the meeting minute for the last GSoC project review meeting(19th
August).

The final demo and the source code was reviewed  by my mentors.
Below mentioned are the new changes to be done to  the implementation.

Assigned tasks:

  1) Change the workflow of Visual Neural Network Builder and integrate
it with the  WSO2 Machine Learner Console and have a link to call the WSO2
Visual builder Main UI when the user selects Neural Network as the
algorithm in the algorithm.jag page.

  2) Remove "Select Project","Analysis" and "Model" drop downs from the
UI and add a dropdown to select the data version .

  3) Add loggers to the source code.

  4) Handle exceptions in front end UI.

  5) Check the Visual builder with MNIST dataset.

  6) Give suggestions to save and reuse models,show graphs in the front
end and include them in the documentation.

  7) Have to send a pull request to  WSO2 Carbon-ML

I have successfully completed 1,2,3,4,5,6 which are mentioned above and I
have created a small demo as well[1].

I have suggested the ways to save and reuse the models and how to show the
graphs in the client side and included them in the documentation.

I have run Visual Neural Network Builder with the MNIST dataset which
includes 7 data rows.

These are the output and
Accuracy: 0.7641904761904762
Precision: 0.8189778449814502
Recall: 0.7629256295725443
F1 Score: 0.7899586770483598

These are the hyperparameters user has set for the MNIST dataset for the UI.

Neural Network Type = Feed Forward Network
Seed = 123
Learning Rate = 0.06
Batch Size = 128
nEpoches = 15
Iteration = 1
Optimization Algorithm = Storchastic Gradient Descent
Updater = Nesterovs
Momentum = 0.9
Pretrain = False
Back Propargation = True

Input Layer:
Input Nodes = 784

1st Hidden Layer:
Number of Hidden Nodes = 1000
WeightInit = Xavier
Activation = RELU

Output Layer:
Output Nodes = 10
WeightInit = Xavier
Activation = Softmax
Loss Function = Negetive Log Likelihood

[1] https://www.youtube.com/watch?v=ZVBhFR8pcHs=youtu.be

Could you please check the demo and advice me accordingly if there is more
to change.

Thank you.

On Sat, Aug 20, 2016 at 12:31 PM, Upul Bandara  wrote:

> Please send notes of the 19th August meeting.
> Also, please do all the changes we discussed in the meeting and send a PR
> before EOD Monday (22-Aug-2016)
>
> Thanks,
> Upul
>
> On Thu, Aug 18, 2016 at 9:34 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> I have completed the implementation of  [ML] Visual (Deep) Neural Network
>> Builder for WSO2 Machine Learner.
>> I have covered all the targets which we discussed in the meetings.
>>
>> I can not provide all the commits history as I did not commit frequently
>> to the GitHub.So I planned to write a blog post about all the work I have
>> done in the project as mentioned in [1].
>>
>> You can find the code from [2],[3],[4],[5],[6].
>> I have created a spreadsheet[7] which includes the details about the code
>> I have committed.
>>
>> I will share the documentation and blog ASAP.
>>
>> [1] https://developers.google.com/open-source/gsoc/help/work-product
>> [2] https://github.com/Lakini/MLbackend/blob/master/componen
>> ts/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/wso2/
>> carbon/ml/rest/api/ModelApiV20.java#L624-L698
>> [3] https://github.com/Lakini/MLbackend/blob/master/componen
>> ts/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/wso2/
>> carbon/ml/rest/api/neuralNetworks/FeedForwardNetwork.java
>> [4] https://github.com/Lakini/MLbackend/blob/master/componen
>> ts/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/wso2/
>> carbon/ml/rest/api/neuralNetworks/OutputLayerDetails.java
>> [5] https://github.com/Lakini/MLbackend/blob/master/componen
>> ts/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/wso2/
>> carbon/ml/rest/api/neuralNetworks/hiddenLayerDetails.java
>> [6] https://github.com/Lakini/MLClientside
>> 
>> [7] https://docs.google.com/spreadsheets/d/1AWXvvfhEKFeUs8k3
>> WaWhEyLyroo1h-8J_p-aKW-0Kdw/edit?usp=sharing
>> 
>>
>> Thank you.
>>
>
>
>
> --
> Upul Bandara,
> Associate Technical Lead, WSO2, Inc.,
> Mob: +94 715 468 345.
>



-- 
KIND Regards,
*Lakini Senanayaka.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-20 Thread Upul Bandara
Please send notes of the 19th August meeting.
Also, please do all the changes we discussed in the meeting and send a PR
before EOD Monday (22-Aug-2016)

Thanks,
Upul

On Thu, Aug 18, 2016 at 9:34 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I have completed the implementation of  [ML] Visual (Deep) Neural Network
> Builder for WSO2 Machine Learner.
> I have covered all the targets which we discussed in the meetings.
>
> I can not provide all the commits history as I did not commit frequently
> to the GitHub.So I planned to write a blog post about all the work I have
> done in the project as mentioned in [1].
>
> You can find the code from [2],[3],[4],[5],[6].
> I have created a spreadsheet[7] which includes the details about the code
> I have committed.
>
> I will share the documentation and blog ASAP.
>
> [1] https://developers.google.com/open-source/gsoc/help/work-product
> [2] https://github.com/Lakini/MLbackend/blob/master/
> components/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/
> wso2/carbon/ml/rest/api/ModelApiV20.java#L624-L698
> [3] https://github.com/Lakini/MLbackend/blob/master/
> components/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/
> wso2/carbon/ml/rest/api/neuralNetworks/FeedForwardNetwork.java
> [4] https://github.com/Lakini/MLbackend/blob/master/
> components/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/
> wso2/carbon/ml/rest/api/neuralNetworks/OutputLayerDetails.java
> [5] https://github.com/Lakini/MLbackend/blob/master/
> components/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/
> wso2/carbon/ml/rest/api/neuralNetworks/hiddenLayerDetails.java
> [6] https://github.com/Lakini/MLClientside
> 
> [7] https://docs.google.com/spreadsheets/d/1AWXvvfhEKFeUs8k3WaWhEyLyroo1h
> -8J_p-aKW-0Kdw/edit?usp=sharing
> 
>
> Thank you.
>



-- 
Upul Bandara,
Associate Technical Lead, WSO2, Inc.,
Mob: +94 715 468 345.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-17 Thread Lakini Senanayaka
Hi,

I have completed the implementation of  [ML] Visual (Deep) Neural Network
Builder for WSO2 Machine Learner.
I have covered all the targets which we discussed in the meetings.

I can not provide all the commits history as I did not commit frequently to
the GitHub.So I planned to write a blog post about all the work I have done
in the project as mentioned in [1].

You can find the code from [2],[3],[4],[5],[6].
I have created a spreadsheet[7] which includes the details about the code I
have committed.

I will share the documentation and blog ASAP.

[1] https://developers.google.com/open-source/gsoc/help/work-product
[2]
https://github.com/Lakini/MLbackend/blob/master/components/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/wso2/carbon/ml/rest/api/ModelApiV20.java#L624-L698
[3]
https://github.com/Lakini/MLbackend/blob/master/components/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/wso2/carbon/ml/rest/api/neuralNetworks/FeedForwardNetwork.java
[4]
https://github.com/Lakini/MLbackend/blob/master/components/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/wso2/carbon/ml/rest/api/neuralNetworks/OutputLayerDetails.java
[5]
https://github.com/Lakini/MLbackend/blob/master/components/ml/org.wso2.carbon.ml.rest.api/src/main/java/org/wso2/carbon/ml/rest/api/neuralNetworks/hiddenLayerDetails.java
[6] https://github.com/Lakini/MLClientside

[7]
 
https://docs.google.com/spreadsheets/d/1AWXvvfhEKFeUs8k3WaWhEyLyroo1h-8J_p-aKW-0Kdw/edit?usp=sharing


Thank you.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-11 Thread Lakini Senanayaka
Hi,

Thank you very much for the information.
I will schedule a final demo presentation meeting on next Tuesday.(16
August 2016)

Thank you.

On Fri, Aug 12, 2016 at 9:33 AM, Upul Bandara  wrote:

> Thanks for the update.
>
> Please schedule a meeting (and demo) on Monday or Tuesday next week.
> As commented by Supun, quality of your code base, UI and demo have to  be
> in  very good quality.
>
> Thanks,
> Upul
>
> On Fri, Aug 12, 2016 at 9:20 AM, Supun Sethunga  wrote:
>
>> Hi Lakini,
>>
>> Thanks for the update. Can you please schedule a final demo with end to
>> end implementation, early next week? Please note that this demo and the
>> quality of deliverables (specially the code, documentations, etc) will have
>> a big impact on the final evaluations.
>>
>> Regards,
>> Supun
>>
>> On Fri, Aug 12, 2016 at 8:54 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I have taken only the Accuracy,Precision,F1 Score and Recall of neural
>>> networks.
>>> The values are listed below.
>>>
>>> *Accuracy: 0.9712*
>>> *Precision: 0.9711317415957886*
>>> *Recall: 0.9708490075847962*
>>> *F1 Score: 0.9709903540085949*
>>>
>>> These are the hyper parameters user has set for the MNIST dataset
>>> for the UI.
>>>
>>> *Neural Network Type = Feed Forward Network*
>>> *Seed = 123*
>>> *Learning Rate = 0.006*
>>> *Batch Size = 128*
>>> *nEpoches = 15*
>>> *Iteration = 1*
>>> *Optimization Algorithm = Storchastic Gradient Descent*
>>> *Updater = Nesterovs*
>>> *Momentum = 0.9*
>>> *Pretrain = False*
>>> *Back Propargation = True*
>>>
>>> *Input Layer:*
>>> * Input Nodes = 784*
>>>
>>> *1st Hidden Layer:*
>>> * Number of Hidden Nodes = 1000*
>>> * WeightInit = Xavier*
>>> * Activation = RELU*
>>>
>>> *Output Layer:*
>>> * Output Nodes = 10*
>>> * WeightInit = Xavier*
>>> * Activation = Softmax*
>>> * Loss Function = Negetive Log Likelihood*
>>>
>>>
>>> For the training purposes and  for the time being I have used the
>>> Dataset of MNIST which is available in DL4J library.
>>>
>>> *DataSetIterator trainIter = new MnistDataSetIterator(bachSize, true,
>>> (int)seed);*
>>> *DataSetIterator testIter = new MnistDataSetIterator(bachSize, false,
>>> (int) seed);*
>>>
>>> I will try to use the dataset from the WSO2 ML Server.I couldn't try it
>>> yesterday.
>>>
>>> The training time for the above scenario is 08 min 45s .
>>> I will share the code once I complete reading data set from the WSO2 ML
>>> Sever.
>>>
>>> Thank you.
>>>
>>> On Thu, Aug 11, 2016 at 8:43 AM, Upul Bandara  wrote:
>>>
 Sounds good

 Can you please share us the performance numbers (and confusion matrix)
 you got with the MINIST?
 Also, how did you do:
 load MNIST data into WSO2 ML Server?
 split training/testing subsets?
 Tune hyper-parameters?

 What was the training time?

 Thanks,
 Upul


 On Thu, Aug 11, 2016 at 6:59 AM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi.
>
> Thank you very much for sharing the code.
> I have solved many of the issues I had with the UI.
>
> I have tested the UI with MNIST dataset.It gave the correct results
> and the UI is working well with large datasets.
>
> The UI gets unresponsive for sometimes as the AJAX call takes nearly 5
> minutes to give the response.Currently, I am handling that issue and I 
> have
> to call the dataset from the ML server.
>
> I will share my documentation as soon as possible.
>
> Thank you.
>
> On Tue, Aug 9, 2016 at 9:52 AM, Upul Bandara  wrote:
>
>> Following jag file ( please look at function loadDatasets(), function
>> updateDatasets(), function deleteDataset(datasetId) and etc) has 
>> everything
>> you need to know to get dataset from ML server to your UI. Please kindly
>> note that it is very difficult for us to give exact code snippet to meet
>> your requirement. As a student, you should be able to go through 
>> available
>> code which shows how to use APIs and uses those APIs in your 
>> applications.
>>
>> I think the API doc Supun shared with you and the following jag file
>> will help you to understand how to extract dataset and versions from the 
>> ML
>> Server and displaying those in your UI.
>>
>> BTW, did you manage to test your UI with large datasets such as
>> MNIST. MNIST is an image dataset but you can convert it to standard CSV
>> format and can be used to train NN using your UI.
>>
>> https://github.com/wso2/carbon-ml/blob/master/apps/ml/site/d
>> ata/datasets.jag
>>
>> On Mon, Aug 8, 2016 at 6:31 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you very much.
>>>
>>> But Upul told me about a code snippet which I can use inside the API
>>> implementation in the 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-11 Thread Upul Bandara
Thanks for the update.

Please schedule a meeting (and demo) on Monday or Tuesday next week.
As commented by Supun, quality of your code base, UI and demo have to  be
in  very good quality.

Thanks,
Upul

On Fri, Aug 12, 2016 at 9:20 AM, Supun Sethunga  wrote:

> Hi Lakini,
>
> Thanks for the update. Can you please schedule a final demo with end to
> end implementation, early next week? Please note that this demo and the
> quality of deliverables (specially the code, documentations, etc) will have
> a big impact on the final evaluations.
>
> Regards,
> Supun
>
> On Fri, Aug 12, 2016 at 8:54 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> I have taken only the Accuracy,Precision,F1 Score and Recall of neural
>> networks.
>> The values are listed below.
>>
>> *Accuracy: 0.9712*
>> *Precision: 0.9711317415957886*
>> *Recall: 0.9708490075847962*
>> *F1 Score: 0.9709903540085949*
>>
>> These are the hyper parameters user has set for the MNIST dataset for the
>> UI.
>>
>> *Neural Network Type = Feed Forward Network*
>> *Seed = 123*
>> *Learning Rate = 0.006*
>> *Batch Size = 128*
>> *nEpoches = 15*
>> *Iteration = 1*
>> *Optimization Algorithm = Storchastic Gradient Descent*
>> *Updater = Nesterovs*
>> *Momentum = 0.9*
>> *Pretrain = False*
>> *Back Propargation = True*
>>
>> *Input Layer:*
>> * Input Nodes = 784*
>>
>> *1st Hidden Layer:*
>> * Number of Hidden Nodes = 1000*
>> * WeightInit = Xavier*
>> * Activation = RELU*
>>
>> *Output Layer:*
>> * Output Nodes = 10*
>> * WeightInit = Xavier*
>> * Activation = Softmax*
>> * Loss Function = Negetive Log Likelihood*
>>
>>
>> For the training purposes and  for the time being I have used the Dataset
>> of MNIST which is available in DL4J library.
>>
>> *DataSetIterator trainIter = new MnistDataSetIterator(bachSize, true,
>> (int)seed);*
>> *DataSetIterator testIter = new MnistDataSetIterator(bachSize, false,
>> (int) seed);*
>>
>> I will try to use the dataset from the WSO2 ML Server.I couldn't try it
>> yesterday.
>>
>> The training time for the above scenario is 08 min 45s .
>> I will share the code once I complete reading data set from the WSO2 ML
>> Sever.
>>
>> Thank you.
>>
>> On Thu, Aug 11, 2016 at 8:43 AM, Upul Bandara  wrote:
>>
>>> Sounds good
>>>
>>> Can you please share us the performance numbers (and confusion matrix)
>>> you got with the MINIST?
>>> Also, how did you do:
>>> load MNIST data into WSO2 ML Server?
>>> split training/testing subsets?
>>> Tune hyper-parameters?
>>>
>>> What was the training time?
>>>
>>> Thanks,
>>> Upul
>>>
>>>
>>> On Thu, Aug 11, 2016 at 6:59 AM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi.

 Thank you very much for sharing the code.
 I have solved many of the issues I had with the UI.

 I have tested the UI with MNIST dataset.It gave the correct results and
 the UI is working well with large datasets.

 The UI gets unresponsive for sometimes as the AJAX call takes nearly 5
 minutes to give the response.Currently, I am handling that issue and I have
 to call the dataset from the ML server.

 I will share my documentation as soon as possible.

 Thank you.

 On Tue, Aug 9, 2016 at 9:52 AM, Upul Bandara  wrote:

> Following jag file ( please look at function loadDatasets(), function
> updateDatasets(), function deleteDataset(datasetId) and etc) has 
> everything
> you need to know to get dataset from ML server to your UI. Please kindly
> note that it is very difficult for us to give exact code snippet to meet
> your requirement. As a student, you should be able to go through available
> code which shows how to use APIs and uses those APIs in your applications.
>
> I think the API doc Supun shared with you and the following jag file
> will help you to understand how to extract dataset and versions from the 
> ML
> Server and displaying those in your UI.
>
> BTW, did you manage to test your UI with large datasets such as MNIST.
> MNIST is an image dataset but you can convert it to standard CSV format 
> and
> can be used to train NN using your UI.
>
> https://github.com/wso2/carbon-ml/blob/master/apps/ml/site/d
> ata/datasets.jag
>
> On Mon, Aug 8, 2016 at 6:31 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you very much.
>>
>> But Upul told me about a code snippet which I can use inside the API
>> implementation in the last meeting.
>>
>> However can I get the dataset file from calling *GET
>> https://localhost:9443/api/datasets/{datasetId}
>>  * inside the
>> API implementation in the backend (inside carbon-ml\components\ml\
>> org.wso2.carbon.ml.rest.api\src\main\java\org\wso2\carbon\ml\rest\api )
>> and can I 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-11 Thread Supun Sethunga
Hi Lakini,

Thanks for the update. Can you please schedule a final demo with end to end
implementation, early next week? Please note that this demo and the quality
of deliverables (specially the code, documentations, etc) will have a big
impact on the final evaluations.

Regards,
Supun

On Fri, Aug 12, 2016 at 8:54 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I have taken only the Accuracy,Precision,F1 Score and Recall of neural
> networks.
> The values are listed below.
>
> *Accuracy: 0.9712*
> *Precision: 0.9711317415957886*
> *Recall: 0.9708490075847962*
> *F1 Score: 0.9709903540085949*
>
> These are the hyper parameters user has set for the MNIST dataset for the
> UI.
>
> *Neural Network Type = Feed Forward Network*
> *Seed = 123*
> *Learning Rate = 0.006*
> *Batch Size = 128*
> *nEpoches = 15*
> *Iteration = 1*
> *Optimization Algorithm = Storchastic Gradient Descent*
> *Updater = Nesterovs*
> *Momentum = 0.9*
> *Pretrain = False*
> *Back Propargation = True*
>
> *Input Layer:*
> * Input Nodes = 784*
>
> *1st Hidden Layer:*
> * Number of Hidden Nodes = 1000*
> * WeightInit = Xavier*
> * Activation = RELU*
>
> *Output Layer:*
> * Output Nodes = 10*
> * WeightInit = Xavier*
> * Activation = Softmax*
> * Loss Function = Negetive Log Likelihood*
>
>
> For the training purposes and  for the time being I have used the Dataset
> of MNIST which is available in DL4J library.
>
> *DataSetIterator trainIter = new MnistDataSetIterator(bachSize, true,
> (int)seed);*
> *DataSetIterator testIter = new MnistDataSetIterator(bachSize, false,
> (int) seed);*
>
> I will try to use the dataset from the WSO2 ML Server.I couldn't try it
> yesterday.
>
> The training time for the above scenario is 08 min 45s .
> I will share the code once I complete reading data set from the WSO2 ML
> Sever.
>
> Thank you.
>
> On Thu, Aug 11, 2016 at 8:43 AM, Upul Bandara  wrote:
>
>> Sounds good
>>
>> Can you please share us the performance numbers (and confusion matrix)
>> you got with the MINIST?
>> Also, how did you do:
>> load MNIST data into WSO2 ML Server?
>> split training/testing subsets?
>> Tune hyper-parameters?
>>
>> What was the training time?
>>
>> Thanks,
>> Upul
>>
>>
>> On Thu, Aug 11, 2016 at 6:59 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi.
>>>
>>> Thank you very much for sharing the code.
>>> I have solved many of the issues I had with the UI.
>>>
>>> I have tested the UI with MNIST dataset.It gave the correct results and
>>> the UI is working well with large datasets.
>>>
>>> The UI gets unresponsive for sometimes as the AJAX call takes nearly 5
>>> minutes to give the response.Currently, I am handling that issue and I have
>>> to call the dataset from the ML server.
>>>
>>> I will share my documentation as soon as possible.
>>>
>>> Thank you.
>>>
>>> On Tue, Aug 9, 2016 at 9:52 AM, Upul Bandara  wrote:
>>>
 Following jag file ( please look at function loadDatasets(), function
 updateDatasets(), function deleteDataset(datasetId) and etc) has everything
 you need to know to get dataset from ML server to your UI. Please kindly
 note that it is very difficult for us to give exact code snippet to meet
 your requirement. As a student, you should be able to go through available
 code which shows how to use APIs and uses those APIs in your applications.

 I think the API doc Supun shared with you and the following jag file
 will help you to understand how to extract dataset and versions from the ML
 Server and displaying those in your UI.

 BTW, did you manage to test your UI with large datasets such as MNIST.
 MNIST is an image dataset but you can convert it to standard CSV format and
 can be used to train NN using your UI.

 https://github.com/wso2/carbon-ml/blob/master/apps/ml/site/d
 ata/datasets.jag

 On Mon, Aug 8, 2016 at 6:31 AM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you very much.
>
> But Upul told me about a code snippet which I can use inside the API
> implementation in the last meeting.
>
> However can I get the dataset file from calling *GET
> https://localhost:9443/api/datasets/{datasetId}
>  * inside the
> API implementation in the backend (inside carbon-ml\components\ml\
> org.wso2.carbon.ml.rest.api\src\main\java\org\wso2\carbon\ml\rest\api )
> and can I access the dataset through the response's *"sourcePath" ?*
>
> Thank you.
>
> On Sun, Aug 7, 2016 at 8:06 PM, Supun Sethunga 
> wrote:
>
>> Hi Lakini,
>>
>> Please find all the APIs and their samples at [1]. Additionally, you
>> can always refer the existing UI to get an idea. for eg: you can check 
>> the
>> dataset page of the existing ML UI to see how the datasets are retrieved.
>>

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-11 Thread Lakini Senanayaka
Hi,

I have taken only the Accuracy,Precision,F1 Score and Recall of neural
networks.
The values are listed below.

*Accuracy: 0.9712*
*Precision: 0.9711317415957886*
*Recall: 0.9708490075847962*
*F1 Score: 0.9709903540085949*

These are the hyper parameters user has set for the MNIST dataset for the
UI.

*Neural Network Type = Feed Forward Network*
*Seed = 123*
*Learning Rate = 0.006*
*Batch Size = 128*
*nEpoches = 15*
*Iteration = 1*
*Optimization Algorithm = Storchastic Gradient Descent*
*Updater = Nesterovs*
*Momentum = 0.9*
*Pretrain = False*
*Back Propargation = True*

*Input Layer:*
* Input Nodes = 784*

*1st Hidden Layer:*
* Number of Hidden Nodes = 1000*
* WeightInit = Xavier*
* Activation = RELU*

*Output Layer:*
* Output Nodes = 10*
* WeightInit = Xavier*
* Activation = Softmax*
* Loss Function = Negetive Log Likelihood*


For the training purposes and  for the time being I have used the Dataset
of MNIST which is available in DL4J library.

*DataSetIterator trainIter = new MnistDataSetIterator(bachSize, true,
(int)seed);*
*DataSetIterator testIter = new MnistDataSetIterator(bachSize, false, (int)
seed);*

I will try to use the dataset from the WSO2 ML Server.I couldn't try it
yesterday.

The training time for the above scenario is 08 min 45s .
I will share the code once I complete reading data set from the WSO2 ML
Sever.

Thank you.

On Thu, Aug 11, 2016 at 8:43 AM, Upul Bandara  wrote:

> Sounds good
>
> Can you please share us the performance numbers (and confusion matrix) you
> got with the MINIST?
> Also, how did you do:
> load MNIST data into WSO2 ML Server?
> split training/testing subsets?
> Tune hyper-parameters?
>
> What was the training time?
>
> Thanks,
> Upul
>
>
> On Thu, Aug 11, 2016 at 6:59 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi.
>>
>> Thank you very much for sharing the code.
>> I have solved many of the issues I had with the UI.
>>
>> I have tested the UI with MNIST dataset.It gave the correct results and
>> the UI is working well with large datasets.
>>
>> The UI gets unresponsive for sometimes as the AJAX call takes nearly 5
>> minutes to give the response.Currently, I am handling that issue and I have
>> to call the dataset from the ML server.
>>
>> I will share my documentation as soon as possible.
>>
>> Thank you.
>>
>> On Tue, Aug 9, 2016 at 9:52 AM, Upul Bandara  wrote:
>>
>>> Following jag file ( please look at function loadDatasets(), function
>>> updateDatasets(), function deleteDataset(datasetId) and etc) has everything
>>> you need to know to get dataset from ML server to your UI. Please kindly
>>> note that it is very difficult for us to give exact code snippet to meet
>>> your requirement. As a student, you should be able to go through available
>>> code which shows how to use APIs and uses those APIs in your applications.
>>>
>>> I think the API doc Supun shared with you and the following jag file
>>> will help you to understand how to extract dataset and versions from the ML
>>> Server and displaying those in your UI.
>>>
>>> BTW, did you manage to test your UI with large datasets such as MNIST.
>>> MNIST is an image dataset but you can convert it to standard CSV format and
>>> can be used to train NN using your UI.
>>>
>>> https://github.com/wso2/carbon-ml/blob/master/apps/ml/site/d
>>> ata/datasets.jag
>>>
>>> On Mon, Aug 8, 2016 at 6:31 AM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

 Thank you very much.

 But Upul told me about a code snippet which I can use inside the API
 implementation in the last meeting.

 However can I get the dataset file from calling *GET
 https://localhost:9443/api/datasets/{datasetId}
  * inside the API
 implementation in the backend (inside carbon-ml\components\ml\org.ws
 o2.carbon.ml.rest.api\src\main\java\org\wso2\carbon\ml\rest\api ) and
 can I access the dataset through the response's *"sourcePath" ?*

 Thank you.

 On Sun, Aug 7, 2016 at 8:06 PM, Supun Sethunga  wrote:

> Hi Lakini,
>
> Please find all the APIs and their samples at [1]. Additionally, you
> can always refer the existing UI to get an idea. for eg: you can check the
> dataset page of the existing ML UI to see how the datasets are retrieved.
>
> [1] https://docs.wso2.com/display/ML110/REST+API+Guides
>
> Regards,
> Supun.
>
> On Sat, Aug 6, 2016 at 11:06 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi Upul,
>>
>> Could you please explain me the way to get the dataset from the
>> carbon ML to the API which I am implementing.
>>
>> Thank you.
>>
>> On Thu, Aug 4, 2016 at 4:37 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> This is the meeting minute for today's GSoC project 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-10 Thread Upul Bandara
Sounds good

Can you please share us the performance numbers (and confusion matrix) you
got with the MINIST?
Also, how did you do:
load MNIST data into WSO2 ML Server?
split training/testing subsets?
Tune hyper-parameters?

What was the training time?

Thanks,
Upul


On Thu, Aug 11, 2016 at 6:59 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi.
>
> Thank you very much for sharing the code.
> I have solved many of the issues I had with the UI.
>
> I have tested the UI with MNIST dataset.It gave the correct results and
> the UI is working well with large datasets.
>
> The UI gets unresponsive for sometimes as the AJAX call takes nearly 5
> minutes to give the response.Currently, I am handling that issue and I have
> to call the dataset from the ML server.
>
> I will share my documentation as soon as possible.
>
> Thank you.
>
> On Tue, Aug 9, 2016 at 9:52 AM, Upul Bandara  wrote:
>
>> Following jag file ( please look at function loadDatasets(), function
>> updateDatasets(), function deleteDataset(datasetId) and etc) has everything
>> you need to know to get dataset from ML server to your UI. Please kindly
>> note that it is very difficult for us to give exact code snippet to meet
>> your requirement. As a student, you should be able to go through available
>> code which shows how to use APIs and uses those APIs in your applications.
>>
>> I think the API doc Supun shared with you and the following jag file will
>> help you to understand how to extract dataset and versions from the ML
>> Server and displaying those in your UI.
>>
>> BTW, did you manage to test your UI with large datasets such as MNIST.
>> MNIST is an image dataset but you can convert it to standard CSV format and
>> can be used to train NN using your UI.
>>
>> https://github.com/wso2/carbon-ml/blob/master/apps/ml/site/d
>> ata/datasets.jag
>>
>> On Mon, Aug 8, 2016 at 6:31 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you very much.
>>>
>>> But Upul told me about a code snippet which I can use inside the API
>>> implementation in the last meeting.
>>>
>>> However can I get the dataset file from calling *GET
>>> https://localhost:9443/api/datasets/{datasetId}
>>>  * inside the API
>>> implementation in the backend (inside carbon-ml\components\ml\org.ws
>>> o2.carbon.ml.rest.api\src\main\java\org\wso2\carbon\ml\rest\api ) and
>>> can I access the dataset through the response's *"sourcePath" ?*
>>>
>>> Thank you.
>>>
>>> On Sun, Aug 7, 2016 at 8:06 PM, Supun Sethunga  wrote:
>>>
 Hi Lakini,

 Please find all the APIs and their samples at [1]. Additionally, you
 can always refer the existing UI to get an idea. for eg: you can check the
 dataset page of the existing ML UI to see how the datasets are retrieved.

 [1] https://docs.wso2.com/display/ML110/REST+API+Guides

 Regards,
 Supun.

 On Sat, Aug 6, 2016 at 11:06 AM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi Upul,
>
> Could you please explain me the way to get the dataset from the carbon
> ML to the API which I am implementing.
>
> Thank you.
>
> On Thu, Aug 4, 2016 at 4:37 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> This is the meeting minute for today's GSoC project review meeting.
>>
>> Upul reviewed the current progress of the project, "(Deep) Neural
>> Network Builder for WSO2 Machine Learner".
>> Below mentioned are the decisions made and the new tasks allocated at
>> the meeting.
>>
>> Assigned action items:
>> -Making the UI more user-friendly.
>> Ex: Physical lines of connections between layers should
>> follow the movements of the layers.
>> -Train the feed forward network for MNIST dataset.
>> -Testing the accuracy of the neural network model for different
>> optimization and updater algorithms.
>> -Handling Exceptions.
>> -Trying to show graphs related to the model, along with the
>> accuracy of the model in the output.
>> -Start writing documentation.
>> -Showing a demo for the ML team.
>>
>> Decisions made:
>>
>>  -Higher priority should be given in implementing feed-forward
>> network than RNN.
>>  -Upul will provide me necessary instructions on the way to
>> access the dataset which is inserted through the WSO2 ML console as NN
>> builder UI needs to access that dataset and use as the training dataset.
>>
>> Thank you.
>>
>> On Wed, Aug 3, 2016 at 5:59 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you very much for your kindness.
>>>
>>> I can schedule a meeting on this Thursday(4th-August-2016).
>>>
>>> Thank you.
>>>
>>> On 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-10 Thread Lakini Senanayaka
Hi.

Thank you very much for sharing the code.
I have solved many of the issues I had with the UI.

I have tested the UI with MNIST dataset.It gave the correct results and the
UI is working well with large datasets.

The UI gets unresponsive for sometimes as the AJAX call takes nearly 5
minutes to give the response.Currently, I am handling that issue and I have
to call the dataset from the ML server.

I will share my documentation as soon as possible.

Thank you.

On Tue, Aug 9, 2016 at 9:52 AM, Upul Bandara  wrote:

> Following jag file ( please look at function loadDatasets(), function
> updateDatasets(), function deleteDataset(datasetId) and etc) has everything
> you need to know to get dataset from ML server to your UI. Please kindly
> note that it is very difficult for us to give exact code snippet to meet
> your requirement. As a student, you should be able to go through available
> code which shows how to use APIs and uses those APIs in your applications.
>
> I think the API doc Supun shared with you and the following jag file will
> help you to understand how to extract dataset and versions from the ML
> Server and displaying those in your UI.
>
> BTW, did you manage to test your UI with large datasets such as MNIST.
> MNIST is an image dataset but you can convert it to standard CSV format and
> can be used to train NN using your UI.
>
> https://github.com/wso2/carbon-ml/blob/master/apps/ml/site/
> data/datasets.jag
>
> On Mon, Aug 8, 2016 at 6:31 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you very much.
>>
>> But Upul told me about a code snippet which I can use inside the API
>> implementation in the last meeting.
>>
>> However can I get the dataset file from calling *GET
>> https://localhost:9443/api/datasets/{datasetId}
>>  * inside the API
>> implementation in the backend (inside carbon-ml\components\ml\org.ws
>> o2.carbon.ml.rest.api\src\main\java\org\wso2\carbon\ml\rest\api ) and
>> can I access the dataset through the response's *"sourcePath" ?*
>>
>> Thank you.
>>
>> On Sun, Aug 7, 2016 at 8:06 PM, Supun Sethunga  wrote:
>>
>>> Hi Lakini,
>>>
>>> Please find all the APIs and their samples at [1]. Additionally, you can
>>> always refer the existing UI to get an idea. for eg: you can check the
>>> dataset page of the existing ML UI to see how the datasets are retrieved.
>>>
>>> [1] https://docs.wso2.com/display/ML110/REST+API+Guides
>>>
>>> Regards,
>>> Supun.
>>>
>>> On Sat, Aug 6, 2016 at 11:06 AM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi Upul,

 Could you please explain me the way to get the dataset from the carbon
 ML to the API which I am implementing.

 Thank you.

 On Thu, Aug 4, 2016 at 4:37 PM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> This is the meeting minute for today's GSoC project review meeting.
>
> Upul reviewed the current progress of the project, "(Deep) Neural
> Network Builder for WSO2 Machine Learner".
> Below mentioned are the decisions made and the new tasks allocated at
> the meeting.
>
> Assigned action items:
> -Making the UI more user-friendly.
> Ex: Physical lines of connections between layers should follow
> the movements of the layers.
> -Train the feed forward network for MNIST dataset.
> -Testing the accuracy of the neural network model for different
> optimization and updater algorithms.
> -Handling Exceptions.
> -Trying to show graphs related to the model, along with the
> accuracy of the model in the output.
> -Start writing documentation.
> -Showing a demo for the ML team.
>
> Decisions made:
>
>  -Higher priority should be given in implementing feed-forward
> network than RNN.
>  -Upul will provide me necessary instructions on the way to access
> the dataset which is inserted through the WSO2 ML console as NN builder UI
> needs to access that dataset and use as the training dataset.
>
> Thank you.
>
> On Wed, Aug 3, 2016 at 5:59 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you very much for your kindness.
>>
>> I can schedule a meeting on this Thursday(4th-August-2016).
>>
>> Thank you.
>>
>> On Tue, Aug 2, 2016 at 10:39 AM, Upul Bandara  wrote:
>>
>>> Hi,
>>>
>>> As you know we have only two weeks to complete GSOC projects.
>>> Unfortunately, this project is a little bit lagging behind and it looks
>>> like you have to put some additional effort during the last two week. In
>>> order to support you, we though it is better to have a small F2F meeting
>>> with you and it will help you to sort out any issues currently you are
>>> 

Re: [Dev] GSOC 2016: Proposal 7

2016-08-09 Thread Dinanjana Gunaratne
t;>>>>>>>>>>>>>>>>>>>>>>>>>>>>> about a "feature"  to ESB ?
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Mon, Feb 29, 2016 at 9:32 AM, Isuru Udana
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> <isu...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Dinanjana,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Intention of this project is to build a tool
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> which ease production incident analysis.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Some of the common production incidents are,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> - Server goes OOM
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> - Increase of CPU usage
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> - Server goes to an unresponsive state
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> We need to detect those situations and need
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> to extract useful information to debug the 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> issue before the server goes to
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> a catastrophic state.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> For an example, when the server goes OOM, it
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> will automatically generate the heap dump. 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> However heap dump is not
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> sufficient to analyse the incident. We need to 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> see what causes the increase
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> of heap. That may be due to increase of load 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (requests) or may be due to a
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> bug. So we need to extract information like TPS 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> of the server, thread dumps
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> to do the further analysis.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-08 Thread Upul Bandara
Following jag file ( please look at function loadDatasets(), function
updateDatasets(), function deleteDataset(datasetId) and etc) has everything
you need to know to get dataset from ML server to your UI. Please kindly
note that it is very difficult for us to give exact code snippet to meet
your requirement. As a student, you should be able to go through available
code which shows how to use APIs and uses those APIs in your applications.

I think the API doc Supun shared with you and the following jag file will
help you to understand how to extract dataset and versions from the ML
Server and displaying those in your UI.

BTW, did you manage to test your UI with large datasets such as MNIST.
MNIST is an image dataset but you can convert it to standard CSV format and
can be used to train NN using your UI.

https://github.com/wso2/carbon-ml/blob/master/apps/ml/site/data/datasets.jag

On Mon, Aug 8, 2016 at 6:31 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you very much.
>
> But Upul told me about a code snippet which I can use inside the API
> implementation in the last meeting.
>
> However can I get the dataset file from calling *GET
> https://localhost:9443/api/datasets/{datasetId}
>  * inside the API
> implementation in the backend (inside carbon-ml\components\ml\org.
> wso2.carbon.ml.rest.api\src\main\java\org\wso2\carbon\ml\rest\api ) and
> can I access the dataset through the response's *"sourcePath" ?*
>
> Thank you.
>
> On Sun, Aug 7, 2016 at 8:06 PM, Supun Sethunga  wrote:
>
>> Hi Lakini,
>>
>> Please find all the APIs and their samples at [1]. Additionally, you can
>> always refer the existing UI to get an idea. for eg: you can check the
>> dataset page of the existing ML UI to see how the datasets are retrieved.
>>
>> [1] https://docs.wso2.com/display/ML110/REST+API+Guides
>>
>> Regards,
>> Supun.
>>
>> On Sat, Aug 6, 2016 at 11:06 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi Upul,
>>>
>>> Could you please explain me the way to get the dataset from the carbon
>>> ML to the API which I am implementing.
>>>
>>> Thank you.
>>>
>>> On Thu, Aug 4, 2016 at 4:37 PM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

 This is the meeting minute for today's GSoC project review meeting.

 Upul reviewed the current progress of the project, "(Deep) Neural
 Network Builder for WSO2 Machine Learner".
 Below mentioned are the decisions made and the new tasks allocated at
 the meeting.

 Assigned action items:
 -Making the UI more user-friendly.
 Ex: Physical lines of connections between layers should follow
 the movements of the layers.
 -Train the feed forward network for MNIST dataset.
 -Testing the accuracy of the neural network model for different
 optimization and updater algorithms.
 -Handling Exceptions.
 -Trying to show graphs related to the model, along with the
 accuracy of the model in the output.
 -Start writing documentation.
 -Showing a demo for the ML team.

 Decisions made:

  -Higher priority should be given in implementing feed-forward
 network than RNN.
  -Upul will provide me necessary instructions on the way to access
 the dataset which is inserted through the WSO2 ML console as NN builder UI
 needs to access that dataset and use as the training dataset.

 Thank you.

 On Wed, Aug 3, 2016 at 5:59 AM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you very much for your kindness.
>
> I can schedule a meeting on this Thursday(4th-August-2016).
>
> Thank you.
>
> On Tue, Aug 2, 2016 at 10:39 AM, Upul Bandara  wrote:
>
>> Hi,
>>
>> As you know we have only two weeks to complete GSOC projects.
>> Unfortunately, this project is a little bit lagging behind and it looks
>> like you have to put some additional effort during the last two week. In
>> order to support you, we though it is better to have a small F2F meeting
>> with you and it will help you to sort out any issues currently you are
>> facing with.
>>
>> So can you please schedule a meeting with the ML team?
>>
>> Thanks,
>> Upul
>>
>> On Sat, Jul 30, 2016 at 5:45 PM, Nirmal Fernando 
>> wrote:
>>
>>>
>>> On Sat, Jul 30, 2016 at 1:43 PM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

 I have solved the above problem.I have referred the mail thread *[Dev]
 "Error 403 - Forbidden" when session expires in admin console*[1] in
 dev mailing list.I couldn't upload  jaggery files to the console  and 
 when
 I was trying to do it, it gave the* Error 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-08-07 Thread Tharindu Edirisinghe
+Mohan

Hi Asantha,

I've added Mohan to this mail thread who is working in the Analytics team
at WSO2. He will be able to give a helping hand to the user activity
analysis part that you are doing in this project.

I've scheduled a google hangout (12th Aug 2016 5.00 p.m IST) for discussing
this further where Mohan would join to clarify your concerns in this
project. I've already sent a meeting request.

Meanwhile, it is better to reply to this thread with the problems you have
faced so Mohan can get an idea on in which areas you need help.

Thanks,
TharinduE

On Mon, Aug 1, 2016 at 12:05 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> yes sure i am comfortable with any time and look forward for that
>
> Thanks,
> Asantha
>
> On Sun, Jul 31, 2016 at 12:15 PM, Tharindu Edirisinghe  > wrote:
>
>> Hi Asantha,
>>
>> Good work so far. Since we are reaching the final stage of GSoC, let's
>> have a hangout at the end of this week and plan the final steps to complete
>> the project.
>>
>> I will go through the deliverables and provide feedback soon.
>>
>> Thanks,
>> Tharindu
>>
>> On Mon, Jul 25, 2016 at 12:08 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have cleaned up all the bugs and removed all unnecessary codes and
>>> committed all the changes into my repository[1]
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Sat, Jul 23, 2016 at 8:26 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 here i added all the commitments to spread sheet[1] and also i updated
 my blog with about java document api[2] and also i added findbug report[3]
 and also i updated my blog with the code quality analysis process i have
 done[4]

 [1]https://docs.google.com/spreadsheets/d/1jwSR_qFV-
 LfOS7ZTZ8CpiFFTYPoudDQF7zQhvblivaE/edit?usp=sharing
 [2]http://asanthamax.blogspot.com/2016/07/mongodb-user-
 store-package-hierarchy.html
 [3]https://googledrive.com/host/0B__ZE1ru1jkXZFdES3BOaHVyZ3M/
 [4]http://asanthamax.blogspot.com/2016/07/findbugs-in-
 mongodbuserstoremanager-in.html

 Thanks,
 Asantha

 On Fri, Jul 22, 2016 at 8:45 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I have created the API documentation and hosted in my google drive[1]
> i will be preparing code inspection report as well will share it as soon 
> as
> well i also added github page also to the userstore script in here[2] as
> well
> [1] http://googledrive.com/host/0B__ZE1ru1jkXbDVoSDlveV9yNk0
> [2] https://asanthamax.github.io/mongodbuserstore/
>
> Thanks,
> Asantha
>
> On Tue, Jul 12, 2016 at 11:59 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>> sure we will arrange a hangout on next week and sure i will refer the
>> link and do the necessary inspect in my code for any security
>> vulnerabilities and update you sooner
>>
>> Thanks,
>> Asantha
>>
>> On Tue, Jul 12, 2016 at 9:56 AM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Hi Asantha,
>>>
>>> Thanks for the update. I'm out of the country this week and won't be
>>> available. Let's have a hangout next week and discuss the final steps of
>>> the project.
>>>
>>> Along with find bugs, if you haven't enabled findsecuritybugs
>>> plugin, you can refer [1] and check if any security weaknesses are 
>>> there in
>>> the code.
>>>
>>> [1] http://tharindue.blogspot.in/2016/06/static-code-analysis-
>>> for-java-using.html
>>>
>>> Thanks,
>>> TharinduE
>>>
>>> On Tue, Jul 12, 2016 at 5:32 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,
 I have clean up the code according to find bug plugin and also for
 rollback purposes since it only concern when modifying or adding new 
 user
 or role to user store i have manually added rollback option where if 
 error
 occured all the changes done to db in code segment will be discard 
 from db
 i updated the my repository with recent changes[1] now i preparing the
 documentation and test scripts.

 [1] https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Mon, Jul 4, 2016 at 2:54 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> thanks for the reply ,sure i will try out that and update the
> progress as soon as possible
>
> Thanks,
> Asantha
>
> On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> Hi Asantha,
>>
>> 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-07 Thread Lakini Senanayaka
Hi,

Thank you very much.

But Upul told me about a code snippet which I can use inside the API
implementation in the last meeting.

However can I get the dataset file from calling *GET
https://localhost:9443/api/datasets/{datasetId}
 * inside the API
implementation in the backend (inside
carbon-ml\components\ml\org.wso2.carbon.ml.rest.api\src\main\java\org\wso2\carbon\ml\rest\api
)
and can I access the dataset through the response's *"sourcePath" ?*

Thank you.

On Sun, Aug 7, 2016 at 8:06 PM, Supun Sethunga  wrote:

> Hi Lakini,
>
> Please find all the APIs and their samples at [1]. Additionally, you can
> always refer the existing UI to get an idea. for eg: you can check the
> dataset page of the existing ML UI to see how the datasets are retrieved.
>
> [1] https://docs.wso2.com/display/ML110/REST+API+Guides
>
> Regards,
> Supun.
>
> On Sat, Aug 6, 2016 at 11:06 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi Upul,
>>
>> Could you please explain me the way to get the dataset from the carbon ML
>> to the API which I am implementing.
>>
>> Thank you.
>>
>> On Thu, Aug 4, 2016 at 4:37 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> This is the meeting minute for today's GSoC project review meeting.
>>>
>>> Upul reviewed the current progress of the project, "(Deep) Neural
>>> Network Builder for WSO2 Machine Learner".
>>> Below mentioned are the decisions made and the new tasks allocated at
>>> the meeting.
>>>
>>> Assigned action items:
>>> -Making the UI more user-friendly.
>>> Ex: Physical lines of connections between layers should follow
>>> the movements of the layers.
>>> -Train the feed forward network for MNIST dataset.
>>> -Testing the accuracy of the neural network model for different
>>> optimization and updater algorithms.
>>> -Handling Exceptions.
>>> -Trying to show graphs related to the model, along with the accuracy
>>> of the model in the output.
>>> -Start writing documentation.
>>> -Showing a demo for the ML team.
>>>
>>> Decisions made:
>>>
>>>  -Higher priority should be given in implementing feed-forward
>>> network than RNN.
>>>  -Upul will provide me necessary instructions on the way to access
>>> the dataset which is inserted through the WSO2 ML console as NN builder UI
>>> needs to access that dataset and use as the training dataset.
>>>
>>> Thank you.
>>>
>>> On Wed, Aug 3, 2016 at 5:59 AM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

 Thank you very much for your kindness.

 I can schedule a meeting on this Thursday(4th-August-2016).

 Thank you.

 On Tue, Aug 2, 2016 at 10:39 AM, Upul Bandara  wrote:

> Hi,
>
> As you know we have only two weeks to complete GSOC projects.
> Unfortunately, this project is a little bit lagging behind and it looks
> like you have to put some additional effort during the last two week. In
> order to support you, we though it is better to have a small F2F meeting
> with you and it will help you to sort out any issues currently you are
> facing with.
>
> So can you please schedule a meeting with the ML team?
>
> Thanks,
> Upul
>
> On Sat, Jul 30, 2016 at 5:45 PM, Nirmal Fernando 
> wrote:
>
>>
>> On Sat, Jul 30, 2016 at 1:43 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I have solved the above problem.I have referred the mail thread *[Dev]
>>> "Error 403 - Forbidden" when session expires in admin console*[1] in
>>> dev mailing list.I couldn't upload  jaggery files to the console  and 
>>> when
>>> I was trying to do it, it gave the* Error 403-Forbidden.*
>>>
>>> I have copied the jaggery files to
>>> */repository/deployment/server/jaggerapps* directory as
>>> Supun instructed and it worked.
>>>
>>> Although I have implemented the back end for feed forward neural
>>> network still it has some problems.It doesn't work well.Do I need to add
>>> the  neural network algorithms to the
>>> *org.wso2.carbon.ml.core.spark.algorithms* in Carbon ML ?Do I need
>>> to follow the same pattern which is used by the Carbon ML when 
>>> implementing
>>> the back end coding and APIs?
>>>
>>
>> Yes please.
>>
>>>
>>> I will submit the demo ASAP.
>>>
>>> [1]https://mail.google.com/mail/u/0/#search/Re%3A+%5BDev%5D+
>>> %22Error+403++Forbidden%22+when+session+expires+in+admin%09c
>>> onsole/155bfcbf7e98992f?projector=1
>>>
>>> Thank you.
>>> --
>>> KIND Regards,
>>> *Lakini Senanayaka.*
>>>
>>>
>>
>>
>> --
>>
>> Thanks & regards,
>> Nirmal
>>
>> Team Lead - WSO2 Machine Learner
>> Associate Technical Lead - Data 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-07 Thread Supun Sethunga
Hi Lakini,

Please find all the APIs and their samples at [1]. Additionally, you can
always refer the existing UI to get an idea. for eg: you can check the
dataset page of the existing ML UI to see how the datasets are retrieved.

[1] https://docs.wso2.com/display/ML110/REST+API+Guides

Regards,
Supun.

On Sat, Aug 6, 2016 at 11:06 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi Upul,
>
> Could you please explain me the way to get the dataset from the carbon ML
> to the API which I am implementing.
>
> Thank you.
>
> On Thu, Aug 4, 2016 at 4:37 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> This is the meeting minute for today's GSoC project review meeting.
>>
>> Upul reviewed the current progress of the project, "(Deep) Neural Network
>> Builder for WSO2 Machine Learner".
>> Below mentioned are the decisions made and the new tasks allocated at the
>> meeting.
>>
>> Assigned action items:
>> -Making the UI more user-friendly.
>> Ex: Physical lines of connections between layers should follow
>> the movements of the layers.
>> -Train the feed forward network for MNIST dataset.
>> -Testing the accuracy of the neural network model for different
>> optimization and updater algorithms.
>> -Handling Exceptions.
>> -Trying to show graphs related to the model, along with the accuracy
>> of the model in the output.
>> -Start writing documentation.
>> -Showing a demo for the ML team.
>>
>> Decisions made:
>>
>>  -Higher priority should be given in implementing feed-forward
>> network than RNN.
>>  -Upul will provide me necessary instructions on the way to access
>> the dataset which is inserted through the WSO2 ML console as NN builder UI
>> needs to access that dataset and use as the training dataset.
>>
>> Thank you.
>>
>> On Wed, Aug 3, 2016 at 5:59 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you very much for your kindness.
>>>
>>> I can schedule a meeting on this Thursday(4th-August-2016).
>>>
>>> Thank you.
>>>
>>> On Tue, Aug 2, 2016 at 10:39 AM, Upul Bandara  wrote:
>>>
 Hi,

 As you know we have only two weeks to complete GSOC projects.
 Unfortunately, this project is a little bit lagging behind and it looks
 like you have to put some additional effort during the last two week. In
 order to support you, we though it is better to have a small F2F meeting
 with you and it will help you to sort out any issues currently you are
 facing with.

 So can you please schedule a meeting with the ML team?

 Thanks,
 Upul

 On Sat, Jul 30, 2016 at 5:45 PM, Nirmal Fernando 
 wrote:

>
> On Sat, Jul 30, 2016 at 1:43 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> I have solved the above problem.I have referred the mail thread *[Dev]
>> "Error 403 - Forbidden" when session expires in admin console*[1] in
>> dev mailing list.I couldn't upload  jaggery files to the console  and 
>> when
>> I was trying to do it, it gave the* Error 403-Forbidden.*
>>
>> I have copied the jaggery files to
>> */repository/deployment/server/jaggerapps* directory as
>> Supun instructed and it worked.
>>
>> Although I have implemented the back end for feed forward neural
>> network still it has some problems.It doesn't work well.Do I need to add
>> the  neural network algorithms to the
>> *org.wso2.carbon.ml.core.spark.algorithms* in Carbon ML ?Do I need
>> to follow the same pattern which is used by the Carbon ML when 
>> implementing
>> the back end coding and APIs?
>>
>
> Yes please.
>
>>
>> I will submit the demo ASAP.
>>
>> [1]https://mail.google.com/mail/u/0/#search/Re%3A+%5BDev%5D+
>> %22Error+403++Forbidden%22+when+session+expires+in+admin%09c
>> onsole/155bfcbf7e98992f?projector=1
>>
>> Thank you.
>> --
>> KIND Regards,
>> *Lakini Senanayaka.*
>>
>>
>
>
> --
>
> Thanks & regards,
> Nirmal
>
> Team Lead - WSO2 Machine Learner
> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
> Mobile: +94715779733
> Blog: http://nirmalfdo.blogspot.com/
>
>
>


 --
 Upul Bandara,
 Associate Technical Lead, WSO2, Inc.,
 Mob: +94 715 468 345.

>>>
>>>
>>>
>>> --
>>> KIND Regards,
>>> *Lakini Senanayaka.*
>>>
>>>
>>
>>
>> --
>> KIND Regards,
>> *Lakini Senanayaka.*
>>
>>
>
>
> --
> KIND Regards,
> *Lakini Senanayaka.*
>
>


-- 
*Supun Sethunga*
Senior Software Engineer
WSO2, Inc.
http://wso2.com/
lean | enterprise | middleware
Mobile : +94 716546324
Blog: http://supunsetunga.blogspot.com
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-05 Thread Lakini Senanayaka
Hi Upul,

Could you please explain me the way to get the dataset from the carbon ML
to the API which I am implementing.

Thank you.

On Thu, Aug 4, 2016 at 4:37 PM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> This is the meeting minute for today's GSoC project review meeting.
>
> Upul reviewed the current progress of the project, "(Deep) Neural Network
> Builder for WSO2 Machine Learner".
> Below mentioned are the decisions made and the new tasks allocated at the
> meeting.
>
> Assigned action items:
> -Making the UI more user-friendly.
> Ex: Physical lines of connections between layers should follow the
> movements of the layers.
> -Train the feed forward network for MNIST dataset.
> -Testing the accuracy of the neural network model for different
> optimization and updater algorithms.
> -Handling Exceptions.
> -Trying to show graphs related to the model, along with the accuracy
> of the model in the output.
> -Start writing documentation.
> -Showing a demo for the ML team.
>
> Decisions made:
>
>  -Higher priority should be given in implementing feed-forward network
> than RNN.
>  -Upul will provide me necessary instructions on the way to access the
> dataset which is inserted through the WSO2 ML console as NN builder UI
> needs to access that dataset and use as the training dataset.
>
> Thank you.
>
> On Wed, Aug 3, 2016 at 5:59 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you very much for your kindness.
>>
>> I can schedule a meeting on this Thursday(4th-August-2016).
>>
>> Thank you.
>>
>> On Tue, Aug 2, 2016 at 10:39 AM, Upul Bandara  wrote:
>>
>>> Hi,
>>>
>>> As you know we have only two weeks to complete GSOC projects.
>>> Unfortunately, this project is a little bit lagging behind and it looks
>>> like you have to put some additional effort during the last two week. In
>>> order to support you, we though it is better to have a small F2F meeting
>>> with you and it will help you to sort out any issues currently you are
>>> facing with.
>>>
>>> So can you please schedule a meeting with the ML team?
>>>
>>> Thanks,
>>> Upul
>>>
>>> On Sat, Jul 30, 2016 at 5:45 PM, Nirmal Fernando 
>>> wrote:
>>>

 On Sat, Jul 30, 2016 at 1:43 PM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I have solved the above problem.I have referred the mail thread *[Dev]
> "Error 403 - Forbidden" when session expires in admin console*[1] in
> dev mailing list.I couldn't upload  jaggery files to the console  and when
> I was trying to do it, it gave the* Error 403-Forbidden.*
>
> I have copied the jaggery files to
> */repository/deployment/server/jaggerapps* directory as
> Supun instructed and it worked.
>
> Although I have implemented the back end for feed forward neural
> network still it has some problems.It doesn't work well.Do I need to add
> the  neural network algorithms to the
> *org.wso2.carbon.ml.core.spark.algorithms* in Carbon ML ?Do I need to
> follow the same pattern which is used by the Carbon ML when implementing
> the back end coding and APIs?
>

 Yes please.

>
> I will submit the demo ASAP.
>
> [1]https://mail.google.com/mail/u/0/#search/Re%3A+%5BDev%5D+
> %22Error+403++Forbidden%22+when+session+expires+in+admin%09c
> onsole/155bfcbf7e98992f?projector=1
>
> Thank you.
> --
> KIND Regards,
> *Lakini Senanayaka.*
>
>


 --

 Thanks & regards,
 Nirmal

 Team Lead - WSO2 Machine Learner
 Associate Technical Lead - Data Technologies Team, WSO2 Inc.
 Mobile: +94715779733
 Blog: http://nirmalfdo.blogspot.com/



>>>
>>>
>>> --
>>> Upul Bandara,
>>> Associate Technical Lead, WSO2, Inc.,
>>> Mob: +94 715 468 345.
>>>
>>
>>
>>
>> --
>> KIND Regards,
>> *Lakini Senanayaka.*
>>
>>
>
>
> --
> KIND Regards,
> *Lakini Senanayaka.*
>
>


-- 
KIND Regards,
*Lakini Senanayaka.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-04 Thread Lakini Senanayaka
Hi,

This is the meeting minute for today's GSoC project review meeting.

Upul reviewed the current progress of the project, "(Deep) Neural Network
Builder for WSO2 Machine Learner".
Below mentioned are the decisions made and the new tasks allocated at the
meeting.

Assigned action items:
-Making the UI more user-friendly.
Ex: Physical lines of connections between layers should follow the
movements of the layers.
-Train the feed forward network for MNIST dataset.
-Testing the accuracy of the neural network model for different
optimization and updater algorithms.
-Handling Exceptions.
-Trying to show graphs related to the model, along with the accuracy of
the model in the output.
-Start writing documentation.
-Showing a demo for the ML team.

Decisions made:

 -Higher priority should be given in implementing feed-forward network
than RNN.
 -Upul will provide me necessary instructions on the way to access the
dataset which is inserted through the WSO2 ML console as NN builder UI
needs to access that dataset and use as the training dataset.

Thank you.

On Wed, Aug 3, 2016 at 5:59 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you very much for your kindness.
>
> I can schedule a meeting on this Thursday(4th-August-2016).
>
> Thank you.
>
> On Tue, Aug 2, 2016 at 10:39 AM, Upul Bandara  wrote:
>
>> Hi,
>>
>> As you know we have only two weeks to complete GSOC projects.
>> Unfortunately, this project is a little bit lagging behind and it looks
>> like you have to put some additional effort during the last two week. In
>> order to support you, we though it is better to have a small F2F meeting
>> with you and it will help you to sort out any issues currently you are
>> facing with.
>>
>> So can you please schedule a meeting with the ML team?
>>
>> Thanks,
>> Upul
>>
>> On Sat, Jul 30, 2016 at 5:45 PM, Nirmal Fernando  wrote:
>>
>>>
>>> On Sat, Jul 30, 2016 at 1:43 PM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

 I have solved the above problem.I have referred the mail thread *[Dev]
 "Error 403 - Forbidden" when session expires in admin console*[1] in
 dev mailing list.I couldn't upload  jaggery files to the console  and when
 I was trying to do it, it gave the* Error 403-Forbidden.*

 I have copied the jaggery files to
 */repository/deployment/server/jaggerapps* directory as Supun
 instructed and it worked.

 Although I have implemented the back end for feed forward neural
 network still it has some problems.It doesn't work well.Do I need to add
 the  neural network algorithms to the
 *org.wso2.carbon.ml.core.spark.algorithms* in Carbon ML ?Do I need to
 follow the same pattern which is used by the Carbon ML when implementing
 the back end coding and APIs?

>>>
>>> Yes please.
>>>

 I will submit the demo ASAP.

 [1]https://mail.google.com/mail/u/0/#search/Re%3A+%5BDev%
 5D+%22Error+403++Forbidden%22+when+session+expires+in+admin%
 09console/155bfcbf7e98992f?projector=1

 Thank you.
 --
 KIND Regards,
 *Lakini Senanayaka.*


>>>
>>>
>>> --
>>>
>>> Thanks & regards,
>>> Nirmal
>>>
>>> Team Lead - WSO2 Machine Learner
>>> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
>>> Mobile: +94715779733
>>> Blog: http://nirmalfdo.blogspot.com/
>>>
>>>
>>>
>>
>>
>> --
>> Upul Bandara,
>> Associate Technical Lead, WSO2, Inc.,
>> Mob: +94 715 468 345.
>>
>
>
>
> --
> KIND Regards,
> *Lakini Senanayaka.*
>
>


-- 
KIND Regards,
*Lakini Senanayaka.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016] Final Evaluation

2016-08-04 Thread Lakini Senanayaka
Thank you!!

On Thu, Aug 4, 2016 at 3:28 PM, Supun Sethunga  wrote:

> [adding ml gsoc students]
>
> On Wed, Aug 3, 2016 at 10:46 PM, Imesh Gunaratne  wrote:
>
>> Dear Students,
>>
>> This is to give you a heads up on $subject.
>>
>> We have seen in the past students being inactive time to time and trying
>> to complete the deliverables at the last minute when the submission
>> deadline is nearby.
>>
>> Please note that at the final evaluation we will be evaluating your
>> overall effort throughout the project period in addition to the
>> deliverables that you submit. On high level this would include following:
>>
>>- Planning
>>- Researching
>>- Problem solving
>>- Initiatives
>>- Level of communication
>>- Community interaction
>>- Continuous effort on design & implementation
>>- Deliverables
>>- Documentation
>>- Quality of code & all deliverables
>>
>> GSoC student manual [1] will be really helpful for you to understand this
>> better.
>>
>> [1] http://write.flossmanuals.net/gsocstudentguide/what-is-
>> google-summer-of-code/
>>
>> Thanks
>>
>> --
>> *Imesh Gunaratne*
>> Software Architect
>> WSO2 Inc: http://wso2.com
>> T: +94 11 214 5345 M: +94 77 374 2057
>> W: https://medium.com/@imesh TW: @imesh
>> lean. enterprise. middleware
>>
>>
>> ___
>> Dev mailing list
>> Dev@wso2.org
>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>
>>
>
>
> --
> *Supun Sethunga*
> Senior Software Engineer
> WSO2, Inc.
> http://wso2.com/
> lean | enterprise | middleware
> Mobile : +94 716546324
> Blog: http://supunsetunga.blogspot.com
>



-- 
KIND Regards,
*Lakini Senanayaka.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016] Final Evaluation

2016-08-04 Thread Supun Sethunga
[adding ml gsoc students]

On Wed, Aug 3, 2016 at 10:46 PM, Imesh Gunaratne  wrote:

> Dear Students,
>
> This is to give you a heads up on $subject.
>
> We have seen in the past students being inactive time to time and trying
> to complete the deliverables at the last minute when the submission
> deadline is nearby.
>
> Please note that at the final evaluation we will be evaluating your
> overall effort throughout the project period in addition to the
> deliverables that you submit. On high level this would include following:
>
>- Planning
>- Researching
>- Problem solving
>- Initiatives
>- Level of communication
>- Community interaction
>- Continuous effort on design & implementation
>- Deliverables
>- Documentation
>- Quality of code & all deliverables
>
> GSoC student manual [1] will be really helpful for you to understand this
> better.
>
> [1]
> http://write.flossmanuals.net/gsocstudentguide/what-is-google-summer-of-code/
>
> Thanks
>
> --
> *Imesh Gunaratne*
> Software Architect
> WSO2 Inc: http://wso2.com
> T: +94 11 214 5345 M: +94 77 374 2057
> W: https://medium.com/@imesh TW: @imesh
> lean. enterprise. middleware
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


-- 
*Supun Sethunga*
Senior Software Engineer
WSO2, Inc.
http://wso2.com/
lean | enterprise | middleware
Mobile : +94 716546324
Blog: http://supunsetunga.blogspot.com
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016: Proposal 7

2016-08-03 Thread Dinanjana Gunaratne
>>>>>>>> before the server goes to
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> a catastrophic state.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> For an example, when the server goes OOM, it
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> will automatically generate the heap dump. 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> However heap dump is not
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> sufficient to analyse the incident. We need to 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> see what causes the increase
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> of heap. That may be due to increase of load 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (requests) or may be due to a
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> bug. So we need to extract information like TPS 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> of the server, thread dumps
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> to do the further analysis.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Feb 26, 2016 at 1:38 PM, Nadeeshaan
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunasinghe <nadeesh...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Dinanjana,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> First let's try to build WSO2 ESB from
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> source and then dig in deep to the source. In 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> order to do so you will need
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> build the following repositories in the order.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [1] https://github.com/wso2/wso2-synapse
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [2] https://github.com/wso2/carbon-mediation
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>&

Re: [Dev] GSOC 2016: Proposal 7

2016-08-03 Thread Dinanjana Gunaratne
>>>> have a very little
>>>>>>>>>>>>>>>>>>>>>>>>>>>> understanding about the architecture of ESB. So 
>>>>>>>>>>>>>>>>>>>>>>>>>>>> what I can't understand is
>>>>>>>>>>>>>>>>>>>>>>>>>>>> where to do the implementation?Are we talking 
>>>>>>>>>>>>>>>>>>>>>>>>>>>> about a "feature"  to ESB ?
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Mon, Feb 29, 2016 at 9:32 AM, Isuru Udana <
>>>>>>>>>>>>>>>>>>>>>>>>>>>> isu...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Dinanjana,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Intention of this project is to build a tool
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> which ease production incident analysis.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Some of the common production incidents are,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> - Server goes OOM
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> - Increase of CPU usage
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> - Server goes to an unresponsive state
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> We need to detect those situations and need to
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> extract useful information to debug the issue 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> before the server goes to a
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> catastrophic state.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> For an example, when the server goes OOM, it
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> will automatically generate the heap dump. 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> However heap dump is not
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> sufficient to analyse the incident. We need to 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> see what causes the increase
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> of heap. That may be due to increase of load 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (requests) or may be due to a
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> bug. So we need to extract information like TPS 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> of the server, thread dumps
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> to do the further analysis.
>>>>>>>>>>>>>>>>>>>>>&

[Dev] [GSoC 2016] Final Evaluation

2016-08-03 Thread Imesh Gunaratne
Dear Students,

This is to give you a heads up on $subject.

We have seen in the past students being inactive time to time and trying to
complete the deliverables at the last minute when the submission deadline
is nearby.

Please note that at the final evaluation we will be evaluating your overall
effort throughout the project period in addition to the deliverables that
you submit. On high level this would include following:

   - Planning
   - Researching
   - Problem solving
   - Initiatives
   - Level of communication
   - Community interaction
   - Continuous effort on design & implementation
   - Deliverables
   - Documentation
   - Quality of code & all deliverables

GSoC student manual [1] will be really helpful for you to understand this
better.

[1]
http://write.flossmanuals.net/gsocstudentguide/what-is-google-summer-of-code/

Thanks

-- 
*Imesh Gunaratne*
Software Architect
WSO2 Inc: http://wso2.com
T: +94 11 214 5345 M: +94 77 374 2057
W: https://medium.com/@imesh TW: @imesh
lean. enterprise. middleware
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-02 Thread Lakini Senanayaka
Hi,

Thank you very much for your kindness.

I can schedule a meeting on this Thursday(4th-August-2016).

Thank you.

On Tue, Aug 2, 2016 at 10:39 AM, Upul Bandara  wrote:

> Hi,
>
> As you know we have only two weeks to complete GSOC projects.
> Unfortunately, this project is a little bit lagging behind and it looks
> like you have to put some additional effort during the last two week. In
> order to support you, we though it is better to have a small F2F meeting
> with you and it will help you to sort out any issues currently you are
> facing with.
>
> So can you please schedule a meeting with the ML team?
>
> Thanks,
> Upul
>
> On Sat, Jul 30, 2016 at 5:45 PM, Nirmal Fernando  wrote:
>
>>
>> On Sat, Jul 30, 2016 at 1:43 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I have solved the above problem.I have referred the mail thread *[Dev]
>>> "Error 403 - Forbidden" when session expires in admin console*[1] in
>>> dev mailing list.I couldn't upload  jaggery files to the console  and when
>>> I was trying to do it, it gave the* Error 403-Forbidden.*
>>>
>>> I have copied the jaggery files to
>>> */repository/deployment/server/jaggerapps* directory as Supun
>>> instructed and it worked.
>>>
>>> Although I have implemented the back end for feed forward neural network
>>> still it has some problems.It doesn't work well.Do I need to add the
>>>  neural network algorithms to the
>>> *org.wso2.carbon.ml.core.spark.algorithms* in Carbon ML ?Do I need to
>>> follow the same pattern which is used by the Carbon ML when implementing
>>> the back end coding and APIs?
>>>
>>
>> Yes please.
>>
>>>
>>> I will submit the demo ASAP.
>>>
>>> [1]
>>> https://mail.google.com/mail/u/0/#search/Re%3A+%5BDev%5D+%22Error+403++Forbidden%22+when+session+expires+in+admin%09console/155bfcbf7e98992f?projector=1
>>>
>>> Thank you.
>>> --
>>> KIND Regards,
>>> *Lakini Senanayaka.*
>>>
>>>
>>
>>
>> --
>>
>> Thanks & regards,
>> Nirmal
>>
>> Team Lead - WSO2 Machine Learner
>> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
>> Mobile: +94715779733
>> Blog: http://nirmalfdo.blogspot.com/
>>
>>
>>
>
>
> --
> Upul Bandara,
> Associate Technical Lead, WSO2, Inc.,
> Mob: +94 715 468 345.
>



-- 
KIND Regards,
*Lakini Senanayaka.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-08-01 Thread Upul Bandara
Hi,

As you know we have only two weeks to complete GSOC projects.
Unfortunately, this project is a little bit lagging behind and it looks
like you have to put some additional effort during the last two week. In
order to support you, we though it is better to have a small F2F meeting
with you and it will help you to sort out any issues currently you are
facing with.

So can you please schedule a meeting with the ML team?

Thanks,
Upul

On Sat, Jul 30, 2016 at 5:45 PM, Nirmal Fernando  wrote:

>
> On Sat, Jul 30, 2016 at 1:43 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> I have solved the above problem.I have referred the mail thread *[Dev]
>> "Error 403 - Forbidden" when session expires in admin console*[1] in dev
>> mailing list.I couldn't upload  jaggery files to the console  and when I
>> was trying to do it, it gave the* Error 403-Forbidden.*
>>
>> I have copied the jaggery files to
>> */repository/deployment/server/jaggerapps* directory as Supun
>> instructed and it worked.
>>
>> Although I have implemented the back end for feed forward neural network
>> still it has some problems.It doesn't work well.Do I need to add the
>>  neural network algorithms to the
>> *org.wso2.carbon.ml.core.spark.algorithms* in Carbon ML ?Do I need to
>> follow the same pattern which is used by the Carbon ML when implementing
>> the back end coding and APIs?
>>
>
> Yes please.
>
>>
>> I will submit the demo ASAP.
>>
>> [1]
>> https://mail.google.com/mail/u/0/#search/Re%3A+%5BDev%5D+%22Error+403++Forbidden%22+when+session+expires+in+admin%09console/155bfcbf7e98992f?projector=1
>>
>> Thank you.
>> --
>> KIND Regards,
>> *Lakini Senanayaka.*
>>
>>
>
>
> --
>
> Thanks & regards,
> Nirmal
>
> Team Lead - WSO2 Machine Learner
> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
> Mobile: +94715779733
> Blog: http://nirmalfdo.blogspot.com/
>
>
>


-- 
Upul Bandara,
Associate Technical Lead, WSO2, Inc.,
Mob: +94 715 468 345.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-31 Thread Asantha Thilina
Hi Tharindu,

yes sure i am comfortable with any time and look forward for that

Thanks,
Asantha

On Sun, Jul 31, 2016 at 12:15 PM, Tharindu Edirisinghe 
wrote:

> Hi Asantha,
>
> Good work so far. Since we are reaching the final stage of GSoC, let's
> have a hangout at the end of this week and plan the final steps to complete
> the project.
>
> I will go through the deliverables and provide feedback soon.
>
> Thanks,
> Tharindu
>
> On Mon, Jul 25, 2016 at 12:08 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> I have cleaned up all the bugs and removed all unnecessary codes and
>> committed all the changes into my repository[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Sat, Jul 23, 2016 at 8:26 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> here i added all the commitments to spread sheet[1] and also i updated
>>> my blog with about java document api[2] and also i added findbug report[3]
>>> and also i updated my blog with the code quality analysis process i have
>>> done[4]
>>>
>>> [1]
>>> https://docs.google.com/spreadsheets/d/1jwSR_qFV-LfOS7ZTZ8CpiFFTYPoudDQF7zQhvblivaE/edit?usp=sharing
>>> [2]
>>> http://asanthamax.blogspot.com/2016/07/mongodb-user-store-package-hierarchy.html
>>> [3]https://googledrive.com/host/0B__ZE1ru1jkXZFdES3BOaHVyZ3M/
>>> [4]
>>> http://asanthamax.blogspot.com/2016/07/findbugs-in-mongodbuserstoremanager-in.html
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Fri, Jul 22, 2016 at 8:45 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I have created the API documentation and hosted in my google drive[1] i
 will be preparing code inspection report as well will share it as soon as
 well i also added github page also to the userstore script in here[2] as
 well
 [1] http://googledrive.com/host/0B__ZE1ru1jkXbDVoSDlveV9yNk0
 [2] https://asanthamax.github.io/mongodbuserstore/

 Thanks,
 Asantha

 On Tue, Jul 12, 2016 at 11:59 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
> sure we will arrange a hangout on next week and sure i will refer the
> link and do the necessary inspect in my code for any security
> vulnerabilities and update you sooner
>
> Thanks,
> Asantha
>
> On Tue, Jul 12, 2016 at 9:56 AM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> Hi Asantha,
>>
>> Thanks for the update. I'm out of the country this week and won't be
>> available. Let's have a hangout next week and discuss the final steps of
>> the project.
>>
>> Along with find bugs, if you haven't enabled findsecuritybugs plugin,
>> you can refer [1] and check if any security weaknesses are there in the
>> code.
>>
>> [1]
>> http://tharindue.blogspot.in/2016/06/static-code-analysis-for-java-using.html
>>
>> Thanks,
>> TharinduE
>>
>> On Tue, Jul 12, 2016 at 5:32 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>> I have clean up the code according to find bug plugin and also for
>>> rollback purposes since it only concern when modifying or adding new 
>>> user
>>> or role to user store i have manually added rollback option where if 
>>> error
>>> occured all the changes done to db in code segment will be discard from 
>>> db
>>> i updated the my repository with recent changes[1] now i preparing the
>>> documentation and test scripts.
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jul 4, 2016 at 2:54 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 thanks for the reply ,sure i will try out that and update the
 progress as soon as possible

 Thanks,
 Asantha

 On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Hi Asantha,
>
> While you are adding the roll back transaction capability, also
> look into testing a high load and try to generate database level
> exceptions. Once thing you can try out is writing a client for 
> performing
> userstore manager operations such as add user, add role, login, 
> logout etc.
> and play it with a high concurrency using Jmeter. Then we should be 
> able to
> get a better understanding of transaction management with respective 
> to
> MongoDB.
>
> Regards,
> TharinduE
>
> On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi all,
>>
>> i will be trying for implement roll back transactions 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-31 Thread Tharindu Edirisinghe
Hi Asantha,

Good work so far. Since we are reaching the final stage of GSoC, let's have
a hangout at the end of this week and plan the final steps to complete the
project.

I will go through the deliverables and provide feedback soon.

Thanks,
Tharindu

On Mon, Jul 25, 2016 at 12:08 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> I have cleaned up all the bugs and removed all unnecessary codes and
> committed all the changes into my repository[1]
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Sat, Jul 23, 2016 at 8:26 AM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> here i added all the commitments to spread sheet[1] and also i updated my
>> blog with about java document api[2] and also i added findbug report[3] and
>> also i updated my blog with the code quality analysis process i have done[4]
>>
>> [1]
>> https://docs.google.com/spreadsheets/d/1jwSR_qFV-LfOS7ZTZ8CpiFFTYPoudDQF7zQhvblivaE/edit?usp=sharing
>> [2]
>> http://asanthamax.blogspot.com/2016/07/mongodb-user-store-package-hierarchy.html
>> [3]https://googledrive.com/host/0B__ZE1ru1jkXZFdES3BOaHVyZ3M/
>> [4]
>> http://asanthamax.blogspot.com/2016/07/findbugs-in-mongodbuserstoremanager-in.html
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jul 22, 2016 at 8:45 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have created the API documentation and hosted in my google drive[1] i
>>> will be preparing code inspection report as well will share it as soon as
>>> well i also added github page also to the userstore script in here[2] as
>>> well
>>> [1] http://googledrive.com/host/0B__ZE1ru1jkXbDVoSDlveV9yNk0
>>> [2] https://asanthamax.github.io/mongodbuserstore/
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Tue, Jul 12, 2016 at 11:59 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,
 sure we will arrange a hangout on next week and sure i will refer the
 link and do the necessary inspect in my code for any security
 vulnerabilities and update you sooner

 Thanks,
 Asantha

 On Tue, Jul 12, 2016 at 9:56 AM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Hi Asantha,
>
> Thanks for the update. I'm out of the country this week and won't be
> available. Let's have a hangout next week and discuss the final steps of
> the project.
>
> Along with find bugs, if you haven't enabled findsecuritybugs plugin,
> you can refer [1] and check if any security weaknesses are there in the
> code.
>
> [1]
> http://tharindue.blogspot.in/2016/06/static-code-analysis-for-java-using.html
>
> Thanks,
> TharinduE
>
> On Tue, Jul 12, 2016 at 5:32 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>> I have clean up the code according to find bug plugin and also for
>> rollback purposes since it only concern when modifying or adding new user
>> or role to user store i have manually added rollback option where if 
>> error
>> occured all the changes done to db in code segment will be discard from 
>> db
>> i updated the my repository with recent changes[1] now i preparing the
>> documentation and test scripts.
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jul 4, 2016 at 2:54 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> thanks for the reply ,sure i will try out that and update the
>>> progress as soon as possible
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Hi Asantha,

 While you are adding the roll back transaction capability, also
 look into testing a high load and try to generate database level
 exceptions. Once thing you can try out is writing a client for 
 performing
 userstore manager operations such as add user, add role, login, logout 
 etc.
 and play it with a high concurrency using Jmeter. Then we should be 
 able to
 get a better understanding of transaction management with respective to
 MongoDB.

 Regards,
 TharinduE

 On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi all,
>
> i will be trying for implement roll back transactions capability
> in MongoDB to add to MongoDB User Store[2] i found that MongoDB use a
> concept call two phase commit[1] i trying to implement that inside my 
> code
> but it seems to be little complex and i think it may arise performance
> issue when adding high load of dataset at once is there any other 
> 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-07-30 Thread Nirmal Fernando
On Sat, Jul 30, 2016 at 1:43 PM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I have solved the above problem.I have referred the mail thread *[Dev]
> "Error 403 - Forbidden" when session expires in admin console*[1] in dev
> mailing list.I couldn't upload  jaggery files to the console  and when I
> was trying to do it, it gave the* Error 403-Forbidden.*
>
> I have copied the jaggery files to
> */repository/deployment/server/jaggerapps* directory as Supun
> instructed and it worked.
>
> Although I have implemented the back end for feed forward neural network
> still it has some problems.It doesn't work well.Do I need to add the
>  neural network algorithms to the
> *org.wso2.carbon.ml.core.spark.algorithms* in Carbon ML ?Do I need to
> follow the same pattern which is used by the Carbon ML when implementing
> the back end coding and APIs?
>

Yes please.

>
> I will submit the demo ASAP.
>
> [1]
> https://mail.google.com/mail/u/0/#search/Re%3A+%5BDev%5D+%22Error+403++Forbidden%22+when+session+expires+in+admin%09console/155bfcbf7e98992f?projector=1
>
> Thank you.
> --
> KIND Regards,
> *Lakini Senanayaka.*
>
>


-- 

Thanks & regards,
Nirmal

Team Lead - WSO2 Machine Learner
Associate Technical Lead - Data Technologies Team, WSO2 Inc.
Mobile: +94715779733
Blog: http://nirmalfdo.blogspot.com/
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-07-30 Thread Lakini Senanayaka
Hi,

I have solved the above problem.I have referred the mail thread *[Dev]
"Error 403 - Forbidden" when session expires in admin console*[1] in dev
mailing list.I couldn't upload  jaggery files to the console  and when I
was trying to do it, it gave the* Error 403-Forbidden.*

I have copied the jaggery files to
*/repository/deployment/server/jaggerapps* directory as Supun
instructed and it worked.

Although I have implemented the back end for feed forward neural network
still it has some problems.It doesn't work well.Do I need to add the
 neural network algorithms to the *org.wso2.carbon.ml.core.spark.algorithms*
in Carbon ML ?Do I need to follow the same pattern which is used by the
Carbon ML when implementing the back end coding and APIs?

I will submit the demo ASAP.

[1]
https://mail.google.com/mail/u/0/#search/Re%3A+%5BDev%5D+%22Error+403++Forbidden%22+when+session+expires+in+admin%09console/155bfcbf7e98992f?projector=1

Thank you.
-- 
KIND Regards,
*Lakini Senanayaka.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016: Proposal 7

2016-07-25 Thread Dinanjana Gunaratne
- Increase of CPU usage
>>>>>>>>>>>>>>>>>>>>>>>>>>>> - Server goes to an unresponsive state
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> We need to detect those situations and need to
>>>>>>>>>>>>>>>>>>>>>>>>>>>> extract useful information to debug the issue 
>>>>>>>>>>>>>>>>>>>>>>>>>>>> before the server goes to a
>>>>>>>>>>>>>>>>>>>>>>>>>>>> catastrophic state.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> For an example, when the server goes OOM, it
>>>>>>>>>>>>>>>>>>>>>>>>>>>> will automatically generate the heap dump. However 
>>>>>>>>>>>>>>>>>>>>>>>>>>>> heap dump is not
>>>>>>>>>>>>>>>>>>>>>>>>>>>> sufficient to analyse the incident. We need to see 
>>>>>>>>>>>>>>>>>>>>>>>>>>>> what causes the increase
>>>>>>>>>>>>>>>>>>>>>>>>>>>> of heap. That may be due to increase of load 
>>>>>>>>>>>>>>>>>>>>>>>>>>>> (requests) or may be due to a
>>>>>>>>>>>>>>>>>>>>>>>>>>>> bug. So we need to extract information like TPS of 
>>>>>>>>>>>>>>>>>>>>>>>>>>>> the server, thread dumps
>>>>>>>>>>>>>>>>>>>>>>>>>>>> to do the further analysis.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Feb 26, 2016 at 1:38 PM, Nadeeshaan
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunasinghe <nadeesh...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Dinanjana,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> First let's try to build WSO2 ESB from source
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> and then dig in deep to the source. In order to 
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> do so you will need build
>>>>>&g

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-25 Thread Asantha Thilina
Hi Tharindu,

I have cleaned up all the bugs and removed all unnecessary codes and
committed all the changes into my repository[1]

[1] https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Sat, Jul 23, 2016 at 8:26 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> here i added all the commitments to spread sheet[1] and also i updated my
> blog with about java document api[2] and also i added findbug report[3] and
> also i updated my blog with the code quality analysis process i have done[4]
>
> [1]
> https://docs.google.com/spreadsheets/d/1jwSR_qFV-LfOS7ZTZ8CpiFFTYPoudDQF7zQhvblivaE/edit?usp=sharing
> [2]
> http://asanthamax.blogspot.com/2016/07/mongodb-user-store-package-hierarchy.html
> [3]https://googledrive.com/host/0B__ZE1ru1jkXZFdES3BOaHVyZ3M/
> [4]
> http://asanthamax.blogspot.com/2016/07/findbugs-in-mongodbuserstoremanager-in.html
>
> Thanks,
> Asantha
>
> On Fri, Jul 22, 2016 at 8:45 AM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> I have created the API documentation and hosted in my google drive[1] i
>> will be preparing code inspection report as well will share it as soon as
>> well i also added github page also to the userstore script in here[2] as
>> well
>> [1] http://googledrive.com/host/0B__ZE1ru1jkXbDVoSDlveV9yNk0
>> [2] https://asanthamax.github.io/mongodbuserstore/
>>
>> Thanks,
>> Asantha
>>
>> On Tue, Jul 12, 2016 at 11:59 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>> sure we will arrange a hangout on next week and sure i will refer the
>>> link and do the necessary inspect in my code for any security
>>> vulnerabilities and update you sooner
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Tue, Jul 12, 2016 at 9:56 AM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Hi Asantha,

 Thanks for the update. I'm out of the country this week and won't be
 available. Let's have a hangout next week and discuss the final steps of
 the project.

 Along with find bugs, if you haven't enabled findsecuritybugs plugin,
 you can refer [1] and check if any security weaknesses are there in the
 code.

 [1]
 http://tharindue.blogspot.in/2016/06/static-code-analysis-for-java-using.html

 Thanks,
 TharinduE

 On Tue, Jul 12, 2016 at 5:32 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
> I have clean up the code according to find bug plugin and also for
> rollback purposes since it only concern when modifying or adding new user
> or role to user store i have manually added rollback option where if error
> occured all the changes done to db in code segment will be discard from db
> i updated the my repository with recent changes[1] now i preparing the
> documentation and test scripts.
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Mon, Jul 4, 2016 at 2:54 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> thanks for the reply ,sure i will try out that and update the
>> progress as soon as possible
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Hi Asantha,
>>>
>>> While you are adding the roll back transaction capability, also look
>>> into testing a high load and try to generate database level exceptions.
>>> Once thing you can try out is writing a client for performing userstore
>>> manager operations such as add user, add role, login, logout etc. and 
>>> play
>>> it with a high concurrency using Jmeter. Then we should be able to get a
>>> better understanding of transaction management with respective to 
>>> MongoDB.
>>>
>>> Regards,
>>> TharinduE
>>>
>>> On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi all,

 i will be trying for implement roll back transactions capability in
 MongoDB to add to MongoDB User Store[2] i found that MongoDB use a 
 concept
 call two phase commit[1] i trying to implement that inside my code but 
 it
 seems to be little complex and i think it may arise performance issue 
 when
 adding high load of dataset at once is there any other better method i 
 can
 achieve this task? any advices would be grateful

 [1]
 https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
 [2] https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Wed, Jun 29, 2016 at 2:55 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I have finished and added delete functions also to users 

Re: [Dev] GSOC 2016: Proposal 7

2016-07-24 Thread Kasun Indrasiri
;>>>>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Feb 26, 2016 at 1:38 PM, Nadeeshaan
>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunasinghe <nadeesh...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Dinanjana,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> First let's try to build WSO2 ESB from source
>>>>>>>>>>>>>>>>>>>>>>>>>>>> and then dig in deep to the source. In order to do 
>>>>>>>>>>>>>>>>>>>>>>>>>>>> so you will need build
>>>>>>>>>>>>>>>>>>>>>>>>>>>> the following repositories in the order.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> [1] https://github.com/wso2/wso2-synapse
>>>>>>>>>>>>>>>>>>>>>>>>>>>> [2] https://github.com/wso2/carbon-mediation
>>>>>>>>>>>>>>>>>>>>>>>>>>>> [3] https://github.com/wso2/product-esb
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> *Nadeeshaan Gunasinghe*
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Software Engineer, WSO2 Inc. http://wso2.com
>>>>>>>>>>>>>>>>>>>>>>>>>>>> +94770596754 | nadeesh...@wso2.com | Skype:
>>>>>>>>>>>>>>>>>>>>>>>>>>>> nadeeshaan.gunasinghe
>>>>>>>>>>>>>>>>>>>>>>>>>>>> <#m_-4157471473235395501_m_528546508811529522_m_-4474129107123403989_m_329900874405857652_m_-1899828863246582844_m_8781437165098998838_m_1906407074206587743_m_-5727450666815379067_m_3100536272952282018_m_-7906738341674903768_m_-488055444625272468_m_-8776032907468064948_m_-7768434574235180537_m_-7235778947164465931_m_7232211748715967048_m_-3757373977837873170_m_-8283982100572052979_m_1362338246273110367_m_-1442751731575898940_m_6485817575745999246_m_265559619745955743_3779151517627746345_-555366748_-88362740_816856320_1348862296_-537557168_478758164_1912754997_-722133546_-1073985791_>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> <http://www.facebook.com/nadeeshaan.gunasinghe>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>   <http://lk.linkedin.com/in/nadeeshaan>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> <http://twitter.com/Nadeeshaan>
>>>>>>>>>>>>>&

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-23 Thread Asantha Thilina
Hi Tharindu,

here i added all the commitments to spread sheet[1] and also i updated my
blog with about java document api[2] and also i added findbug report[3] and
also i updated my blog with the code quality analysis process i have done[4]

[1]
https://docs.google.com/spreadsheets/d/1jwSR_qFV-LfOS7ZTZ8CpiFFTYPoudDQF7zQhvblivaE/edit?usp=sharing
[2]
http://asanthamax.blogspot.com/2016/07/mongodb-user-store-package-hierarchy.html
[3]https://googledrive.com/host/0B__ZE1ru1jkXZFdES3BOaHVyZ3M/
[4]
http://asanthamax.blogspot.com/2016/07/findbugs-in-mongodbuserstoremanager-in.html

Thanks,
Asantha

On Fri, Jul 22, 2016 at 8:45 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> I have created the API documentation and hosted in my google drive[1] i
> will be preparing code inspection report as well will share it as soon as
> well i also added github page also to the userstore script in here[2] as
> well
> [1] http://googledrive.com/host/0B__ZE1ru1jkXbDVoSDlveV9yNk0
> [2] https://asanthamax.github.io/mongodbuserstore/
>
> Thanks,
> Asantha
>
> On Tue, Jul 12, 2016 at 11:59 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>> sure we will arrange a hangout on next week and sure i will refer the
>> link and do the necessary inspect in my code for any security
>> vulnerabilities and update you sooner
>>
>> Thanks,
>> Asantha
>>
>> On Tue, Jul 12, 2016 at 9:56 AM, Tharindu Edirisinghe > > wrote:
>>
>>> Hi Asantha,
>>>
>>> Thanks for the update. I'm out of the country this week and won't be
>>> available. Let's have a hangout next week and discuss the final steps of
>>> the project.
>>>
>>> Along with find bugs, if you haven't enabled findsecuritybugs plugin,
>>> you can refer [1] and check if any security weaknesses are there in the
>>> code.
>>>
>>> [1]
>>> http://tharindue.blogspot.in/2016/06/static-code-analysis-for-java-using.html
>>>
>>> Thanks,
>>> TharinduE
>>>
>>> On Tue, Jul 12, 2016 at 5:32 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,
 I have clean up the code according to find bug plugin and also for
 rollback purposes since it only concern when modifying or adding new user
 or role to user store i have manually added rollback option where if error
 occured all the changes done to db in code segment will be discard from db
 i updated the my repository with recent changes[1] now i preparing the
 documentation and test scripts.

 [1] https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Mon, Jul 4, 2016 at 2:54 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> thanks for the reply ,sure i will try out that and update the progress
> as soon as possible
>
> Thanks,
> Asantha
>
> On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> Hi Asantha,
>>
>> While you are adding the roll back transaction capability, also look
>> into testing a high load and try to generate database level exceptions.
>> Once thing you can try out is writing a client for performing userstore
>> manager operations such as add user, add role, login, logout etc. and 
>> play
>> it with a high concurrency using Jmeter. Then we should be able to get a
>> better understanding of transaction management with respective to 
>> MongoDB.
>>
>> Regards,
>> TharinduE
>>
>> On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> i will be trying for implement roll back transactions capability in
>>> MongoDB to add to MongoDB User Store[2] i found that MongoDB use a 
>>> concept
>>> call two phase commit[1] i trying to implement that inside my code but 
>>> it
>>> seems to be little complex and i think it may arise performance issue 
>>> when
>>> adding high load of dataset at once is there any other better method i 
>>> can
>>> achieve this task? any advices would be grateful
>>>
>>> [1]
>>> https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
>>> [2] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, Jun 29, 2016 at 2:55 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I have finished and added delete functions also to users ,roles and
 user claim deletions to my repo[1]

 [1] https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Mon, Jun 27, 2016 at 4:18 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi aiya,
>
> i have small problem in my research, i will be developing
> convolution neural network using 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-22 Thread Asantha Thilina
Hi Tharindu,

I have created the API documentation and hosted in my google drive[1] i
will be preparing code inspection report as well will share it as soon as
well i also added github page also to the userstore script in here[2] as
well
[1] http://googledrive.com/host/0B__ZE1ru1jkXbDVoSDlveV9yNk0
[2] https://asanthamax.github.io/mongodbuserstore/

Thanks,
Asantha

On Tue, Jul 12, 2016 at 11:59 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
> sure we will arrange a hangout on next week and sure i will refer the link
> and do the necessary inspect in my code for any security vulnerabilities
> and update you sooner
>
> Thanks,
> Asantha
>
> On Tue, Jul 12, 2016 at 9:56 AM, Tharindu Edirisinghe 
> wrote:
>
>> Hi Asantha,
>>
>> Thanks for the update. I'm out of the country this week and won't be
>> available. Let's have a hangout next week and discuss the final steps of
>> the project.
>>
>> Along with find bugs, if you haven't enabled findsecuritybugs plugin, you
>> can refer [1] and check if any security weaknesses are there in the code.
>>
>> [1]
>> http://tharindue.blogspot.in/2016/06/static-code-analysis-for-java-using.html
>>
>> Thanks,
>> TharinduE
>>
>> On Tue, Jul 12, 2016 at 5:32 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>> I have clean up the code according to find bug plugin and also for
>>> rollback purposes since it only concern when modifying or adding new user
>>> or role to user store i have manually added rollback option where if error
>>> occured all the changes done to db in code segment will be discard from db
>>> i updated the my repository with recent changes[1] now i preparing the
>>> documentation and test scripts.
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jul 4, 2016 at 2:54 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 thanks for the reply ,sure i will try out that and update the progress
 as soon as possible

 Thanks,
 Asantha

 On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Hi Asantha,
>
> While you are adding the roll back transaction capability, also look
> into testing a high load and try to generate database level exceptions.
> Once thing you can try out is writing a client for performing userstore
> manager operations such as add user, add role, login, logout etc. and play
> it with a high concurrency using Jmeter. Then we should be able to get a
> better understanding of transaction management with respective to MongoDB.
>
> Regards,
> TharinduE
>
> On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi all,
>>
>> i will be trying for implement roll back transactions capability in
>> MongoDB to add to MongoDB User Store[2] i found that MongoDB use a 
>> concept
>> call two phase commit[1] i trying to implement that inside my code but it
>> seems to be little complex and i think it may arise performance issue 
>> when
>> adding high load of dataset at once is there any other better method i 
>> can
>> achieve this task? any advices would be grateful
>>
>> [1]
>> https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
>> [2] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 29, 2016 at 2:55 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have finished and added delete functions also to users ,roles and
>>> user claim deletions to my repo[1]
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 27, 2016 at 4:18 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi aiya,

 i have small problem in my research, i will be developing
 convolution neural network using deeplearning4j to detect frauds i have
 discovered some fraud patterns which can use to train my network but 
 the
 problem i having is,are there any possibility to add condition driven
 capability to dataset to train model

 Thanks,
 Asantha

 On Wed, Jun 22, 2016 at 9:35 PM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Good work Asantha... Meanwhile let's look at getting your research
> work published as well. I will provide feedback for the work so far in
> couple of days time. I have also completed the Mid Review based on 
> your
> current work where you are already ahead of schedule.
>
> Regards,
> TharinduE
>
> On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina <

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-12 Thread Asantha Thilina
Hi Tharindu,
sure we will arrange a hangout on next week and sure i will refer the link
and do the necessary inspect in my code for any security vulnerabilities
and update you sooner

Thanks,
Asantha

On Tue, Jul 12, 2016 at 9:56 AM, Tharindu Edirisinghe 
wrote:

> Hi Asantha,
>
> Thanks for the update. I'm out of the country this week and won't be
> available. Let's have a hangout next week and discuss the final steps of
> the project.
>
> Along with find bugs, if you haven't enabled findsecuritybugs plugin, you
> can refer [1] and check if any security weaknesses are there in the code.
>
> [1]
> http://tharindue.blogspot.in/2016/06/static-code-analysis-for-java-using.html
>
> Thanks,
> TharinduE
>
> On Tue, Jul 12, 2016 at 5:32 PM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>> I have clean up the code according to find bug plugin and also for
>> rollback purposes since it only concern when modifying or adding new user
>> or role to user store i have manually added rollback option where if error
>> occured all the changes done to db in code segment will be discard from db
>> i updated the my repository with recent changes[1] now i preparing the
>> documentation and test scripts.
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jul 4, 2016 at 2:54 AM, Asantha Thilina > > wrote:
>>
>>> Hi Tharindu,
>>>
>>> thanks for the reply ,sure i will try out that and update the progress
>>> as soon as possible
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe >> > wrote:
>>>
 Hi Asantha,

 While you are adding the roll back transaction capability, also look
 into testing a high load and try to generate database level exceptions.
 Once thing you can try out is writing a client for performing userstore
 manager operations such as add user, add role, login, logout etc. and play
 it with a high concurrency using Jmeter. Then we should be able to get a
 better understanding of transaction management with respective to MongoDB.

 Regards,
 TharinduE

 On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi all,
>
> i will be trying for implement roll back transactions capability in
> MongoDB to add to MongoDB User Store[2] i found that MongoDB use a concept
> call two phase commit[1] i trying to implement that inside my code but it
> seems to be little complex and i think it may arise performance issue when
> adding high load of dataset at once is there any other better method i can
> achieve this task? any advices would be grateful
>
> [1]
> https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
> [2] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Wed, Jun 29, 2016 at 2:55 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> I have finished and added delete functions also to users ,roles and
>> user claim deletions to my repo[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 27, 2016 at 4:18 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi aiya,
>>>
>>> i have small problem in my research, i will be developing
>>> convolution neural network using deeplearning4j to detect frauds i have
>>> discovered some fraud patterns which can use to train my network but the
>>> problem i having is,are there any possibility to add condition driven
>>> capability to dataset to train model
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, Jun 22, 2016 at 9:35 PM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Good work Asantha... Meanwhile let's look at getting your research
 work published as well. I will provide feedback for the work so far in
 couple of days time. I have also completed the Mid Review based on your
 current work where you are already ahead of schedule.

 Regards,
 TharinduE

 On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> following is the summary of operations i have implemented up to
> now and yet to implement
>
> 1. Add new MongoDB User Store - done both case sensitive and
> intensensitive
> 2. Add new users to MongoDB user store - done both case sensitive
> and intensensitive
> 3. Add new roles to MongoDB user store - done both case sensitive
> and intensensitive
> 4. Search users and roles - done both case sensitive and
> intensensitive
> 5. Assign roles to mongodb 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-12 Thread Tharindu Edirisinghe
Hi Asantha,

Thanks for the update. I'm out of the country this week and won't be
available. Let's have a hangout next week and discuss the final steps of
the project.

Along with find bugs, if you haven't enabled findsecuritybugs plugin, you
can refer [1] and check if any security weaknesses are there in the code.

[1]
http://tharindue.blogspot.in/2016/06/static-code-analysis-for-java-using.html

Thanks,
TharinduE

On Tue, Jul 12, 2016 at 5:32 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
> I have clean up the code according to find bug plugin and also for
> rollback purposes since it only concern when modifying or adding new user
> or role to user store i have manually added rollback option where if error
> occured all the changes done to db in code segment will be discard from db
> i updated the my repository with recent changes[1] now i preparing the
> documentation and test scripts.
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Mon, Jul 4, 2016 at 2:54 AM, Asantha Thilina 
> wrote:
>
>> Hi Tharindu,
>>
>> thanks for the reply ,sure i will try out that and update the progress as
>> soon as possible
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe 
>> wrote:
>>
>>> Hi Asantha,
>>>
>>> While you are adding the roll back transaction capability, also look
>>> into testing a high load and try to generate database level exceptions.
>>> Once thing you can try out is writing a client for performing userstore
>>> manager operations such as add user, add role, login, logout etc. and play
>>> it with a high concurrency using Jmeter. Then we should be able to get a
>>> better understanding of transaction management with respective to MongoDB.
>>>
>>> Regards,
>>> TharinduE
>>>
>>> On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi all,

 i will be trying for implement roll back transactions capability in
 MongoDB to add to MongoDB User Store[2] i found that MongoDB use a concept
 call two phase commit[1] i trying to implement that inside my code but it
 seems to be little complex and i think it may arise performance issue when
 adding high load of dataset at once is there any other better method i can
 achieve this task? any advices would be grateful

 [1] https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
 [2] https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Wed, Jun 29, 2016 at 2:55 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I have finished and added delete functions also to users ,roles and
> user claim deletions to my repo[1]
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Mon, Jun 27, 2016 at 4:18 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi aiya,
>>
>> i have small problem in my research, i will be developing convolution
>> neural network using deeplearning4j to detect frauds i have discovered 
>> some
>> fraud patterns which can use to train my network but the problem i having
>> is,are there any possibility to add condition driven capability to 
>> dataset
>> to train model
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 22, 2016 at 9:35 PM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Good work Asantha... Meanwhile let's look at getting your research
>>> work published as well. I will provide feedback for the work so far in
>>> couple of days time. I have also completed the Mid Review based on your
>>> current work where you are already ahead of schedule.
>>>
>>> Regards,
>>> TharinduE
>>>
>>> On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 following is the summary of operations i have implemented up to now
 and yet to implement

 1. Add new MongoDB User Store - done both case sensitive and
 intensensitive
 2. Add new users to MongoDB user store - done both case sensitive
 and intensensitive
 3. Add new roles to MongoDB user store - done both case sensitive
 and intensensitive
 4. Search users and roles - done both case sensitive and
 intensensitive
 5. Assign roles to mongodb user store users - done both case
 sensitive and intensensitive
 6. Assign users to mongodb user store roles - done both case
 sensitive and intensensitive
 7. Edit claim values of user profiles  - done both case sensitive
 and intensensitive
 for those implemented user operations i have added selenium scripts
 also to my repo[1] and also i have prepared user 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-12 Thread Asantha Thilina
Hi Tharindu,
I have clean up the code according to find bug plugin and also for rollback
purposes since it only concern when modifying or adding new user or role to
user store i have manually added rollback option where if error occured all
the changes done to db in code segment will be discard from db i updated
the my repository with recent changes[1] now i preparing the documentation
and test scripts.

[1] https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Mon, Jul 4, 2016 at 2:54 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> thanks for the reply ,sure i will try out that and update the progress as
> soon as possible
>
> Thanks,
> Asantha
>
> On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe 
> wrote:
>
>> Hi Asantha,
>>
>> While you are adding the roll back transaction capability, also look into
>> testing a high load and try to generate database level exceptions. Once
>> thing you can try out is writing a client for performing userstore manager
>> operations such as add user, add role, login, logout etc. and play it with
>> a high concurrency using Jmeter. Then we should be able to get a better
>> understanding of transaction management with respective to MongoDB.
>>
>> Regards,
>> TharinduE
>>
>> On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> i will be trying for implement roll back transactions capability in
>>> MongoDB to add to MongoDB User Store[2] i found that MongoDB use a concept
>>> call two phase commit[1] i trying to implement that inside my code but it
>>> seems to be little complex and i think it may arise performance issue when
>>> adding high load of dataset at once is there any other better method i can
>>> achieve this task? any advices would be grateful
>>>
>>> [1] https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
>>> [2] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, Jun 29, 2016 at 2:55 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I have finished and added delete functions also to users ,roles and
 user claim deletions to my repo[1]

 [1] https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Mon, Jun 27, 2016 at 4:18 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi aiya,
>
> i have small problem in my research, i will be developing convolution
> neural network using deeplearning4j to detect frauds i have discovered 
> some
> fraud patterns which can use to train my network but the problem i having
> is,are there any possibility to add condition driven capability to dataset
> to train model
>
> Thanks,
> Asantha
>
> On Wed, Jun 22, 2016 at 9:35 PM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> Good work Asantha... Meanwhile let's look at getting your research
>> work published as well. I will provide feedback for the work so far in
>> couple of days time. I have also completed the Mid Review based on your
>> current work where you are already ahead of schedule.
>>
>> Regards,
>> TharinduE
>>
>> On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> following is the summary of operations i have implemented up to now
>>> and yet to implement
>>>
>>> 1. Add new MongoDB User Store - done both case sensitive and
>>> intensensitive
>>> 2. Add new users to MongoDB user store - done both case sensitive
>>> and intensensitive
>>> 3. Add new roles to MongoDB user store - done both case sensitive
>>> and intensensitive
>>> 4. Search users and roles - done both case sensitive and
>>> intensensitive
>>> 5. Assign roles to mongodb user store users - done both case
>>> sensitive and intensensitive
>>> 6. Assign users to mongodb user store roles - done both case
>>> sensitive and intensensitive
>>> 7. Edit claim values of user profiles  - done both case sensitive
>>> and intensensitive
>>> for those implemented user operations i have added selenium scripts
>>> also to my repo[1] and also i have prepared user guide[2] and 
>>> administrator
>>> guide[3] also and also i have updated my blog[4] with all my tasks what 
>>> i
>>> have done and following are the tasks yet to complete
>>>
>>> 1. implement delete operations
>>> 2. implement new profiles adding
>>> 3. check for injections possibilities and improve the security of
>>> all the functions
>>> 4. prepare full test scripts for all the functions
>>> 5. prepare developer guide and database architecture diagrams
>>>
>>> expect your feedback
>>>
>>> [1]  https://github.com/asanthamax/mongodbuserstore
>>> [2]
>>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-04 Thread Asantha Thilina
Hi Tharindu,

thanks for the reply ,sure i will try out that and update the progress as
soon as possible

Thanks,
Asantha

On Mon, Jul 4, 2016 at 1:38 AM, Tharindu Edirisinghe 
wrote:

> Hi Asantha,
>
> While you are adding the roll back transaction capability, also look into
> testing a high load and try to generate database level exceptions. Once
> thing you can try out is writing a client for performing userstore manager
> operations such as add user, add role, login, logout etc. and play it with
> a high concurrency using Jmeter. Then we should be able to get a better
> understanding of transaction management with respective to MongoDB.
>
> Regards,
> TharinduE
>
> On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina  > wrote:
>
>> Hi all,
>>
>> i will be trying for implement roll back transactions capability in
>> MongoDB to add to MongoDB User Store[2] i found that MongoDB use a concept
>> call two phase commit[1] i trying to implement that inside my code but it
>> seems to be little complex and i think it may arise performance issue when
>> adding high load of dataset at once is there any other better method i can
>> achieve this task? any advices would be grateful
>>
>> [1] https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
>> [2] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 29, 2016 at 2:55 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have finished and added delete functions also to users ,roles and user
>>> claim deletions to my repo[1]
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 27, 2016 at 4:18 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi aiya,

 i have small problem in my research, i will be developing convolution
 neural network using deeplearning4j to detect frauds i have discovered some
 fraud patterns which can use to train my network but the problem i having
 is,are there any possibility to add condition driven capability to dataset
 to train model

 Thanks,
 Asantha

 On Wed, Jun 22, 2016 at 9:35 PM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Good work Asantha... Meanwhile let's look at getting your research
> work published as well. I will provide feedback for the work so far in
> couple of days time. I have also completed the Mid Review based on your
> current work where you are already ahead of schedule.
>
> Regards,
> TharinduE
>
> On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> following is the summary of operations i have implemented up to now
>> and yet to implement
>>
>> 1. Add new MongoDB User Store - done both case sensitive and
>> intensensitive
>> 2. Add new users to MongoDB user store - done both case sensitive and
>> intensensitive
>> 3. Add new roles to MongoDB user store - done both case sensitive and
>> intensensitive
>> 4. Search users and roles - done both case sensitive and
>> intensensitive
>> 5. Assign roles to mongodb user store users - done both case
>> sensitive and intensensitive
>> 6. Assign users to mongodb user store roles - done both case
>> sensitive and intensensitive
>> 7. Edit claim values of user profiles  - done both case sensitive and
>> intensensitive
>> for those implemented user operations i have added selenium scripts
>> also to my repo[1] and also i have prepared user guide[2] and 
>> administrator
>> guide[3] also and also i have updated my blog[4] with all my tasks what i
>> have done and following are the tasks yet to complete
>>
>> 1. implement delete operations
>> 2. implement new profiles adding
>> 3. check for injections possibilities and improve the security of all
>> the functions
>> 4. prepare full test scripts for all the functions
>> 5. prepare developer guide and database architecture diagrams
>>
>> expect your feedback
>>
>> [1]  https://github.com/asanthamax/mongodbuserstore
>> [2]
>> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
>> [3]
>> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
>> [4]  http://asanthamax.blogspot.com
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 22, 2016 at 12:29 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have finished the case insensitive user operations as well and i
>>> added selenium test scripts for those implemented functions to my 
>>> repo[1]
>>> except delete function all the other functions with test script added 
>>> to my
>>> repo[1]
>>>

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-03 Thread Tharindu Edirisinghe
Hi Asantha,

While you are adding the roll back transaction capability, also look into
testing a high load and try to generate database level exceptions. Once
thing you can try out is writing a client for performing userstore manager
operations such as add user, add role, login, logout etc. and play it with
a high concurrency using Jmeter. Then we should be able to get a better
understanding of transaction management with respective to MongoDB.

Regards,
TharinduE

On Mon, Jul 4, 2016 at 10:57 AM, Asantha Thilina 
wrote:

> Hi all,
>
> i will be trying for implement roll back transactions capability in
> MongoDB to add to MongoDB User Store[2] i found that MongoDB use a concept
> call two phase commit[1] i trying to implement that inside my code but it
> seems to be little complex and i think it may arise performance issue when
> adding high load of dataset at once is there any other better method i can
> achieve this task? any advices would be grateful
>
> [1] https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
> [2] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Wed, Jun 29, 2016 at 2:55 PM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> I have finished and added delete functions also to users ,roles and user
>> claim deletions to my repo[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 27, 2016 at 4:18 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi aiya,
>>>
>>> i have small problem in my research, i will be developing convolution
>>> neural network using deeplearning4j to detect frauds i have discovered some
>>> fraud patterns which can use to train my network but the problem i having
>>> is,are there any possibility to add condition driven capability to dataset
>>> to train model
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, Jun 22, 2016 at 9:35 PM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Good work Asantha... Meanwhile let's look at getting your research work
 published as well. I will provide feedback for the work so far in couple of
 days time. I have also completed the Mid Review based on your current work
 where you are already ahead of schedule.

 Regards,
 TharinduE

 On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> following is the summary of operations i have implemented up to now
> and yet to implement
>
> 1. Add new MongoDB User Store - done both case sensitive and
> intensensitive
> 2. Add new users to MongoDB user store - done both case sensitive and
> intensensitive
> 3. Add new roles to MongoDB user store - done both case sensitive and
> intensensitive
> 4. Search users and roles - done both case sensitive and intensensitive
> 5. Assign roles to mongodb user store users - done both case sensitive
> and intensensitive
> 6. Assign users to mongodb user store roles - done both case sensitive
> and intensensitive
> 7. Edit claim values of user profiles  - done both case sensitive and
> intensensitive
> for those implemented user operations i have added selenium scripts
> also to my repo[1] and also i have prepared user guide[2] and 
> administrator
> guide[3] also and also i have updated my blog[4] with all my tasks what i
> have done and following are the tasks yet to complete
>
> 1. implement delete operations
> 2. implement new profiles adding
> 3. check for injections possibilities and improve the security of all
> the functions
> 4. prepare full test scripts for all the functions
> 5. prepare developer guide and database architecture diagrams
>
> expect your feedback
>
> [1]  https://github.com/asanthamax/mongodbuserstore
> [2]
> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
> [3]
> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
> [4]  http://asanthamax.blogspot.com
>
> Thanks,
> Asantha
>
> On Wed, Jun 22, 2016 at 12:29 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> I have finished the case insensitive user operations as well and i
>> added selenium test scripts for those implemented functions to my repo[1]
>> except delete function all the other functions with test script added to 
>> my
>> repo[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jun 17, 2016 at 2:28 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sure i'll be look forward for the hangout
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Fri, Jun 17, 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-07-03 Thread Asantha Thilina
Hi all,

i will be trying for implement roll back transactions capability in MongoDB
to add to MongoDB User Store[2] i found that MongoDB use a concept call two
phase commit[1] i trying to implement that inside my code but it seems to
be little complex and i think it may arise performance issue when adding
high load of dataset at once is there any other better method i can achieve
this task? any advices would be grateful

[1] https://docs.mongodb.com/manual/tutorial/perform-two-phase-commits/
[2] https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Wed, Jun 29, 2016 at 2:55 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> I have finished and added delete functions also to users ,roles and user
> claim deletions to my repo[1]
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Mon, Jun 27, 2016 at 4:18 AM, Asantha Thilina  > wrote:
>
>> Hi aiya,
>>
>> i have small problem in my research, i will be developing convolution
>> neural network using deeplearning4j to detect frauds i have discovered some
>> fraud patterns which can use to train my network but the problem i having
>> is,are there any possibility to add condition driven capability to dataset
>> to train model
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 22, 2016 at 9:35 PM, Tharindu Edirisinghe > > wrote:
>>
>>> Good work Asantha... Meanwhile let's look at getting your research work
>>> published as well. I will provide feedback for the work so far in couple of
>>> days time. I have also completed the Mid Review based on your current work
>>> where you are already ahead of schedule.
>>>
>>> Regards,
>>> TharinduE
>>>
>>> On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 following is the summary of operations i have implemented up to now and
 yet to implement

 1. Add new MongoDB User Store - done both case sensitive and
 intensensitive
 2. Add new users to MongoDB user store - done both case sensitive and
 intensensitive
 3. Add new roles to MongoDB user store - done both case sensitive and
 intensensitive
 4. Search users and roles - done both case sensitive and intensensitive
 5. Assign roles to mongodb user store users - done both case sensitive
 and intensensitive
 6. Assign users to mongodb user store roles - done both case sensitive
 and intensensitive
 7. Edit claim values of user profiles  - done both case sensitive and
 intensensitive
 for those implemented user operations i have added selenium scripts
 also to my repo[1] and also i have prepared user guide[2] and administrator
 guide[3] also and also i have updated my blog[4] with all my tasks what i
 have done and following are the tasks yet to complete

 1. implement delete operations
 2. implement new profiles adding
 3. check for injections possibilities and improve the security of all
 the functions
 4. prepare full test scripts for all the functions
 5. prepare developer guide and database architecture diagrams

 expect your feedback

 [1]  https://github.com/asanthamax/mongodbuserstore
 [2]
 https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
 [3]
 https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
 [4]  http://asanthamax.blogspot.com

 Thanks,
 Asantha

 On Wed, Jun 22, 2016 at 12:29 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I have finished the case insensitive user operations as well and i
> added selenium test scripts for those implemented functions to my repo[1]
> except delete function all the other functions with test script added to 
> my
> repo[1]
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Fri, Jun 17, 2016 at 2:28 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> sure i'll be look forward for the hangout
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jun 17, 2016 at 2:22 AM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Hi Asantha,
>>>
>>> I will go through the docs and provide feedback soon. Let's have a
>>> hangout session to discuss the pending issues.
>>>
>>> I'm available today 9.00 P.M IST for a google hangout.
>>>
>>> Thanks,
>>> TharinduE
>>>
>>> On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I have prepared the user guide[1] and administrator guide[2] in
 google doc since all tasks are not finished yet i have only added the 
 tasks
 i have already done 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-29 Thread Asantha Thilina
Hi Tharindu,

I have finished and added delete functions also to users ,roles and user
claim deletions to my repo[1]

[1] https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Mon, Jun 27, 2016 at 4:18 AM, Asantha Thilina 
wrote:

> Hi aiya,
>
> i have small problem in my research, i will be developing convolution
> neural network using deeplearning4j to detect frauds i have discovered some
> fraud patterns which can use to train my network but the problem i having
> is,are there any possibility to add condition driven capability to dataset
> to train model
>
> Thanks,
> Asantha
>
> On Wed, Jun 22, 2016 at 9:35 PM, Tharindu Edirisinghe 
> wrote:
>
>> Good work Asantha... Meanwhile let's look at getting your research work
>> published as well. I will provide feedback for the work so far in couple of
>> days time. I have also completed the Mid Review based on your current work
>> where you are already ahead of schedule.
>>
>> Regards,
>> TharinduE
>>
>> On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> following is the summary of operations i have implemented up to now and
>>> yet to implement
>>>
>>> 1. Add new MongoDB User Store - done both case sensitive and
>>> intensensitive
>>> 2. Add new users to MongoDB user store - done both case sensitive and
>>> intensensitive
>>> 3. Add new roles to MongoDB user store - done both case sensitive and
>>> intensensitive
>>> 4. Search users and roles - done both case sensitive and intensensitive
>>> 5. Assign roles to mongodb user store users - done both case sensitive
>>> and intensensitive
>>> 6. Assign users to mongodb user store roles - done both case sensitive
>>> and intensensitive
>>> 7. Edit claim values of user profiles  - done both case sensitive and
>>> intensensitive
>>> for those implemented user operations i have added selenium scripts also
>>> to my repo[1] and also i have prepared user guide[2] and administrator
>>> guide[3] also and also i have updated my blog[4] with all my tasks what i
>>> have done and following are the tasks yet to complete
>>>
>>> 1. implement delete operations
>>> 2. implement new profiles adding
>>> 3. check for injections possibilities and improve the security of all
>>> the functions
>>> 4. prepare full test scripts for all the functions
>>> 5. prepare developer guide and database architecture diagrams
>>>
>>> expect your feedback
>>>
>>> [1]  https://github.com/asanthamax/mongodbuserstore
>>> [2]
>>> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
>>> [3]
>>> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
>>> [4]  http://asanthamax.blogspot.com
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, Jun 22, 2016 at 12:29 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I have finished the case insensitive user operations as well and i
 added selenium test scripts for those implemented functions to my repo[1]
 except delete function all the other functions with test script added to my
 repo[1]

 [1] https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Fri, Jun 17, 2016 at 2:28 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> sure i'll be look forward for the hangout
>
> Thanks,
> Asantha
>
> On Fri, Jun 17, 2016 at 2:22 AM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> Hi Asantha,
>>
>> I will go through the docs and provide feedback soon. Let's have a
>> hangout session to discuss the pending issues.
>>
>> I'm available today 9.00 P.M IST for a google hangout.
>>
>> Thanks,
>> TharinduE
>>
>> On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have prepared the user guide[1] and administrator guide[2] in
>>> google doc since all tasks are not finished yet i have only added the 
>>> tasks
>>> i have already done and there is still the developer guide has to be
>>> prepare i will prepare it as sooner as well
>>>
>>> [1]
>>> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
>>> [2]
>>> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 sure i will prepare those documents sooner

 Thanks,
 Asantha

 On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Excellent work Asantha !
>

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-22 Thread Tharindu Edirisinghe
Good work Asantha... Meanwhile let's look at getting your research work
published as well. I will provide feedback for the work so far in couple of
days time. I have also completed the Mid Review based on your current work
where you are already ahead of schedule.

Regards,
TharinduE

On Wed, Jun 22, 2016 at 9:41 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> following is the summary of operations i have implemented up to now and
> yet to implement
>
> 1. Add new MongoDB User Store - done both case sensitive and intensensitive
> 2. Add new users to MongoDB user store - done both case sensitive and
> intensensitive
> 3. Add new roles to MongoDB user store - done both case sensitive and
> intensensitive
> 4. Search users and roles - done both case sensitive and intensensitive
> 5. Assign roles to mongodb user store users - done both case sensitive and
> intensensitive
> 6. Assign users to mongodb user store roles - done both case sensitive and
> intensensitive
> 7. Edit claim values of user profiles  - done both case sensitive and
> intensensitive
> for those implemented user operations i have added selenium scripts also
> to my repo[1] and also i have prepared user guide[2] and administrator
> guide[3] also and also i have updated my blog[4] with all my tasks what i
> have done and following are the tasks yet to complete
>
> 1. implement delete operations
> 2. implement new profiles adding
> 3. check for injections possibilities and improve the security of all the
> functions
> 4. prepare full test scripts for all the functions
> 5. prepare developer guide and database architecture diagrams
>
> expect your feedback
>
> [1]  https://github.com/asanthamax/mongodbuserstore
> [2]
> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
> [3]
> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
> [4]  http://asanthamax.blogspot.com
>
> Thanks,
> Asantha
>
> On Wed, Jun 22, 2016 at 12:29 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> I have finished the case insensitive user operations as well and i added
>> selenium test scripts for those implemented functions to my repo[1] except
>> delete function all the other functions with test script added to my repo[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jun 17, 2016 at 2:28 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sure i'll be look forward for the hangout
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Fri, Jun 17, 2016 at 2:22 AM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Hi Asantha,

 I will go through the docs and provide feedback soon. Let's have a
 hangout session to discuss the pending issues.

 I'm available today 9.00 P.M IST for a google hangout.

 Thanks,
 TharinduE

 On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I have prepared the user guide[1] and administrator guide[2] in google
> doc since all tasks are not finished yet i have only added the tasks i 
> have
> already done and there is still the developer guide has to be prepare i
> will prepare it as sooner as well
>
> [1]
> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
> [2]
> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
>
> Thanks,
> Asantha
>
> On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> sure i will prepare those documents sooner
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Excellent work Asantha !
>>>
>>> Meanwhile you can prepare a document also adding the screenshots you
>>> have got. Basically we will need following documentation.
>>>
>>> 1. Developer Guide ( The architecture of the userstoremanager,
>>> diagrams of all the collections, how they are related to each other 
>>> etc.)
>>>
>>> 2. Administrator Guide (How to guide a server administrator to setup
>>> a secondary userstore with mongodb)
>>>
>>> 3. User Guide (All the functionality of the userstoremanager, i.e
>>> each function in RemoteUserStoreManager with sample SOAP requests and
>>> responses)
>>>
>>> We will need to look at the QA aspect of the project also.. but
>>> let's keep aside for the moment until we get all the functionality 
>>> working.
>>>
>>> Thanks for all the hard work !
>>>
>>> Best Regards,
>>> Tharindu Edirisinghe
>>>
>>> On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
>>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-22 Thread Asantha Thilina
Hi Tharindu,

following is the summary of operations i have implemented up to now and yet
to implement

1. Add new MongoDB User Store - done both case sensitive and intensensitive
2. Add new users to MongoDB user store - done both case sensitive and
intensensitive
3. Add new roles to MongoDB user store - done both case sensitive and
intensensitive
4. Search users and roles - done both case sensitive and intensensitive
5. Assign roles to mongodb user store users - done both case sensitive and
intensensitive
6. Assign users to mongodb user store roles - done both case sensitive and
intensensitive
7. Edit claim values of user profiles  - done both case sensitive and
intensensitive
for those implemented user operations i have added selenium scripts also to
my repo[1] and also i have prepared user guide[2] and administrator
guide[3] also and also i have updated my blog[4] with all my tasks what i
have done and following are the tasks yet to complete

1. implement delete operations
2. implement new profiles adding
3. check for injections possibilities and improve the security of all the
functions
4. prepare full test scripts for all the functions
5. prepare developer guide and database architecture diagrams

expect your feedback

[1]  https://github.com/asanthamax/mongodbuserstore
[2]
https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
[3]
https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
[4]  http://asanthamax.blogspot.com

Thanks,
Asantha

On Wed, Jun 22, 2016 at 12:29 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> I have finished the case insensitive user operations as well and i added
> selenium test scripts for those implemented functions to my repo[1] except
> delete function all the other functions with test script added to my repo[1]
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Fri, Jun 17, 2016 at 2:28 AM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> sure i'll be look forward for the hangout
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jun 17, 2016 at 2:22 AM, Tharindu Edirisinghe > > wrote:
>>
>>> Hi Asantha,
>>>
>>> I will go through the docs and provide feedback soon. Let's have a
>>> hangout session to discuss the pending issues.
>>>
>>> I'm available today 9.00 P.M IST for a google hangout.
>>>
>>> Thanks,
>>> TharinduE
>>>
>>> On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I have prepared the user guide[1] and administrator guide[2] in google
 doc since all tasks are not finished yet i have only added the tasks i have
 already done and there is still the developer guide has to be prepare i
 will prepare it as sooner as well

 [1]
 https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
 [2]
 https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing

 Thanks,
 Asantha

 On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> sure i will prepare those documents sooner
>
> Thanks,
> Asantha
>
> On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> Excellent work Asantha !
>>
>> Meanwhile you can prepare a document also adding the screenshots you
>> have got. Basically we will need following documentation.
>>
>> 1. Developer Guide ( The architecture of the userstoremanager,
>> diagrams of all the collections, how they are related to each other etc.)
>>
>> 2. Administrator Guide (How to guide a server administrator to setup
>> a secondary userstore with mongodb)
>>
>> 3. User Guide (All the functionality of the userstoremanager, i.e
>> each function in RemoteUserStoreManager with sample SOAP requests and
>> responses)
>>
>> We will need to look at the QA aspect of the project also.. but let's
>> keep aside for the moment until we get all the functionality working.
>>
>> Thanks for all the hard work !
>>
>> Best Regards,
>> Tharindu Edirisinghe
>>
>> On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> as you advice me i added soap ui screen shots of test result and
>>> selenium script for implemented functions into my repository[1]
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 i updated my blog[1] with all the works i have done so far there i
 added all the methods and their 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-22 Thread Asantha Thilina
Hi Tharindu,

I have finished the case insensitive user operations as well and i added
selenium test scripts for those implemented functions to my repo[1] except
delete function all the other functions with test script added to my repo[1]

[1] https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Fri, Jun 17, 2016 at 2:28 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> sure i'll be look forward for the hangout
>
> Thanks,
> Asantha
>
> On Fri, Jun 17, 2016 at 2:22 AM, Tharindu Edirisinghe 
> wrote:
>
>> Hi Asantha,
>>
>> I will go through the docs and provide feedback soon. Let's have a
>> hangout session to discuss the pending issues.
>>
>> I'm available today 9.00 P.M IST for a google hangout.
>>
>> Thanks,
>> TharinduE
>>
>> On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have prepared the user guide[1] and administrator guide[2] in google
>>> doc since all tasks are not finished yet i have only added the tasks i have
>>> already done and there is still the developer guide has to be prepare i
>>> will prepare it as sooner as well
>>>
>>> [1]
>>> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
>>> [2]
>>> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 sure i will prepare those documents sooner

 Thanks,
 Asantha

 On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Excellent work Asantha !
>
> Meanwhile you can prepare a document also adding the screenshots you
> have got. Basically we will need following documentation.
>
> 1. Developer Guide ( The architecture of the userstoremanager,
> diagrams of all the collections, how they are related to each other etc.)
>
> 2. Administrator Guide (How to guide a server administrator to setup a
> secondary userstore with mongodb)
>
> 3. User Guide (All the functionality of the userstoremanager, i.e each
> function in RemoteUserStoreManager with sample SOAP requests and 
> responses)
>
> We will need to look at the QA aspect of the project also.. but let's
> keep aside for the moment until we get all the functionality working.
>
> Thanks for all the hard work !
>
> Best Regards,
> Tharindu Edirisinghe
>
> On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> as you advice me i added soap ui screen shots of test result and
>> selenium script for implemented functions into my repository[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> i updated my blog[1] with all the works i have done so far there i
>>> added all the methods and their use in MongoDBUserStoreManager ,
>>> hopes your feedback
>>> [1] http://asanthamax.blogspot.com/
>>> Thanks,
>>> Asantha
>>>
>>> On Sun, Jun 12, 2016 at 2:11 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 i have solved the login issue for registered users in my mongodb
 user store. after compare my implementation with JDBCUserStoreManager i
 realized that i would gone through the wrong path by implementing
 UserStoreManager so i changed it by extending AbstractUserStoreManager
 instead of UserStoreManager thereafter most of the issues i have faced
 being resolved now it can add new users,roles and assign users to roles
 ,roles to users can change user profile claim values and also 
 registered
 users can successfully logged into IS still the delete part has to be
 implemented and i will prepare a test scripts for my already 
 implemented
 working parts sooner and from implemented modules only issue i'm 
 facing at
 the moment is i can't decrypt the salted password of MongoDB server
 configuration in user store property xml file
 And also I need some advice from you to how i can improve the
 security of my query parameters in MongoDB
 i updated all my works in my repository[1]

 [1]https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> sorry for the delay i have updated my blog today and i'm 

Re: [Dev] GSOC 2016: Proposal 7

2016-06-21 Thread Dinanjana Gunaratne
gt;>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> Intention of this project is to build a tool
>>>>>>>>>>>>>>>>>>>>>>>>>> which ease production incident analysis.
>>>>>>>>>>>>>>>>>>>>>>>>>> Some of the common production incidents are,
>>>>>>>>>>>>>>>>>>>>>>>>>> - Server goes OOM
>>>>>>>>>>>>>>>>>>>>>>>>>> - Increase of CPU usage
>>>>>>>>>>>>>>>>>>>>>>>>>> - Server goes to an unresponsive state
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> We need to detect those situations and need to
>>>>>>>>>>>>>>>>>>>>>>>>>> extract useful information to debug the issue before 
>>>>>>>>>>>>>>>>>>>>>>>>>> the server goes to a
>>>>>>>>>>>>>>>>>>>>>>>>>> catastrophic state.
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> For an example, when the server goes OOM, it will
>>>>>>>>>>>>>>>>>>>>>>>>>> automatically generate the heap dump. However heap 
>>>>>>>>>>>>>>>>>>>>>>>>>> dump is not sufficient
>>>>>>>>>>>>>>>>>>>>>>>>>> to analyse the incident. We need to see what causes 
>>>>>>>>>>>>>>>>>>>>>>>>>> the increase of heap.
>>>>>>>>>>>>>>>>>>>>>>>>>> That may be due to increase of load (requests) or 
>>>>>>>>>>>>>>>>>>>>>>>>>> may be due to a bug. So
>>>>>>>>>>>>>>>>>>>>>>>>>> we need to extract information like TPS of the 
>>>>>>>>>>>>>>>>>>>>>>>>>> server, thread dumps to do
>>>>>>>>>>>>>>>>>>>>>>>>>> the further analysis.
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Feb 26, 2016 at 1:38 PM, Nadeeshaan
>>>>>>>>>>>>>>>>>>>>>>>>>> Gunasinghe <nadeesh...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Dinanjana,
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> First let's try to build WSO2 ESB from source
>>>>>>>>>>>>>>>>>>>>>>>>>>> and then dig in deep to the source. In order to do 
>&

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-17 Thread Asantha Thilina
Hi Tharindu,

sure i'll be look forward for the hangout

Thanks,
Asantha

On Fri, Jun 17, 2016 at 2:22 AM, Tharindu Edirisinghe 
wrote:

> Hi Asantha,
>
> I will go through the docs and provide feedback soon. Let's have a hangout
> session to discuss the pending issues.
>
> I'm available today 9.00 P.M IST for a google hangout.
>
> Thanks,
> TharinduE
>
> On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> I have prepared the user guide[1] and administrator guide[2] in google
>> doc since all tasks are not finished yet i have only added the tasks i have
>> already done and there is still the developer guide has to be prepare i
>> will prepare it as sooner as well
>>
>> [1]
>> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
>> [2]
>> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
>>
>> Thanks,
>> Asantha
>>
>> On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sure i will prepare those documents sooner
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Excellent work Asantha !

 Meanwhile you can prepare a document also adding the screenshots you
 have got. Basically we will need following documentation.

 1. Developer Guide ( The architecture of the userstoremanager, diagrams
 of all the collections, how they are related to each other etc.)

 2. Administrator Guide (How to guide a server administrator to setup a
 secondary userstore with mongodb)

 3. User Guide (All the functionality of the userstoremanager, i.e each
 function in RemoteUserStoreManager with sample SOAP requests and responses)

 We will need to look at the QA aspect of the project also.. but let's
 keep aside for the moment until we get all the functionality working.

 Thanks for all the hard work !

 Best Regards,
 Tharindu Edirisinghe

 On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> as you advice me i added soap ui screen shots of test result and
> selenium script for implemented functions into my repository[1]
>
> [1] https://github.com/asanthamax/mongodbuserstore
> Thanks,
> Asantha
>
> On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> i updated my blog[1] with all the works i have done so far there i
>> added all the methods and their use in MongoDBUserStoreManager ,
>> hopes your feedback
>> [1] http://asanthamax.blogspot.com/
>> Thanks,
>> Asantha
>>
>> On Sun, Jun 12, 2016 at 2:11 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> i have solved the login issue for registered users in my mongodb
>>> user store. after compare my implementation with JDBCUserStoreManager i
>>> realized that i would gone through the wrong path by implementing
>>> UserStoreManager so i changed it by extending AbstractUserStoreManager
>>> instead of UserStoreManager thereafter most of the issues i have faced
>>> being resolved now it can add new users,roles and assign users to roles
>>> ,roles to users can change user profile claim values and also registered
>>> users can successfully logged into IS still the delete part has to be
>>> implemented and i will prepare a test scripts for my already implemented
>>> working parts sooner and from implemented modules only issue i'm facing 
>>> at
>>> the moment is i can't decrypt the salted password of MongoDB server
>>> configuration in user store property xml file
>>> And also I need some advice from you to how i can improve the
>>> security of my query parameters in MongoDB
>>> i updated all my works in my repository[1]
>>>
>>> [1]https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 sorry for the delay i have updated my blog today and i'm keep
 posting all the progress in their[1] up to now and i am look forward 
 for
 your feedbacks and comments

 [1]http://asanthamax.blogspot.com/

 Thanks,
 Asantha

 On Thu, Jun 9, 2016 at 7:37 AM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Hi Asantha,
>
> Great ! There has been a delay in my replies but it's really good
> to see your progress with the project with a minimum level of 
> supervision.

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-17 Thread Tharindu Edirisinghe
Hi Asantha,

I will go through the docs and provide feedback soon. Let's have a hangout
session to discuss the pending issues.

I'm available today 9.00 P.M IST for a google hangout.

Thanks,
TharinduE

On Fri, Jun 17, 2016 at 11:30 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> I have prepared the user guide[1] and administrator guide[2] in google doc
> since all tasks are not finished yet i have only added the tasks i have
> already done and there is still the developer guide has to be prepare i
> will prepare it as sooner as well
>
> [1]
> https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
> [2]
> https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing
>
> Thanks,
> Asantha
>
> On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> sure i will prepare those documents sooner
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe > > wrote:
>>
>>> Excellent work Asantha !
>>>
>>> Meanwhile you can prepare a document also adding the screenshots you
>>> have got. Basically we will need following documentation.
>>>
>>> 1. Developer Guide ( The architecture of the userstoremanager, diagrams
>>> of all the collections, how they are related to each other etc.)
>>>
>>> 2. Administrator Guide (How to guide a server administrator to setup a
>>> secondary userstore with mongodb)
>>>
>>> 3. User Guide (All the functionality of the userstoremanager, i.e each
>>> function in RemoteUserStoreManager with sample SOAP requests and responses)
>>>
>>> We will need to look at the QA aspect of the project also.. but let's
>>> keep aside for the moment until we get all the functionality working.
>>>
>>> Thanks for all the hard work !
>>>
>>> Best Regards,
>>> Tharindu Edirisinghe
>>>
>>> On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 as you advice me i added soap ui screen shots of test result and
 selenium script for implemented functions into my repository[1]

 [1] https://github.com/asanthamax/mongodbuserstore
 Thanks,
 Asantha

 On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> i updated my blog[1] with all the works i have done so far there i
> added all the methods and their use in MongoDBUserStoreManager ,
> hopes your feedback
> [1] http://asanthamax.blogspot.com/
> Thanks,
> Asantha
>
> On Sun, Jun 12, 2016 at 2:11 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> i have solved the login issue for registered users in my mongodb user
>> store. after compare my implementation with JDBCUserStoreManager i 
>> realized
>> that i would gone through the wrong path by implementing UserStoreManager
>> so i changed it by extending AbstractUserStoreManager instead of
>> UserStoreManager thereafter most of the issues i have faced being 
>> resolved
>> now it can add new users,roles and assign users to roles ,roles to users
>> can change user profile claim values and also registered users can
>> successfully logged into IS still the delete part has to be implemented 
>> and
>> i will prepare a test scripts for my already implemented working parts
>> sooner and from implemented modules only issue i'm facing at the moment 
>> is
>> i can't decrypt the salted password of MongoDB server configuration in 
>> user
>> store property xml file
>> And also I need some advice from you to how i can improve the
>> security of my query parameters in MongoDB
>> i updated all my works in my repository[1]
>>
>> [1]https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sorry for the delay i have updated my blog today and i'm keep
>>> posting all the progress in their[1] up to now and i am look forward for
>>> your feedbacks and comments
>>>
>>> [1]http://asanthamax.blogspot.com/
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Thu, Jun 9, 2016 at 7:37 AM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Hi Asantha,

 Great ! There has been a delay in my replies but it's really good
 to see your progress with the project with a minimum level of 
 supervision.

 I will arrange a review next week with the Identity Server team for
 the work completed so far and then we can provide the Mid Review 
 feedback
 for the project.

 Keep on communicating the progress and the issues you face via

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-17 Thread Asantha Thilina
Hi Tharindu,

I have prepared the user guide[1] and administrator guide[2] in google doc
since all tasks are not finished yet i have only added the tasks i have
already done and there is still the developer guide has to be prepare i
will prepare it as sooner as well

[1]
https://docs.google.com/document/d/1fCLfZYsPOBkHMzRCGM3aexoBSplX3bKIRmONmFsgkBc/edit?usp=sharing
[2]
https://docs.google.com/document/d/1mdnmYruzQz5QSxAYwM1XVeJntJMFdxUsV5gord7LuPA/edit?usp=sharing

Thanks,
Asantha

On Tue, Jun 14, 2016 at 1:55 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> sure i will prepare those documents sooner
>
> Thanks,
> Asantha
>
> On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe 
> wrote:
>
>> Excellent work Asantha !
>>
>> Meanwhile you can prepare a document also adding the screenshots you have
>> got. Basically we will need following documentation.
>>
>> 1. Developer Guide ( The architecture of the userstoremanager, diagrams
>> of all the collections, how they are related to each other etc.)
>>
>> 2. Administrator Guide (How to guide a server administrator to setup a
>> secondary userstore with mongodb)
>>
>> 3. User Guide (All the functionality of the userstoremanager, i.e each
>> function in RemoteUserStoreManager with sample SOAP requests and responses)
>>
>> We will need to look at the QA aspect of the project also.. but let's
>> keep aside for the moment until we get all the functionality working.
>>
>> Thanks for all the hard work !
>>
>> Best Regards,
>> Tharindu Edirisinghe
>>
>> On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> as you advice me i added soap ui screen shots of test result and
>>> selenium script for implemented functions into my repository[1]
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 i updated my blog[1] with all the works i have done so far there i
 added all the methods and their use in MongoDBUserStoreManager ,
 hopes your feedback
 [1] http://asanthamax.blogspot.com/
 Thanks,
 Asantha

 On Sun, Jun 12, 2016 at 2:11 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> i have solved the login issue for registered users in my mongodb user
> store. after compare my implementation with JDBCUserStoreManager i 
> realized
> that i would gone through the wrong path by implementing UserStoreManager
> so i changed it by extending AbstractUserStoreManager instead of
> UserStoreManager thereafter most of the issues i have faced being resolved
> now it can add new users,roles and assign users to roles ,roles to users
> can change user profile claim values and also registered users can
> successfully logged into IS still the delete part has to be implemented 
> and
> i will prepare a test scripts for my already implemented working parts
> sooner and from implemented modules only issue i'm facing at the moment is
> i can't decrypt the salted password of MongoDB server configuration in 
> user
> store property xml file
> And also I need some advice from you to how i can improve the security
> of my query parameters in MongoDB
> i updated all my works in my repository[1]
>
> [1]https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> sorry for the delay i have updated my blog today and i'm keep posting
>> all the progress in their[1] up to now and i am look forward for your
>> feedbacks and comments
>>
>> [1]http://asanthamax.blogspot.com/
>>
>> Thanks,
>> Asantha
>>
>> On Thu, Jun 9, 2016 at 7:37 AM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Hi Asantha,
>>>
>>> Great ! There has been a delay in my replies but it's really good to
>>> see your progress with the project with a minimum level of supervision.
>>>
>>> I will arrange a review next week with the Identity Server team for
>>> the work completed so far and then we can provide the Mid Review 
>>> feedback
>>> for the project.
>>>
>>> Keep on communicating the progress and the issues you face via
>>> emails and also update your blog with the findings.
>>>
>>> Thank you,
>>> TharinduE
>>>
>>> On Thu, Jun 9, 2016 at 4:44 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 i rearranged the UM_USER_ATTRIBUTE collection now when ever user
 update his profile, claim values will save in the collection the way we
 discussed in hangout i updated my repo[1] with 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-13 Thread Asantha Thilina
Hi Tharindu,

sure i will prepare those documents sooner

Thanks,
Asantha

On Mon, Jun 13, 2016 at 9:38 PM, Tharindu Edirisinghe 
wrote:

> Excellent work Asantha !
>
> Meanwhile you can prepare a document also adding the screenshots you have
> got. Basically we will need following documentation.
>
> 1. Developer Guide ( The architecture of the userstoremanager, diagrams of
> all the collections, how they are related to each other etc.)
>
> 2. Administrator Guide (How to guide a server administrator to setup a
> secondary userstore with mongodb)
>
> 3. User Guide (All the functionality of the userstoremanager, i.e each
> function in RemoteUserStoreManager with sample SOAP requests and responses)
>
> We will need to look at the QA aspect of the project also.. but let's keep
> aside for the moment until we get all the functionality working.
>
> Thanks for all the hard work !
>
> Best Regards,
> Tharindu Edirisinghe
>
> On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> as you advice me i added soap ui screen shots of test result and selenium
>> script for implemented functions into my repository[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> i updated my blog[1] with all the works i have done so far there i added
>>> all the methods and their use in MongoDBUserStoreManager ,
>>> hopes your feedback
>>> [1] http://asanthamax.blogspot.com/
>>> Thanks,
>>> Asantha
>>>
>>> On Sun, Jun 12, 2016 at 2:11 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 i have solved the login issue for registered users in my mongodb user
 store. after compare my implementation with JDBCUserStoreManager i realized
 that i would gone through the wrong path by implementing UserStoreManager
 so i changed it by extending AbstractUserStoreManager instead of
 UserStoreManager thereafter most of the issues i have faced being resolved
 now it can add new users,roles and assign users to roles ,roles to users
 can change user profile claim values and also registered users can
 successfully logged into IS still the delete part has to be implemented and
 i will prepare a test scripts for my already implemented working parts
 sooner and from implemented modules only issue i'm facing at the moment is
 i can't decrypt the salted password of MongoDB server configuration in user
 store property xml file
 And also I need some advice from you to how i can improve the security
 of my query parameters in MongoDB
 i updated all my works in my repository[1]

 [1]https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> sorry for the delay i have updated my blog today and i'm keep posting
> all the progress in their[1] up to now and i am look forward for your
> feedbacks and comments
>
> [1]http://asanthamax.blogspot.com/
>
> Thanks,
> Asantha
>
> On Thu, Jun 9, 2016 at 7:37 AM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> Hi Asantha,
>>
>> Great ! There has been a delay in my replies but it's really good to
>> see your progress with the project with a minimum level of supervision.
>>
>> I will arrange a review next week with the Identity Server team for
>> the work completed so far and then we can provide the Mid Review feedback
>> for the project.
>>
>> Keep on communicating the progress and the issues you face via emails
>> and also update your blog with the findings.
>>
>> Thank you,
>> TharinduE
>>
>> On Thu, Jun 9, 2016 at 4:44 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> i rearranged the UM_USER_ATTRIBUTE collection now when ever user
>>> update his profile, claim values will save in the collection the way we
>>> discussed in hangout i updated my repo[1] with latest modification
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, Jun 8, 2016 at 8:03 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 sorry i forget to attach my github repository here is the
 repository link i have update the repository with my latest errors 
 fixed
 https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Wed, Jun 8, 2016 at 8:00 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I have fixed the claims issue now it 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-13 Thread Tharindu Edirisinghe
Excellent work Asantha !

Meanwhile you can prepare a document also adding the screenshots you have
got. Basically we will need following documentation.

1. Developer Guide ( The architecture of the userstoremanager, diagrams of
all the collections, how they are related to each other etc.)

2. Administrator Guide (How to guide a server administrator to setup a
secondary userstore with mongodb)

3. User Guide (All the functionality of the userstoremanager, i.e each
function in RemoteUserStoreManager with sample SOAP requests and responses)

We will need to look at the QA aspect of the project also.. but let's keep
aside for the moment until we get all the functionality working.

Thanks for all the hard work !

Best Regards,
Tharindu Edirisinghe

On Tue, Jun 14, 2016 at 12:46 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> as you advice me i added soap ui screen shots of test result and selenium
> script for implemented functions into my repository[1]
>
> [1] https://github.com/asanthamax/mongodbuserstore
> Thanks,
> Asantha
>
> On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> i updated my blog[1] with all the works i have done so far there i added
>> all the methods and their use in MongoDBUserStoreManager ,
>> hopes your feedback
>> [1] http://asanthamax.blogspot.com/
>> Thanks,
>> Asantha
>>
>> On Sun, Jun 12, 2016 at 2:11 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> i have solved the login issue for registered users in my mongodb user
>>> store. after compare my implementation with JDBCUserStoreManager i realized
>>> that i would gone through the wrong path by implementing UserStoreManager
>>> so i changed it by extending AbstractUserStoreManager instead of
>>> UserStoreManager thereafter most of the issues i have faced being resolved
>>> now it can add new users,roles and assign users to roles ,roles to users
>>> can change user profile claim values and also registered users can
>>> successfully logged into IS still the delete part has to be implemented and
>>> i will prepare a test scripts for my already implemented working parts
>>> sooner and from implemented modules only issue i'm facing at the moment is
>>> i can't decrypt the salted password of MongoDB server configuration in user
>>> store property xml file
>>> And also I need some advice from you to how i can improve the security
>>> of my query parameters in MongoDB
>>> i updated all my works in my repository[1]
>>>
>>> [1]https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 sorry for the delay i have updated my blog today and i'm keep posting
 all the progress in their[1] up to now and i am look forward for your
 feedbacks and comments

 [1]http://asanthamax.blogspot.com/

 Thanks,
 Asantha

 On Thu, Jun 9, 2016 at 7:37 AM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Hi Asantha,
>
> Great ! There has been a delay in my replies but it's really good to
> see your progress with the project with a minimum level of supervision.
>
> I will arrange a review next week with the Identity Server team for
> the work completed so far and then we can provide the Mid Review feedback
> for the project.
>
> Keep on communicating the progress and the issues you face via emails
> and also update your blog with the findings.
>
> Thank you,
> TharinduE
>
> On Thu, Jun 9, 2016 at 4:44 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> i rearranged the UM_USER_ATTRIBUTE collection now when ever user
>> update his profile, claim values will save in the collection the way we
>> discussed in hangout i updated my repo[1] with latest modification
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 8, 2016 at 8:03 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sorry i forget to attach my github repository here is the repository
>>> link i have update the repository with my latest errors fixed
>>> https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, Jun 8, 2016 at 8:00 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I have fixed the claims issue now it can update and add claims to
 user but still the db structure is same as in relational structure i 
 have
 currently mapping it to a way we discussed ,most of the issues being 
 fixed
 now following tasks can do in now MongoDBUserStoreManager
 can add users.
 can 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-13 Thread Asantha Thilina
Hi Tharindu,

as you advice me i added soap ui screen shots of test result and selenium
script for implemented functions into my repository[1]

[1] https://github.com/asanthamax/mongodbuserstore
Thanks,
Asantha

On Mon, Jun 13, 2016 at 6:23 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> i updated my blog[1] with all the works i have done so far there i added
> all the methods and their use in MongoDBUserStoreManager ,
> hopes your feedback
> [1] http://asanthamax.blogspot.com/
> Thanks,
> Asantha
>
> On Sun, Jun 12, 2016 at 2:11 PM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> i have solved the login issue for registered users in my mongodb user
>> store. after compare my implementation with JDBCUserStoreManager i realized
>> that i would gone through the wrong path by implementing UserStoreManager
>> so i changed it by extending AbstractUserStoreManager instead of
>> UserStoreManager thereafter most of the issues i have faced being resolved
>> now it can add new users,roles and assign users to roles ,roles to users
>> can change user profile claim values and also registered users can
>> successfully logged into IS still the delete part has to be implemented and
>> i will prepare a test scripts for my already implemented working parts
>> sooner and from implemented modules only issue i'm facing at the moment is
>> i can't decrypt the salted password of MongoDB server configuration in user
>> store property xml file
>> And also I need some advice from you to how i can improve the security of
>> my query parameters in MongoDB
>> i updated all my works in my repository[1]
>>
>> [1]https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sorry for the delay i have updated my blog today and i'm keep posting
>>> all the progress in their[1] up to now and i am look forward for your
>>> feedbacks and comments
>>>
>>> [1]http://asanthamax.blogspot.com/
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Thu, Jun 9, 2016 at 7:37 AM, Tharindu Edirisinghe >> > wrote:
>>>
 Hi Asantha,

 Great ! There has been a delay in my replies but it's really good to
 see your progress with the project with a minimum level of supervision.

 I will arrange a review next week with the Identity Server team for the
 work completed so far and then we can provide the Mid Review feedback for
 the project.

 Keep on communicating the progress and the issues you face via emails
 and also update your blog with the findings.

 Thank you,
 TharinduE

 On Thu, Jun 9, 2016 at 4:44 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> i rearranged the UM_USER_ATTRIBUTE collection now when ever user
> update his profile, claim values will save in the collection the way we
> discussed in hangout i updated my repo[1] with latest modification
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Wed, Jun 8, 2016 at 8:03 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> sorry i forget to attach my github repository here is the repository
>> link i have update the repository with my latest errors fixed
>> https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 8, 2016 at 8:00 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have fixed the claims issue now it can update and add claims to
>>> user but still the db structure is same as in relational structure i 
>>> have
>>> currently mapping it to a way we discussed ,most of the issues being 
>>> fixed
>>> now following tasks can do in now MongoDBUserStoreManager
>>> can add users.
>>> can add roles.
>>> can assign roles to users.
>>> can assign users to roles.
>>> can edit user claim values in update profile.
>>> I creating the documentation of my MongoDBUserStoreManager as well
>>> sooner i will publish the document and also test scripts as well
>>> And also following are the issues now i facing in
>>> registered users in my user store domain can't login to the IS it's
>>> giving error as MongoDBUserStoreManager can't cast to
>>> AbstractUserStoreManager since i done MongoDBUserStoreManager by
>>> implementing the UserStoreManager is there any special changes to do in 
>>> my
>>> code to authenticate user ? i debugged and see my doAuthenticate method 
>>> not
>>> get triggered during runtime
>>> expect some advice from you
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 6, 2016 at 1:18 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-13 Thread Asantha Thilina
Hi Tharindu,

i updated my blog[1] with all the works i have done so far there i added
all the methods and their use in MongoDBUserStoreManager ,
hopes your feedback
[1] http://asanthamax.blogspot.com/
Thanks,
Asantha

On Sun, Jun 12, 2016 at 2:11 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> i have solved the login issue for registered users in my mongodb user
> store. after compare my implementation with JDBCUserStoreManager i realized
> that i would gone through the wrong path by implementing UserStoreManager
> so i changed it by extending AbstractUserStoreManager instead of
> UserStoreManager thereafter most of the issues i have faced being resolved
> now it can add new users,roles and assign users to roles ,roles to users
> can change user profile claim values and also registered users can
> successfully logged into IS still the delete part has to be implemented and
> i will prepare a test scripts for my already implemented working parts
> sooner and from implemented modules only issue i'm facing at the moment is
> i can't decrypt the salted password of MongoDB server configuration in user
> store property xml file
> And also I need some advice from you to how i can improve the security of
> my query parameters in MongoDB
> i updated all my works in my repository[1]
>
> [1]https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> sorry for the delay i have updated my blog today and i'm keep posting all
>> the progress in their[1] up to now and i am look forward for your feedbacks
>> and comments
>>
>> [1]http://asanthamax.blogspot.com/
>>
>> Thanks,
>> Asantha
>>
>> On Thu, Jun 9, 2016 at 7:37 AM, Tharindu Edirisinghe 
>> wrote:
>>
>>> Hi Asantha,
>>>
>>> Great ! There has been a delay in my replies but it's really good to see
>>> your progress with the project with a minimum level of supervision.
>>>
>>> I will arrange a review next week with the Identity Server team for the
>>> work completed so far and then we can provide the Mid Review feedback for
>>> the project.
>>>
>>> Keep on communicating the progress and the issues you face via emails
>>> and also update your blog with the findings.
>>>
>>> Thank you,
>>> TharinduE
>>>
>>> On Thu, Jun 9, 2016 at 4:44 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 i rearranged the UM_USER_ATTRIBUTE collection now when ever user update
 his profile, claim values will save in the collection the way we discussed
 in hangout i updated my repo[1] with latest modification

 [1] https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Wed, Jun 8, 2016 at 8:03 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> sorry i forget to attach my github repository here is the repository
> link i have update the repository with my latest errors fixed
> https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Wed, Jun 8, 2016 at 8:00 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> I have fixed the claims issue now it can update and add claims to
>> user but still the db structure is same as in relational structure i have
>> currently mapping it to a way we discussed ,most of the issues being 
>> fixed
>> now following tasks can do in now MongoDBUserStoreManager
>> can add users.
>> can add roles.
>> can assign roles to users.
>> can assign users to roles.
>> can edit user claim values in update profile.
>> I creating the documentation of my MongoDBUserStoreManager as well
>> sooner i will publish the document and also test scripts as well
>> And also following are the issues now i facing in
>> registered users in my user store domain can't login to the IS it's
>> giving error as MongoDBUserStoreManager can't cast to
>> AbstractUserStoreManager since i done MongoDBUserStoreManager by
>> implementing the UserStoreManager is there any special changes to do in 
>> my
>> code to authenticate user ? i debugged and see my doAuthenticate method 
>> not
>> get triggered during runtime
>> expect some advice from you
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 6, 2016 at 1:18 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> ok sure i will modify the readme content as appropriately,at the
>>> moment i didn't add that feature, set to all default i will modify that 
>>> to
>>> add a port number also,
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 6, 2016 at 12:04 AM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Hi Asantha,

 We might not need 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-12 Thread Asantha Thilina
Hi Tharindu,

i have solved the login issue for registered users in my mongodb user
store. after compare my implementation with JDBCUserStoreManager i realized
that i would gone through the wrong path by implementing UserStoreManager
so i changed it by extending AbstractUserStoreManager instead of
UserStoreManager thereafter most of the issues i have faced being resolved
now it can add new users,roles and assign users to roles ,roles to users
can change user profile claim values and also registered users can
successfully logged into IS still the delete part has to be implemented and
i will prepare a test scripts for my already implemented working parts
sooner and from implemented modules only issue i'm facing at the moment is
i can't decrypt the salted password of MongoDB server configuration in user
store property xml file
And also I need some advice from you to how i can improve the security of
my query parameters in MongoDB
i updated all my works in my repository[1]

[1]https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Fri, Jun 10, 2016 at 12:51 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> sorry for the delay i have updated my blog today and i'm keep posting all
> the progress in their[1] up to now and i am look forward for your feedbacks
> and comments
>
> [1]http://asanthamax.blogspot.com/
>
> Thanks,
> Asantha
>
> On Thu, Jun 9, 2016 at 7:37 AM, Tharindu Edirisinghe 
> wrote:
>
>> Hi Asantha,
>>
>> Great ! There has been a delay in my replies but it's really good to see
>> your progress with the project with a minimum level of supervision.
>>
>> I will arrange a review next week with the Identity Server team for the
>> work completed so far and then we can provide the Mid Review feedback for
>> the project.
>>
>> Keep on communicating the progress and the issues you face via emails and
>> also update your blog with the findings.
>>
>> Thank you,
>> TharinduE
>>
>> On Thu, Jun 9, 2016 at 4:44 PM, Asantha Thilina > > wrote:
>>
>>> Hi Tharindu,
>>>
>>> i rearranged the UM_USER_ATTRIBUTE collection now when ever user update
>>> his profile, claim values will save in the collection the way we discussed
>>> in hangout i updated my repo[1] with latest modification
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, Jun 8, 2016 at 8:03 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 sorry i forget to attach my github repository here is the repository
 link i have update the repository with my latest errors fixed
 https://github.com/asanthamax/mongodbuserstore

 Thanks,
 Asantha

 On Wed, Jun 8, 2016 at 8:00 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I have fixed the claims issue now it can update and add claims to user
> but still the db structure is same as in relational structure i have
> currently mapping it to a way we discussed ,most of the issues being fixed
> now following tasks can do in now MongoDBUserStoreManager
> can add users.
> can add roles.
> can assign roles to users.
> can assign users to roles.
> can edit user claim values in update profile.
> I creating the documentation of my MongoDBUserStoreManager as well
> sooner i will publish the document and also test scripts as well
> And also following are the issues now i facing in
> registered users in my user store domain can't login to the IS it's
> giving error as MongoDBUserStoreManager can't cast to
> AbstractUserStoreManager since i done MongoDBUserStoreManager by
> implementing the UserStoreManager is there any special changes to do in my
> code to authenticate user ? i debugged and see my doAuthenticate method 
> not
> get triggered during runtime
> expect some advice from you
>
> Thanks,
> Asantha
>
> On Mon, Jun 6, 2016 at 1:18 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> ok sure i will modify the readme content as appropriately,at the
>> moment i didn't add that feature, set to all default i will modify that 
>> to
>> add a port number also,
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 6, 2016 at 12:04 AM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Hi Asantha,
>>>
>>> We might not need implementing the HybridRoleManager... I'll provide
>>> you the exact details after trying out the functionality you have
>>> implemented up to now.
>>>
>>> Can you please write a basic document with the steps for creating
>>> the mongodb database and adding a userstore in IS pointing to the 
>>> created
>>> mongodb database and include in the ReadMe of github repo.
>>>
>>> Also if mongodb server is running in a different port other than 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-10 Thread Asantha Thilina
Hi Tharindu,

sorry for the delay i have updated my blog today and i'm keep posting all
the progress in their[1] up to now and i am look forward for your feedbacks
and comments

[1]http://asanthamax.blogspot.com/

Thanks,
Asantha

On Thu, Jun 9, 2016 at 7:37 AM, Tharindu Edirisinghe 
wrote:

> Hi Asantha,
>
> Great ! There has been a delay in my replies but it's really good to see
> your progress with the project with a minimum level of supervision.
>
> I will arrange a review next week with the Identity Server team for the
> work completed so far and then we can provide the Mid Review feedback for
> the project.
>
> Keep on communicating the progress and the issues you face via emails and
> also update your blog with the findings.
>
> Thank you,
> TharinduE
>
> On Thu, Jun 9, 2016 at 4:44 PM, Asantha Thilina 
> wrote:
>
>> Hi Tharindu,
>>
>> i rearranged the UM_USER_ATTRIBUTE collection now when ever user update
>> his profile, claim values will save in the collection the way we discussed
>> in hangout i updated my repo[1] with latest modification
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 8, 2016 at 8:03 AM, Asantha Thilina > > wrote:
>>
>>> Hi Tharindu,
>>>
>>> sorry i forget to attach my github repository here is the repository
>>> link i have update the repository with my latest errors fixed
>>> https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, Jun 8, 2016 at 8:00 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I have fixed the claims issue now it can update and add claims to user
 but still the db structure is same as in relational structure i have
 currently mapping it to a way we discussed ,most of the issues being fixed
 now following tasks can do in now MongoDBUserStoreManager
 can add users.
 can add roles.
 can assign roles to users.
 can assign users to roles.
 can edit user claim values in update profile.
 I creating the documentation of my MongoDBUserStoreManager as well
 sooner i will publish the document and also test scripts as well
 And also following are the issues now i facing in
 registered users in my user store domain can't login to the IS it's
 giving error as MongoDBUserStoreManager can't cast to
 AbstractUserStoreManager since i done MongoDBUserStoreManager by
 implementing the UserStoreManager is there any special changes to do in my
 code to authenticate user ? i debugged and see my doAuthenticate method not
 get triggered during runtime
 expect some advice from you

 Thanks,
 Asantha

 On Mon, Jun 6, 2016 at 1:18 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> ok sure i will modify the readme content as appropriately,at the
> moment i didn't add that feature, set to all default i will modify that to
> add a port number also,
>
> Thanks,
> Asantha
>
> On Mon, Jun 6, 2016 at 12:04 AM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> Hi Asantha,
>>
>> We might not need implementing the HybridRoleManager... I'll provide
>> you the exact details after trying out the functionality you have
>> implemented up to now.
>>
>> Can you please write a basic document with the steps for creating the
>> mongodb database and adding a userstore in IS pointing to the created
>> mongodb database and include in the ReadMe of github repo.
>>
>> Also if mongodb server is running in a different port other than the
>> default port, can we still connect to that ? I didn't see a place to 
>> define
>> the port in the configuration.. should it be added as a connection 
>> string ?
>> (didn't go through the code to find what is going wrong)
>>
>> Thanks,
>> TharinduE
>>
>> On Sun, Jun 5, 2016 at 11:55 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> As we discussed on hangout i doing the changes in UM_USER_ATTRIBUTE
>>> collection and also changing the hybrid role to master datasource but 
>>> when
>>> i try to add user to hybrid role i facing a small issue i can't grab the
>>> datasource ,in HybridRoleManager class it need to give 
>>> java.sql.DataSource
>>> but in my current user store manager class i have never used a sql
>>> datasource(since it nosql) so i think i need to grab the master 
>>> datasource
>>> of IS which is h2 database datasource, is there a way to get the primary
>>> datasource?
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Sat, Jun 4, 2016 at 1:59 PM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 The call details are as following.

 1. Demonstrated how to use 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-09 Thread Tharindu Edirisinghe
Hi Asantha,

Great ! There has been a delay in my replies but it's really good to see
your progress with the project with a minimum level of supervision.

I will arrange a review next week with the Identity Server team for the
work completed so far and then we can provide the Mid Review feedback for
the project.

Keep on communicating the progress and the issues you face via emails and
also update your blog with the findings.

Thank you,
TharinduE

On Thu, Jun 9, 2016 at 4:44 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> i rearranged the UM_USER_ATTRIBUTE collection now when ever user update
> his profile, claim values will save in the collection the way we discussed
> in hangout i updated my repo[1] with latest modification
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Wed, Jun 8, 2016 at 8:03 AM, Asantha Thilina 
> wrote:
>
>> Hi Tharindu,
>>
>> sorry i forget to attach my github repository here is the repository link
>> i have update the repository with my latest errors fixed
>> https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 8, 2016 at 8:00 AM, Asantha Thilina > > wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have fixed the claims issue now it can update and add claims to user
>>> but still the db structure is same as in relational structure i have
>>> currently mapping it to a way we discussed ,most of the issues being fixed
>>> now following tasks can do in now MongoDBUserStoreManager
>>> can add users.
>>> can add roles.
>>> can assign roles to users.
>>> can assign users to roles.
>>> can edit user claim values in update profile.
>>> I creating the documentation of my MongoDBUserStoreManager as well
>>> sooner i will publish the document and also test scripts as well
>>> And also following are the issues now i facing in
>>> registered users in my user store domain can't login to the IS it's
>>> giving error as MongoDBUserStoreManager can't cast to
>>> AbstractUserStoreManager since i done MongoDBUserStoreManager by
>>> implementing the UserStoreManager is there any special changes to do in my
>>> code to authenticate user ? i debugged and see my doAuthenticate method not
>>> get triggered during runtime
>>> expect some advice from you
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 6, 2016 at 1:18 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 ok sure i will modify the readme content as appropriately,at the moment
 i didn't add that feature, set to all default i will modify that to add a
 port number also,

 Thanks,
 Asantha

 On Mon, Jun 6, 2016 at 12:04 AM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Hi Asantha,
>
> We might not need implementing the HybridRoleManager... I'll provide
> you the exact details after trying out the functionality you have
> implemented up to now.
>
> Can you please write a basic document with the steps for creating the
> mongodb database and adding a userstore in IS pointing to the created
> mongodb database and include in the ReadMe of github repo.
>
> Also if mongodb server is running in a different port other than the
> default port, can we still connect to that ? I didn't see a place to 
> define
> the port in the configuration.. should it be added as a connection string 
> ?
> (didn't go through the code to find what is going wrong)
>
> Thanks,
> TharinduE
>
> On Sun, Jun 5, 2016 at 11:55 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> As we discussed on hangout i doing the changes in UM_USER_ATTRIBUTE
>> collection and also changing the hybrid role to master datasource but 
>> when
>> i try to add user to hybrid role i facing a small issue i can't grab the
>> datasource ,in HybridRoleManager class it need to give 
>> java.sql.DataSource
>> but in my current user store manager class i have never used a sql
>> datasource(since it nosql) so i think i need to grab the master 
>> datasource
>> of IS which is h2 database datasource, is there a way to get the primary
>> datasource?
>>
>> Thanks,
>> Asantha
>>
>> On Sat, Jun 4, 2016 at 1:59 PM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> The call details are as following.
>>>
>>> 1. Demonstrated how to use WSO2 admin services.
>>>
>>> 2. All the user operations in *RemoteUserStoreManagerService *[1]
>>> should be tested (using SOAP UI) for the mongodb userstore.
>>>
>>> 3. When the user profile is saved in a JDBC userstore, for each
>>> attribute of the user, it will add a new entry in *UM_USER_ATTRIBUTE
>>> **(Refer [2] for more information) *like below.
>>>
>>>
>>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-09 Thread Asantha Thilina
Hi Tharindu,

i rearranged the UM_USER_ATTRIBUTE collection now when ever user update his
profile, claim values will save in the collection the way we discussed in
hangout i updated my repo[1] with latest modification

[1] https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Wed, Jun 8, 2016 at 8:03 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> sorry i forget to attach my github repository here is the repository link
> i have update the repository with my latest errors fixed
> https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Wed, Jun 8, 2016 at 8:00 AM, Asantha Thilina 
> wrote:
>
>> Hi Tharindu,
>>
>> I have fixed the claims issue now it can update and add claims to user
>> but still the db structure is same as in relational structure i have
>> currently mapping it to a way we discussed ,most of the issues being fixed
>> now following tasks can do in now MongoDBUserStoreManager
>> can add users.
>> can add roles.
>> can assign roles to users.
>> can assign users to roles.
>> can edit user claim values in update profile.
>> I creating the documentation of my MongoDBUserStoreManager as well sooner
>> i will publish the document and also test scripts as well
>> And also following are the issues now i facing in
>> registered users in my user store domain can't login to the IS it's
>> giving error as MongoDBUserStoreManager can't cast to
>> AbstractUserStoreManager since i done MongoDBUserStoreManager by
>> implementing the UserStoreManager is there any special changes to do in my
>> code to authenticate user ? i debugged and see my doAuthenticate method not
>> get triggered during runtime
>> expect some advice from you
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 6, 2016 at 1:18 AM, Asantha Thilina > > wrote:
>>
>>> Hi Tharindu,
>>>
>>> ok sure i will modify the readme content as appropriately,at the moment
>>> i didn't add that feature, set to all default i will modify that to add a
>>> port number also,
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Mon, Jun 6, 2016 at 12:04 AM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Hi Asantha,

 We might not need implementing the HybridRoleManager... I'll provide
 you the exact details after trying out the functionality you have
 implemented up to now.

 Can you please write a basic document with the steps for creating the
 mongodb database and adding a userstore in IS pointing to the created
 mongodb database and include in the ReadMe of github repo.

 Also if mongodb server is running in a different port other than the
 default port, can we still connect to that ? I didn't see a place to define
 the port in the configuration.. should it be added as a connection string ?
 (didn't go through the code to find what is going wrong)

 Thanks,
 TharinduE

 On Sun, Jun 5, 2016 at 11:55 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> As we discussed on hangout i doing the changes in UM_USER_ATTRIBUTE
> collection and also changing the hybrid role to master datasource but when
> i try to add user to hybrid role i facing a small issue i can't grab the
> datasource ,in HybridRoleManager class it need to give java.sql.DataSource
> but in my current user store manager class i have never used a sql
> datasource(since it nosql) so i think i need to grab the master datasource
> of IS which is h2 database datasource, is there a way to get the primary
> datasource?
>
> Thanks,
> Asantha
>
> On Sat, Jun 4, 2016 at 1:59 PM, Tharindu Edirisinghe <
> tharin...@wso2.com> wrote:
>
>> The call details are as following.
>>
>> 1. Demonstrated how to use WSO2 admin services.
>>
>> 2. All the user operations in *RemoteUserStoreManagerService *[1]
>> should be tested (using SOAP UI) for the mongodb userstore.
>>
>> 3. When the user profile is saved in a JDBC userstore, for each
>> attribute of the user, it will add a new entry in *UM_USER_ATTRIBUTE
>> **(Refer [2] for more information) *like below.
>>
>>
>> +---+--+-+---++--+
>> | UM_ID | UM_ATTR_NAME | UM_ATTR_VALUE   | UM_PROFILE_ID |
>> UM_USER_ID | UM_TENANT_ID |
>>
>> +---+--+-+---++--+
>> | 1 | im   | | default
>> |  1 |-1234 |
>> | 2 | region   | Western | default
>> |  1 |-1234 |
>> | 3 | streetAddress| | default
>> |  1 |-1234 |
>> | 4 | country  | | default
>> |  1 |-1234 |
>> | 5 | mobile 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-08 Thread Asantha Thilina
Hi Tharindu,

sorry i forget to attach my github repository here is the repository link i
have update the repository with my latest errors fixed
https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Wed, Jun 8, 2016 at 8:00 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> I have fixed the claims issue now it can update and add claims to user but
> still the db structure is same as in relational structure i have currently
> mapping it to a way we discussed ,most of the issues being fixed now
> following tasks can do in now MongoDBUserStoreManager
> can add users.
> can add roles.
> can assign roles to users.
> can assign users to roles.
> can edit user claim values in update profile.
> I creating the documentation of my MongoDBUserStoreManager as well sooner
> i will publish the document and also test scripts as well
> And also following are the issues now i facing in
> registered users in my user store domain can't login to the IS it's giving
> error as MongoDBUserStoreManager can't cast to AbstractUserStoreManager
> since i done MongoDBUserStoreManager by implementing the UserStoreManager
> is there any special changes to do in my code to authenticate user ? i
> debugged and see my doAuthenticate method not get triggered during runtime
> expect some advice from you
>
> Thanks,
> Asantha
>
> On Mon, Jun 6, 2016 at 1:18 AM, Asantha Thilina 
> wrote:
>
>> Hi Tharindu,
>>
>> ok sure i will modify the readme content as appropriately,at the moment i
>> didn't add that feature, set to all default i will modify that to add a
>> port number also,
>>
>> Thanks,
>> Asantha
>>
>> On Mon, Jun 6, 2016 at 12:04 AM, Tharindu Edirisinghe > > wrote:
>>
>>> Hi Asantha,
>>>
>>> We might not need implementing the HybridRoleManager... I'll provide you
>>> the exact details after trying out the functionality you have implemented
>>> up to now.
>>>
>>> Can you please write a basic document with the steps for creating the
>>> mongodb database and adding a userstore in IS pointing to the created
>>> mongodb database and include in the ReadMe of github repo.
>>>
>>> Also if mongodb server is running in a different port other than the
>>> default port, can we still connect to that ? I didn't see a place to define
>>> the port in the configuration.. should it be added as a connection string ?
>>> (didn't go through the code to find what is going wrong)
>>>
>>> Thanks,
>>> TharinduE
>>>
>>> On Sun, Jun 5, 2016 at 11:55 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 As we discussed on hangout i doing the changes in UM_USER_ATTRIBUTE
 collection and also changing the hybrid role to master datasource but when
 i try to add user to hybrid role i facing a small issue i can't grab the
 datasource ,in HybridRoleManager class it need to give java.sql.DataSource
 but in my current user store manager class i have never used a sql
 datasource(since it nosql) so i think i need to grab the master datasource
 of IS which is h2 database datasource, is there a way to get the primary
 datasource?

 Thanks,
 Asantha

 On Sat, Jun 4, 2016 at 1:59 PM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> The call details are as following.
>
> 1. Demonstrated how to use WSO2 admin services.
>
> 2. All the user operations in *RemoteUserStoreManagerService *[1]
> should be tested (using SOAP UI) for the mongodb userstore.
>
> 3. When the user profile is saved in a JDBC userstore, for each
> attribute of the user, it will add a new entry in *UM_USER_ATTRIBUTE 
> **(Refer
> [2] for more information) *like below.
>
>
> +---+--+-+---++--+
> | UM_ID | UM_ATTR_NAME | UM_ATTR_VALUE   | UM_PROFILE_ID |
> UM_USER_ID | UM_TENANT_ID |
>
> +---+--+-+---++--+
> | 1 | im   | | default
> |  1 |-1234 |
> | 2 | region   | Western | default
> |  1 |-1234 |
> | 3 | streetAddress| | default
> |  1 |-1234 |
> | 4 | country  | | default
> |  1 |-1234 |
> | 5 | mobile   | | default
> |  1 |-1234 |
> | 6 | sn   | NewLastname | default
> |  1 |-1234 |
> | 7 | profileConfiguration | default | default
> |  1 |-1234 |
> | 8 | dateOfBirth  | | default
> |  1 |-1234 |
> | 9 | mail | newu...@new.com | default
> |  1 |-1234 |
> |  

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-08 Thread Asantha Thilina
Hi Tharindu,

I have fixed the claims issue now it can update and add claims to user but
still the db structure is same as in relational structure i have currently
mapping it to a way we discussed ,most of the issues being fixed now
following tasks can do in now MongoDBUserStoreManager
can add users.
can add roles.
can assign roles to users.
can assign users to roles.
can edit user claim values in update profile.
I creating the documentation of my MongoDBUserStoreManager as well sooner i
will publish the document and also test scripts as well
And also following are the issues now i facing in
registered users in my user store domain can't login to the IS it's giving
error as MongoDBUserStoreManager can't cast to AbstractUserStoreManager
since i done MongoDBUserStoreManager by implementing the UserStoreManager
is there any special changes to do in my code to authenticate user ? i
debugged and see my doAuthenticate method not get triggered during runtime
expect some advice from you

Thanks,
Asantha

On Mon, Jun 6, 2016 at 1:18 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> ok sure i will modify the readme content as appropriately,at the moment i
> didn't add that feature, set to all default i will modify that to add a
> port number also,
>
> Thanks,
> Asantha
>
> On Mon, Jun 6, 2016 at 12:04 AM, Tharindu Edirisinghe 
> wrote:
>
>> Hi Asantha,
>>
>> We might not need implementing the HybridRoleManager... I'll provide you
>> the exact details after trying out the functionality you have implemented
>> up to now.
>>
>> Can you please write a basic document with the steps for creating the
>> mongodb database and adding a userstore in IS pointing to the created
>> mongodb database and include in the ReadMe of github repo.
>>
>> Also if mongodb server is running in a different port other than the
>> default port, can we still connect to that ? I didn't see a place to define
>> the port in the configuration.. should it be added as a connection string ?
>> (didn't go through the code to find what is going wrong)
>>
>> Thanks,
>> TharinduE
>>
>> On Sun, Jun 5, 2016 at 11:55 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> As we discussed on hangout i doing the changes in UM_USER_ATTRIBUTE
>>> collection and also changing the hybrid role to master datasource but when
>>> i try to add user to hybrid role i facing a small issue i can't grab the
>>> datasource ,in HybridRoleManager class it need to give java.sql.DataSource
>>> but in my current user store manager class i have never used a sql
>>> datasource(since it nosql) so i think i need to grab the master datasource
>>> of IS which is h2 database datasource, is there a way to get the primary
>>> datasource?
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Sat, Jun 4, 2016 at 1:59 PM, Tharindu Edirisinghe >> > wrote:
>>>
 The call details are as following.

 1. Demonstrated how to use WSO2 admin services.

 2. All the user operations in *RemoteUserStoreManagerService *[1]
 should be tested (using SOAP UI) for the mongodb userstore.

 3. When the user profile is saved in a JDBC userstore, for each
 attribute of the user, it will add a new entry in *UM_USER_ATTRIBUTE 
 **(Refer
 [2] for more information) *like below.


 +---+--+-+---++--+
 | UM_ID | UM_ATTR_NAME | UM_ATTR_VALUE   | UM_PROFILE_ID |
 UM_USER_ID | UM_TENANT_ID |

 +---+--+-+---++--+
 | 1 | im   | | default
 |  1 |-1234 |
 | 2 | region   | Western | default
 |  1 |-1234 |
 | 3 | streetAddress| | default
 |  1 |-1234 |
 | 4 | country  | | default
 |  1 |-1234 |
 | 5 | mobile   | | default
 |  1 |-1234 |
 | 6 | sn   | NewLastname | default
 |  1 |-1234 |
 | 7 | profileConfiguration | default | default
 |  1 |-1234 |
 | 8 | dateOfBirth  | | default
 |  1 |-1234 |
 | 9 | mail | newu...@new.com | default
 |  1 |-1234 |
 |10 | organizationName | WSO2| default
 |  1 |-1234 |
 |11 | givenName| NewUser | default
 |  1 |-1234 |
 |12 | province | western | default
 |  1 |-1234 |

 +---+--+-+---++--+

 Performance wise this is 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-06-07 Thread Supun Sethunga
Hi Lakini,

Can you host your current code somewhere, may be in jsfiddle, with all
html+css+js stuff (as a working sample), so that we can have a look? It is
hard to suggest a solution without even seeing the issue :)

Btw, please keep an eye on the gsoc timeline as well. Mid-term evaluations
are less than two weeks away, so we need to have some basic version of the
UI in working state, as we discussed at the start. Also try to schedule the
demo before that, so that we can have a look at the implementation as well
as can sort out any issue prior to the evaluation.

Thanks,
Supun

On Tue, Jun 7, 2016 at 12:57 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> This is my javascript file.I forgot to attach it with the last email.
>
> Thank you.
>
> On Mon, Jun 6, 2016 at 10:41 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> I have started to build the front end web page and now I'm getting an
>> error.
>> *jquery UI draggable elements are no longer draggable after drop it in
>> the working space*.I have gone through stack over flow questions and
>> answers but still I can't drag the element after drop.
>>
>> I would greatly appreciate  if you kindly give me some solutions on this
>> problem.
>>
>> Thank you.
>>
>> On Sat, Jun 4, 2016 at 8:55 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi mentors,
>>>
>>> I have a prototype presentation for my 4th year research project next
>>> week.So I didn't have time to look in to the builder.How ever  I have
>>> started to build the NN builder today.I'll submit the demo as soon as
>>> possible.
>>>
>>> Thank you.
>>>
>>> On Fri, Jun 3, 2016 at 4:40 PM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

 Thank you very much Chathurike.It will be really helpful for my NN
 Builder.

 Thank you.

 On Fri, Jun 3, 2016 at 10:50 AM, CD Athuraliya 
 wrote:

> Hi Lakini,
>
> You can gain some insight for your NN builder from TensorFlow
> Playground [1]. It is also open source under Apache 2.0 licence [2].
>
> [1] http://playground.tensorflow.org
> [2] https://github.com/tensorflow/playground
>
> Regards,
> CD
>
> On Thu, Jun 2, 2016 at 8:00 AM, Upul Bandara  wrote:
>
>> Yes at the moment this looks OK.
>>
>> Please put some effort to create a basic version of the NN builder
>> and let's have a quick demo.
>>
>> Let me know if you have further questions or clarifications.
>>
>> Thanks,
>> Upul
>>
>> On Wed, Jun 1, 2016 at 11:29 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you very much Upul. I will submit a demo soon.
>>>
>>> I have drawn a sketch of NN builder front end[1]. Basically it will
>>> be like this UI[2].(The content will be changed.)
>>>
>>> [1]Sketch of NN Builder
>>> 
>>> [2]https://www.draw.io/  
>>>
>>> In [1],under "layers" users can select the type of the
>>> layer-Input,Hidden or Output layer.
>>> Under "node" and "Connectors"-users can drag and drop nodes and
>>> connectors to the working area and they can build their NN as they wish.
>>>
>>> In the right hand side,there is a setting area.From that user can
>>> set Optimization algorithms,iterations,learning rates,seed etc. of the
>>> neural network.
>>>
>>> Could you please give me comments and your thoughts regrading this?
>>>
>>> Thank you.
>>>
>>>
>>>
>>> On Wed, Jun 1, 2016 at 2:19 PM, Upul Bandara  wrote:
>>>
 Hi,

 Good progress.

 The key parts of the project are designing the front-end of NN
 builder, communicating between the front-end and the Deeplearning4J
 back-end.
 So at this stage of the project, it is better to put your effort on
 above the components. Later, we can integrate what you have built with 
 WSO2
 Machine Learning server.

 Once you have completed a basic NN builder (ability to build a
 simple feedforward  is enough) we would like to have a quick demo.

 Let me know if you have further questions or clarifications.

 Thanks,
 Upul

 On Wed, Jun 1, 2016 at 10:42 AM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I'm sorry for the late response.Thank you very much for the last
> email.I have gone through JQueryUI and I have implemented some samples
> using JQueryUI.I have gone through the  WSO2 machine learner and I 
> have
> identified the place to insert this jaggery 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-06-06 Thread Lakini Senanayaka
Hi,

I have started to build the front end web page and now I'm getting an error.
*jquery UI draggable elements are no longer draggable after drop it in the
working space*.I have gone through stack over flow questions and answers
but still I can't drag the element after drop.

I would greatly appreciate  if you kindly give me some solutions on this
problem.

Thank you.

On Sat, Jun 4, 2016 at 8:55 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi mentors,
>
> I have a prototype presentation for my 4th year research project next
> week.So I didn't have time to look in to the builder.How ever  I have
> started to build the NN builder today.I'll submit the demo as soon as
> possible.
>
> Thank you.
>
> On Fri, Jun 3, 2016 at 4:40 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you very much Chathurike.It will be really helpful for my NN
>> Builder.
>>
>> Thank you.
>>
>> On Fri, Jun 3, 2016 at 10:50 AM, CD Athuraliya 
>> wrote:
>>
>>> Hi Lakini,
>>>
>>> You can gain some insight for your NN builder from TensorFlow Playground
>>> [1]. It is also open source under Apache 2.0 licence [2].
>>>
>>> [1] http://playground.tensorflow.org
>>> [2] https://github.com/tensorflow/playground
>>>
>>> Regards,
>>> CD
>>>
>>> On Thu, Jun 2, 2016 at 8:00 AM, Upul Bandara  wrote:
>>>
 Yes at the moment this looks OK.

 Please put some effort to create a basic version of the NN builder and
 let's have a quick demo.

 Let me know if you have further questions or clarifications.

 Thanks,
 Upul

 On Wed, Jun 1, 2016 at 11:29 PM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you very much Upul. I will submit a demo soon.
>
> I have drawn a sketch of NN builder front end[1]. Basically it will be
> like this UI[2].(The content will be changed.)
>
> [1]Sketch of NN Builder
> 
> [2]https://www.draw.io/  
>
> In [1],under "layers" users can select the type of the
> layer-Input,Hidden or Output layer.
> Under "node" and "Connectors"-users can drag and drop nodes and
> connectors to the working area and they can build their NN as they wish.
>
> In the right hand side,there is a setting area.From that user can set
> Optimization algorithms,iterations,learning rates,seed etc. of the neural
> network.
>
> Could you please give me comments and your thoughts regrading this?
>
> Thank you.
>
>
>
> On Wed, Jun 1, 2016 at 2:19 PM, Upul Bandara  wrote:
>
>> Hi,
>>
>> Good progress.
>>
>> The key parts of the project are designing the front-end of NN
>> builder, communicating between the front-end and the Deeplearning4J
>> back-end.
>> So at this stage of the project, it is better to put your effort on
>> above the components. Later, we can integrate what you have built with 
>> WSO2
>> Machine Learning server.
>>
>> Once you have completed a basic NN builder (ability to build a simple
>> feedforward  is enough) we would like to have a quick demo.
>>
>> Let me know if you have further questions or clarifications.
>>
>> Thanks,
>> Upul
>>
>> On Wed, Jun 1, 2016 at 10:42 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm sorry for the late response.Thank you very much for the last
>>> email.I have gone through JQueryUI and I have implemented some samples
>>> using JQueryUI.I have gone through the  WSO2 machine learner and I have
>>> identified the place to insert this jaggery page(replace the
>>> hyper-parameter page in the ML UI).
>>> Currently I'm designing the sketch of the Deep Neural Network
>>> Builder-the front end.
>>> I'll send my sketch before tonight.Based on your comments I can
>>> start implementations.
>>>
>>> Thank you.
>>>
>>>
>>> On Wed, Jun 1, 2016 at 9:29 AM, Supun Sethunga 
>>> wrote:
>>>
 Hi Lakini,

 Any update on the progress?

 Regards,
 Supun

 On Fri, May 27, 2016 at 5:34 PM, Supun Sethunga 
 wrote:

> Hi Lakini,
>
> Sorry for the delayed response. As the first part of the project,
> you can start the work on the UI/drag and drop feature, as the core 
> of your
> project is based around that. Therefore, shall we try to get a basic
> version of drag and drop UI, by the mid-term evaluation? (No need to
> connect the UI with the dl4j, for the first phase)  So this would be
> include:
>
>- A link/re-direct to go to 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-05 Thread Asantha Thilina
Hi Tharindu,

ok sure i will modify the readme content as appropriately,at the moment i
didn't add that feature, set to all default i will modify that to add a
port number also,

Thanks,
Asantha

On Mon, Jun 6, 2016 at 12:04 AM, Tharindu Edirisinghe 
wrote:

> Hi Asantha,
>
> We might not need implementing the HybridRoleManager... I'll provide you
> the exact details after trying out the functionality you have implemented
> up to now.
>
> Can you please write a basic document with the steps for creating the
> mongodb database and adding a userstore in IS pointing to the created
> mongodb database and include in the ReadMe of github repo.
>
> Also if mongodb server is running in a different port other than the
> default port, can we still connect to that ? I didn't see a place to define
> the port in the configuration.. should it be added as a connection string ?
> (didn't go through the code to find what is going wrong)
>
> Thanks,
> TharinduE
>
> On Sun, Jun 5, 2016 at 11:55 PM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> As we discussed on hangout i doing the changes in UM_USER_ATTRIBUTE
>> collection and also changing the hybrid role to master datasource but when
>> i try to add user to hybrid role i facing a small issue i can't grab the
>> datasource ,in HybridRoleManager class it need to give java.sql.DataSource
>> but in my current user store manager class i have never used a sql
>> datasource(since it nosql) so i think i need to grab the master datasource
>> of IS which is h2 database datasource, is there a way to get the primary
>> datasource?
>>
>> Thanks,
>> Asantha
>>
>> On Sat, Jun 4, 2016 at 1:59 PM, Tharindu Edirisinghe 
>> wrote:
>>
>>> The call details are as following.
>>>
>>> 1. Demonstrated how to use WSO2 admin services.
>>>
>>> 2. All the user operations in *RemoteUserStoreManagerService *[1]
>>> should be tested (using SOAP UI) for the mongodb userstore.
>>>
>>> 3. When the user profile is saved in a JDBC userstore, for each
>>> attribute of the user, it will add a new entry in *UM_USER_ATTRIBUTE 
>>> **(Refer
>>> [2] for more information) *like below.
>>>
>>>
>>> +---+--+-+---++--+
>>> | UM_ID | UM_ATTR_NAME | UM_ATTR_VALUE   | UM_PROFILE_ID |
>>> UM_USER_ID | UM_TENANT_ID |
>>>
>>> +---+--+-+---++--+
>>> | 1 | im   | | default
>>> |  1 |-1234 |
>>> | 2 | region   | Western | default
>>> |  1 |-1234 |
>>> | 3 | streetAddress| | default
>>> |  1 |-1234 |
>>> | 4 | country  | | default
>>> |  1 |-1234 |
>>> | 5 | mobile   | | default
>>> |  1 |-1234 |
>>> | 6 | sn   | NewLastname | default
>>> |  1 |-1234 |
>>> | 7 | profileConfiguration | default | default
>>> |  1 |-1234 |
>>> | 8 | dateOfBirth  | | default
>>> |  1 |-1234 |
>>> | 9 | mail | newu...@new.com | default
>>> |  1 |-1234 |
>>> |10 | organizationName | WSO2| default
>>> |  1 |-1234 |
>>> |11 | givenName| NewUser | default
>>> |  1 |-1234 |
>>> |12 | province | western | default
>>> |  1 |-1234 |
>>>
>>> +---+--+-+---++--+
>>>
>>> Performance wise this is not a good design. For mongodb userstore, I
>>> suggested to add a new document in *UM_USER_ATTRIBUTE *collection for
>>> each user. If the attribute value is empty in the profile, an empty string
>>> can be stored.
>>>
>>> {
>>>"im": "",
>>>" region": "Western",
>>>"street": "Address",
>>>"country": "",
>>>"mobile": "",
>>>"sn": "NewLastname",
>>>"profileConfiguration": "default",
>>>"dateOfBirth": "",
>>>"mail": "newu...@new.com",
>>>"organizationName": "WSO2",
>>>"givenName": "NewUser",
>>>"province": "western"
>>>
>>> }
>>>
>>> 3. Profile saving is having some issues currently and we need to further
>>> investigate what is going wrong. Until the issue is figured out, asked to
>>> manually create json documents in *UM_USER_ATTRIBUTE *collection and
>>> implement the retrieval of user attributes.
>>>
>>> *(can test getUserClaimValues method in the admin service using SOAP UI)*
>>> 4. For the analytics part of the project, suggested to extend the 
>>> *AbstractUserOperationEventListener
>>> *class [1] and override the methods for publishing events.
>>>
>>> 5. Developer documentation, Administration Guide and Testing Guide *(sample
>>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-05 Thread Tharindu Edirisinghe
Hi Asantha,

We might not need implementing the HybridRoleManager... I'll provide you
the exact details after trying out the functionality you have implemented
up to now.

Can you please write a basic document with the steps for creating the
mongodb database and adding a userstore in IS pointing to the created
mongodb database and include in the ReadMe of github repo.

Also if mongodb server is running in a different port other than the
default port, can we still connect to that ? I didn't see a place to define
the port in the configuration.. should it be added as a connection string ?
(didn't go through the code to find what is going wrong)

Thanks,
TharinduE

On Sun, Jun 5, 2016 at 11:55 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> As we discussed on hangout i doing the changes in UM_USER_ATTRIBUTE
> collection and also changing the hybrid role to master datasource but when
> i try to add user to hybrid role i facing a small issue i can't grab the
> datasource ,in HybridRoleManager class it need to give java.sql.DataSource
> but in my current user store manager class i have never used a sql
> datasource(since it nosql) so i think i need to grab the master datasource
> of IS which is h2 database datasource, is there a way to get the primary
> datasource?
>
> Thanks,
> Asantha
>
> On Sat, Jun 4, 2016 at 1:59 PM, Tharindu Edirisinghe 
> wrote:
>
>> The call details are as following.
>>
>> 1. Demonstrated how to use WSO2 admin services.
>>
>> 2. All the user operations in *RemoteUserStoreManagerService *[1] should
>> be tested (using SOAP UI) for the mongodb userstore.
>>
>> 3. When the user profile is saved in a JDBC userstore, for each attribute
>> of the user, it will add a new entry in *UM_USER_ATTRIBUTE **(Refer [2]
>> for more information) *like below.
>>
>>
>> +---+--+-+---++--+
>> | UM_ID | UM_ATTR_NAME | UM_ATTR_VALUE   | UM_PROFILE_ID |
>> UM_USER_ID | UM_TENANT_ID |
>>
>> +---+--+-+---++--+
>> | 1 | im   | | default
>> |  1 |-1234 |
>> | 2 | region   | Western | default
>> |  1 |-1234 |
>> | 3 | streetAddress| | default
>> |  1 |-1234 |
>> | 4 | country  | | default
>> |  1 |-1234 |
>> | 5 | mobile   | | default
>> |  1 |-1234 |
>> | 6 | sn   | NewLastname | default
>> |  1 |-1234 |
>> | 7 | profileConfiguration | default | default
>> |  1 |-1234 |
>> | 8 | dateOfBirth  | | default
>> |  1 |-1234 |
>> | 9 | mail | newu...@new.com | default
>> |  1 |-1234 |
>> |10 | organizationName | WSO2| default
>> |  1 |-1234 |
>> |11 | givenName| NewUser | default
>> |  1 |-1234 |
>> |12 | province | western | default
>> |  1 |-1234 |
>>
>> +---+--+-+---++--+
>>
>> Performance wise this is not a good design. For mongodb userstore, I
>> suggested to add a new document in *UM_USER_ATTRIBUTE *collection for
>> each user. If the attribute value is empty in the profile, an empty string
>> can be stored.
>>
>> {
>>"im": "",
>>" region": "Western",
>>"street": "Address",
>>"country": "",
>>"mobile": "",
>>"sn": "NewLastname",
>>"profileConfiguration": "default",
>>"dateOfBirth": "",
>>"mail": "newu...@new.com",
>>"organizationName": "WSO2",
>>"givenName": "NewUser",
>>"province": "western"
>>
>> }
>>
>> 3. Profile saving is having some issues currently and we need to further
>> investigate what is going wrong. Until the issue is figured out, asked to
>> manually create json documents in *UM_USER_ATTRIBUTE *collection and
>> implement the retrieval of user attributes.
>>
>> *(can test getUserClaimValues method in the admin service using SOAP UI)*
>> 4. For the analytics part of the project, suggested to extend the 
>> *AbstractUserOperationEventListener
>> *class [1] and override the methods for publishing events.
>>
>> 5. Developer documentation, Administration Guide and Testing Guide *(sample
>> SOAP requests and responses in RemoteUserStoreManagerService API) *should
>> be written as deliverables. For all actions related to the mongodb
>> userstore manager *(i.e add user, delete user, add role ...) *, Selenium
>> scripts should be provided *(can use firefox selenium addon and record
>> each operation and provide the scripts)*.
>>
>> So far the progress is satisfactory. Keep on the good work !
>>
>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-05 Thread Asantha Thilina
Hi Tharindu,

As we discussed on hangout i doing the changes in UM_USER_ATTRIBUTE
collection and also changing the hybrid role to master datasource but when
i try to add user to hybrid role i facing a small issue i can't grab the
datasource ,in HybridRoleManager class it need to give java.sql.DataSource
but in my current user store manager class i have never used a sql
datasource(since it nosql) so i think i need to grab the master datasource
of IS which is h2 database datasource, is there a way to get the primary
datasource?

Thanks,
Asantha

On Sat, Jun 4, 2016 at 1:59 PM, Tharindu Edirisinghe 
wrote:

> The call details are as following.
>
> 1. Demonstrated how to use WSO2 admin services.
>
> 2. All the user operations in *RemoteUserStoreManagerService *[1] should
> be tested (using SOAP UI) for the mongodb userstore.
>
> 3. When the user profile is saved in a JDBC userstore, for each attribute
> of the user, it will add a new entry in *UM_USER_ATTRIBUTE **(Refer [2]
> for more information) *like below.
>
>
> +---+--+-+---++--+
> | UM_ID | UM_ATTR_NAME | UM_ATTR_VALUE   | UM_PROFILE_ID |
> UM_USER_ID | UM_TENANT_ID |
>
> +---+--+-+---++--+
> | 1 | im   | | default
> |  1 |-1234 |
> | 2 | region   | Western | default
> |  1 |-1234 |
> | 3 | streetAddress| | default
> |  1 |-1234 |
> | 4 | country  | | default
> |  1 |-1234 |
> | 5 | mobile   | | default
> |  1 |-1234 |
> | 6 | sn   | NewLastname | default
> |  1 |-1234 |
> | 7 | profileConfiguration | default | default
> |  1 |-1234 |
> | 8 | dateOfBirth  | | default
> |  1 |-1234 |
> | 9 | mail | newu...@new.com | default
> |  1 |-1234 |
> |10 | organizationName | WSO2| default
> |  1 |-1234 |
> |11 | givenName| NewUser | default
> |  1 |-1234 |
> |12 | province | western | default
> |  1 |-1234 |
>
> +---+--+-+---++--+
>
> Performance wise this is not a good design. For mongodb userstore, I
> suggested to add a new document in *UM_USER_ATTRIBUTE *collection for
> each user. If the attribute value is empty in the profile, an empty string
> can be stored.
>
> {
>"im": "",
>" region": "Western",
>"street": "Address",
>"country": "",
>"mobile": "",
>"sn": "NewLastname",
>"profileConfiguration": "default",
>"dateOfBirth": "",
>"mail": "newu...@new.com",
>"organizationName": "WSO2",
>"givenName": "NewUser",
>"province": "western"
>
> }
>
> 3. Profile saving is having some issues currently and we need to further
> investigate what is going wrong. Until the issue is figured out, asked to
> manually create json documents in *UM_USER_ATTRIBUTE *collection and
> implement the retrieval of user attributes.
>
> *(can test getUserClaimValues method in the admin service using SOAP UI)*
> 4. For the analytics part of the project, suggested to extend the 
> *AbstractUserOperationEventListener
> *class [1] and override the methods for publishing events.
>
> 5. Developer documentation, Administration Guide and Testing Guide *(sample
> SOAP requests and responses in RemoteUserStoreManagerService API) *should
> be written as deliverables. For all actions related to the mongodb
> userstore manager *(i.e add user, delete user, add role ...) *, Selenium
> scripts should be provided *(can use firefox selenium addon and record
> each operation and provide the scripts)*.
>
> So far the progress is satisfactory. Keep on the good work !
>
> [1] https://localhost:9443/services/RemoteUserStoreManagerService?wsdl
> [2]
> http://tharindue.blogspot.com/2015/04/wso2-identity-server-data-dictionary.html
> [3]
> https://github.com/wso2/carbon-kernel/blob/v4.4.3/core/org.wso2.carbon.user.core/src/main/java/org/wso2/carbon/user/core/common/AbstractUserOperationEventListener.java
>
> Thank you,
> TharinduE
>
> On Sat, Jun 4, 2016 at 9:48 AM, Asantha Thilina 
> wrote:
>
>> Hi Tharindu,
>>
>> ok sure i will look forward for that
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Jun 3, 2016 at 2:44 PM, Tharindu Edirisinghe 
>> wrote:
>>
>>> Hi Asantha,
>>>
>>> Shall we have a google hangout tomorrow (Saturday) at 9.00 p.m ? So we
>>> can discuss about the issues you are facing and get them resolved.
>>>
>>> Regards,
>>> TharinduE
>>>
>>> On Fri, Jun 3, 2016 at 11:43 PM, 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-04 Thread Tharindu Edirisinghe
The call details are as following.

1. Demonstrated how to use WSO2 admin services.

2. All the user operations in *RemoteUserStoreManagerService *[1] should be
tested (using SOAP UI) for the mongodb userstore.

3. When the user profile is saved in a JDBC userstore, for each attribute
of the user, it will add a new entry in *UM_USER_ATTRIBUTE **(Refer [2] for
more information) *like below.

+---+--+-+---++--+
| UM_ID | UM_ATTR_NAME | UM_ATTR_VALUE   | UM_PROFILE_ID |
UM_USER_ID | UM_TENANT_ID |
+---+--+-+---++--+
| 1 | im   | | default   |
1 |-1234 |
| 2 | region   | Western | default   |
1 |-1234 |
| 3 | streetAddress| | default   |
1 |-1234 |
| 4 | country  | | default   |
1 |-1234 |
| 5 | mobile   | | default   |
1 |-1234 |
| 6 | sn   | NewLastname | default   |
1 |-1234 |
| 7 | profileConfiguration | default | default   |
1 |-1234 |
| 8 | dateOfBirth  | | default   |
1 |-1234 |
| 9 | mail | newu...@new.com | default   |
1 |-1234 |
|10 | organizationName | WSO2| default   |
1 |-1234 |
|11 | givenName| NewUser | default   |
1 |-1234 |
|12 | province | western | default   |
1 |-1234 |
+---+--+-+---++--+

Performance wise this is not a good design. For mongodb userstore, I
suggested to add a new document in *UM_USER_ATTRIBUTE *collection for each
user. If the attribute value is empty in the profile, an empty string can
be stored.

{
   "im": "",
   " region": "Western",
   "street": "Address",
   "country": "",
   "mobile": "",
   "sn": "NewLastname",
   "profileConfiguration": "default",
   "dateOfBirth": "",
   "mail": "newu...@new.com",
   "organizationName": "WSO2",
   "givenName": "NewUser",
   "province": "western"

}

3. Profile saving is having some issues currently and we need to further
investigate what is going wrong. Until the issue is figured out, asked to
manually create json documents in *UM_USER_ATTRIBUTE *collection and
implement the retrieval of user attributes.

*(can test getUserClaimValues method in the admin service using SOAP UI)*
4. For the analytics part of the project, suggested to extend the
*AbstractUserOperationEventListener
*class [1] and override the methods for publishing events.

5. Developer documentation, Administration Guide and Testing Guide *(sample
SOAP requests and responses in RemoteUserStoreManagerService API) *should
be written as deliverables. For all actions related to the mongodb
userstore manager *(i.e add user, delete user, add role ...) *, Selenium
scripts should be provided *(can use firefox selenium addon and record each
operation and provide the scripts)*.

So far the progress is satisfactory. Keep on the good work !

[1] https://localhost:9443/services/RemoteUserStoreManagerService?wsdl
[2]
http://tharindue.blogspot.com/2015/04/wso2-identity-server-data-dictionary.html
[3]
https://github.com/wso2/carbon-kernel/blob/v4.4.3/core/org.wso2.carbon.user.core/src/main/java/org/wso2/carbon/user/core/common/AbstractUserOperationEventListener.java

Thank you,
TharinduE

On Sat, Jun 4, 2016 at 9:48 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> ok sure i will look forward for that
>
> Thanks,
> Asantha
>
> On Fri, Jun 3, 2016 at 2:44 PM, Tharindu Edirisinghe 
> wrote:
>
>> Hi Asantha,
>>
>> Shall we have a google hangout tomorrow (Saturday) at 9.00 p.m ? So we
>> can discuss about the issues you are facing and get them resolved.
>>
>> Regards,
>> TharinduE
>>
>> On Fri, Jun 3, 2016 at 11:43 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> i fixed the most of the errors appeared in my user store in user
>>> management side now it's almost done in user management side now i can add
>>> new users ,roles and search roles of users and users of roles only issue i
>>> having now is i can't update a user profile of user in user store i getting
>>> a exception ,i want to get some advice from you to resolve that error and
>>> to implement a logic to commit transaction in mongodb and also another
>>> small problem is when i added a new claim where will it save in primary
>>> user store ? is there any feature to change the user store  where claims
>>> going to save. like it giving an option to select userstore in a dropdown
>>> when adding newusers and roles.
>>>
>>> all the works i have done so far in my repo[1]
>>>
>>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-03 Thread Asantha Thilina
Hi Tharindu,

ok sure i will look forward for that

Thanks,
Asantha

On Fri, Jun 3, 2016 at 2:44 PM, Tharindu Edirisinghe 
wrote:

> Hi Asantha,
>
> Shall we have a google hangout tomorrow (Saturday) at 9.00 p.m ? So we can
> discuss about the issues you are facing and get them resolved.
>
> Regards,
> TharinduE
>
> On Fri, Jun 3, 2016 at 11:43 PM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> i fixed the most of the errors appeared in my user store in user
>> management side now it's almost done in user management side now i can add
>> new users ,roles and search roles of users and users of roles only issue i
>> having now is i can't update a user profile of user in user store i getting
>> a exception ,i want to get some advice from you to resolve that error and
>> to implement a logic to commit transaction in mongodb and also another
>> small problem is when i added a new claim where will it save in primary
>> user store ? is there any feature to change the user store  where claims
>> going to save. like it giving an option to select userstore in a dropdown
>> when adding newusers and roles.
>>
>> all the works i have done so far in my repo[1]
>>
>> [1] . https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Wed, Jun 1, 2016 at 3:00 AM, Asantha Thilina > > wrote:
>>
>>>
>>> -- Forwarded message --
>>> From: Asantha Thilina 
>>> Date: Wed, Jun 1, 2016 at 2:59 AM
>>> Subject: Fwd: GSOC 2016 - Project 21 : MongoDB Userstore Development
>>> To: WSO2 Developers' List , Tharindu Edirisinghe <
>>> tharin...@wso2.com>
>>>
>>>
>>>
>>> -- Forwarded message --
>>> From: Asantha Thilina 
>>> Date: Wed, Jun 1, 2016 at 2:51 AM
>>> Subject: Re: GSOC 2016 - Project 21 : MongoDB Userstore Development
>>> To: Tharindu Edirisinghe 
>>> Cc: WSO2 Developers' List , Lakmal Rupasinghe <
>>> lakma...@sliit.lk>
>>>
>>>
>>> Hi Tharindu,
>>>
>>> I fixed the most of the errors i got now my user store working it is
>>> successfully registered and can add users and roles to user store as well
>>> still there are some issues in other functions those are query errors i
>>> still fixing those as well ,i having some issues  about database
>>> transaction point of view and i need some advice from you, in mongodb there
>>> is no option to rollback transaction if error occurred how can i manage it?
>>> can we arrange a hangout meeting today or any comfortable day for you ? i'm
>>> ok with any time
>>> all the updates up to now i pushed to my repository[1]
>>>
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Fri, May 27, 2016 at 1:56 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 sure i'll be look forward for that

 Thanks,
 Asantha

 On Thu, May 26, 2016 at 9:37 PM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Hi Asantha,
>
> Glad to hear the progress... Sure I'll review over the weekend and
> provide feedback. By next week we'll have a hangout to discuss on how to
> move forward and the difficulties you have faced.  Keep the momentum 
> going !
>
> Regards,
> TharinduE
>
> On Fri, May 27, 2016 at 12:17 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> i been able to fix the mongodb user store intitalizing error now it
>> working successfully it will be registered as a secondary user store in 
>> IS
>> and when going to add a new users and roles it will show the domain of
>> mongodb userstore still i having small issues in my json query formats 
>> for
>> mongodb i fixing those issues at the moment all the progress so far i 
>> made
>> updated to my github repository[1] and i recently updated my blog[2] as
>> well,can you review my code and give me a feedback?
>>
>> [1]https://github.com/asanthamax/mongodbuserstore
>> [2]http://asanthamax.blogspot.com/
>>
>> Thanks,
>> Asantha
>>
>> On Sun, May 22, 2016 at 3:38 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have override all the methods in AbstractUserStoreManager in my
>>> MongoDBUserStoreManager class after that when i try to add new secondary
>>> user store in management console i got following error i attached the
>>> screen shot of the error with this mail
>>> i have pushed all the progress upto now to my github repository[1]
>>> can you give me some tips to solve this issue?
>>> any suggestion would be grateful
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>> Thanks,
>>> Asantha
>>>
>>> On Thu, May 19, 2016 at 11:47 PM, Asantha Thilina <
>>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-03 Thread Tharindu Edirisinghe
Hi Asantha,

Shall we have a google hangout tomorrow (Saturday) at 9.00 p.m ? So we can
discuss about the issues you are facing and get them resolved.

Regards,
TharinduE

On Fri, Jun 3, 2016 at 11:43 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> i fixed the most of the errors appeared in my user store in user
> management side now it's almost done in user management side now i can add
> new users ,roles and search roles of users and users of roles only issue i
> having now is i can't update a user profile of user in user store i getting
> a exception ,i want to get some advice from you to resolve that error and
> to implement a logic to commit transaction in mongodb and also another
> small problem is when i added a new claim where will it save in primary
> user store ? is there any feature to change the user store  where claims
> going to save. like it giving an option to select userstore in a dropdown
> when adding newusers and roles.
>
> all the works i have done so far in my repo[1]
>
> [1] . https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Wed, Jun 1, 2016 at 3:00 AM, Asantha Thilina 
> wrote:
>
>>
>> -- Forwarded message --
>> From: Asantha Thilina 
>> Date: Wed, Jun 1, 2016 at 2:59 AM
>> Subject: Fwd: GSOC 2016 - Project 21 : MongoDB Userstore Development
>> To: WSO2 Developers' List , Tharindu Edirisinghe <
>> tharin...@wso2.com>
>>
>>
>>
>> -- Forwarded message --
>> From: Asantha Thilina 
>> Date: Wed, Jun 1, 2016 at 2:51 AM
>> Subject: Re: GSOC 2016 - Project 21 : MongoDB Userstore Development
>> To: Tharindu Edirisinghe 
>> Cc: WSO2 Developers' List , Lakmal Rupasinghe <
>> lakma...@sliit.lk>
>>
>>
>> Hi Tharindu,
>>
>> I fixed the most of the errors i got now my user store working it is
>> successfully registered and can add users and roles to user store as well
>> still there are some issues in other functions those are query errors i
>> still fixing those as well ,i having some issues  about database
>> transaction point of view and i need some advice from you, in mongodb there
>> is no option to rollback transaction if error occurred how can i manage it?
>> can we arrange a hangout meeting today or any comfortable day for you ? i'm
>> ok with any time
>> all the updates up to now i pushed to my repository[1]
>>
>> [1] https://github.com/asanthamax/mongodbuserstore
>>
>> Thanks,
>> Asantha
>>
>> On Fri, May 27, 2016 at 1:56 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sure i'll be look forward for that
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Thu, May 26, 2016 at 9:37 PM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Hi Asantha,

 Glad to hear the progress... Sure I'll review over the weekend and
 provide feedback. By next week we'll have a hangout to discuss on how to
 move forward and the difficulties you have faced.  Keep the momentum going 
 !

 Regards,
 TharinduE

 On Fri, May 27, 2016 at 12:17 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> i been able to fix the mongodb user store intitalizing error now it
> working successfully it will be registered as a secondary user store in IS
> and when going to add a new users and roles it will show the domain of
> mongodb userstore still i having small issues in my json query formats for
> mongodb i fixing those issues at the moment all the progress so far i made
> updated to my github repository[1] and i recently updated my blog[2] as
> well,can you review my code and give me a feedback?
>
> [1]https://github.com/asanthamax/mongodbuserstore
> [2]http://asanthamax.blogspot.com/
>
> Thanks,
> Asantha
>
> On Sun, May 22, 2016 at 3:38 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> I have override all the methods in AbstractUserStoreManager in my
>> MongoDBUserStoreManager class after that when i try to add new secondary
>> user store in management console i got following error i attached the
>> screen shot of the error with this mail
>> i have pushed all the progress upto now to my github repository[1]
>> can you give me some tips to solve this issue?
>> any suggestion would be grateful
>> [1] https://github.com/asanthamax/mongodbuserstore
>> Thanks,
>> Asantha
>>
>> On Thu, May 19, 2016 at 11:47 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sorry for the late reply ,as you advised i remove the scr reference
>>> and its corresponding methods from user store now it's works fine but i
>>> having another small issue if i wanted to run my mongodb user store as 
>>> as
>>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-06-03 Thread Asantha Thilina
Hi Tharindu,

i fixed the most of the errors appeared in my user store in user management
side now it's almost done in user management side now i can add new users
,roles and search roles of users and users of roles only issue i having now
is i can't update a user profile of user in user store i getting a
exception ,i want to get some advice from you to resolve that error and to
implement a logic to commit transaction in mongodb and also another small
problem is when i added a new claim where will it save in primary user
store ? is there any feature to change the user store  where claims going
to save. like it giving an option to select userstore in a dropdown when
adding newusers and roles.

all the works i have done so far in my repo[1]

[1] . https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Wed, Jun 1, 2016 at 3:00 AM, Asantha Thilina 
wrote:

>
> -- Forwarded message --
> From: Asantha Thilina 
> Date: Wed, Jun 1, 2016 at 2:59 AM
> Subject: Fwd: GSOC 2016 - Project 21 : MongoDB Userstore Development
> To: WSO2 Developers' List , Tharindu Edirisinghe <
> tharin...@wso2.com>
>
>
>
> -- Forwarded message --
> From: Asantha Thilina 
> Date: Wed, Jun 1, 2016 at 2:51 AM
> Subject: Re: GSOC 2016 - Project 21 : MongoDB Userstore Development
> To: Tharindu Edirisinghe 
> Cc: WSO2 Developers' List , Lakmal Rupasinghe <
> lakma...@sliit.lk>
>
>
> Hi Tharindu,
>
> I fixed the most of the errors i got now my user store working it is
> successfully registered and can add users and roles to user store as well
> still there are some issues in other functions those are query errors i
> still fixing those as well ,i having some issues  about database
> transaction point of view and i need some advice from you, in mongodb there
> is no option to rollback transaction if error occurred how can i manage it?
> can we arrange a hangout meeting today or any comfortable day for you ? i'm
> ok with any time
> all the updates up to now i pushed to my repository[1]
>
> [1] https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Fri, May 27, 2016 at 1:56 AM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> sure i'll be look forward for that
>>
>> Thanks,
>> Asantha
>>
>> On Thu, May 26, 2016 at 9:37 PM, Tharindu Edirisinghe > > wrote:
>>
>>> Hi Asantha,
>>>
>>> Glad to hear the progress... Sure I'll review over the weekend and
>>> provide feedback. By next week we'll have a hangout to discuss on how to
>>> move forward and the difficulties you have faced.  Keep the momentum going !
>>>
>>> Regards,
>>> TharinduE
>>>
>>> On Fri, May 27, 2016 at 12:17 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 i been able to fix the mongodb user store intitalizing error now it
 working successfully it will be registered as a secondary user store in IS
 and when going to add a new users and roles it will show the domain of
 mongodb userstore still i having small issues in my json query formats for
 mongodb i fixing those issues at the moment all the progress so far i made
 updated to my github repository[1] and i recently updated my blog[2] as
 well,can you review my code and give me a feedback?

 [1]https://github.com/asanthamax/mongodbuserstore
 [2]http://asanthamax.blogspot.com/

 Thanks,
 Asantha

 On Sun, May 22, 2016 at 3:38 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I have override all the methods in AbstractUserStoreManager in my
> MongoDBUserStoreManager class after that when i try to add new secondary
> user store in management console i got following error i attached the
> screen shot of the error with this mail
> i have pushed all the progress upto now to my github repository[1]
> can you give me some tips to solve this issue?
> any suggestion would be grateful
> [1] https://github.com/asanthamax/mongodbuserstore
> Thanks,
> Asantha
>
> On Thu, May 19, 2016 at 11:47 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> sorry for the late reply ,as you advised i remove the scr reference
>> and its corresponding methods from user store now it's works fine but i
>> having another small issue if i wanted to run my mongodb user store as as
>> my primary user store how would i do that?
>> i added my user store configurations to user-mgt.xml file and
>> comented the ldap userstore properties and i added MongoDBUserStore to
>> tenant-mgt.xml as well but then i get error as datasource cannot be 
>> casted
>> to MongoDB db source while deploying thats mean its still referring to
>> Default Activator inside carbon core module how 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-06-03 Thread Lakini Senanayaka
Hi,

Thank you very much Chathurike.It will be really helpful for my NN Builder.

Thank you.

On Fri, Jun 3, 2016 at 10:50 AM, CD Athuraliya  wrote:

> Hi Lakini,
>
> You can gain some insight for your NN builder from TensorFlow Playground
> [1]. It is also open source under Apache 2.0 licence [2].
>
> [1] http://playground.tensorflow.org
> [2] https://github.com/tensorflow/playground
>
> Regards,
> CD
>
> On Thu, Jun 2, 2016 at 8:00 AM, Upul Bandara  wrote:
>
>> Yes at the moment this looks OK.
>>
>> Please put some effort to create a basic version of the NN builder and
>> let's have a quick demo.
>>
>> Let me know if you have further questions or clarifications.
>>
>> Thanks,
>> Upul
>>
>> On Wed, Jun 1, 2016 at 11:29 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you very much Upul. I will submit a demo soon.
>>>
>>> I have drawn a sketch of NN builder front end[1]. Basically it will be
>>> like this UI[2].(The content will be changed.)
>>>
>>> [1]Sketch of NN Builder
>>> 
>>> [2]https://www.draw.io/  
>>>
>>> In [1],under "layers" users can select the type of the
>>> layer-Input,Hidden or Output layer.
>>> Under "node" and "Connectors"-users can drag and drop nodes and
>>> connectors to the working area and they can build their NN as they wish.
>>>
>>> In the right hand side,there is a setting area.From that user can set
>>> Optimization algorithms,iterations,learning rates,seed etc. of the neural
>>> network.
>>>
>>> Could you please give me comments and your thoughts regrading this?
>>>
>>> Thank you.
>>>
>>>
>>>
>>> On Wed, Jun 1, 2016 at 2:19 PM, Upul Bandara  wrote:
>>>
 Hi,

 Good progress.

 The key parts of the project are designing the front-end of NN builder,
 communicating between the front-end and the Deeplearning4J back-end.
 So at this stage of the project, it is better to put your effort on
 above the components. Later, we can integrate what you have built with WSO2
 Machine Learning server.

 Once you have completed a basic NN builder (ability to build a simple
 feedforward  is enough) we would like to have a quick demo.

 Let me know if you have further questions or clarifications.

 Thanks,
 Upul

 On Wed, Jun 1, 2016 at 10:42 AM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I'm sorry for the late response.Thank you very much for the last
> email.I have gone through JQueryUI and I have implemented some samples
> using JQueryUI.I have gone through the  WSO2 machine learner and I have
> identified the place to insert this jaggery page(replace the
> hyper-parameter page in the ML UI).
> Currently I'm designing the sketch of the Deep Neural Network
> Builder-the front end.
> I'll send my sketch before tonight.Based on your comments I can start
> implementations.
>
> Thank you.
>
>
> On Wed, Jun 1, 2016 at 9:29 AM, Supun Sethunga 
> wrote:
>
>> Hi Lakini,
>>
>> Any update on the progress?
>>
>> Regards,
>> Supun
>>
>> On Fri, May 27, 2016 at 5:34 PM, Supun Sethunga 
>> wrote:
>>
>>> Hi Lakini,
>>>
>>> Sorry for the delayed response. As the first part of the project,
>>> you can start the work on the UI/drag and drop feature, as the core of 
>>> your
>>> project is based around that. Therefore, shall we try to get a basic
>>> version of drag and drop UI, by the mid-term evaluation? (No need to
>>> connect the UI with the dl4j, for the first phase)  So this would be
>>> include:
>>>
>>>- A link/re-direct to go to Visual builder, upon selecting the
>>>Neural Netowrks (as the algorithm)
>>>- The drawing/dropping area and a panel to pick the objects to
>>>be dragged (objects as in, nodes, layers, links, etc)
>>>
>>> This drag and drop page should replace the hyper-parameter page in
>>> the ML UI. More precisely, In the Machine Learner wizard, when a user 
>>> picks
>>> the algorithm name as Neural Network, and proceed, this drag and drop 
>>> page
>>> should be prompted instead of the hyper-parameters page. You can create 
>>> the
>>> overall page as a jaggery page (.jag). It would be easier for you to 
>>> get a
>>> copy of an existing page, and modifying the content. That will preserve 
>>> the
>>> existing styles, session handling etc.
>>>
>>> Please feel free to raise any question you come across during
>>> implementing.
>>>
>>> Regards,
>>> Supun
>>>
>>> On Tue, May 24, 2016 at 8:09 PM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-06-02 Thread CD Athuraliya
Hi Lakini,

You can gain some insight for your NN builder from TensorFlow Playground
[1]. It is also open source under Apache 2.0 licence [2].

[1] http://playground.tensorflow.org
[2] https://github.com/tensorflow/playground

Regards,
CD

On Thu, Jun 2, 2016 at 8:00 AM, Upul Bandara  wrote:

> Yes at the moment this looks OK.
>
> Please put some effort to create a basic version of the NN builder and
> let's have a quick demo.
>
> Let me know if you have further questions or clarifications.
>
> Thanks,
> Upul
>
> On Wed, Jun 1, 2016 at 11:29 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you very much Upul. I will submit a demo soon.
>>
>> I have drawn a sketch of NN builder front end[1]. Basically it will be
>> like this UI[2].(The content will be changed.)
>>
>> [1]Sketch of NN Builder
>> 
>> [2]https://www.draw.io/  
>>
>> In [1],under "layers" users can select the type of the layer-Input,Hidden
>> or Output layer.
>> Under "node" and "Connectors"-users can drag and drop nodes and
>> connectors to the working area and they can build their NN as they wish.
>>
>> In the right hand side,there is a setting area.From that user can set
>> Optimization algorithms,iterations,learning rates,seed etc. of the neural
>> network.
>>
>> Could you please give me comments and your thoughts regrading this?
>>
>> Thank you.
>>
>>
>>
>> On Wed, Jun 1, 2016 at 2:19 PM, Upul Bandara  wrote:
>>
>>> Hi,
>>>
>>> Good progress.
>>>
>>> The key parts of the project are designing the front-end of NN builder,
>>> communicating between the front-end and the Deeplearning4J back-end.
>>> So at this stage of the project, it is better to put your effort on
>>> above the components. Later, we can integrate what you have built with WSO2
>>> Machine Learning server.
>>>
>>> Once you have completed a basic NN builder (ability to build a simple
>>> feedforward  is enough) we would like to have a quick demo.
>>>
>>> Let me know if you have further questions or clarifications.
>>>
>>> Thanks,
>>> Upul
>>>
>>> On Wed, Jun 1, 2016 at 10:42 AM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

 I'm sorry for the late response.Thank you very much for the last
 email.I have gone through JQueryUI and I have implemented some samples
 using JQueryUI.I have gone through the  WSO2 machine learner and I have
 identified the place to insert this jaggery page(replace the
 hyper-parameter page in the ML UI).
 Currently I'm designing the sketch of the Deep Neural Network
 Builder-the front end.
 I'll send my sketch before tonight.Based on your comments I can start
 implementations.

 Thank you.


 On Wed, Jun 1, 2016 at 9:29 AM, Supun Sethunga  wrote:

> Hi Lakini,
>
> Any update on the progress?
>
> Regards,
> Supun
>
> On Fri, May 27, 2016 at 5:34 PM, Supun Sethunga 
> wrote:
>
>> Hi Lakini,
>>
>> Sorry for the delayed response. As the first part of the project, you
>> can start the work on the UI/drag and drop feature, as the core of your
>> project is based around that. Therefore, shall we try to get a basic
>> version of drag and drop UI, by the mid-term evaluation? (No need to
>> connect the UI with the dl4j, for the first phase)  So this would be
>> include:
>>
>>- A link/re-direct to go to Visual builder, upon selecting the
>>Neural Netowrks (as the algorithm)
>>- The drawing/dropping area and a panel to pick the objects to be
>>dragged (objects as in, nodes, layers, links, etc)
>>
>> This drag and drop page should replace the hyper-parameter page in
>> the ML UI. More precisely, In the Machine Learner wizard, when a user 
>> picks
>> the algorithm name as Neural Network, and proceed, this drag and drop 
>> page
>> should be prompted instead of the hyper-parameters page. You can create 
>> the
>> overall page as a jaggery page (.jag). It would be easier for you to get 
>> a
>> copy of an existing page, and modifying the content. That will preserve 
>> the
>> existing styles, session handling etc.
>>
>> Please feel free to raise any question you come across during
>> implementing.
>>
>> Regards,
>> Supun
>>
>> On Tue, May 24, 2016 at 8:09 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you very much for the suggestions.I will be using JQueryUI.
>>>
>>> As my coding period started yesterday according to the GSoC Schedule
>>>  I would like to know the workload that should be completed
>>> before the midterm evaluation. Please advise me accordingly.
>>>
>>> Thank you.
>>>

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-06-01 Thread Upul Bandara
Yes at the moment this looks OK.

Please put some effort to create a basic version of the NN builder and
let's have a quick demo.

Let me know if you have further questions or clarifications.

Thanks,
Upul

On Wed, Jun 1, 2016 at 11:29 PM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you very much Upul. I will submit a demo soon.
>
> I have drawn a sketch of NN builder front end[1]. Basically it will be
> like this UI[2].(The content will be changed.)
>
> [1]Sketch of NN Builder
> 
> [2]https://www.draw.io/  
>
> In [1],under "layers" users can select the type of the layer-Input,Hidden
> or Output layer.
> Under "node" and "Connectors"-users can drag and drop nodes and connectors
> to the working area and they can build their NN as they wish.
>
> In the right hand side,there is a setting area.From that user can set
> Optimization algorithms,iterations,learning rates,seed etc. of the neural
> network.
>
> Could you please give me comments and your thoughts regrading this?
>
> Thank you.
>
>
>
> On Wed, Jun 1, 2016 at 2:19 PM, Upul Bandara  wrote:
>
>> Hi,
>>
>> Good progress.
>>
>> The key parts of the project are designing the front-end of NN builder,
>> communicating between the front-end and the Deeplearning4J back-end.
>> So at this stage of the project, it is better to put your effort on above
>> the components. Later, we can integrate what you have built with WSO2
>> Machine Learning server.
>>
>> Once you have completed a basic NN builder (ability to build a simple
>> feedforward  is enough) we would like to have a quick demo.
>>
>> Let me know if you have further questions or clarifications.
>>
>> Thanks,
>> Upul
>>
>> On Wed, Jun 1, 2016 at 10:42 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm sorry for the late response.Thank you very much for the last email.I
>>> have gone through JQueryUI and I have implemented some samples using
>>> JQueryUI.I have gone through the  WSO2 machine learner and I have
>>> identified the place to insert this jaggery page(replace the
>>> hyper-parameter page in the ML UI).
>>> Currently I'm designing the sketch of the Deep Neural Network
>>> Builder-the front end.
>>> I'll send my sketch before tonight.Based on your comments I can start
>>> implementations.
>>>
>>> Thank you.
>>>
>>>
>>> On Wed, Jun 1, 2016 at 9:29 AM, Supun Sethunga  wrote:
>>>
 Hi Lakini,

 Any update on the progress?

 Regards,
 Supun

 On Fri, May 27, 2016 at 5:34 PM, Supun Sethunga 
 wrote:

> Hi Lakini,
>
> Sorry for the delayed response. As the first part of the project, you
> can start the work on the UI/drag and drop feature, as the core of your
> project is based around that. Therefore, shall we try to get a basic
> version of drag and drop UI, by the mid-term evaluation? (No need to
> connect the UI with the dl4j, for the first phase)  So this would be
> include:
>
>- A link/re-direct to go to Visual builder, upon selecting the
>Neural Netowrks (as the algorithm)
>- The drawing/dropping area and a panel to pick the objects to be
>dragged (objects as in, nodes, layers, links, etc)
>
> This drag and drop page should replace the hyper-parameter page in the
> ML UI. More precisely, In the Machine Learner wizard, when a user picks 
> the
> algorithm name as Neural Network, and proceed, this drag and drop page
> should be prompted instead of the hyper-parameters page. You can create 
> the
> overall page as a jaggery page (.jag). It would be easier for you to get a
> copy of an existing page, and modifying the content. That will preserve 
> the
> existing styles, session handling etc.
>
> Please feel free to raise any question you come across during
> implementing.
>
> Regards,
> Supun
>
> On Tue, May 24, 2016 at 8:09 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you very much for the suggestions.I will be using JQueryUI.
>>
>> As my coding period started yesterday according to the GSoC Schedule
>>  I would like to know the workload that should be completed
>> before the midterm evaluation. Please advise me accordingly.
>>
>> Thank you.
>>
>>
>> On Tue, May 24, 2016 at 10:34 AM, Supun Sethunga 
>> wrote:
>>
>>> Hi Lakini,
>>>
>>> Yes you can use any of them, with open source licence. But I would
>>> prefer JQueryUI, as its a well known library, and is already been used 
>>> by
>>> some of the wso2 products.
>>>
>>> Regards,
>>> Supun
>>>
>>> On Tue, May 24, 2016 at 9:29 AM, Lakini Senanayaka <
>>> 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-06-01 Thread Lakini Senanayaka
Hi,

Thank you very much Upul. I will submit a demo soon.

I have drawn a sketch of NN builder front end[1]. Basically it will be like
this UI[2].(The content will be changed.)

[1]Sketch of NN Builder

[2]https://www.draw.io/  

In [1],under "layers" users can select the type of the layer-Input,Hidden
or Output layer.
Under "node" and "Connectors"-users can drag and drop nodes and connectors
to the working area and they can build their NN as they wish.

In the right hand side,there is a setting area.From that user can set
Optimization algorithms,iterations,learning rates,seed etc. of the neural
network.

Could you please give me comments and your thoughts regrading this?

Thank you.



On Wed, Jun 1, 2016 at 2:19 PM, Upul Bandara  wrote:

> Hi,
>
> Good progress.
>
> The key parts of the project are designing the front-end of NN builder,
> communicating between the front-end and the Deeplearning4J back-end.
> So at this stage of the project, it is better to put your effort on above
> the components. Later, we can integrate what you have built with WSO2
> Machine Learning server.
>
> Once you have completed a basic NN builder (ability to build a simple
> feedforward  is enough) we would like to have a quick demo.
>
> Let me know if you have further questions or clarifications.
>
> Thanks,
> Upul
>
> On Wed, Jun 1, 2016 at 10:42 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> I'm sorry for the late response.Thank you very much for the last email.I
>> have gone through JQueryUI and I have implemented some samples using
>> JQueryUI.I have gone through the  WSO2 machine learner and I have
>> identified the place to insert this jaggery page(replace the
>> hyper-parameter page in the ML UI).
>> Currently I'm designing the sketch of the Deep Neural Network Builder-the
>> front end.
>> I'll send my sketch before tonight.Based on your comments I can start
>> implementations.
>>
>> Thank you.
>>
>>
>> On Wed, Jun 1, 2016 at 9:29 AM, Supun Sethunga  wrote:
>>
>>> Hi Lakini,
>>>
>>> Any update on the progress?
>>>
>>> Regards,
>>> Supun
>>>
>>> On Fri, May 27, 2016 at 5:34 PM, Supun Sethunga  wrote:
>>>
 Hi Lakini,

 Sorry for the delayed response. As the first part of the project, you
 can start the work on the UI/drag and drop feature, as the core of your
 project is based around that. Therefore, shall we try to get a basic
 version of drag and drop UI, by the mid-term evaluation? (No need to
 connect the UI with the dl4j, for the first phase)  So this would be
 include:

- A link/re-direct to go to Visual builder, upon selecting the
Neural Netowrks (as the algorithm)
- The drawing/dropping area and a panel to pick the objects to be
dragged (objects as in, nodes, layers, links, etc)

 This drag and drop page should replace the hyper-parameter page in the
 ML UI. More precisely, In the Machine Learner wizard, when a user picks the
 algorithm name as Neural Network, and proceed, this drag and drop page
 should be prompted instead of the hyper-parameters page. You can create the
 overall page as a jaggery page (.jag). It would be easier for you to get a
 copy of an existing page, and modifying the content. That will preserve the
 existing styles, session handling etc.

 Please feel free to raise any question you come across during
 implementing.

 Regards,
 Supun

 On Tue, May 24, 2016 at 8:09 PM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you very much for the suggestions.I will be using JQueryUI.
>
> As my coding period started yesterday according to the GSoC Schedule
>  I would like to know the workload that should be completed
> before the midterm evaluation. Please advise me accordingly.
>
> Thank you.
>
>
> On Tue, May 24, 2016 at 10:34 AM, Supun Sethunga 
> wrote:
>
>> Hi Lakini,
>>
>> Yes you can use any of them, with open source licence. But I would
>> prefer JQueryUI, as its a well known library, and is already been used by
>> some of the wso2 products.
>>
>> Regards,
>> Supun
>>
>> On Tue, May 24, 2016 at 9:29 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I have found some libraries to build drag and drop UI for our front
>>> end .They are JQury UI[1],Dragula[2],Draggablily[3].
>>> I hope I can do the developments using these libraries.
>>>
>>> [1]jqueryui 
>>> [2]dragula 
>>> [3]draggabilly 
>>>
>>> Could you please tell me if you have any other 

Re: [Dev] GSOC 2016: Proposal 7

2016-06-01 Thread Dinanjana Gunaratne
gt;>>>>>> to analyse the incident. We need to see what causes 
>>>>>>>>>>>>>>>>>>>>>>>>> the increase of heap.
>>>>>>>>>>>>>>>>>>>>>>>>> That may be due to increase of load (requests) or may 
>>>>>>>>>>>>>>>>>>>>>>>>> be due to a bug. So
>>>>>>>>>>>>>>>>>>>>>>>>> we need to extract information like TPS of the 
>>>>>>>>>>>>>>>>>>>>>>>>> server, thread dumps to do
>>>>>>>>>>>>>>>>>>>>>>>>> the further analysis.
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Feb 26, 2016 at 1:38 PM, Nadeeshaan
>>>>>>>>>>>>>>>>>>>>>>>>> Gunasinghe <nadeesh...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Dinanjana,
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> First let's try to build WSO2 ESB from source and
>>>>>>>>>>>>>>>>>>>>>>>>>> then dig in deep to the source. In order to do so 
>>>>>>>>>>>>>>>>>>>>>>>>>> you will need build the
>>>>>>>>>>>>>>>>>>>>>>>>>> following repositories in the order.
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> [1] https://github.com/wso2/wso2-synapse
>>>>>>>>>>>>>>>>>>>>>>>>>> [2] https://github.com/wso2/carbon-mediation
>>>>>>>>>>>>>>>>>>>>>>>>>> [3] https://github.com/wso2/product-esb
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> *Nadeeshaan Gunasinghe*
>>>>>>>>>>>>>>>>>>>>>>>>>> Software Engineer, WSO2 Inc. http://wso2.com
>>>>>>>>>>>>>>>>>>>>>>>>>> +94770596754 | nadeesh...@wso2.com | Skype:
>>>>>>>>>>>>>>>>>>>>>>>>>> nadeeshaan.gunasinghe
>>>>>>>>>>>>>>>>>>>>>>>>>> <#m_-4474129107123403989_m_329900874405857652_m_-1899828863246582844_m_8781437165098998838_m_1906407074206587743_m_-5727450666815379067_m_3100536272952282018_m_-7906738341674903768_m_-488055444625272468_m_-8776032907468064948_m_-7768434574235180537_m_-7235778947164465931_m_7232211748715967048_m_-3757373977837873170_m_-8283982100572052979_m_1362338246273110367_m_-1442751731575898940_m_6485817575745999246_m_265559619745955743_3779151517627746345_-555366748_-88362740_816856320_1348862

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-06-01 Thread Upul Bandara
Hi,

Good progress.

The key parts of the project are designing the front-end of NN builder,
communicating between the front-end and the Deeplearning4J back-end.
So at this stage of the project, it is better to put your effort on above
the components. Later, we can integrate what you have built with WSO2
Machine Learning server.

Once you have completed a basic NN builder (ability to build a simple
feedforward  is enough) we would like to have a quick demo.

Let me know if you have further questions or clarifications.

Thanks,
Upul

On Wed, Jun 1, 2016 at 10:42 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I'm sorry for the late response.Thank you very much for the last email.I
> have gone through JQueryUI and I have implemented some samples using
> JQueryUI.I have gone through the  WSO2 machine learner and I have
> identified the place to insert this jaggery page(replace the
> hyper-parameter page in the ML UI).
> Currently I'm designing the sketch of the Deep Neural Network Builder-the
> front end.
> I'll send my sketch before tonight.Based on your comments I can start
> implementations.
>
> Thank you.
>
>
> On Wed, Jun 1, 2016 at 9:29 AM, Supun Sethunga  wrote:
>
>> Hi Lakini,
>>
>> Any update on the progress?
>>
>> Regards,
>> Supun
>>
>> On Fri, May 27, 2016 at 5:34 PM, Supun Sethunga  wrote:
>>
>>> Hi Lakini,
>>>
>>> Sorry for the delayed response. As the first part of the project, you
>>> can start the work on the UI/drag and drop feature, as the core of your
>>> project is based around that. Therefore, shall we try to get a basic
>>> version of drag and drop UI, by the mid-term evaluation? (No need to
>>> connect the UI with the dl4j, for the first phase)  So this would be
>>> include:
>>>
>>>- A link/re-direct to go to Visual builder, upon selecting the
>>>Neural Netowrks (as the algorithm)
>>>- The drawing/dropping area and a panel to pick the objects to be
>>>dragged (objects as in, nodes, layers, links, etc)
>>>
>>> This drag and drop page should replace the hyper-parameter page in the
>>> ML UI. More precisely, In the Machine Learner wizard, when a user picks the
>>> algorithm name as Neural Network, and proceed, this drag and drop page
>>> should be prompted instead of the hyper-parameters page. You can create the
>>> overall page as a jaggery page (.jag). It would be easier for you to get a
>>> copy of an existing page, and modifying the content. That will preserve the
>>> existing styles, session handling etc.
>>>
>>> Please feel free to raise any question you come across during
>>> implementing.
>>>
>>> Regards,
>>> Supun
>>>
>>> On Tue, May 24, 2016 at 8:09 PM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

 Thank you very much for the suggestions.I will be using JQueryUI.

 As my coding period started yesterday according to the GSoC Schedule  I
 would like to know the workload that should be completed
 before the midterm evaluation. Please advise me accordingly.

 Thank you.


 On Tue, May 24, 2016 at 10:34 AM, Supun Sethunga 
 wrote:

> Hi Lakini,
>
> Yes you can use any of them, with open source licence. But I would
> prefer JQueryUI, as its a well known library, and is already been used by
> some of the wso2 products.
>
> Regards,
> Supun
>
> On Tue, May 24, 2016 at 9:29 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> I have found some libraries to build drag and drop UI for our front
>> end .They are JQury UI[1],Dragula[2],Draggablily[3].
>> I hope I can do the developments using these libraries.
>>
>> [1]jqueryui 
>> [2]dragula 
>> [3]draggabilly 
>>
>> Could you please tell me if you have any other suggestions?
>>
>> On Sat, May 21, 2016 at 11:05 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi ,
>>>
>>> This is my weekly progress update of my project.
>>>
>>> I have solved all the problems I have mentioned  in the last email.I
>>> could find a class BaseDatasetIterator which is in DL4J where we can 
>>> find
>>> inbuilt iterators for CurvesDataSetIterator, IrisDataSetIterator,
>>> MnistDataSetIterator, MovingWindowBaseDataSetIterator,
>>> RawMnistDataSetIterator .There is no iterator for CIFAR dataset yet.
>>>
>>> I have gone through the whole documentation except Deeplearning4j on
>>> Spark.The latest documentation is very understandable than the earlier
>>> one.I have studied neural networks-  Restricted Boltzmann Machines,
>>> Convolutional Nets (ConvNets),
>>> Long Short-Term Memory Units (LSTMs),
>>> Denoising Autoencoders,
>>>  

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-31 Thread Lakini Senanayaka
Hi,

I'm sorry for the late response.Thank you very much for the last email.I
have gone through JQueryUI and I have implemented some samples using
JQueryUI.I have gone through the  WSO2 machine learner and I have
identified the place to insert this jaggery page(replace the
hyper-parameter page in the ML UI).
Currently I'm designing the sketch of the Deep Neural Network Builder-the
front end.
I'll send my sketch before tonight.Based on your comments I can start
implementations.

Thank you.


On Wed, Jun 1, 2016 at 9:29 AM, Supun Sethunga  wrote:

> Hi Lakini,
>
> Any update on the progress?
>
> Regards,
> Supun
>
> On Fri, May 27, 2016 at 5:34 PM, Supun Sethunga  wrote:
>
>> Hi Lakini,
>>
>> Sorry for the delayed response. As the first part of the project, you can
>> start the work on the UI/drag and drop feature, as the core of your project
>> is based around that. Therefore, shall we try to get a basic version of
>> drag and drop UI, by the mid-term evaluation? (No need to connect the UI
>> with the dl4j, for the first phase)  So this would be include:
>>
>>- A link/re-direct to go to Visual builder, upon selecting the Neural
>>Netowrks (as the algorithm)
>>- The drawing/dropping area and a panel to pick the objects to be
>>dragged (objects as in, nodes, layers, links, etc)
>>
>> This drag and drop page should replace the hyper-parameter page in the ML
>> UI. More precisely, In the Machine Learner wizard, when a user picks the
>> algorithm name as Neural Network, and proceed, this drag and drop page
>> should be prompted instead of the hyper-parameters page. You can create the
>> overall page as a jaggery page (.jag). It would be easier for you to get a
>> copy of an existing page, and modifying the content. That will preserve the
>> existing styles, session handling etc.
>>
>> Please feel free to raise any question you come across during
>> implementing.
>>
>> Regards,
>> Supun
>>
>> On Tue, May 24, 2016 at 8:09 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you very much for the suggestions.I will be using JQueryUI.
>>>
>>> As my coding period started yesterday according to the GSoC Schedule  I
>>> would like to know the workload that should be completed
>>> before the midterm evaluation. Please advise me accordingly.
>>>
>>> Thank you.
>>>
>>>
>>> On Tue, May 24, 2016 at 10:34 AM, Supun Sethunga 
>>> wrote:
>>>
 Hi Lakini,

 Yes you can use any of them, with open source licence. But I would
 prefer JQueryUI, as its a well known library, and is already been used by
 some of the wso2 products.

 Regards,
 Supun

 On Tue, May 24, 2016 at 9:29 AM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I have found some libraries to build drag and drop UI for our front
> end .They are JQury UI[1],Dragula[2],Draggablily[3].
> I hope I can do the developments using these libraries.
>
> [1]jqueryui 
> [2]dragula 
> [3]draggabilly 
>
> Could you please tell me if you have any other suggestions?
>
> On Sat, May 21, 2016 at 11:05 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi ,
>>
>> This is my weekly progress update of my project.
>>
>> I have solved all the problems I have mentioned  in the last email.I
>> could find a class BaseDatasetIterator which is in DL4J where we can find
>> inbuilt iterators for CurvesDataSetIterator, IrisDataSetIterator,
>> MnistDataSetIterator, MovingWindowBaseDataSetIterator,
>> RawMnistDataSetIterator .There is no iterator for CIFAR dataset yet.
>>
>> I have gone through the whole documentation except Deeplearning4j on
>> Spark.The latest documentation is very understandable than the earlier
>> one.I have studied neural networks-  Restricted Boltzmann Machines,
>> Convolutional Nets (ConvNets),
>> Long Short-Term Memory Units (LSTMs),
>> Denoising Autoencoders,
>> Recurrent Nets and LSTMs,
>> Multilayer Neural Nets,
>> Deep-Belief Network,
>> Deep AutoEncoder,
>> Stacked Denoising Autoencoders
>>
>> I have run the example codes[1] and I have understood the
>> implementations.I have rerun the codes with modifying different parameter
>> values like number and size of the hidden layers,  learning rate, 
>> momentum,
>> weight distribution and various types of regularization and checked the
>> performance.
>>
>> I have implemented a convolution net[3] and trained it using LFW
>> dataset[2] and a Recurrent net[4].Still I have a problem in vectorizing
>> CIFRA-10 data set.
>>
>> 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-31 Thread Supun Sethunga
Hi Lakini,

Any update on the progress?

Regards,
Supun

On Fri, May 27, 2016 at 5:34 PM, Supun Sethunga  wrote:

> Hi Lakini,
>
> Sorry for the delayed response. As the first part of the project, you can
> start the work on the UI/drag and drop feature, as the core of your project
> is based around that. Therefore, shall we try to get a basic version of
> drag and drop UI, by the mid-term evaluation? (No need to connect the UI
> with the dl4j, for the first phase)  So this would be include:
>
>- A link/re-direct to go to Visual builder, upon selecting the Neural
>Netowrks (as the algorithm)
>- The drawing/dropping area and a panel to pick the objects to be
>dragged (objects as in, nodes, layers, links, etc)
>
> This drag and drop page should replace the hyper-parameter page in the ML
> UI. More precisely, In the Machine Learner wizard, when a user picks the
> algorithm name as Neural Network, and proceed, this drag and drop page
> should be prompted instead of the hyper-parameters page. You can create the
> overall page as a jaggery page (.jag). It would be easier for you to get a
> copy of an existing page, and modifying the content. That will preserve the
> existing styles, session handling etc.
>
> Please feel free to raise any question you come across during implementing.
>
> Regards,
> Supun
>
> On Tue, May 24, 2016 at 8:09 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you very much for the suggestions.I will be using JQueryUI.
>>
>> As my coding period started yesterday according to the GSoC Schedule  I
>> would like to know the workload that should be completed
>> before the midterm evaluation. Please advise me accordingly.
>>
>> Thank you.
>>
>>
>> On Tue, May 24, 2016 at 10:34 AM, Supun Sethunga  wrote:
>>
>>> Hi Lakini,
>>>
>>> Yes you can use any of them, with open source licence. But I would
>>> prefer JQueryUI, as its a well known library, and is already been used by
>>> some of the wso2 products.
>>>
>>> Regards,
>>> Supun
>>>
>>> On Tue, May 24, 2016 at 9:29 AM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi,

 I have found some libraries to build drag and drop UI for our front end
 .They are JQury UI[1],Dragula[2],Draggablily[3].
 I hope I can do the developments using these libraries.

 [1]jqueryui 
 [2]dragula 
 [3]draggabilly 

 Could you please tell me if you have any other suggestions?

 On Sat, May 21, 2016 at 11:05 PM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi ,
>
> This is my weekly progress update of my project.
>
> I have solved all the problems I have mentioned  in the last email.I
> could find a class BaseDatasetIterator which is in DL4J where we can find
> inbuilt iterators for CurvesDataSetIterator, IrisDataSetIterator,
> MnistDataSetIterator, MovingWindowBaseDataSetIterator,
> RawMnistDataSetIterator .There is no iterator for CIFAR dataset yet.
>
> I have gone through the whole documentation except Deeplearning4j on
> Spark.The latest documentation is very understandable than the earlier
> one.I have studied neural networks-  Restricted Boltzmann Machines,
> Convolutional Nets (ConvNets),
> Long Short-Term Memory Units (LSTMs),
> Denoising Autoencoders,
> Recurrent Nets and LSTMs,
> Multilayer Neural Nets,
> Deep-Belief Network,
> Deep AutoEncoder,
> Stacked Denoising Autoencoders
>
> I have run the example codes[1] and I have understood the
> implementations.I have rerun the codes with modifying different parameter
> values like number and size of the hidden layers,  learning rate, 
> momentum,
> weight distribution and various types of regularization and checked the
> performance.
>
> I have implemented a convolution net[3] and trained it using LFW
> dataset[2] and a Recurrent net[4].Still I have a problem in vectorizing
> CIFRA-10 data set.
>
> Currently  I am researching about  libraries to build drag & drop UI
> for front end.
>
> [1]dl4j-0.4-examples
> 
> [2]LFW Face Dataset 
> [3]ConvolutionNetLFW
> 
> [4]RecurrentNetworkExample
> 
>
>
> Could you please guide me to do the next step of my project .
>
> Thank you.

Re: [Dev] GSOC 2016: Proposal 7

2016-05-30 Thread Viraj Senevirathne
gt;>>>>>>>>>>>>>>>>>>> For an example, when the server goes OOM, it will
>>>>>>>>>>>>>>>>>>>>>>> automatically generate the heap dump. However heap dump 
>>>>>>>>>>>>>>>>>>>>>>> is not sufficient
>>>>>>>>>>>>>>>>>>>>>>> to analyse the incident. We need to see what causes the 
>>>>>>>>>>>>>>>>>>>>>>> increase of heap.
>>>>>>>>>>>>>>>>>>>>>>> That may be due to increase of load (requests) or may 
>>>>>>>>>>>>>>>>>>>>>>> be due to a bug. So
>>>>>>>>>>>>>>>>>>>>>>> we need to extract information like TPS of the server, 
>>>>>>>>>>>>>>>>>>>>>>> thread dumps to do
>>>>>>>>>>>>>>>>>>>>>>> the further analysis.
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> On Fri, Feb 26, 2016 at 1:38 PM, Nadeeshaan
>>>>>>>>>>>>>>>>>>>>>>> Gunasinghe <nadeesh...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> Hi Dinanjana,
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> First let's try to build WSO2 ESB from source and
>>>>>>>>>>>>>>>>>>>>>>>> then dig in deep to the source. In order to do so you 
>>>>>>>>>>>>>>>>>>>>>>>> will need build the
>>>>>>>>>>>>>>>>>>>>>>>> following repositories in the order.
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> [1] https://github.com/wso2/wso2-synapse
>>>>>>>>>>>>>>>>>>>>>>>> [2] https://github.com/wso2/carbon-mediation
>>>>>>>>>>>>>>>>>>>>>>>> [3] https://github.com/wso2/product-esb
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> *Nadeeshaan Gunasinghe*
>>>>>>>>>>>>>>>>>>>>>>>> Software Engineer, WSO2 Inc. http://wso2.com
>>>>>>>>>>>>>>>>>>>>>>>> +94770596754 | nadeesh...@wso2.com | Skype:
>>>>>>>>>>>>>>>>>>>>>>>> nadeeshaan.gunasinghe
>>>>>>>>>>>>>>>>>>>>>>>> <#m_-1899828863246582844_m_8781437165098998838_m_1906407074206587743_m_-5727450666815379067_m_3100536272952282018_m_-7906738341674903768_m_-488055444625272468_m_-8776032907468064948_m_-7768434574235180537_m_-7235778947164465931_m_7232211748715967048_m_-3757373977837873170_m_-8283982100572052979_m_1362338246273110367_m_-14427517

Re: [Dev] GSOC 2016: Proposal 7

2016-05-28 Thread Dinanjana Gunaratne
gt;>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> On Fri, Feb 26, 2016 at 1:38 PM, Nadeeshaan
>>>>>>>>>>>>>>>>>>>>>> Gunasinghe <nadeesh...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Hi Dinanjana,
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> First let's try to build WSO2 ESB from source and
>>>>>>>>>>>>>>>>>>>>>>> then dig in deep to the source. In order to do so you 
>>>>>>>>>>>>>>>>>>>>>>> will need build the
>>>>>>>>>>>>>>>>>>>>>>> following repositories in the order.
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> [1] https://github.com/wso2/wso2-synapse
>>>>>>>>>>>>>>>>>>>>>>> [2] https://github.com/wso2/carbon-mediation
>>>>>>>>>>>>>>>>>>>>>>> [3] https://github.com/wso2/product-esb
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> *Nadeeshaan Gunasinghe*
>>>>>>>>>>>>>>>>>>>>>>> Software Engineer, WSO2 Inc. http://wso2.com
>>>>>>>>>>>>>>>>>>>>>>> +94770596754 | nadeesh...@wso2.com | Skype:
>>>>>>>>>>>>>>>>>>>>>>> nadeeshaan.gunasinghe
>>>>>>>>>>>>>>>>>>>>>>> <#m_8781437165098998838_m_1906407074206587743_m_-5727450666815379067_m_3100536272952282018_m_-7906738341674903768_m_-488055444625272468_m_-8776032907468064948_m_-7768434574235180537_m_-7235778947164465931_m_7232211748715967048_m_-3757373977837873170_m_-8283982100572052979_m_1362338246273110367_m_-1442751731575898940_m_6485817575745999246_m_265559619745955743_3779151517627746345_-555366748_-88362740_816856320_1348862296_-537557168_478758164_1912754997_-722133546_-1073985791_>
>>>>>>>>>>>>>>>>>>>>>>> <http://www.facebook.com/nadeeshaan.gunasinghe>
>>>>>>>>>>>>>>>>>>>>>>> <http://lk.linkedin.com/in/nadeeshaan>
>>>>>>>>>>>>>>>>>>>>>>> <http://twitter.com/Nadeeshaan>
>>>>>>>>>>>>>>>>>>>>>>> <http://nadeeshaan.blogspot.com/>
>>>>>>>>>>>>>>>>>>>>>>> Get a signature like this: Click here!
>>>>>>>>>>>>>>>>>>>>>>> <http://ws-promos.appspot.com/r?rdata=eyJydXJsIjogImh0dHA6Ly93d3cud2lzZXN0YW1wLmNvbS9lbWFpbC1pbnN0YWxsP3dzX25jaWQ9NjcyMjk0MDA4JnV0bV9zb3VyY2U9ZXh0ZW5zaW9uJnV0bV9tZWRpdW09ZW1haWwmdXRtX2NhbXBhaWduPXByb21vXzU3MzI1Njg1NDg3Njk3OTIiLCAiZSI6ICI1NzMyNTY4NTQ4NzY5NzkyIn0==153303653327748>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> On Thu, Feb 25, 2016 at 6:24 AM, Dinanjana Gunaratne
>>>>>>>>>>>>>>>>>>>>>>> <dinanj

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-27 Thread Supun Sethunga
Hi Lakini,

Sorry for the delayed response. As the first part of the project, you can
start the work on the UI/drag and drop feature, as the core of your project
is based around that. Therefore, shall we try to get a basic version of
drag and drop UI, by the mid-term evaluation? (No need to connect the UI
with the dl4j, for the first phase)  So this would be include:

   - A link/re-direct to go to Visual builder, upon selecting the Neural
   Netowrks (as the algorithm)
   - The drawing/dropping area and a panel to pick the objects to be
   dragged (objects as in, nodes, layers, links, etc)

This drag and drop page should replace the hyper-parameter page in the ML
UI. More precisely, In the Machine Learner wizard, when a user picks the
algorithm name as Neural Network, and proceed, this drag and drop page
should be prompted instead of the hyper-parameters page. You can create the
overall page as a jaggery page (.jag). It would be easier for you to get a
copy of an existing page, and modifying the content. That will preserve the
existing styles, session handling etc.

Please feel free to raise any question you come across during implementing.

Regards,
Supun

On Tue, May 24, 2016 at 8:09 PM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you very much for the suggestions.I will be using JQueryUI.
>
> As my coding period started yesterday according to the GSoC Schedule  I
> would like to know the workload that should be completed
> before the midterm evaluation. Please advise me accordingly.
>
> Thank you.
>
>
> On Tue, May 24, 2016 at 10:34 AM, Supun Sethunga  wrote:
>
>> Hi Lakini,
>>
>> Yes you can use any of them, with open source licence. But I would prefer
>> JQueryUI, as its a well known library, and is already been used by some of
>> the wso2 products.
>>
>> Regards,
>> Supun
>>
>> On Tue, May 24, 2016 at 9:29 AM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I have found some libraries to build drag and drop UI for our front end
>>> .They are JQury UI[1],Dragula[2],Draggablily[3].
>>> I hope I can do the developments using these libraries.
>>>
>>> [1]jqueryui 
>>> [2]dragula 
>>> [3]draggabilly 
>>>
>>> Could you please tell me if you have any other suggestions?
>>>
>>> On Sat, May 21, 2016 at 11:05 PM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi ,

 This is my weekly progress update of my project.

 I have solved all the problems I have mentioned  in the last email.I
 could find a class BaseDatasetIterator which is in DL4J where we can find
 inbuilt iterators for CurvesDataSetIterator, IrisDataSetIterator,
 MnistDataSetIterator, MovingWindowBaseDataSetIterator,
 RawMnistDataSetIterator .There is no iterator for CIFAR dataset yet.

 I have gone through the whole documentation except Deeplearning4j on
 Spark.The latest documentation is very understandable than the earlier
 one.I have studied neural networks-  Restricted Boltzmann Machines,
 Convolutional Nets (ConvNets),
 Long Short-Term Memory Units (LSTMs),
 Denoising Autoencoders,
 Recurrent Nets and LSTMs,
 Multilayer Neural Nets,
 Deep-Belief Network,
 Deep AutoEncoder,
 Stacked Denoising Autoencoders

 I have run the example codes[1] and I have understood the
 implementations.I have rerun the codes with modifying different parameter
 values like number and size of the hidden layers,  learning rate, momentum,
 weight distribution and various types of regularization and checked the
 performance.

 I have implemented a convolution net[3] and trained it using LFW
 dataset[2] and a Recurrent net[4].Still I have a problem in vectorizing
 CIFRA-10 data set.

 Currently  I am researching about  libraries to build drag & drop UI
 for front end.

 [1]dl4j-0.4-examples
 
 [2]LFW Face Dataset 
 [3]ConvolutionNetLFW
 
 [4]RecurrentNetworkExample
 


 Could you please guide me to do the next step of my project .

 Thank you.

 Sincerely,
 *Lakini Senanayaka.*


>>>
>>>
>>> --
>>> Thank you.
>>>
>>> Sincerely,
>>> *Lakini Senanayaka.*
>>>
>>>
>>
>>
>> --
>> *Supun Sethunga*
>> Software Engineer
>> WSO2, Inc.
>> http://wso2.com/
>> lean | enterprise | middleware
>> Mobile : +94 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-05-26 Thread Asantha Thilina
Hi Tharindu,

sure i'll be look forward for that

Thanks,
Asantha

On Thu, May 26, 2016 at 9:37 PM, Tharindu Edirisinghe 
wrote:

> Hi Asantha,
>
> Glad to hear the progress... Sure I'll review over the weekend and provide
> feedback. By next week we'll have a hangout to discuss on how to move
> forward and the difficulties you have faced.  Keep the momentum going !
>
> Regards,
> TharinduE
>
> On Fri, May 27, 2016 at 12:17 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> i been able to fix the mongodb user store intitalizing error now it
>> working successfully it will be registered as a secondary user store in IS
>> and when going to add a new users and roles it will show the domain of
>> mongodb userstore still i having small issues in my json query formats for
>> mongodb i fixing those issues at the moment all the progress so far i made
>> updated to my github repository[1] and i recently updated my blog[2] as
>> well,can you review my code and give me a feedback?
>>
>> [1]https://github.com/asanthamax/mongodbuserstore
>> [2]http://asanthamax.blogspot.com/
>>
>> Thanks,
>> Asantha
>>
>> On Sun, May 22, 2016 at 3:38 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> I have override all the methods in AbstractUserStoreManager in my
>>> MongoDBUserStoreManager class after that when i try to add new secondary
>>> user store in management console i got following error i attached the
>>> screen shot of the error with this mail
>>> i have pushed all the progress upto now to my github repository[1]
>>> can you give me some tips to solve this issue?
>>> any suggestion would be grateful
>>> [1] https://github.com/asanthamax/mongodbuserstore
>>> Thanks,
>>> Asantha
>>>
>>> On Thu, May 19, 2016 at 11:47 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 sorry for the late reply ,as you advised i remove the scr reference and
 its corresponding methods from user store now it's works fine but i having
 another small issue if i wanted to run my mongodb user store as as my
 primary user store how would i do that?
 i added my user store configurations to user-mgt.xml file and comented
 the ldap userstore properties and i added MongoDBUserStore to
 tenant-mgt.xml as well but then i get error as datasource cannot be casted
 to MongoDB db source while deploying thats mean its still referring to
 Default Activator inside carbon core module how would i set it to my
 activator to reffer?
 any suggestion or help would be grateful
 Thanks,
 Asantha

 On Wed, May 18, 2016 at 10:29 PM, Tharindu Edirisinghe <
 tharin...@wso2.com> wrote:

> Hi Asantha,
>
> Great progress so far !
>
> Since the reference is given to realm service in the bundle activator,
> you should be facing the issue. Can you remove the service reference from
> the bundle activator class. (You can delete the following from the class).
>
> * @scr.reference name="user.realmservice.default"
>  * interface="org.wso2.carbon.user.core.service.RealmService"
> cardinality="1..1"
>  * policy="dynamic" bind="setRealmService"
>  * unbind="unsetRealmService"
>
> Also delete the following methods where realm service is used.
>
> getRealmService()
> setRealmService(RealmService rlmService)
> unsetRealmService(RealmService rlmService)
>
> After that can you try if the userstore manager is working as
> expected. If you face any issues, please get back.
>
> Thank you,
> TharinduE
>
>
>
>
>
>
> On Sun, May 15, 2016 at 7:48 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> I found the issue after debugging into my code ,my service bundle is
>> not get activated because i referring into mongodb-driver which is not 
>> osgi
>> comaptible and i just found another library in here[1] and it is worked 
>> for
>> me ,fixed project i pushed into my github repository [2].
>> i found out that *DefaultRealmService* which is used in Bundle
>> Activator of JDBCUserstoreManager cannot be used for MongoDB since it 
>> used
>> *java.sql.DataSource*.
>> Is their having any DataSource class like that for MongoDB? or would
>> i have to create a different logic to implement that scenario in MongoDB?
>> waiting for your suggestion
>>
>> [1].
>> http://central.maven.org/maven2/org/mongodb/mongo-java-driver/3.2.2/
>> [2]. https://github.com/asanthamax/mongodbuserstore
>> Thanks,
>> Asantha
>>
>> On Sat, May 14, 2016 at 10:53 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> i faced following issue while i developing ,
>>> after adding my new json query support i didn't able to see My
>>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-05-26 Thread Tharindu Edirisinghe
Hi Asantha,

Glad to hear the progress... Sure I'll review over the weekend and provide
feedback. By next week we'll have a hangout to discuss on how to move
forward and the difficulties you have faced.  Keep the momentum going !

Regards,
TharinduE

On Fri, May 27, 2016 at 12:17 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> i been able to fix the mongodb user store intitalizing error now it
> working successfully it will be registered as a secondary user store in IS
> and when going to add a new users and roles it will show the domain of
> mongodb userstore still i having small issues in my json query formats for
> mongodb i fixing those issues at the moment all the progress so far i made
> updated to my github repository[1] and i recently updated my blog[2] as
> well,can you review my code and give me a feedback?
>
> [1]https://github.com/asanthamax/mongodbuserstore
> [2]http://asanthamax.blogspot.com/
>
> Thanks,
> Asantha
>
> On Sun, May 22, 2016 at 3:38 PM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> I have override all the methods in AbstractUserStoreManager in my
>> MongoDBUserStoreManager class after that when i try to add new secondary
>> user store in management console i got following error i attached the
>> screen shot of the error with this mail
>> i have pushed all the progress upto now to my github repository[1]
>> can you give me some tips to solve this issue?
>> any suggestion would be grateful
>> [1] https://github.com/asanthamax/mongodbuserstore
>> Thanks,
>> Asantha
>>
>> On Thu, May 19, 2016 at 11:47 PM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> sorry for the late reply ,as you advised i remove the scr reference and
>>> its corresponding methods from user store now it's works fine but i having
>>> another small issue if i wanted to run my mongodb user store as as my
>>> primary user store how would i do that?
>>> i added my user store configurations to user-mgt.xml file and comented
>>> the ldap userstore properties and i added MongoDBUserStore to
>>> tenant-mgt.xml as well but then i get error as datasource cannot be casted
>>> to MongoDB db source while deploying thats mean its still referring to
>>> Default Activator inside carbon core module how would i set it to my
>>> activator to reffer?
>>> any suggestion or help would be grateful
>>> Thanks,
>>> Asantha
>>>
>>> On Wed, May 18, 2016 at 10:29 PM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
 Hi Asantha,

 Great progress so far !

 Since the reference is given to realm service in the bundle activator,
 you should be facing the issue. Can you remove the service reference from
 the bundle activator class. (You can delete the following from the class).

 * @scr.reference name="user.realmservice.default"
  * interface="org.wso2.carbon.user.core.service.RealmService"
 cardinality="1..1"
  * policy="dynamic" bind="setRealmService"
  * unbind="unsetRealmService"

 Also delete the following methods where realm service is used.

 getRealmService()
 setRealmService(RealmService rlmService)
 unsetRealmService(RealmService rlmService)

 After that can you try if the userstore manager is working as expected.
 If you face any issues, please get back.

 Thank you,
 TharinduE






 On Sun, May 15, 2016 at 7:48 PM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> I found the issue after debugging into my code ,my service bundle is
> not get activated because i referring into mongodb-driver which is not 
> osgi
> comaptible and i just found another library in here[1] and it is worked 
> for
> me ,fixed project i pushed into my github repository [2].
> i found out that *DefaultRealmService* which is used in Bundle
> Activator of JDBCUserstoreManager cannot be used for MongoDB since it used
> *java.sql.DataSource*.
> Is their having any DataSource class like that for MongoDB? or would i
> have to create a different logic to implement that scenario in MongoDB?
> waiting for your suggestion
>
> [1].
> http://central.maven.org/maven2/org/mongodb/mongo-java-driver/3.2.2/
> [2]. https://github.com/asanthamax/mongodbuserstore
> Thanks,
> Asantha
>
> On Sat, May 14, 2016 at 10:53 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> i faced following issue while i developing ,
>> after adding my new json query support i didn't able to see My
>> MongoDBUserStore in dropdown in create user store option.
>> for json related activites i used an external json dependency from
>> here[1] and i added it jar to lib folder in IS as well,i have enabled
>> remote debugging and inspect my code and there i found in my 
>> 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-05-26 Thread Asantha Thilina
Hi Tharindu,

i been able to fix the mongodb user store intitalizing error now it working
successfully it will be registered as a secondary user store in IS and when
going to add a new users and roles it will show the domain of mongodb
userstore still i having small issues in my json query formats for mongodb
i fixing those issues at the moment all the progress so far i made updated
to my github repository[1] and i recently updated my blog[2] as well,can
you review my code and give me a feedback?

[1]https://github.com/asanthamax/mongodbuserstore
[2]http://asanthamax.blogspot.com/

Thanks,
Asantha

On Sun, May 22, 2016 at 3:38 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> I have override all the methods in AbstractUserStoreManager in my
> MongoDBUserStoreManager class after that when i try to add new secondary
> user store in management console i got following error i attached the
> screen shot of the error with this mail
> i have pushed all the progress upto now to my github repository[1]
> can you give me some tips to solve this issue?
> any suggestion would be grateful
> [1] https://github.com/asanthamax/mongodbuserstore
> Thanks,
> Asantha
>
> On Thu, May 19, 2016 at 11:47 PM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> sorry for the late reply ,as you advised i remove the scr reference and
>> its corresponding methods from user store now it's works fine but i having
>> another small issue if i wanted to run my mongodb user store as as my
>> primary user store how would i do that?
>> i added my user store configurations to user-mgt.xml file and comented
>> the ldap userstore properties and i added MongoDBUserStore to
>> tenant-mgt.xml as well but then i get error as datasource cannot be casted
>> to MongoDB db source while deploying thats mean its still referring to
>> Default Activator inside carbon core module how would i set it to my
>> activator to reffer?
>> any suggestion or help would be grateful
>> Thanks,
>> Asantha
>>
>> On Wed, May 18, 2016 at 10:29 PM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Hi Asantha,
>>>
>>> Great progress so far !
>>>
>>> Since the reference is given to realm service in the bundle activator,
>>> you should be facing the issue. Can you remove the service reference from
>>> the bundle activator class. (You can delete the following from the class).
>>>
>>> * @scr.reference name="user.realmservice.default"
>>>  * interface="org.wso2.carbon.user.core.service.RealmService"
>>> cardinality="1..1"
>>>  * policy="dynamic" bind="setRealmService"
>>>  * unbind="unsetRealmService"
>>>
>>> Also delete the following methods where realm service is used.
>>>
>>> getRealmService()
>>> setRealmService(RealmService rlmService)
>>> unsetRealmService(RealmService rlmService)
>>>
>>> After that can you try if the userstore manager is working as expected.
>>> If you face any issues, please get back.
>>>
>>> Thank you,
>>> TharinduE
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Sun, May 15, 2016 at 7:48 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 I found the issue after debugging into my code ,my service bundle is
 not get activated because i referring into mongodb-driver which is not osgi
 comaptible and i just found another library in here[1] and it is worked for
 me ,fixed project i pushed into my github repository [2].
 i found out that *DefaultRealmService* which is used in Bundle
 Activator of JDBCUserstoreManager cannot be used for MongoDB since it used
 *java.sql.DataSource*.
 Is their having any DataSource class like that for MongoDB? or would i
 have to create a different logic to implement that scenario in MongoDB?
 waiting for your suggestion

 [1].
 http://central.maven.org/maven2/org/mongodb/mongo-java-driver/3.2.2/
 [2]. https://github.com/asanthamax/mongodbuserstore
 Thanks,
 Asantha

 On Sat, May 14, 2016 at 10:53 AM, Asantha Thilina <
 asanthathil...@gmail.com> wrote:

> Hi Tharindu,
>
> i faced following issue while i developing ,
> after adding my new json query support i didn't able to see My
> MongoDBUserStore in dropdown in create user store option.
> for json related activites i used an external json dependency from
> here[1] and i added it jar to lib folder in IS as well,i have enabled
> remote debugging and inspect my code and there i found in my 
> *MongoDBUserStoreDSComponent
> *class *activate *method triggered but execute 1st line of code only.
> it will not registered the service but in my osgi console window when
> i run *ss mongo* command i get monodb.userstore bundle and mongodb
> java driver bundle are activated successfully i attached my console output
> and identity server output for your consideration as well
> any suggestion would be grateful
>
> [1]. 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-24 Thread Lakini Senanayaka
Hi,

Thank you very much for the suggestions.I will be using JQueryUI.

As my coding period started yesterday according to the GSoC Schedule  I
would like to know the workload that should be completed
before the midterm evaluation. Please advise me accordingly.

Thank you.


On Tue, May 24, 2016 at 10:34 AM, Supun Sethunga  wrote:

> Hi Lakini,
>
> Yes you can use any of them, with open source licence. But I would prefer
> JQueryUI, as its a well known library, and is already been used by some of
> the wso2 products.
>
> Regards,
> Supun
>
> On Tue, May 24, 2016 at 9:29 AM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> I have found some libraries to build drag and drop UI for our front end
>> .They are JQury UI[1],Dragula[2],Draggablily[3].
>> I hope I can do the developments using these libraries.
>>
>> [1]jqueryui 
>> [2]dragula 
>> [3]draggabilly 
>>
>> Could you please tell me if you have any other suggestions?
>>
>> On Sat, May 21, 2016 at 11:05 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi ,
>>>
>>> This is my weekly progress update of my project.
>>>
>>> I have solved all the problems I have mentioned  in the last email.I
>>> could find a class BaseDatasetIterator which is in DL4J where we can find
>>> inbuilt iterators for CurvesDataSetIterator, IrisDataSetIterator,
>>> MnistDataSetIterator, MovingWindowBaseDataSetIterator,
>>> RawMnistDataSetIterator .There is no iterator for CIFAR dataset yet.
>>>
>>> I have gone through the whole documentation except Deeplearning4j on
>>> Spark.The latest documentation is very understandable than the earlier
>>> one.I have studied neural networks-  Restricted Boltzmann Machines,
>>> Convolutional Nets (ConvNets),
>>> Long Short-Term Memory Units (LSTMs),
>>> Denoising Autoencoders,
>>> Recurrent Nets and LSTMs,
>>> Multilayer Neural Nets,
>>> Deep-Belief Network,
>>> Deep AutoEncoder,
>>> Stacked Denoising Autoencoders
>>>
>>> I have run the example codes[1] and I have understood the
>>> implementations.I have rerun the codes with modifying different parameter
>>> values like number and size of the hidden layers,  learning rate, momentum,
>>> weight distribution and various types of regularization and checked the
>>> performance.
>>>
>>> I have implemented a convolution net[3] and trained it using LFW
>>> dataset[2] and a Recurrent net[4].Still I have a problem in vectorizing
>>> CIFRA-10 data set.
>>>
>>> Currently  I am researching about  libraries to build drag & drop UI
>>> for front end.
>>>
>>> [1]dl4j-0.4-examples
>>> 
>>> [2]LFW Face Dataset 
>>> [3]ConvolutionNetLFW
>>> 
>>> [4]RecurrentNetworkExample
>>> 
>>>
>>>
>>> Could you please guide me to do the next step of my project .
>>>
>>> Thank you.
>>>
>>> Sincerely,
>>> *Lakini Senanayaka.*
>>>
>>>
>>
>>
>> --
>> Thank you.
>>
>> Sincerely,
>> *Lakini Senanayaka.*
>>
>>
>
>
> --
> *Supun Sethunga*
> Software Engineer
> WSO2, Inc.
> http://wso2.com/
> lean | enterprise | middleware
> Mobile : +94 716546324
>



-- 
Thank you.

Sincerely,
*Lakini Senanayaka.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-23 Thread Supun Sethunga
Hi Lakini,

Yes you can use any of them, with open source licence. But I would prefer
JQueryUI, as its a well known library, and is already been used by some of
the wso2 products.

Regards,
Supun

On Tue, May 24, 2016 at 9:29 AM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I have found some libraries to build drag and drop UI for our front end
> .They are JQury UI[1],Dragula[2],Draggablily[3].
> I hope I can do the developments using these libraries.
>
> [1]jqueryui 
> [2]dragula 
> [3]draggabilly 
>
> Could you please tell me if you have any other suggestions?
>
> On Sat, May 21, 2016 at 11:05 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi ,
>>
>> This is my weekly progress update of my project.
>>
>> I have solved all the problems I have mentioned  in the last email.I
>> could find a class BaseDatasetIterator which is in DL4J where we can find
>> inbuilt iterators for CurvesDataSetIterator, IrisDataSetIterator,
>> MnistDataSetIterator, MovingWindowBaseDataSetIterator,
>> RawMnistDataSetIterator .There is no iterator for CIFAR dataset yet.
>>
>> I have gone through the whole documentation except Deeplearning4j on
>> Spark.The latest documentation is very understandable than the earlier
>> one.I have studied neural networks-  Restricted Boltzmann Machines,
>> Convolutional Nets (ConvNets),
>> Long Short-Term Memory Units (LSTMs),
>> Denoising Autoencoders,
>> Recurrent Nets and LSTMs,
>> Multilayer Neural Nets,
>> Deep-Belief Network,
>> Deep AutoEncoder,
>> Stacked Denoising Autoencoders
>>
>> I have run the example codes[1] and I have understood the
>> implementations.I have rerun the codes with modifying different parameter
>> values like number and size of the hidden layers,  learning rate, momentum,
>> weight distribution and various types of regularization and checked the
>> performance.
>>
>> I have implemented a convolution net[3] and trained it using LFW
>> dataset[2] and a Recurrent net[4].Still I have a problem in vectorizing
>> CIFRA-10 data set.
>>
>> Currently  I am researching about  libraries to build drag & drop UI for
>> front end.
>>
>> [1]dl4j-0.4-examples
>> 
>> [2]LFW Face Dataset 
>> [3]ConvolutionNetLFW
>> 
>> [4]RecurrentNetworkExample
>> 
>>
>>
>> Could you please guide me to do the next step of my project .
>>
>> Thank you.
>>
>> Sincerely,
>> *Lakini Senanayaka.*
>>
>>
>
>
> --
> Thank you.
>
> Sincerely,
> *Lakini Senanayaka.*
>
>


-- 
*Supun Sethunga*
Software Engineer
WSO2, Inc.
http://wso2.com/
lean | enterprise | middleware
Mobile : +94 716546324
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-23 Thread Lakini Senanayaka
Hi,

I have found some libraries to build drag and drop UI for our front end
.They are JQury UI[1],Dragula[2],Draggablily[3].
I hope I can do the developments using these libraries.

[1]jqueryui 
[2]dragula 
[3]draggabilly 

Could you please tell me if you have any other suggestions?

On Sat, May 21, 2016 at 11:05 PM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi ,
>
> This is my weekly progress update of my project.
>
> I have solved all the problems I have mentioned  in the last email.I could
> find a class BaseDatasetIterator which is in DL4J where we can find inbuilt
> iterators for CurvesDataSetIterator, IrisDataSetIterator,
> MnistDataSetIterator, MovingWindowBaseDataSetIterator,
> RawMnistDataSetIterator .There is no iterator for CIFAR dataset yet.
>
> I have gone through the whole documentation except Deeplearning4j on
> Spark.The latest documentation is very understandable than the earlier
> one.I have studied neural networks-  Restricted Boltzmann Machines,
> Convolutional Nets (ConvNets),
> Long Short-Term Memory Units (LSTMs),
> Denoising Autoencoders,
> Recurrent Nets and LSTMs,
> Multilayer Neural Nets,
> Deep-Belief Network,
> Deep AutoEncoder,
> Stacked Denoising Autoencoders
>
> I have run the example codes[1] and I have understood the
> implementations.I have rerun the codes with modifying different parameter
> values like number and size of the hidden layers,  learning rate, momentum,
> weight distribution and various types of regularization and checked the
> performance.
>
> I have implemented a convolution net[3] and trained it using LFW
> dataset[2] and a Recurrent net[4].Still I have a problem in vectorizing
> CIFRA-10 data set.
>
> Currently  I am researching about  libraries to build drag & drop UI for
> front end.
>
> [1]dl4j-0.4-examples 
> [2]LFW Face Dataset 
> [3]ConvolutionNetLFW
> 
> [4]RecurrentNetworkExample
> 
>
>
> Could you please guide me to do the next step of my project .
>
> Thank you.
>
> Sincerely,
> *Lakini Senanayaka.*
>
>


-- 
Thank you.

Sincerely,
*Lakini Senanayaka.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-21 Thread Lakini Senanayaka
Hi ,

This is my weekly progress update of my project.

I have solved all the problems I have mentioned  in the last email.I could
find a class BaseDatasetIterator which is in DL4J where we can find inbuilt
iterators for CurvesDataSetIterator, IrisDataSetIterator,
MnistDataSetIterator, MovingWindowBaseDataSetIterator,
RawMnistDataSetIterator .There is no iterator for CIFAR dataset yet.

I have gone through the whole documentation except Deeplearning4j on
Spark.The latest documentation is very understandable than the earlier
one.I have studied neural networks-  Restricted Boltzmann Machines,
Convolutional Nets (ConvNets),
Long Short-Term Memory Units (LSTMs),
Denoising Autoencoders,
Recurrent Nets and LSTMs,
Multilayer Neural Nets,
Deep-Belief Network,
Deep AutoEncoder,
Stacked Denoising Autoencoders

I have run the example codes[1] and I have understood the implementations.I
have rerun the codes with modifying different parameter values like number
and size of the hidden layers,  learning rate, momentum, weight
distribution and various types of regularization and checked the
performance.

I have implemented a convolution net[3] and trained it using LFW dataset[2]
and a Recurrent net[4].Still I have a problem in vectorizing CIFRA-10 data
set.

Currently  I am researching about  libraries to build drag & drop UI for
front end.

[1]dl4j-0.4-examples 
[2]LFW Face Dataset 
[3]ConvolutionNetLFW

[4]RecurrentNetworkExample



Could you please guide me to do the next step of my project .

Thank you.

Sincerely,
*Lakini Senanayaka.*
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-05-19 Thread Asantha Thilina
Hi Tharindu,

sorry for the late reply ,as you advised i remove the scr reference and its
corresponding methods from user store now it's works fine but i having
another small issue if i wanted to run my mongodb user store as as my
primary user store how would i do that?
i added my user store configurations to user-mgt.xml file and comented the
ldap userstore properties and i added MongoDBUserStore to tenant-mgt.xml as
well but then i get error as datasource cannot be casted to MongoDB db
source while deploying thats mean its still referring to Default Activator
inside carbon core module how would i set it to my activator to reffer?
any suggestion or help would be grateful
Thanks,
Asantha

On Wed, May 18, 2016 at 10:29 PM, Tharindu Edirisinghe 
wrote:

> Hi Asantha,
>
> Great progress so far !
>
> Since the reference is given to realm service in the bundle activator, you
> should be facing the issue. Can you remove the service reference from the
> bundle activator class. (You can delete the following from the class).
>
> * @scr.reference name="user.realmservice.default"
>  * interface="org.wso2.carbon.user.core.service.RealmService"
> cardinality="1..1"
>  * policy="dynamic" bind="setRealmService"
>  * unbind="unsetRealmService"
>
> Also delete the following methods where realm service is used.
>
> getRealmService()
> setRealmService(RealmService rlmService)
> unsetRealmService(RealmService rlmService)
>
> After that can you try if the userstore manager is working as expected. If
> you face any issues, please get back.
>
> Thank you,
> TharinduE
>
>
>
>
>
>
> On Sun, May 15, 2016 at 7:48 PM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> I found the issue after debugging into my code ,my service bundle is not
>> get activated because i referring into mongodb-driver which is not osgi
>> comaptible and i just found another library in here[1] and it is worked for
>> me ,fixed project i pushed into my github repository [2].
>> i found out that *DefaultRealmService* which is used in Bundle Activator
>> of JDBCUserstoreManager cannot be used for MongoDB since it used
>> *java.sql.DataSource*.
>> Is their having any DataSource class like that for MongoDB? or would i
>> have to create a different logic to implement that scenario in MongoDB?
>> waiting for your suggestion
>>
>> [1]. http://central.maven.org/maven2/org/mongodb/mongo-java-driver/3.2.2/
>> [2]. https://github.com/asanthamax/mongodbuserstore
>> Thanks,
>> Asantha
>>
>> On Sat, May 14, 2016 at 10:53 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> i faced following issue while i developing ,
>>> after adding my new json query support i didn't able to see My
>>> MongoDBUserStore in dropdown in create user store option.
>>> for json related activites i used an external json dependency from
>>> here[1] and i added it jar to lib folder in IS as well,i have enabled
>>> remote debugging and inspect my code and there i found in my 
>>> *MongoDBUserStoreDSComponent
>>> *class *activate *method triggered but execute 1st line of code only.
>>> it will not registered the service but in my osgi console window when i
>>> run *ss mongo* command i get monodb.userstore bundle and mongodb java
>>> driver bundle are activated successfully i attached my console output and
>>> identity server output for your consideration as well
>>> any suggestion would be grateful
>>>
>>> [1]. http://mvnrepository.com/artifact/org.json/json/20160212
>>> my github repository
>>>
>>> https://github.com/asanthamax/mongodbuserstore/tree/master/mongodb.userstoremanager
>>> Thanks,
>>> Asantha
>>>
>>>
>>> On Thu, May 12, 2016 at 2:01 AM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
 Hi Tharindu,

 since mongodb driver not having prepared statement support earlier i
 developed a logic to support prepared statement but i realized that it has
 a limitation such as parameters has to be pass as same order it exists in
 prepared statement then as you suggested to use key value relationship
 instead of order during our hangout conversation i created a new logic same
 to prepared statement in sql and it will work according to key value
 relationship and i created standard query format for mongodb with json to
 support prepared statements and i rewrite the JDBCRealmConstants class with
 those supporting json queries instead of sql queries

 All of my prepared statement methods contain in
 MongoDBPreparedStatement interface and its implementation in
 MongoDBPreparedStatementImpl class

 All the changes i have pushed to my repo in here[1]

 security of this prepared statements has to be improve

 I'll be grateful if you can provide me some suggestions to improve it
 and also another small issue i having is can i write a DataSource for
 MongoDB as in java.sql.DataSource ?

 [1]
 

Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-05-18 Thread Tharindu Edirisinghe
Hi Asantha,

Great progress so far !

Since the reference is given to realm service in the bundle activator, you
should be facing the issue. Can you remove the service reference from the
bundle activator class. (You can delete the following from the class).

* @scr.reference name="user.realmservice.default"
 * interface="org.wso2.carbon.user.core.service.RealmService"
cardinality="1..1"
 * policy="dynamic" bind="setRealmService"
 * unbind="unsetRealmService"

Also delete the following methods where realm service is used.

getRealmService()
setRealmService(RealmService rlmService)
unsetRealmService(RealmService rlmService)

After that can you try if the userstore manager is working as expected. If
you face any issues, please get back.

Thank you,
TharinduE






On Sun, May 15, 2016 at 7:48 PM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> I found the issue after debugging into my code ,my service bundle is not
> get activated because i referring into mongodb-driver which is not osgi
> comaptible and i just found another library in here[1] and it is worked for
> me ,fixed project i pushed into my github repository [2].
> i found out that *DefaultRealmService* which is used in Bundle Activator
> of JDBCUserstoreManager cannot be used for MongoDB since it used
> *java.sql.DataSource*.
> Is their having any DataSource class like that for MongoDB? or would i
> have to create a different logic to implement that scenario in MongoDB?
> waiting for your suggestion
>
> [1]. http://central.maven.org/maven2/org/mongodb/mongo-java-driver/3.2.2/
> [2]. https://github.com/asanthamax/mongodbuserstore
> Thanks,
> Asantha
>
> On Sat, May 14, 2016 at 10:53 AM, Asantha Thilina <
> asanthathil...@gmail.com> wrote:
>
>> Hi Tharindu,
>>
>> i faced following issue while i developing ,
>> after adding my new json query support i didn't able to see My
>> MongoDBUserStore in dropdown in create user store option.
>> for json related activites i used an external json dependency from
>> here[1] and i added it jar to lib folder in IS as well,i have enabled
>> remote debugging and inspect my code and there i found in my 
>> *MongoDBUserStoreDSComponent
>> *class *activate *method triggered but execute 1st line of code only. it
>> will not registered the service but in my osgi console window when i run *ss
>> mongo* command i get monodb.userstore bundle and mongodb java driver
>> bundle are activated successfully i attached my console output and identity
>> server output for your consideration as well
>> any suggestion would be grateful
>>
>> [1]. http://mvnrepository.com/artifact/org.json/json/20160212
>> my github repository
>>
>> https://github.com/asanthamax/mongodbuserstore/tree/master/mongodb.userstoremanager
>> Thanks,
>> Asantha
>>
>>
>> On Thu, May 12, 2016 at 2:01 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> since mongodb driver not having prepared statement support earlier i
>>> developed a logic to support prepared statement but i realized that it has
>>> a limitation such as parameters has to be pass as same order it exists in
>>> prepared statement then as you suggested to use key value relationship
>>> instead of order during our hangout conversation i created a new logic same
>>> to prepared statement in sql and it will work according to key value
>>> relationship and i created standard query format for mongodb with json to
>>> support prepared statements and i rewrite the JDBCRealmConstants class with
>>> those supporting json queries instead of sql queries
>>>
>>> All of my prepared statement methods contain in MongoDBPreparedStatement
>>> interface and its implementation in MongoDBPreparedStatementImpl class
>>>
>>> All the changes i have pushed to my repo in here[1]
>>>
>>> security of this prepared statements has to be improve
>>>
>>> I'll be grateful if you can provide me some suggestions to improve it
>>> and also another small issue i having is can i write a DataSource for
>>> MongoDB as in java.sql.DataSource ?
>>>
>>> [1]
>>> https://github.com/asanthamax/mongodbuserstore/tree/master/mongodb.userstoremanager
>>>
>>> Thanks,
>>> Asantha
>>>
>>
>>
>


-- 

Tharindu Edirisinghe
Software Engineer | WSO2 Inc
Platform Security Team
Blog : tharindue.blogspot.com
mobile : +94 775181586
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-05-15 Thread Asantha Thilina
Hi Tharindu,

I found the issue after debugging into my code ,my service bundle is not
get activated because i referring into mongodb-driver which is not osgi
comaptible and i just found another library in here[1] and it is worked for
me ,fixed project i pushed into my github repository [2].
i found out that *DefaultRealmService* which is used in Bundle Activator of
JDBCUserstoreManager cannot be used for MongoDB since it used
*java.sql.DataSource*.
Is their having any DataSource class like that for MongoDB? or would i have
to create a different logic to implement that scenario in MongoDB?
waiting for your suggestion

[1]. http://central.maven.org/maven2/org/mongodb/mongo-java-driver/3.2.2/
[2]. https://github.com/asanthamax/mongodbuserstore
Thanks,
Asantha

On Sat, May 14, 2016 at 10:53 AM, Asantha Thilina 
wrote:

> Hi Tharindu,
>
> i faced following issue while i developing ,
> after adding my new json query support i didn't able to see My
> MongoDBUserStore in dropdown in create user store option.
> for json related activites i used an external json dependency from here[1]
> and i added it jar to lib folder in IS as well,i have enabled remote
> debugging and inspect my code and there i found in my 
> *MongoDBUserStoreDSComponent
> *class *activate *method triggered but execute 1st line of code only. it
> will not registered the service but in my osgi console window when i run *ss
> mongo* command i get monodb.userstore bundle and mongodb java driver
> bundle are activated successfully i attached my console output and identity
> server output for your consideration as well
> any suggestion would be grateful
>
> [1]. http://mvnrepository.com/artifact/org.json/json/20160212
> my github repository
>
> https://github.com/asanthamax/mongodbuserstore/tree/master/mongodb.userstoremanager
> Thanks,
> Asantha
>
>
> On Thu, May 12, 2016 at 2:01 AM, Asantha Thilina  > wrote:
>
>> Hi Tharindu,
>>
>> since mongodb driver not having prepared statement support earlier i
>> developed a logic to support prepared statement but i realized that it has
>> a limitation such as parameters has to be pass as same order it exists in
>> prepared statement then as you suggested to use key value relationship
>> instead of order during our hangout conversation i created a new logic same
>> to prepared statement in sql and it will work according to key value
>> relationship and i created standard query format for mongodb with json to
>> support prepared statements and i rewrite the JDBCRealmConstants class with
>> those supporting json queries instead of sql queries
>>
>> All of my prepared statement methods contain in MongoDBPreparedStatement
>> interface and its implementation in MongoDBPreparedStatementImpl class
>>
>> All the changes i have pushed to my repo in here[1]
>>
>> security of this prepared statements has to be improve
>>
>> I'll be grateful if you can provide me some suggestions to improve it and
>> also another small issue i having is can i write a DataSource for MongoDB
>> as in java.sql.DataSource ?
>>
>> [1]
>> https://github.com/asanthamax/mongodbuserstore/tree/master/mongodb.userstoremanager
>>
>> Thanks,
>> Asantha
>>
>
>
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016: Proposal 7

2016-05-14 Thread Dinanjana Gunaratne
gt;>>>>>>>>>> following repositories in the order.
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> [1] https://github.com/wso2/wso2-synapse
>>>>>>>>>>>>>>>>>>>>>> [2] https://github.com/wso2/carbon-mediation
>>>>>>>>>>>>>>>>>>>>>> [3] https://github.com/wso2/product-esb
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> *Nadeeshaan Gunasinghe*
>>>>>>>>>>>>>>>>>>>>>> Software Engineer, WSO2 Inc. http://wso2.com
>>>>>>>>>>>>>>>>>>>>>> +94770596754 | nadeesh...@wso2.com | Skype:
>>>>>>>>>>>>>>>>>>>>>> nadeeshaan.gunasinghe
>>>>>>>>>>>>>>>>>>>>>> <#m_1906407074206587743_m_-5727450666815379067_m_3100536272952282018_m_-7906738341674903768_m_-488055444625272468_m_-8776032907468064948_m_-7768434574235180537_m_-7235778947164465931_m_7232211748715967048_m_-3757373977837873170_m_-8283982100572052979_m_1362338246273110367_m_-1442751731575898940_m_6485817575745999246_m_265559619745955743_3779151517627746345_-555366748_-88362740_816856320_1348862296_-537557168_478758164_1912754997_-722133546_-1073985791_>
>>>>>>>>>>>>>>>>>>>>>> <http://www.facebook.com/nadeeshaan.gunasinghe>
>>>>>>>>>>>>>>>>>>>>>> <http://lk.linkedin.com/in/nadeeshaan>
>>>>>>>>>>>>>>>>>>>>>> <http://twitter.com/Nadeeshaan>
>>>>>>>>>>>>>>>>>>>>>> <http://nadeeshaan.blogspot.com/>
>>>>>>>>>>>>>>>>>>>>>> Get a signature like this: Click here!
>>>>>>>>>>>>>>>>>>>>>> <http://ws-promos.appspot.com/r?rdata=eyJydXJsIjogImh0dHA6Ly93d3cud2lzZXN0YW1wLmNvbS9lbWFpbC1pbnN0YWxsP3dzX25jaWQ9NjcyMjk0MDA4JnV0bV9zb3VyY2U9ZXh0ZW5zaW9uJnV0bV9tZWRpdW09ZW1haWwmdXRtX2NhbXBhaWduPXByb21vXzU3MzI1Njg1NDg3Njk3OTIiLCAiZSI6ICI1NzMyNTY4NTQ4NzY5NzkyIn0==153303653327748>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> On Thu, Feb 25, 2016 at 6:24 AM, Dinanjana Gunaratne
>>>>>>>>>>>>>>>>>>>>>> <dinanjanagunara...@gmail.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Dear Isuru,
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Can you send me a link of api documentation of
>>>>>>>>>>>>>>>>>>>>>>> management package of ESB ?
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> On Sun, Feb 21, 2016 at 2:34 PM, Dinanjana Gunaratne
>>>>>>>>>>>>>>>>>>>>>>> <dinanjanagunara...@gmail.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> Dear Isuru,
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> Sorry for bothering you again. I created a sample
>>>>>>>>>>>>>>>>

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-12 Thread Upul Bandara
ML algorithms work with numerical data but in your scenario  response
 variable is represented as strings.  Encode strings with numerical
values.  If you carefully read the error message you will be able to
understand the root course of the error.

Additionally, nowadays Iris is considered as a toy dataset and not suitable
for training big deep networks. Please, use one of the datasets mentioned
in my previous email.


On Thu, May 12, 2016 at 11:37 PM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> I have gone through  DL4J examples which are given in DL4J documentation
> [1]
> I have studied convolution nets,feed forward nets-classification,and
> Restricted Boltzmann machines.
>
> I have tried to implement my own model using linear classification feed
> forward network as in the example [2].You can find my git repo here[3]
> In here I used Iris Data set[4] and I have encountered a problem while
> running the code.
>
> This is my error log.
>
> INFO: successfully loaded
> C:\Users\Lakini\AppData\Local\Temp\jniloader9080956326584987445netlib-native_system-win-x86_64.dll
> Exception in thread "main" java.lang.NumberFormatException: For input
> string: "Iris-setosa"
> at
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Integer.parseInt(Integer.java:580)
> at java.lang.Integer.parseInt(Integer.java:615)
> at org.canova.api.io.data.Text.toInt(Text.java:615)
> at
> org.deeplearning4j.datasets.canova.RecordReaderDataSetIterator.getDataSet(RecordReaderDataSetIterator.java:204)
> at
> org.deeplearning4j.datasets.canova.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:150)
> at
> org.deeplearning4j.datasets.canova.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:288)
> at
> org.deeplearning4j.datasets.canova.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:42)
> at
> org.deeplearning4j.nn.multilayer.MultiLayerNetwork.fit(MultiLayerNetwork.java:1149)
> at
> org.deeplearning4j.examples.feedforward.classification.MLPClassifierLinearIrisData.main(MLPClassifierLinearIrisData.java:85)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
>
> As I understood the error is occurring because I didn't vectorise the data
> set in to a numerical form.
>
> Is there any method to vectorise CSV using canova using DL4J libraries,
> without installing and using Canova Cli separately?
>
>
> [1]DL4J Documentation 
> [2]MLPClassifierLinear
> 
> [3]MLPClassifierLinearIrisDataSet
> 
> [4]Iris Dataset
> 
>
> On Sat, May 7, 2016 at 6:42 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Thank you Upul. I will do that.
>>
>> Thank you,
>> Lakini Senanayaka
>>
>> On Sat, May 7, 2016 at 10:10 AM, Upul Bandara  wrote:
>>
>>> +1 for maintaining a blog.
>>>
>>> Regarding DL4J, no need to go very deep. Please familiar with its API
>>> and you should be able to build common NN architectures such as fully
>>> connected networks, convolution networks and recurrent networks using DL4J.
>>>
>>> So try to build few models using publically available datasets such as
>>> MNIST, CIFAR-10.
>>>
>>> Regarding front-end development: Please do some research and find out
>>> few libraries that we can use for building our drag & drop UI.
>>>
>>> Thanks,
>>> Upul
>>>
>>> On Fri, May 6, 2016 at 10:14 PM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi all,

 I have gone through the Machine Learner source code[1][2].I am still
 reading DL4J and ND4J documentations.Do I need to understand and study the
 DL4J in deep?
 Do I need to maintain a blog about my GSoC project?

 Could you please give me further guidance and the next steps to follow?

 [1] https://github.com/wso2/carbon-ml
 [2] https://github.com/wso2/product-ml

 Thank you.
 Lakini Senanayaka.

 On Tue, May 3, 2016 at 2:30 PM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi all,
>
> Thank you very much.I will go through these links.
>
> On Tue, May 3, 2016 at 2:00 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi,
>>
>> Thank you for the response Supun.I thought I am 

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-12 Thread Lakini Senanayaka
Hi,

I have gone through  DL4J examples which are given in DL4J documentation [1]
I have studied convolution nets,feed forward nets-classification,and
Restricted Boltzmann machines.

I have tried to implement my own model using linear classification feed
forward network as in the example [2].You can find my git repo here[3]
In here I used Iris Data set[4] and I have encountered a problem while
running the code.

This is my error log.

INFO: successfully loaded
C:\Users\Lakini\AppData\Local\Temp\jniloader9080956326584987445netlib-native_system-win-x86_64.dll
Exception in thread "main" java.lang.NumberFormatException: For input
string: "Iris-setosa"
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:580)
at java.lang.Integer.parseInt(Integer.java:615)
at org.canova.api.io.data.Text.toInt(Text.java:615)
at
org.deeplearning4j.datasets.canova.RecordReaderDataSetIterator.getDataSet(RecordReaderDataSetIterator.java:204)
at
org.deeplearning4j.datasets.canova.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:150)
at
org.deeplearning4j.datasets.canova.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:288)
at
org.deeplearning4j.datasets.canova.RecordReaderDataSetIterator.next(RecordReaderDataSetIterator.java:42)
at
org.deeplearning4j.nn.multilayer.MultiLayerNetwork.fit(MultiLayerNetwork.java:1149)
at
org.deeplearning4j.examples.feedforward.classification.MLPClassifierLinearIrisData.main(MLPClassifierLinearIrisData.java:85)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)

As I understood the error is occurring because I didn't vectorise the data
set in to a numerical form.

Is there any method to vectorise CSV using canova using DL4J libraries,
without installing and using Canova Cli separately?


[1]DL4J Documentation 
[2]MLPClassifierLinear

[3]MLPClassifierLinearIrisDataSet

[4]Iris Dataset


On Sat, May 7, 2016 at 6:42 PM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Thank you Upul. I will do that.
>
> Thank you,
> Lakini Senanayaka
>
> On Sat, May 7, 2016 at 10:10 AM, Upul Bandara  wrote:
>
>> +1 for maintaining a blog.
>>
>> Regarding DL4J, no need to go very deep. Please familiar with its API and
>> you should be able to build common NN architectures such as fully connected
>> networks, convolution networks and recurrent networks using DL4J.
>>
>> So try to build few models using publically available datasets such as
>> MNIST, CIFAR-10.
>>
>> Regarding front-end development: Please do some research and find out few
>> libraries that we can use for building our drag & drop UI.
>>
>> Thanks,
>> Upul
>>
>> On Fri, May 6, 2016 at 10:14 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> I have gone through the Machine Learner source code[1][2].I am still
>>> reading DL4J and ND4J documentations.Do I need to understand and study the
>>> DL4J in deep?
>>> Do I need to maintain a blog about my GSoC project?
>>>
>>> Could you please give me further guidance and the next steps to follow?
>>>
>>> [1] https://github.com/wso2/carbon-ml
>>> [2] https://github.com/wso2/product-ml
>>>
>>> Thank you.
>>> Lakini Senanayaka.
>>>
>>> On Tue, May 3, 2016 at 2:30 PM, Lakini Senanayaka <
>>> lakinisenanayak...@gmail.com> wrote:
>>>
 Hi all,

 Thank you very much.I will go through these links.

 On Tue, May 3, 2016 at 2:00 PM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you for the response Supun.I thought I am out from the
> competition as no one replied  me at least for my first mail.
> Thank you so much.
>
> On Tue, May 3, 2016 at 9:43 AM, Supun Sethunga 
> wrote:
>
>> Hi Lakini,
>>
>> Sorry for the delay in getting back to you. While you are reading
>> about DL4J, you can setup your dev environment and get familiarized with
>> the Machine Learner source code. For that, you can fork the following two
>> repos [1] [2] and try to build from the source (when you do some code
>> change to [1], you have to build the two repos in order). Implementations
>> of the existing algorithms can be found at [3]. You 

[Dev] GSOC 2016 - Project 21 : MongoDB Userstore Development

2016-05-12 Thread Asantha Thilina
Hi Tharindu,

since mongodb driver not having prepared statement support earlier i
developed a logic to support prepared statement but i realized that it has
a limitation such as parameters has to be pass as same order it exists in
prepared statement then as you suggested to use key value relationship
instead of order during our hangout conversation i created a new logic same
to prepared statement in sql and it will work according to key value
relationship and i created standard query format for mongodb with json to
support prepared statements and i rewrite the JDBCRealmConstants class with
those supporting json queries instead of sql queries

All of my prepared statement methods contain in MongoDBPreparedStatement
interface and its implementation in MongoDBPreparedStatementImpl class

All the changes i have pushed to my repo in here[1]

security of this prepared statements has to be improve

I'll be grateful if you can provide me some suggestions to improve it and
also another small issue i having is can i write a DataSource for MongoDB
as in java.sql.DataSource ?

[1]
https://github.com/asanthamax/mongodbuserstore/tree/master/mongodb.userstoremanager

Thanks,
Asantha
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


[Dev] GSoC 2016: [ML][CEP] Proposal 6, discussion @ Fri May 6, 2016

2016-05-07 Thread Mahesh Dananjaya
HI Maheshakya,
first of all thank you for the discussion. I could possibly solved couple
of doubts regarding the project. I think i get some idea about the work
flow of Carbon-ML, product-ml, product-cep and apache spark MLLib
algorithms. It was  a good discussion and thank you for the invitation to
visit wso2. I will update my progress as we moving on.thank you.
regards,
Mahesh.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016 - Project 21 : Review Proposal

2016-05-07 Thread Asantha Thilina
Hi Tharindu,

As you advice i updated my blog[1] with all my works i have done so far ,
looking for your feedback

[1]. http://asanthamax.blogspot.com/

Thanks,
Asantha

On Fri, May 6, 2016 at 11:21 AM, Asantha Thilina <asanthathil...@gmail.com>
wrote:

> Hi Tharindu,
>
> i have done some coding in my user store ,does mongodb contain a
> parameterized query mechanism such as prepared statements in sql?
> i search through mongodb documentation and i didn't find any related idea
> therefore i create my own class to do that job and i tested it with sample
> data for all 4 CRUDS and it worked. my logic will be as follows,
> first it will read the query as json input,
> then as same as in prepared statement when function calling has to pass
> what are the parameters as example i can define the template query as
> follows
> {'UM_USER_NAME': '?'}
> then has to convert this query to DBObject and parse to find function with
> parameters and respective collection name as follows
> find("UM_USER",object,"test");
> so that then in find function i mapping the corresponding parameter to
> suitable query position but the problem in how would i  sanitize the user
> input parameters to avoid security threats as in prepared statements? do i
> have to write regular expressions or is their any other way of doing? is
> sql injections kind of thing possible with mongodb if so how would i escape
> it?
> i would be thankful if you can review my code and give me a feedback
> whether my logic is correct and also is there are a way to write schema in
> mongodb like in sql?
>
> all my works up to this is added to my repository in here [1]
>
> [1]. https://github.com/asanthamax/mongodbuserstore
>
> Thanks,
> Asantha
>
> On Thu, May 5, 2016 at 11:24 AM, Asantha Thilina <asanthathil...@gmail.com
> > wrote:
>
>> ------ Forwarded message --
>> From: Asantha Thilina <asanthathil...@gmail.com>
>> Date: Mon, May 2, 2016 at 12:46 AM
>> Subject: Re: [Dev] GSOC 2016 - Project 21 : Review Proposal
>> To: Tharindu Edirisinghe <tharin...@wso2.com>, dev@wso2.org
>>
>>
>> Hi Tharindu,
>>
>> as you adviced i started creating corresponding mongodb database
>> structure for IS user store i done the user store database script and share
>> it in here [1] and identity script still writing  before further progress
>> on identity script i would be very thankful if i can get your comment about
>> my user store script whether it correct or need to improve while i mapping
>> mysql script to mongodb i faced on following issue
>> MongoDB is not supporting to multikey hashed indexes according to their
>> documentation in here [2] therefore i create one hash index per document
>> which are need hash indexes
>> for mapping foreign keys i used the manual way than db refs or embeded
>> documents to avoid data repition for that i refer their documentation in
>> here [3]
>> For storage engine i used the default engine called wired tiger according
>> to their documentation in here [4]
>> waiting for your feedback about my works,
>> [1].
>> https://github.com/asanthamax/mongodbuserstore/blob/master/identity_server.js
>> [2]. https://docs.mongodb.org/v3.0/tutorial/create-a-hashed-index/
>> [3]. https://docs.mongodb.org/manual/reference/database-references/
>> [4]. https://docs.mongodb.org/manual/core/wiredtiger/
>>
>> Thanks,
>> Asantha
>>
>> On Sat, Apr 30, 2016 at 4:02 AM, Asantha Thilina <
>> asanthathil...@gmail.com> wrote:
>>
>>> Hi Tharindu,
>>>
>>> thanks for the guidance sure i'll do that way and update you as i
>>> progress
>>>
>>> Thanks,
>>> Asantha
>>>
>>> On Fri, Apr 29, 2016 at 10:00 PM, Tharindu Edirisinghe <
>>> tharin...@wso2.com> wrote:
>>>
>>>> Hi Asantha,
>>>>
>>>> Great work ! Yes, you will have to manually create the database with
>>>> the tables. Then once you create the userstore in Identity Server and point
>>>> to the particular database, it should work properly.
>>>>
>>>> Then what you can do here is converting the relational db schema to
>>>> collections in mongodb. You can refer the IS_5.1.0_HOME/dbscripts/ location
>>>> where all the database scripts are stored. You need to look at only 2 sql
>>>> files for the moment. They are the IS_5.1.0_HOME/dbscripts/mysql.sql and
>>>> IS_5.1.0_HOME/dbscripts/identity/mysql.sql . Referring these two files, you
>>>> can write 2 sql files for mongodb.
>>>>
>>>>

Re: [Dev] [GSoC 2016]Proposal 03: [ML]Visual(Deep) Neural Network Builder -Project Progress

2016-05-06 Thread Upul Bandara
+1 for maintaining a blog.

Regarding DL4J, no need to go very deep. Please familiar with its API and
you should be able to build common NN architectures such as fully connected
networks, convolution networks and recurrent networks using DL4J.

So try to build few models using publically available datasets such as
MNIST, CIFAR-10.

Regarding front-end development: Please do some research and find out few
libraries that we can use for building our drag & drop UI.

Thanks,
Upul

On Fri, May 6, 2016 at 10:14 PM, Lakini Senanayaka <
lakinisenanayak...@gmail.com> wrote:

> Hi all,
>
> I have gone through the Machine Learner source code[1][2].I am still
> reading DL4J and ND4J documentations.Do I need to understand and study the
> DL4J in deep?
> Do I need to maintain a blog about my GSoC project?
>
> Could you please give me further guidance and the next steps to follow?
>
> [1] https://github.com/wso2/carbon-ml
> [2] https://github.com/wso2/product-ml
>
> Thank you.
> Lakini Senanayaka.
>
> On Tue, May 3, 2016 at 2:30 PM, Lakini Senanayaka <
> lakinisenanayak...@gmail.com> wrote:
>
>> Hi all,
>>
>> Thank you very much.I will go through these links.
>>
>> On Tue, May 3, 2016 at 2:00 PM, Lakini Senanayaka <
>> lakinisenanayak...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Thank you for the response Supun.I thought I am out from the competition
>>> as no one replied  me at least for my first mail.
>>> Thank you so much.
>>>
>>> On Tue, May 3, 2016 at 9:43 AM, Supun Sethunga  wrote:
>>>
 Hi Lakini,

 Sorry for the delay in getting back to you. While you are reading about
 DL4J, you can setup your dev environment and get familiarized with the
 Machine Learner source code. For that, you can fork the following two
 repos [1] [2] and try to build from the source (when you do some code
 change to [1], you have to build the two repos in order). Implementations
 of the existing algorithms can be found at [3]. You can refer those to get
 an idea on the code conventions and the implementation patterns used.
 Please feel free o ask if you have any questions.

 Meantime, Upul will give you the steps on how to proceed with the
 project.

 [1] https://github.com/wso2/carbon-ml
 [2] https://github.com/wso2/product-ml
 [3]
 https://github.com/wso2/carbon-ml/tree/master/components/ml/org.wso2.carbon.ml.core/src/main/java/org/wso2/carbon/ml/core/spark/algorithms

 Regards,
 Supun

 On Mon, May 2, 2016 at 8:26 AM, Lakini Senanayaka <
 lakinisenanayak...@gmail.com> wrote:

> Hi,
>
> Thank you very much for accepting my project proposal and all the
> comments,feedback and help, you did to prepare a good proposal.
>
> I have started the project as in my project time line.
> These days I am reading DL4J concepts and it's documentation and
> started to learn Jaggery as it will be useful in front end development.As
> well as I have started learning REST APIs.
>
> I like to know WSO2 coding conventions and other information related
> to my project.I'm looking forward for further guidance.
>
>
> --
> Thank you.
>
> Sincerely,
> *Lakini Senanayaka.*
>
>
> ___
> Dev mailing list
> Dev@wso2.org
> http://wso2.org/cgi-bin/mailman/listinfo/dev
>
>


 --
 *Supun Sethunga*
 Software Engineer
 WSO2, Inc.
 http://wso2.com/
 lean | enterprise | middleware
 Mobile : +94 716546324

>>>
>>>
>>>
>>> --
>>> Thank you.
>>>
>>> Sincerely,
>>> *Lakini Senanayaka.*
>>>
>>>
>>
>>
>> --
>> Thank you.
>>
>> Sincerely,
>> *Lakini Senanayaka.*
>>
>>
>


-- 
Upul Bandara,
Associate Technical Lead, WSO2, Inc.,
Mob: +94 715 468 345.
___
Dev mailing list
Dev@wso2.org
http://wso2.org/cgi-bin/mailman/listinfo/dev


Re: [Dev] GSOC 2016 - Project 21 : Review Proposal

2016-05-06 Thread Asantha Thilina
Hi Tharindu,

i have done some coding in my user store ,does mongodb contain a
parameterized query mechanism such as prepared statements in sql?
i search through mongodb documentation and i didn't find any related idea
therefore i create my own class to do that job and i tested it with sample
data for all 4 CRUDS and it worked. my logic will be as follows,
first it will read the query as json input,
then as same as in prepared statement when function calling has to pass
what are the parameters as example i can define the template query as
follows
{'UM_USER_NAME': '?'}
then has to convert this query to DBObject and parse to find function with
parameters and respective collection name as follows
find("UM_USER",object,"test");
so that then in find function i mapping the corresponding parameter to
suitable query position but the problem in how would i  sanitize the user
input parameters to avoid security threats as in prepared statements? do i
have to write regular expressions or is their any other way of doing? is
sql injections kind of thing possible with mongodb if so how would i escape
it?
i would be thankful if you can review my code and give me a feedback
whether my logic is correct and also is there are a way to write schema in
mongodb like in sql?

all my works up to this is added to my repository in here [1]

[1]. https://github.com/asanthamax/mongodbuserstore

Thanks,
Asantha

On Thu, May 5, 2016 at 11:24 AM, Asantha Thilina <asanthathil...@gmail.com>
wrote:

> -- Forwarded message --
> From: Asantha Thilina <asanthathil...@gmail.com>
> Date: Mon, May 2, 2016 at 12:46 AM
> Subject: Re: [Dev] GSOC 2016 - Project 21 : Review Proposal
> To: Tharindu Edirisinghe <tharin...@wso2.com>, dev@wso2.org
>
>
> Hi Tharindu,
>
> as you adviced i started creating corresponding mongodb database structure
> for IS user store i done the user store database script and share it in
> here [1] and identity script still writing  before further progress on
> identity script i would be very thankful if i can get your comment about my
> user store script whether it correct or need to improve while i mapping
> mysql script to mongodb i faced on following issue
> MongoDB is not supporting to multikey hashed indexes according to their
> documentation in here [2] therefore i create one hash index per document
> which are need hash indexes
> for mapping foreign keys i used the manual way than db refs or embeded
> documents to avoid data repition for that i refer their documentation in
> here [3]
> For storage engine i used the default engine called wired tiger according
> to their documentation in here [4]
> waiting for your feedback about my works,
> [1].
> https://github.com/asanthamax/mongodbuserstore/blob/master/identity_server.js
> [2]. https://docs.mongodb.org/v3.0/tutorial/create-a-hashed-index/
> [3]. https://docs.mongodb.org/manual/reference/database-references/
> [4]. https://docs.mongodb.org/manual/core/wiredtiger/
>
> Thanks,
> Asantha
>
> On Sat, Apr 30, 2016 at 4:02 AM, Asantha Thilina <asanthathil...@gmail.com
> > wrote:
>
>> Hi Tharindu,
>>
>> thanks for the guidance sure i'll do that way and update you as i progress
>>
>> Thanks,
>> Asantha
>>
>> On Fri, Apr 29, 2016 at 10:00 PM, Tharindu Edirisinghe <
>> tharin...@wso2.com> wrote:
>>
>>> Hi Asantha,
>>>
>>> Great work ! Yes, you will have to manually create the database with the
>>> tables. Then once you create the userstore in Identity Server and point to
>>> the particular database, it should work properly.
>>>
>>> Then what you can do here is converting the relational db schema to
>>> collections in mongodb. You can refer the IS_5.1.0_HOME/dbscripts/ location
>>> where all the database scripts are stored. You need to look at only 2 sql
>>> files for the moment. They are the IS_5.1.0_HOME/dbscripts/mysql.sql and
>>> IS_5.1.0_HOME/dbscripts/identity/mysql.sql . Referring these two files, you
>>> can write 2 sql files for mongodb.
>>>
>>> Later we can do some modifications to automatically create the database
>>> (if the mongodb userstore is selected to be the PRIMARY userstore)
>>> referring the schema in above 2 files.
>>>
>>> Regards,
>>> TharinduE
>>>
>>> On Fri, Apr 29, 2016 at 10:22 PM, Asantha Thilina <
>>> asanthathil...@gmail.com> wrote:
>>>
>>>> Hi Tharindu,
>>>>
>>>> Thanks for the instructions As you described in mail i followed all the
>>>> steps and i  have been now able to see my new user store service is started
>>>> and shown in IS as

Re: [Dev] GSOC 2016: Proposal 7

2016-05-06 Thread Dinanjana Gunaratne
40_816856320_1348862296_-537557168_478758164_1912754997_-722133546_-1073985791_>
>>>>>>>>>>>>>>>>>>>>> <http://www.facebook.com/nadeeshaan.gunasinghe>
>>>>>>>>>>>>>>>>>>>>> <http://lk.linkedin.com/in/nadeeshaan>
>>>>>>>>>>>>>>>>>>>>> <http://twitter.com/Nadeeshaan>
>>>>>>>>>>>>>>>>>>>>> <http://nadeeshaan.blogspot.com/>
>>>>>>>>>>>>>>>>>>>>> Get a signature like this: Click here!
>>>>>>>>>>>>>>>>>>>>> <http://ws-promos.appspot.com/r?rdata=eyJydXJsIjogImh0dHA6Ly93d3cud2lzZXN0YW1wLmNvbS9lbWFpbC1pbnN0YWxsP3dzX25jaWQ9NjcyMjk0MDA4JnV0bV9zb3VyY2U9ZXh0ZW5zaW9uJnV0bV9tZWRpdW09ZW1haWwmdXRtX2NhbXBhaWduPXByb21vXzU3MzI1Njg1NDg3Njk3OTIiLCAiZSI6ICI1NzMyNTY4NTQ4NzY5NzkyIn0==153303653327748>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> On Thu, Feb 25, 2016 at 6:24 AM, Dinanjana Gunaratne <
>>>>>>>>>>>>>>>>>>>>> dinanjanagunara...@gmail.com> wrote:
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> Dear Isuru,
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> Can you send me a link of api documentation of
>>>>>>>>>>>>>>>>>>>>>> management package of ESB ?
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> On Sun, Feb 21, 2016 at 2:34 PM, Dinanjana Gunaratne
>>>>>>>>>>>>>>>>>>>>>> <dinanjanagunara...@gmail.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Dear Isuru,
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Sorry for bothering you again. I created a sample
>>>>>>>>>>>>>>>>>>>>>>> module with some of the requirements you mentioned in 
>>>>>>>>>>>>>>>>>>>>>>> gsoc project page.
>>>>>>>>>>>>>>>>>>>>>>> Those requirements are creating thread dumps when 
>>>>>>>>>>>>>>>>>>>>>>> resources usage increased
>>>>>>>>>>>>>>>>>>>>>>> unexpectedly. Now I like to know how to integrate this 
>>>>>>>>>>>>>>>>>>>>>>> in to ESB and test
>>>>>>>>>>>>>>>>>>>>>>> the functionality. I couldn't find the location of ESB 
>>>>>>>>>>>>>>>>>>>>>>> source.
>>>>>>>>>>>>>>>>>>>>>>> On Feb 20, 2016 9:33 AM, "Dinanjana Gunaratne" <
>>>>>>>>>>>>>>>>>>>>>>> dinanjanagunara...@gmail.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> Dear Isuru,
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> Are we looking at an implementation like this ?
>>>>>>>>>>>>>>>>>>>>>>>> "Dashboard is a remote monitoring system which was
>>>>>>>>>>>>>>>>>>>>>>>> developed to monitor the status(server's aliveness and 
>>>>>>>>>>>>>>>>>>>>>>>> management details)
>>>>>>>>>>>>>>>>>

  1   2   3   >