Re: [hpx-users] Unable to connect to rostam
Thank you very much. Alireza Kheirkhahan a écrit : > Gabriel, > > The cluster is up and ruining now and you should have access to it. > The thing was that the electronic lock system also wasn't working after the > power outage and I had to wait till Monday to someone from staff show up > and let me in the server room. Now everything is back to normal. > > Regards, > Al > > On Sun, Jun 17, 2018 at 8:55 PM Gabriel Laberge > wrote: > >> Did you manage to get the cluster running again? If yes, I still can't >> connect. >> Thank you. >> Hartmut Kaiser a écrit : >> >> > We've had a power outage at LSU today. We'll make the cluster available >> > again asap. >> > >> > Regards Hartmut >> > --- >> > http://stellar.cct.lsu.edu >> > https://github.com/STEllAR-GROUP/hpx >> > >> > >> >> -Original Message- >> >> From: hpx-users-boun...@stellar.cct.lsu.edu > >> boun...@stellar.cct.lsu.edu> On Behalf Of Gabriel Laberge >> >> Sent: Friday, June 15, 2018 5:31 PM >> >> To: hpx-users@stellar.cct.lsu.edu >> >> Subject: [hpx-users] Unable to connect to rostam >> >> >> >> Hi >> >> today I was working on the rostam clusters but suddenly I was unable to >> >> connect. I've not been able to connect since then. I'm not sure of what >> >> could cause such a problem. >> >> >> >> Thank you. >> >> >> >> ___ >> >> hpx-users mailing list >> >> hpx-users@stellar.cct.lsu.edu >> >> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users >> > >> > >> > ___ >> > hpx-users mailing list >> > hpx-users@stellar.cct.lsu.edu >> > https://mail.cct.lsu.edu/mailman/listinfo/hpx-users >> >> >> >> ___ >> hpx-users mailing list >> hpx-users@stellar.cct.lsu.edu >> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users >> ___ hpx-users mailing list hpx-users@stellar.cct.lsu.edu https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
Re: [hpx-users] Unable to connect to rostam
Did you manage to get the cluster running again? If yes, I still can't connect. Thank you. Hartmut Kaiser a écrit : > We've had a power outage at LSU today. We'll make the cluster available > again asap. > > Regards Hartmut > --- > http://stellar.cct.lsu.edu > https://github.com/STEllAR-GROUP/hpx > > >> -Original Message- >> From: hpx-users-boun...@stellar.cct.lsu.edu > boun...@stellar.cct.lsu.edu> On Behalf Of Gabriel Laberge >> Sent: Friday, June 15, 2018 5:31 PM >> To: hpx-users@stellar.cct.lsu.edu >> Subject: [hpx-users] Unable to connect to rostam >> >> Hi >> today I was working on the rostam clusters but suddenly I was unable to >> connect. I've not been able to connect since then. I'm not sure of what >> could cause such a problem. >> >> Thank you. >> >> ___ >> hpx-users mailing list >> hpx-users@stellar.cct.lsu.edu >> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users > > > ___ > hpx-users mailing list > hpx-users@stellar.cct.lsu.edu > https://mail.cct.lsu.edu/mailman/listinfo/hpx-users ___ hpx-users mailing list hpx-users@stellar.cct.lsu.edu https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
[hpx-users] Report GSoC: Alternative Smart Executors
Hi, First of, I would like to apologize for submitting this report late. I forgot the deadline was 10h and I assume full responsibility for this mistake. I promise other reports will be submitted on time. Here is the progress in the project: Alternative Smart executors https://github.com/gablabc/hpxML/tree/submodules 0- The hpx repository within hpxml has been built with clang6.0.0 and boost1.67 on rostam. Some modifications had to be made concerning missing headers. The loop-convert executable used to extract features of given loops has been built. the path to hpx headers must me set manually when calling the executable but this will be changed further on in the project. 1- A python machine learning repository as been added to hpxml. This repository contains a python script that uses scikit-learn's algorithms on data files. Those algorithms are Support Vector Regression, Neural-Network regression and k-Nearest-Neighbors regression. The current data files used to train the algorithms have been previously generated by Zahra but soon I should be able to train the algorithms using my own data files. To compare the different algorithms, the kfold-cross-validation technique is used. the error chosen to compare the regressions with the test set is the mean absolute error. The algorithm with the lowest error will be chosen. Also, since right now, the target values for chunk_size and prefetching distance are on different scales, there is an option to fit the log(Y) instead of fitting Y dues ensuring that the targets values are on the same scale. 2- A training data repository has been added. The goal of this repository is to generate a framework that anyone can use to automatically generate data. The algorithm folder contains various functions that apply a for_each loop on a given lambda function with different chunk_size values and output the execution time for all the chunk-size candidates. The number of functions will continue to grow as the project moves one. To make data, the user can use the training.txt file which contains a list of the functions and the number of iterations they want to run. Then using the sbatch command sbatch train.sbatch training.txt the user can automatically run all the functions and the results will be written in a data file. What is left to be done in the near future. 1-Currently the data generated in the training repository doesn't extract features using loop-convert. This will have to be added to ensure that the data files contain all the information necessary to train the pythons machine learning algorithms. 2-Once an optimal regression has been found using kfold-cross-validation, the algorithm will be fully implemented in python as a way for me to get familiar with the algorithm. Thank you very much, Once again I would like to apologize for missing the deadline. Gabriel Laberge ___ hpx-users mailing list hpx-users@stellar.cct.lsu.edu https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
Re: [hpx-users] HPX Smart executors for_each and for_loop
Also I wonder, why the smart executors make_prefetcher_policy and adaptive_chunk_size are not present on the list of execution policies [1]https://stellar-group.github.io/hpx/docs/html/hpx/manual/parallel/executor_parameters.html Gabriel Laberge <gabriel.labe...@polymtl.ca> a écrit : > Ok thank you very much. > But I'm wondering why for_each loops are used in the article? > When code is shown in the article smart executors are used as > execution policies in for_each loops. > Is that something that was previously implemented? > Zahra Khatami <z.khatam...@gmail.com> a écrit : > >> Hi Gabriel, >> >> They are tested on HPX for loop. >> >> Zahra >> >> On Tue, Mar 13, 2018 at 9:27 AM Gabriel Laberge <gabriel.labe...@polymtl.ca> >> wrote: >> >>> Hi, >>> in the article [0] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf >>> smart executors adaptive_chunk_size and make_prefetcher_distance are >>> tested as execution policies on for_each loops. I was wondering if >>> they also work as execution policies of HPX's for_loop. >>> >>> Thank you. >>> Gabriel. >>> >>> >>> >>> ___ >>> hpx-users mailing list >>> hpx-users@stellar.cct.lsu.edu >>> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users >>> >> -- >> Best Regards, >> >> *Zahra Khatami* | Member of Technical Staff >> Virtual OS >> Oracle >> 400 Oracle Parkway >> Redwood City, CA 94065 > > > > ___ > hpx-users mailing list > hpx-users@stellar.cct.lsu.edu > https://mail.cct.lsu.edu/mailman/listinfo/hpx-users ___ hpx-users mailing list hpx-users@stellar.cct.lsu.edu https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
[hpx-users] HPX Smart executors for_each and for_loop
Hi, in the article [0] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf smart executors adaptive_chunk_size and make_prefetcher_distance are tested as execution policies on for_each loops. I was wondering if they also work as execution policies of HPX's for_loop. Thank you. Gabriel. ___ hpx-users mailing list hpx-users@stellar.cct.lsu.edu https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
[hpx-users] Generating Data for HPX smart executors
Hi, I had a questions on the way data was generated in order to train the logistics regressions models talked about in [0] https://arxiv.org/pdf/1711.01519.pdf For each of the training examples, the optimal execution policies,chunk sizes and prefetching distance had to be found before the training process in order to have good data. I wonder if the optimal parameters for the training examples were found by trial and error or if there is another technique. Thank you.. ___ hpx-users mailing list hpx-users@stellar.cct.lsu.edu https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
[hpx-users] Machine learning applied to HPX smart executors
Hi, In the article [0]https://arxiv.org/abs/1711.01519 It is written that a binary logistic regression was used to find the execution policy and that a multinomial regression was used to find the chunk size and the prefetching distance. Would there be a possibility to use only one regression to find all 3 parameters instead of using two? Thank you ___ hpx-users mailing list hpx-users@stellar.cct.lsu.edu https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
[hpx-users] HPX smart executors data generation
Hi, In have a question about the HPX smart executors talked about in this article https://arxiv.org/pdf/1711.01519.pdf . I'm not sure to understand the way the way the data is generated. As an example, let's say I want to optimize a matrix multiplication task. The executor will use a logistic regression to optimize the task but has the logistic regression already been trained with previous data from a large data set? Or does the executor generate data from the task I give it and then it trains a logistic regression using that data which would mean that the regression is perfectly optimized for the given task but take some time to train. Thank you very much, ___ hpx-users mailing list hpx-users@stellar.cct.lsu.edu https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
