Re: [hpx-users] [GSoC 2018] Are there any Programming Competency Test?

[Patrick Diehl]

Hi,

now we do not have tests. You should judge yourself. Please look into
our wiki and use the template for your proposal. I just had a look on
your proposal and it does not fit our requirements.

Best,

Patrick

On 26/03/18 10:03 AM, Recolic Keghart wrote:
> Hi,
> 
> I'm Bensong Liu, a second year undergraduate student. I'm currently
> finishing my proposal to HPX::PythonBindings. But I'm not sure how could
> I fill the area "Programming Competency".
> 
> I noticed that some organizations/projects provided some application
> tasks/programming competency tests, and are there any similar tests for
> this project?
> 
> Thanks a lot for your help.
> Bensong Liu
> 
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSoC 2018] Are there any Programming Competency Test?

[Recolic Keghart]

Hi,

I'm Bensong Liu, a second year undergraduate student. I'm currently
finishing my proposal to HPX::PythonBindings. But I'm not sure how could
I fill the area "Programming Competency".

I noticed that some organizations/projects provided some application
tasks/programming competency tests, and are there any similar tests for
this project?

Thanks a lot for your help.
Bensong Liu



signature.asc
Description: OpenPGP digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Lee Jin]

Hello Patrick Diehl:

Thank you very much for taking time reading my proposal. The opinion you
give is really helpful. I read the irc history and make some change on my
proposal draft. If you have time, can you go over it again and give me more
advises. The shared link is not changed.

Furthermore, when I am writing my proposal today, I come up with a
question: What will happen if a task runs on an hpx thread and it call some
non-hpx thread. Today, I try to write a small program using VideoCapture in
the main hpx thread. I initialize the hpx run time, in the hpx_main
function, I open my webcam and use highgui to display the captured image. I
look at the windows resource manager, the program has 21 threads. It seems
VideoCapture generates so many threads. I believe they can not be
hpx-thread, right? But it seems nothing bad happens, the small example just
works as I think.

Best Regards
Jin Li

2018-03-25 4:07 GMT+08:00 Patrick Diehl :

> Hi,
>
> I read your proposal and please look into the archive of the mailing
> list and our irc channel. We discussed several things there and plenty
> of them are missing in your proposal. Please include them and address
> our concerns we had for reading image from webcams and synchronize QT
> threads.
>
> Best,
>
> Patrick
>
> On 03/24/2018 02:29 PM, Lee Jin wrote:
> > Hi,
> >
> >   I have submitted my proposal draft to GSoC and make it shared. I
> > think that you can see it in the system. Please make comments on my
> > proposal. Your suggestions will be very useful for me.
> >
> >   Here is the shared link:
> >
> > https://docs.google.com/document/d/1QNVCvUpe-
> WSdmIMSmYdoEqybEVFknEljqo6bao7uFgA/edit?usp=sharing
> >
> > Best regards
> > Jin Li
> >
> > 2018-03-18 16:38 GMT+08:00 Lee Jin  > <mailto:lijin199...@gmail.com>>:
> >
> > Hi  Patrick
> >
> >Thank you for reminding. I am aware of the proposal deadline.
> >
> > Best Regards
> > Jin Li
> >
> > 2018-03-17 22:55 GMT+08:00 Patrick Diehl  > <mailto:patrickdie...@gmail.com>>:
> >
> > Hi Jin Li,
> >
> > so you know that you have to submit a proposal until 27.03.2018?
> >
> > Best,
> >
> > Patrick
> >
> > On 03/17/2018 10:31 AM, Lee Jin wrote:
> > > Hello:
> > >
> > > Thank you very much for your advice. It will be much easier to
> learn
> > > through video tutorials. I will try my best to understand the
> library
> > > before the project starts.
> > >
> > > Best regards
> > > Jin Li
> > >
> > > 2018-03-16 21:07 GMT+08:00 Biddiscombe, John A. <
> biddi...@cscs.ch <mailto:biddi...@cscs.ch>
> > > <mailto:biddi...@cscs.ch <mailto:biddi...@cscs.ch>>>:
> > >
> > > Hi Jin Li
> > >
> > > __ __
> > >
> > > I must apologise for self promotion, but we put some
> tutorial videos
> > > on youtube that might be of use to you
> > >
> > > https://www.youtube.com/results?search_query=CSCS+HPX
> > <https://www.youtube.com/results?search_query=CSCS+HPX>
> > > <https://www.youtube.com/results?search_query=CSCS+HPX
> > <https://www.youtube.com/results?search_query=CSCS+HPX>>
> > >
> > > __ __
> > >
> > > The full set from 2016 tutorial are there, and the first
> couple from
> > > the 2017 tutorial too - the content is the same, but
> perhaps the
> > > 2017 version is slightly more up to date.
> > >
> > > __ __
> > >
> > > For the openCV project it will be important to understand
> thread
> > > pools and how to use the new resource partitioner to allow
> HPX to
> > > work on one set of threads, whilst things like Qt gui
> threads,
> > > webcam capture threads, etc work on non hpx threads.
> > >
> > > __ __
> > >
> > > JB
> > >
> > > __ __
> > >
> > > *From:*hpx-users-boun...@stellar.cct.lsu.edu
> > <mailto:hpx-users-boun...@stellar.cct.lsu.edu>
> &

Re: [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Patrick Diehl]

Hi,

I read your proposal and please look into the archive of the mailing
list and our irc channel. We discussed several things there and plenty
of them are missing in your proposal. Please include them and address
our concerns we had for reading image from webcams and synchronize QT
threads.

Best,

Patrick

On 03/24/2018 02:29 PM, Lee Jin wrote:
> Hi,
> 
>       I have submitted my proposal draft to GSoC and make it shared. I
> think that you can see it in the system. Please make comments on my
> proposal. Your suggestions will be very useful for me.
> 
>       Here is the shared link:
>      
> https://docs.google.com/document/d/1QNVCvUpe-WSdmIMSmYdoEqybEVFknEljqo6bao7uFgA/edit?usp=sharing
> 
> Best regards
> Jin Li
> 
> 2018-03-18 16:38 GMT+08:00 Lee Jin  <mailto:lijin199...@gmail.com>>:
> 
> Hi  Patrick
> 
>    Thank you for reminding. I am aware of the proposal deadline.
> 
> Best Regards
> Jin Li
> 
> 2018-03-17 22:55 GMT+08:00 Patrick Diehl  <mailto:patrickdie...@gmail.com>>:
> 
> Hi Jin Li,
> 
> so you know that you have to submit a proposal until 27.03.2018?
> 
> Best,
> 
> Patrick
> 
> On 03/17/2018 10:31 AM, Lee Jin wrote:
> > Hello:
> >
> > Thank you very much for your advice. It will be much easier to learn
> > through video tutorials. I will try my best to understand the 
> library
> > before the project starts.
> >
> > Best regards
> > Jin Li
> >
> > 2018-03-16 21:07 GMT+08:00 Biddiscombe, John A.  <mailto:biddi...@cscs.ch>
> > <mailto:biddi...@cscs.ch <mailto:biddi...@cscs.ch>>>:
> >
> >     Hi Jin Li
> >
> >     __ __
> >
> >     I must apologise for self promotion, but we put some tutorial 
> videos
> >     on youtube that might be of use to you
> >
> >     https://www.youtube.com/results?search_query=CSCS+HPX
> <https://www.youtube.com/results?search_query=CSCS+HPX>
> >     <https://www.youtube.com/results?search_query=CSCS+HPX
> <https://www.youtube.com/results?search_query=CSCS+HPX>>
> >
> >     __ __
> >
> >     The full set from 2016 tutorial are there, and the first couple 
> from
> >     the 2017 tutorial too - the content is the same, but perhaps the
> >     2017 version is slightly more up to date.
> >
> >     __ __
> >
> >     For the openCV project it will be important to understand thread
> >     pools and how to use the new resource partitioner to allow HPX 
> to
> >     work on one set of threads, whilst things like Qt gui threads,
> >     webcam capture threads, etc work on non hpx threads.
> >
> >     __ __
> >
> >     JB
> >
> >     __ __
> >
> >     *From:*hpx-users-boun...@stellar.cct.lsu.edu
> <mailto:hpx-users-boun...@stellar.cct.lsu.edu>
> >     <mailto:hpx-users-boun...@stellar.cct.lsu.edu
> <mailto:hpx-users-boun...@stellar.cct.lsu.edu>>
> >      <mailto:hpx-users-boun...@stellar.cct.lsu.edu>
> >     <mailto:hpx-users-boun...@stellar.cct.lsu.edu
> <mailto:hpx-users-boun...@stellar.cct.lsu.edu>>> *On Behalf Of
> *Lee Jin
> >     *Sent:* 16 March 2018 13:34
> >     *To:* hpx-users@stellar.cct.lsu.edu
> <mailto:hpx-users@stellar.cct.lsu.edu>
> >     <mailto:hpx-users@stellar.cct.lsu.edu
> <mailto:hpx-users@stellar.cct.lsu.edu>>
> >     *Subject:* [hpx-users] [GSoC 2018] Applying for HPX
> Backend for
> >     OpenCV
> >
> >     __ __
> >
> >     Hello:
> >
> >     __ __
> >
> >     I am Jin Li, a postgraduate from Beihang University, China. I am
> >     interested in working on "HPX Backend for OpenCV" project.
> >
> >     __ __
> >
> >     I majored in image processing and patter recognition. So I need 
> to
> >     use OpenCV frequently, I have viewed the code of parallel.cpp 
> before
> >     to understand how OpenC

Re: [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Lee Jin]

Hi,

  I have submitted my proposal draft to GSoC and make it shared. I
think that you can see it in the system. Please make comments on my
proposal. Your suggestions will be very useful for me.

  Here is the shared link:

https://docs.google.com/document/d/1QNVCvUpe-WSdmIMSmYdoEqybEVFknEljqo6bao7uFgA/edit?usp=sharing

Best regards
Jin Li

2018-03-18 16:38 GMT+08:00 Lee Jin :

> Hi  Patrick
>
>Thank you for reminding. I am aware of the proposal deadline.
>
> Best Regards
> Jin Li
>
> 2018-03-17 22:55 GMT+08:00 Patrick Diehl :
>
>> Hi Jin Li,
>>
>> so you know that you have to submit a proposal until 27.03.2018?
>>
>> Best,
>>
>> Patrick
>>
>> On 03/17/2018 10:31 AM, Lee Jin wrote:
>> > Hello:
>> >
>> > Thank you very much for your advice. It will be much easier to learn
>> > through video tutorials. I will try my best to understand the library
>> > before the project starts.
>> >
>> > Best regards
>> > Jin Li
>> >
>> > 2018-03-16 21:07 GMT+08:00 Biddiscombe, John A. > > <mailto:biddi...@cscs.ch>>:
>> >
>> > Hi Jin Li
>> >
>> > __ __
>> >
>> > I must apologise for self promotion, but we put some tutorial videos
>> > on youtube that might be of use to you
>> >
>> > https://www.youtube.com/results?search_query=CSCS+HPX
>> > <https://www.youtube.com/results?search_query=CSCS+HPX>
>> >
>> > __ __
>> >
>> > The full set from 2016 tutorial are there, and the first couple from
>> > the 2017 tutorial too - the content is the same, but perhaps the
>> > 2017 version is slightly more up to date.
>> >
>> > __ __
>> >
>> > For the openCV project it will be important to understand thread
>> > pools and how to use the new resource partitioner to allow HPX to
>> > work on one set of threads, whilst things like Qt gui threads,
>> > webcam capture threads, etc work on non hpx threads.
>> >
>> >     __ __
>> >
>> > JB
>> >
>> > __ __
>> >
>> > *From:*hpx-users-boun...@stellar.cct.lsu.edu
>> > <mailto:hpx-users-boun...@stellar.cct.lsu.edu>
>> > > > <mailto:hpx-users-boun...@stellar.cct.lsu.edu>> *On Behalf Of *Lee
>> Jin
>> > *Sent:* 16 March 2018 13:34
>> > *To:* hpx-users@stellar.cct.lsu.edu
>> > <mailto:hpx-users@stellar.cct.lsu.edu>
>> > *Subject:* [hpx-users] [GSoC 2018] Applying for HPX Backend for
>> > OpenCV
>> >
>> > __ __
>> >
>> > Hello:
>> >
>> > __ __
>> >
>> > I am Jin Li, a postgraduate from Beihang University, China. I am
>> > interested in working on "HPX Backend for OpenCV" project.
>> >
>> > __ __
>> >
>> > I majored in image processing and patter recognition. So I need to
>> > use OpenCV frequently, I have viewed the code of parallel.cpp before
>> > to understand how OpenCV accelerate with multi-core architecture. I
>> > am familiar with C++ and I have some knowledge on thread library
>> > like pthread and VC thread,
>> >
>> > __ __
>> >
>> > However, I am not quite familiar with the HPX library. So maybe I
>> > need to spend some time getting familiar with the APIs.
>> >
>> > __ __
>> >
>> > Do you have any suggestion on what should I do to apply for this
>> > project?
>> >
>> > __ __
>> >
>> > Best regards.
>> >
>> > Jin Li
>> >
>> > __ __
>> >
>> >
>> > ___
>> > hpx-users mailing list
>> > hpx-users@stellar.cct.lsu.edu <mailto:hpx-users@stellar.cct.lsu.edu
>> >
>> > https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>> > <https://mail.cct.lsu.edu/mailman/listinfo/hpx-users>
>> >
>> >
>> >
>> >
>> > ___
>> > hpx-users mailing list
>> > hpx-users@stellar.cct.lsu.edu
>> > https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>> >
>>
>> --
>> Patrick Diehl
>> diehlpk.github.io
>>
>>
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018

[Andreas Schäfer]

Hey Alanas,

thanks for getting in touch.

On 19:45 Fri 16 Mar , Alanas Plascinskas wrote:
> Hey,
> 
> I wanted to ask about the availability of your projects for GSoC 2018.
> 
> I would mainly be interested in these projects: All to All Communications,
> Conflict (Range-Based) Locks and Newtonian Physics Sandbox but I"m open to
> any suggestions as well.

The Newtonian Physics Sandbox project is available until someone
solves it. :-)

> Have any of these received any serious proposals and if so do you have any
> other projects that would be important for you and are still open?

I haven't seen any proposal this year yet. In my experience they
usually come in hours before the deadline. That said, acceptance is,
as with probably all GSoC projects, conditional to a vote from all
mentors. So having no competition doesn't mean a free ticket. The
proposal still needs to be good. Let me know if I can answer any
questions on it.

Thanks
-Andi


-- 
==
Andreas Schäfer

HPC and Supercomputing for Computer Simulations
LibGeoDecomp project lead, http://www.libgeodecomp.org

PGP/GPG key via keyserver

I'm an SRE @ Google, this is a private account though.
All mails are my own and not Google's.
==

(\___/)
(+'.'+)
(")_(")
This is Bunny. Copy and paste Bunny into your
signature to help him gain world domination!


signature.asc
Description: Digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018

[권태국]

Hi,

I'm Taeguk Kwon who participated in GSoC 2017 last year.

Like you, I also had only 1-2 weeks until deadline last year. I started to
select organizations in student application period. That period was the
first time that I heard about HPX.
Although there is only a few time to prepare, I think you can do if you do
your best with efficient strategy.

Good luck,

taeguk

2018. 3. 17. 오전 10:21에 "Alanas Plascinskas" 님이
작성:

> Hey,
>
> I wanted to ask about the availability of your projects for GSoC 2018.
>
> I would mainly be interested in these projects: All to All Communications,
> Conflict (Range-Based) Locks and Newtonian Physics Sandbox but I"m open to
> any suggestions as well.
>
> Have any of these received any serious proposals and if so do you have any
> other projects that would be important for you and are still open?
>
> A little bit about my background (the first part of the form that you ask
> to fill):
>
>
>- Name: Alanas Plascinskas
>- College/University: University of Toronto (Year Abroad), University
>of Edinburgh (Home)
>- Course/Major: Computer Science & Mathematics
>- Degree Program: BSc
>- Email: alanas.plascins...@gmail.com
>- Homepage: https://www.linkedin.com/in/alanaspla/
>- Availability:
>   - Available for the whole duration of the project (mid-May to
>   late-August)
>   - What are your intended start and end dates? 14 May to 14 August
>   - What other factors affect your availability (exams, courses,
>   moving, work, etc.)? I will be available throughout without any major
>   disruptions
>
> Best,
> Alanas
>
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Lee Jin]

Hi  Patrick

   Thank you for reminding. I am aware of the proposal deadline.

Best Regards
Jin Li

2018-03-17 22:55 GMT+08:00 Patrick Diehl :

> Hi Jin Li,
>
> so you know that you have to submit a proposal until 27.03.2018?
>
> Best,
>
> Patrick
>
> On 03/17/2018 10:31 AM, Lee Jin wrote:
> > Hello:
> >
> > Thank you very much for your advice. It will be much easier to learn
> > through video tutorials. I will try my best to understand the library
> > before the project starts.
> >
> > Best regards
> > Jin Li
> >
> > 2018-03-16 21:07 GMT+08:00 Biddiscombe, John A.  > <mailto:biddi...@cscs.ch>>:
> >
> > Hi Jin Li
> >
> > __ __
> >
> > I must apologise for self promotion, but we put some tutorial videos
> > on youtube that might be of use to you
> >
> > https://www.youtube.com/results?search_query=CSCS+HPX
> > <https://www.youtube.com/results?search_query=CSCS+HPX>
> >
> > __ __
> >
> > The full set from 2016 tutorial are there, and the first couple from
> > the 2017 tutorial too - the content is the same, but perhaps the
> > 2017 version is slightly more up to date.
> >
> > __ __
> >
> > For the openCV project it will be important to understand thread
> > pools and how to use the new resource partitioner to allow HPX to
> > work on one set of threads, whilst things like Qt gui threads,
> > webcam capture threads, etc work on non hpx threads.
> >
> > __ __
> >
> > JB
> >
> > __ __
> >
> > *From:*hpx-users-boun...@stellar.cct.lsu.edu
> >     <mailto:hpx-users-boun...@stellar.cct.lsu.edu>
> >  > <mailto:hpx-users-boun...@stellar.cct.lsu.edu>> *On Behalf Of *Lee
> Jin
> > *Sent:* 16 March 2018 13:34
> > *To:* hpx-users@stellar.cct.lsu.edu
> > <mailto:hpx-users@stellar.cct.lsu.edu>
> > *Subject:* [hpx-users] [GSoC 2018] Applying for HPX Backend for
> > OpenCV
> >
> > __ __
> >
> > Hello:
> >
> > __ __
> >
> > I am Jin Li, a postgraduate from Beihang University, China. I am
> > interested in working on "HPX Backend for OpenCV" project.
> >
> > __ __
> >
> > I majored in image processing and patter recognition. So I need to
> > use OpenCV frequently, I have viewed the code of parallel.cpp before
> > to understand how OpenCV accelerate with multi-core architecture. I
> > am familiar with C++ and I have some knowledge on thread library
> > like pthread and VC thread,
> >
> > __ __
> >
> > However, I am not quite familiar with the HPX library. So maybe I
> > need to spend some time getting familiar with the APIs.
> >
> > __ __
> >
> > Do you have any suggestion on what should I do to apply for this
> > project?
> >
> > __ __
> >
> > Best regards.
> >
> > Jin Li
> >
> > __ __
> >
> >
> > ___
> > hpx-users mailing list
> > hpx-users@stellar.cct.lsu.edu <mailto:hpx-users@stellar.cct.lsu.edu>
> > https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> > <https://mail.cct.lsu.edu/mailman/listinfo/hpx-users>
> >
> >
> >
> >
> > ___
> > hpx-users mailing list
> > hpx-users@stellar.cct.lsu.edu
> > https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> >
>
> --
> Patrick Diehl
> diehlpk.github.io
>
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018

[Biddiscombe, John A.]

Alanas

We haven’t had anyone else interested in the all-to-all communications project 
yet.
The description on the web page dates back to last year - but we’ve had some 
new ideas since then (or at least I have had), not so sure about the other 
potential mentors.

We added a libfabric parcelport last year that gives very high performance 
using rdma methods - its quite low level, working right off the network layer 
and integrating into the HPX parcelport framework.

A chap at ETHZ has developed a library for All-toAll communication that would 
fit very nicely with our libfabric implementation - it uses tree methods to 
minimize the total number of messges sent and also supports offloading od some 
operations to the network - if the network has logic capability (modern 
networks have this capability in the switches). If the network doesn’ then an 
abstraction can be created to handle it.
There’s a paper and code here
https://spcl.inf.ethz.ch/Research/Parallel_Programming/FFlib/

This woukd require pretty good knowledge of both the libfabric layer and also 
the library mentioned, so it would be quite a hard project - but if you took it 
on and were able to get even 1 of the algorithms (allGather/AllReduce/etc) 
working inside HPX, then it would be a fantastic contribution. I have not had 
time to work on it myself, but it’s been high on my to-do list for some time.

Have a skim through that material and look at the libfabric web pages - if 
you’re willing to try, please let us know, there’s not much time till the 
project dedline

JB

From: hpx-users-boun...@stellar.cct.lsu.edu 
 On Behalf Of Alanas Plascinskas
Sent: 17 March 2018 00:46
To: hpx-users@stellar.cct.lsu.edu
Subject: [hpx-users] GSoC 2018

Hey,

I wanted to ask about the availability of your projects for GSoC 2018.

I would mainly be interested in these projects: All to All Communications, 
Conflict (Range-Based) Locks and Newtonian Physics Sandbox but I"m open to any 
suggestions as well.

Have any of these received any serious proposals and if so do you have any 
other projects that would be important for you and are still open?

A little bit about my background (the first part of the form that you ask to 
fill):


  *   Name: Alanas Plascinskas
  *   College/University: University of Toronto (Year Abroad), University of 
Edinburgh (Home)
  *   Course/Major: Computer Science & Mathematics
  *   Degree Program: BSc
  *   Email: alanas.plascins...@gmail.com<mailto:alanas.plascins...@gmail.com>
  *   Homepage: https://www.linkedin.com/in/alanaspla/
  *   Availability:

 *   Available for the whole duration of the project (mid-May to 
late-August)
 *   What are your intended start and end dates? 14 May to 14 August
 *   What other factors affect your availability (exams, courses, moving, 
work, etc.)? I will be available throughout without any major disruptions
Best,
Alanas
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018

[Patrick Diehl]

Hi Alanas,

some students are interested to these proposals. Also you are very late
on contacting us and the deadline for submitting a proposal is at the
27.03.2018.

Best,

Patrick

On 16/03/18 07:45 PM, Alanas Plascinskas wrote:
> Hey, 
> 
> I wanted to ask about the availability of your projects for GSoC 2018. 
> 
> I would mainly be interested in these projects: All to All
> Communications, Conflict (Range-Based) Locks and Newtonian Physics
> Sandbox but I"m open to any suggestions as well.
> 
> Have any of these received any serious proposals and if so do you have
> any other projects that would be important for you and are still open?
> 
> A little bit about my background (the first part of the form that you
> ask to fill): 
> 
>   * Name: Alanas Plascinskas
>   * College/University: University of Toronto (Year Abroad), University
> of Edinburgh (Home)
>   * Course/Major: Computer Science & Mathematics
>   * Degree Program: BSc
>   * Email: alanas.plascins...@gmail.com
> 
>   * Homepage: https://www.linkedin.com/in/alanaspla/
>   * Availability:
>   o Available for the whole duration of the project (mid-May to
> late-August)
>   o What are your intended start and end dates? 14 May to 14 August
>   o What other factors affect your availability (exams, courses,
> moving, work, etc.)? I will be available throughout without any
> major disruptions
> 
> Best, 
> Alanas
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Patrick Diehl]

Hi Jin Li,

so you know that you have to submit a proposal until 27.03.2018?

Best,

Patrick

On 03/17/2018 10:31 AM, Lee Jin wrote:
> Hello:
> 
> Thank you very much for your advice. It will be much easier to learn
> through video tutorials. I will try my best to understand the library
> before the project starts.
> 
> Best regards
> Jin Li
> 
> 2018-03-16 21:07 GMT+08:00 Biddiscombe, John A.  <mailto:biddi...@cscs.ch>>:
> 
> Hi Jin Li
> 
> __ __
> 
> I must apologise for self promotion, but we put some tutorial videos
> on youtube that might be of use to you
> 
> https://www.youtube.com/results?search_query=CSCS+HPX
> <https://www.youtube.com/results?search_query=CSCS+HPX>
> 
> __ __
> 
> The full set from 2016 tutorial are there, and the first couple from
> the 2017 tutorial too - the content is the same, but perhaps the
> 2017 version is slightly more up to date.
> 
> __ __
> 
> For the openCV project it will be important to understand thread
> pools and how to use the new resource partitioner to allow HPX to
> work on one set of threads, whilst things like Qt gui threads,
> webcam capture threads, etc work on non hpx threads.
> 
> __ __
> 
> JB
> 
> __ __
> 
> *From:*hpx-users-boun...@stellar.cct.lsu.edu
> <mailto:hpx-users-boun...@stellar.cct.lsu.edu>
>  <mailto:hpx-users-boun...@stellar.cct.lsu.edu>> *On Behalf Of *Lee Jin
> *Sent:* 16 March 2018 13:34
> *To:* hpx-users@stellar.cct.lsu.edu
> <mailto:hpx-users@stellar.cct.lsu.edu>
> *Subject:* [hpx-users] [GSoC 2018] Applying for HPX Backend for
> OpenCV
> 
> __ __
> 
> Hello:
> 
> __ __
> 
> I am Jin Li, a postgraduate from Beihang University, China. I am
> interested in working on "HPX Backend for OpenCV" project.
> 
> __ __
> 
> I majored in image processing and patter recognition. So I need to
> use OpenCV frequently, I have viewed the code of parallel.cpp before
> to understand how OpenCV accelerate with multi-core architecture. I
> am familiar with C++ and I have some knowledge on thread library
> like pthread and VC thread,
> 
> __ __
> 
> However, I am not quite familiar with the HPX library. So maybe I
> need to spend some time getting familiar with the APIs.
> 
> __ __
> 
> Do you have any suggestion on what should I do to apply for this
> project?
> 
> __ __
> 
> Best regards.
> 
> Jin Li
> 
> __ __
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu <mailto:hpx-users@stellar.cct.lsu.edu>
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> <https://mail.cct.lsu.edu/mailman/listinfo/hpx-users>
> 
> 
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 

-- 
Patrick Diehl
diehlpk.github.io



signature.asc
Description: OpenPGP digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Lee Jin]

Hello:

Thank you very much for your advice. It will be much easier to learn
through video tutorials. I will try my best to understand the library
before the project starts.

Best regards
Jin Li

2018-03-16 21:07 GMT+08:00 Biddiscombe, John A. :

> Hi Jin Li
>
>
>
> I must apologise for self promotion, but we put some tutorial videos on
> youtube that might be of use to you
>
> https://www.youtube.com/results?search_query=CSCS+HPX
>
>
>
> The full set from 2016 tutorial are there, and the first couple from the
> 2017 tutorial too - the content is the same, but perhaps the 2017 version
> is slightly more up to date.
>
>
>
> For the openCV project it will be important to understand thread pools and
> how to use the new resource partitioner to allow HPX to work on one set of
> threads, whilst things like Qt gui threads, webcam capture threads, etc
> work on non hpx threads.
>
>
>
> JB
>
>
>
> *From:* hpx-users-boun...@stellar.cct.lsu.edu  cct.lsu.edu> *On Behalf Of *Lee Jin
> *Sent:* 16 March 2018 13:34
> *To:* hpx-users@stellar.cct.lsu.edu
> *Subject:* [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV
>
>
>
> Hello:
>
>
>
> I am Jin Li, a postgraduate from Beihang University, China. I am
> interested in working on "HPX Backend for OpenCV" project.
>
>
>
> I majored in image processing and patter recognition. So I need to use
> OpenCV frequently, I have viewed the code of parallel.cpp before to
> understand how OpenCV accelerate with multi-core architecture. I am
> familiar with C++ and I have some knowledge on thread library like pthread
> and VC thread,
>
>
>
> However, I am not quite familiar with the HPX library. So maybe I need to
> spend some time getting familiar with the APIs.
>
>
>
> Do you have any suggestion on what should I do to apply for this project?
>
>
>
> Best regards.
>
> Jin Li
>
>
>
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>
>
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC 2018

[Alanas Plascinskas]

Hey,

I wanted to ask about the availability of your projects for GSoC 2018.

I would mainly be interested in these projects: All to All Communications,
Conflict (Range-Based) Locks and Newtonian Physics Sandbox but I"m open to
any suggestions as well.

Have any of these received any serious proposals and if so do you have any
other projects that would be important for you and are still open?

A little bit about my background (the first part of the form that you ask
to fill):


   - Name: Alanas Plascinskas
   - College/University: University of Toronto (Year Abroad), University of
   Edinburgh (Home)
   - Course/Major: Computer Science & Mathematics
   - Degree Program: BSc
   - Email: alanas.plascins...@gmail.com
   - Homepage: https://www.linkedin.com/in/alanaspla/
   - Availability:
  - Available for the whole duration of the project (mid-May to
  late-August)
  - What are your intended start and end dates? 14 May to 14 August
  - What other factors affect your availability (exams, courses,
  moving, work, etc.)? I will be available throughout without any major
  disruptions

Best,
Alanas
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Biddiscombe, John A.]

Hi Jin Li

I must apologise for self promotion, but we put some tutorial videos on youtube 
that might be of use to you
https://www.youtube.com/results?search_query=CSCS+HPX

The full set from 2016 tutorial are there, and the first couple from the 2017 
tutorial too - the content is the same, but perhaps the 2017 version is 
slightly more up to date.

For the openCV project it will be important to understand thread pools and how 
to use the new resource partitioner to allow HPX to work on one set of threads, 
whilst things like Qt gui threads, webcam capture threads, etc work on non hpx 
threads.

JB

From: hpx-users-boun...@stellar.cct.lsu.edu 
 On Behalf Of Lee Jin
Sent: 16 March 2018 13:34
To: hpx-users@stellar.cct.lsu.edu
Subject: [hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

Hello:

I am Jin Li, a postgraduate from Beihang University, China. I am interested in 
working on "HPX Backend for OpenCV" project.

I majored in image processing and patter recognition. So I need to use OpenCV 
frequently, I have viewed the code of parallel.cpp before to understand how 
OpenCV accelerate with multi-core architecture. I am familiar with C++ and I 
have some knowledge on thread library like pthread and VC thread,

However, I am not quite familiar with the HPX library. So maybe I need to spend 
some time getting familiar with the APIs.

Do you have any suggestion on what should I do to apply for this project?

Best regards.
Jin Li

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSoC 2018] Applying for HPX Backend for OpenCV

[Lee Jin]

Hello:

I am Jin Li, a postgraduate from Beihang University, China. I am interested
in working on "HPX Backend for OpenCV" project.

I majored in image processing and patter recognition. So I need to use
OpenCV frequently, I have viewed the code of parallel.cpp before to
understand how OpenCV accelerate with multi-core architecture. I am
familiar with C++ and I have some knowledge on thread library like pthread
and VC thread,

However, I am not quite familiar with the HPX library. So maybe I need to
spend some time getting familiar with the APIs.

Do you have any suggestion on what should I do to apply for this project?

Best regards.
Jin Li
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2018

[Parimi Viraj]

Hi everyone!

I am interested in contributing to HPX during Summer 2018 through GSOC.

Firstly, I would like to introduce myself. I have been working on parallel
programming over the last couple of months. During this time I have made a
static and dynamic task mapping runtimes which provides an easy interface
to work on compared to Pthreads. Also, I have been learning CUDA by
implementing parallel DFS. I find parallel programming paradigm quite
intriguing.

I looked up your project ideas for GSOC 2018 and found 2 projects that
seemed to align perfectly with my interests.


   1. HPX Backend for OpenCV
   2. Concurrent Data structure Support

Can you guys point me to some issues which I could solve so that I can get
a better understanding of your codebase?

Regards,
Viraj Parimi 
‌
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSOC 2018, question about "smart executors" paper

[Zahra Khatami]

Hi Ray,

In my research, these parameters are also heuristicaly found. Basically we
tested our framework on hpx for-each using different selected chunk sizes
each time. These loops had different parameters ( static and dynamic) which
reacted differently for those chunk size candidates. Then, we determined
which chunk size resulted in better performance on each of those loops.
That’s how we collected our training data, which we trained our model using
them. You can find training data in HPXML on hpx GitHub.

Thanks,
Zahra,

On Wed, Feb 21, 2018 at 4:21 AM 김규래  wrote:

> Hi Zahra,
> I've read your amazong paper for quite a while.
> There's one thing I cannot find answers.
>
> What were the label data that the models were trained on?
> I cannot find explanation about how 'optimal chunk size' and 'optimal
> prefetching distance' labels were collected.
>
> Previous work mostly states heuristically found labels.
> In the case of your paper, how was this done?
>
> My respects.
> msca8h at naver dot com
> msca8h at sogang dot ac dot kr
> Ray Kim
>
-- 
Best Regards, Zahra Khatami | PhD Student Center for Computation &
Technology (CCT) School of Electrical Engineering & Computer Science
Louisiana State University 2027 Digital Media Center (DMC) Baton Rouge, LA
70803
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSOC 2018, question about "smart executors" paper

[김규래]

Hi Zahra,
I've read your amazong paper for quite a while.
There's one thing I cannot find answers.

What were the label data that the models were trained on?
I cannot find explanation about how 'optimal chunk size' and 'optimal 
prefetching distance' labels were collected.

Previous work mostly states heuristically found labels.
In the case of your paper, how was this done?

My respects.
msca8h at naver dot com
msca8h at sogang dot ac dot kr
Ray Kim___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSOC 2018] Add More Arithmetic Performance Counters

[surya priy]

Hello all !

I , SURYA PRIY would like to work on *"Add More Arithmetic Performance
Counters and Adding PARALLEL ALGORITHMS " *in the coming GSOC 2018 with
STELLAR GROUP. I am B.TECH student with Computer Science stream and have
previously worked with Chapel  .
Sorry for being late in introducing myself in this group . Actually, I am
studying about HPX framework and learning them . I have introduced myself
on IRC with username *victor_ludorum*  .  So, As per the issue
 , there should be
implementation of some more arithmetic performance counters having
statistical properties. I have done some research on this and found the
statistical functions in BOOST

.
Some of them have been already implemented but many of them are left .I
would mention some of the functions that should be implemented here like

   - COUNT
   - COVARIANCE
   - DENSITY
   - ERROR OF MEANS
   - KURTOSIS
   - MOMENT
   - TAIL
   - SKEWNESS

and some important numeric functions too like

   - LOG
   - EXPONENT
   - ABS

I have also thought to implement some *PARALLEL ALGORITHMS* left
unimplemented from the List
 like

   - PARTIAL_SORT
   - NTH_ELEMENT
   - STABLE SORT

and more important should be suggested that should be work on .
Please suggest how do I start my work on this .

Thanks .

Regards
Surya Priy

Github profile Link - victor-ludorum 
My work in Chapel - PR

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2018] Histogram Performance Counter

[Simberg Mikael]

Hi Saurav,

I'd also be happy to hear more about HdrHistogram. It seems to me that the main 
feature is the HDR-ness. This means roughly the same as having exponentially 
spaced bins in the histogram?

More generally, if HdrHistogram offers compelling features over the one we 
already have, it is definitely a useful addition. Concurrency is in any case a 
must. If you haven't already seen the "More Arithmetic Performance Counters" 
and "Augment CSV Files" projects have a look at them as parts of those can 
(more likely should) be combined into one project. "More Arithmetic Performance 
Counters" has already been done by Hartmut in PR 2745, but more operations 
could potentially be useful (log, exp?). If you'd like to do more data analysis 
you should look at "Augment CSV Files". You could mix and match parts of these 
into a nice package.

Looking at the histogram implementation that Hartmut linked is a good place to 
start, as is the rest of the performance counter framework. That should give 
you a better idea of what we already have and what we might be lacking.

Hop onto IRC (#ste||ar on freenode) if you have more detailed questions!

Kind regards,
Mikael

From: hpx-users-boun...@stellar.cct.lsu.edu 
[hpx-users-boun...@stellar.cct.lsu.edu] on behalf of Hartmut Kaiser 
[hartmut.kai...@gmail.com]
Sent: Monday, February 19, 2018 10:57 PM
To: hpx-users@stellar.cct.lsu.edu; 'Saurav Sachidanand'
Subject: Re: [hpx-users] [GSoC 2018] Histogram Performance Counter

Hey Saurav,

> My name is Saurav Sachidanand and I wish to participate in GSoC 2018.
> I'm intrigued with the Histogram Performance Counter project. I've
> previously worked with HdrHistorgram [1], which is a histogram
> implementation that can record integer and float values with high range
> and precission, with fixed space and time costs. Implementations in
> several languages exist, but not in C++. The reference Java version [2]
> provides several more features, including a concurrent version of the
> histogram. Would implementing a generic C++ concurrent HdrHistgram
> perforamance counter, supporting all features from the Java version and
> utilizing HPX's APIs, be a useful addition?
>
> This idea came to mind beacuse I participated in GSoC last year [3], where
> I built a Performance Co-Pilot instrumentation library in Rust, and I had
> to integrate HdrHistogram into the API [4].
>
> Any guidance and feedback will be greatly appreciated.

I don't know anything about the HdrHistgram you're referring to. Would you care 
to elaborate?

We have a histogram implementation in HPX 
(https://github.com/STEllAR-GROUP/hpx/blob/master/hpx/util/histogram.hpp) which 
is currently used for a special performance counter in the parcel (message) 
coalescing layer. But this does not have to be used for a general purpose 
counter.

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu

>
> Thanks,
> Saurav
>
> [1] - https://hdrhistogram.github.io/HdrHistogram/
> [2] - https://github.com/HdrHistogram/HdrHistogram
> [3] -
>  https://summerofcode.withgoogle.com/archive/2017/projects/479329678209843
> 2/
> [4] - https://github.com/performancecopilot/hornet#histogram

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] [GSoC 2018] Histogram Performance Counter

[Hartmut Kaiser]

Hey Saurav,

> My name is Saurav Sachidanand and I wish to participate in GSoC 2018.
> I'm intrigued with the Histogram Performance Counter project. I've
> previously worked with HdrHistorgram [1], which is a histogram
> implementation that can record integer and float values with high range
> and precission, with fixed space and time costs. Implementations in
> several languages exist, but not in C++. The reference Java version [2]
> provides several more features, including a concurrent version of the
> histogram. Would implementing a generic C++ concurrent HdrHistgram
> perforamance counter, supporting all features from the Java version and
> utilizing HPX's APIs, be a useful addition?
> 
> This idea came to mind beacuse I participated in GSoC last year [3], where
> I built a Performance Co-Pilot instrumentation library in Rust, and I had
> to integrate HdrHistogram into the API [4].
> 
> Any guidance and feedback will be greatly appreciated.

I don't know anything about the HdrHistgram you're referring to. Would you care 
to elaborate?

We have a histogram implementation in HPX 
(https://github.com/STEllAR-GROUP/hpx/blob/master/hpx/util/histogram.hpp) which 
is currently used for a special performance counter in the parcel (message) 
coalescing layer. But this does not have to be used for a general purpose 
counter.

Regards Hartmut
---
http://boost-spirit.com
http://stellar.cct.lsu.edu

> 
> Thanks,
> Saurav
> 
> [1] - https://hdrhistogram.github.io/HdrHistogram/
> [2] - https://github.com/HdrHistogram/HdrHistogram
> [3] -
>  https://summerofcode.withgoogle.com/archive/2017/projects/479329678209843
> 2/
> [4] - https://github.com/performancecopilot/hornet#histogram

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Patricia Grubel]

As far as performance counters you may wish to experiment with the overhead 
counter in addition to the idle-rate counter.

Pat
> On Feb 19, 2018, at 12:26 PM, Zahra Khatami  wrote:
> 
> Hi Ray,
> 
> If you refer to the published paper, you could get more information. 
> Generally talking, this project uses compiler and runtime system to gather 
> both static and dynamic information to set HPX algorithm parameters such as 
> chunk sizes efficiently. Static information are gathered by a compiler, which 
> we used clang and we developed a new class for clang for this purpose. 
> Dynamic information are gathered by new HPX policies that we developed for 
> this purpose. You can look at the example in HPXML in HPX GitHub.
> 
> Thanks,
> Zahra
> 
> On Mon, Feb 19, 2018 at 9:04 AM 김규래  > wrote:
> Hi Adrian,
> 
> Thanks for clarifying.
> 
> I think I pretty much get the picture.
> 
>  
> Looking forward to get in touch with Patrick in IRC within this week.
> 
>  
> Thanks everyone.
> 
>  
> msca8h at naver dot com
> 
> msca8h at sogang dot ac dot kr
> 
> Ray Kim
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu 
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users 
> 
> -- 
> Best Regards, Zahra Khatami | PhD Student Center for Computation & Technology 
> (CCT) School of Electrical Engineering & Computer Science Louisiana State 
> University 2027 Digital Media Center (DMC) Baton Rouge, LA 70803
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Zahra Khatami]

Hi Ray,

If you refer to the published paper, you could get more information.
Generally talking, this project uses compiler and runtime system to gather
both static and dynamic information to set HPX algorithm parameters such as
chunk sizes efficiently. Static information are gathered by a compiler,
which we used clang and we developed a new class for clang for this
purpose. Dynamic information are gathered by new HPX policies that we
developed for this purpose. You can look at the example in HPXML in HPX
GitHub.

Thanks,
Zahra

On Mon, Feb 19, 2018 at 9:04 AM 김규래  wrote:

> Hi Adrian,
>
> Thanks for clarifying.
>
> I think I pretty much get the picture.
>
>
>
> Looking forward to get in touch with Patrick in IRC within this week.
>
>
>
> Thanks everyone.
>
>
>
> msca8h at naver dot com
>
> msca8h at sogang dot ac dot kr
>
> Ray Kim
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
>
-- 
Best Regards, Zahra Khatami | PhD Student Center for Computation &
Technology (CCT) School of Electrical Engineering & Computer Science
Louisiana State University 2027 Digital Media Center (DMC) Baton Rouge, LA
70803
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[김규래]

Hi Adrian,
Thanks for clarifying.
I think I pretty much get the picture.
 
Looking forward to get in touch with Patrick in IRC within this week.
 
Thanks everyone.
 
msca8h at naver dot com
msca8h at sogang dot ac dot kr
Ray Kim
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Adrian Serio]

Patrick and Ray,

Just for clarity's sake I will point out that Zahra's work did include 
information gathered at compile time. She used a custom Clang plugin to 
gather this information.


That being said, we may want to only utilize runtime information in the 
context of this project. However, I will deffer that decision to the 
mentors assigned to the project.


Adrian


On 2/18/2018 4:10 PM, Patrick Diehl wrote:

Hi Ray Kim,


But the original GSoC project description and the paper[1]  both mention
*compiler provided* *static data*.
 From my belief this cannot be acquired from HPX performance counters
(excuse me if they actually do)
If this project should be independent of compiler (or libray), than I
suppose I may not be bothered?

Yes, this was mentioned in the project description. But since we wrote
the description, I looked into the blaze library and how they decide to
use single core or omp execution, depending on the parameters, like the
input size. They measuring the threshold when a parallel execution is
faster as the single core execution. These thresholds for different
algorithms are provided in a header file as constants.

I was thinking that something similar could be done with machine
learning for the different algorithms. Instead of a threshold we would
have function learned by the machine learning algorithm.

This is just my thinking how to do this. For sure, there are many other
approaches out there. it is your task to propose any solution, you think
could solve this problem.


In case of not doing any machine learning during run time,
What form of implementation are you expecting?

I was thinking to have for different parallel algorithms one function

f_i(length of input, amount of cpus, ...) -> (chunk_size, used amount of
cpus)

So during run time, your function get input parameters, like the amount
of cpus and the length of the input, and maybe many more. And the
function returns the optimal chunk size and maybe the  used amount of
cpus. Where used amount is the amount of cpu used by hpx. For example
one wants to run hpx with 3 cpus, but the input size is very small and
it would be faster to just use one cpu. So your function would predict
this.

I was thinking that one could use performance counters to obtain, e.g.
the /threads/idle-rate for different input parameters. So one would have
an d-dimensional input space, which could be used to learn a function
approximating this points.


A separate program that does prediction and sets all the parameters?

1) A shell script, which runs the hpx applications and save all data to
a csv file.

2) A python script, which uses this data to learn the function f_i.

3) These functions should be implemented and a possible smart executor
could use the function for each parallel algorithm to predict the best
chunk size and parallel or serial execution, depending on your input
parameters.


Or a meta program that does the job in compile time?

If you think this is necessary, please provide a explanation why and how
you want to do this.


Or is this up to my proposition?

Yes, you should look into how the task could be solved and propose to
the community any solution, you think could do this. We will discuss
with you your proposed solution and improve it.

I am happy to discuss with you next week on irc. I think it will be
easier to clarify things.

Best,

Patrick

On 02/18/2018 02:15 PM, 김규래 wrote:

​Hi again Patrick,
​Thanks for keeping track of me.

But the original GSoC project description and the paper[1]  both mention
*compiler provided* *static data*.
 From my belief this cannot be acquired from HPX performance counters
(excuse me if they actually do)
If this project should be independent of compiler (or libray), than I
suppose I may not be bothered?

/> If you collect data and try to generate a model and use the > trained
model without any machine learning during run time,/

In case of not doing any machine learning during run time,
What form of implementation are you expecting?
A separate program that does prediction and sets all the parameters?
Or a meta program that does the job in compile time?
Or is this up to my proposition?

Thanks for all
Ray Kim

[1] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf, p4 fig2




___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users


--
Adrian Serio
Scientific Program Coordinator
2118 Digital Media Center
225.578.8506

___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] [GSoC 2018] Histogram Performance Counter

[Saurav Sachidanand]

Hello all,

My name is Saurav Sachidanand and I wish to participate in GSoC 2018.
I'm intrigued with the Histogram Performance Counter project. I've
previously worked with HdrHistorgram [1], which is a histogram
implementation that can record integer and float values with high range and
precission, with fixed space and time costs. Implementations in several
languages exist, but not in C++. The reference Java version [2] provides
several more features, including a concurrent version of the histogram.
Would implementing a generic C++ concurrent HdrHistgram perforamance
counter, supporting all features from the Java version and utilizing HPX's
APIs, be a useful addition?

This idea came to mind beacuse I participated in GSoC last year [3], where
I built a Performance Co-Pilot instrumentation library in Rust, and I had
to integrate HdrHistogram into the API [4].

Any guidance and feedback will be greatly appreciated.

Thanks,
Saurav

[1] - https://hdrhistogram.github.io/HdrHistogram/
[2] - https://github.com/HdrHistogram/HdrHistogram
[3] -
https://summerofcode.withgoogle.com/archive/2017/projects/4793296782098432/
[4] - https://github.com/performancecopilot/hornet#histogram
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Patrick Diehl]

Hi Ray Kim,

> But the original GSoC project description and the paper[1]  both mention
> *compiler provided* *static data*.
> From my belief this cannot be acquired from HPX performance counters
> (excuse me if they actually do)
> If this project should be independent of compiler (or libray), than I
> suppose I may not be bothered?

Yes, this was mentioned in the project description. But since we wrote
the description, I looked into the blaze library and how they decide to
use single core or omp execution, depending on the parameters, like the
input size. They measuring the threshold when a parallel execution is
faster as the single core execution. These thresholds for different
algorithms are provided in a header file as constants.

I was thinking that something similar could be done with machine
learning for the different algorithms. Instead of a threshold we would
have function learned by the machine learning algorithm.

This is just my thinking how to do this. For sure, there are many other
approaches out there. it is your task to propose any solution, you think
could solve this problem.

> In case of not doing any machine learning during run time,
> What form of implementation are you expecting?

I was thinking to have for different parallel algorithms one function

f_i(length of input, amount of cpus, ...) -> (chunk_size, used amount of
cpus)

So during run time, your function get input parameters, like the amount
of cpus and the length of the input, and maybe many more. And the
function returns the optimal chunk size and maybe the  used amount of
cpus. Where used amount is the amount of cpu used by hpx. For example
one wants to run hpx with 3 cpus, but the input size is very small and
it would be faster to just use one cpu. So your function would predict
this.

I was thinking that one could use performance counters to obtain, e.g.
the /threads/idle-rate for different input parameters. So one would have
an d-dimensional input space, which could be used to learn a function
approximating this points.

> A separate program that does prediction and sets all the parameters?

1) A shell script, which runs the hpx applications and save all data to
a csv file.

2) A python script, which uses this data to learn the function f_i.

3) These functions should be implemented and a possible smart executor
could use the function for each parallel algorithm to predict the best
chunk size and parallel or serial execution, depending on your input
parameters.

> Or a meta program that does the job in compile time?

If you think this is necessary, please provide a explanation why and how
you want to do this.

> Or is this up to my proposition?

Yes, you should look into how the task could be solved and propose to
the community any solution, you think could do this. We will discuss
with you your proposed solution and improve it.

I am happy to discuss with you next week on irc. I think it will be
easier to clarify things.

Best,

Patrick

On 02/18/2018 02:15 PM, 김규래 wrote:
> ​Hi again Patrick,
> ​Thanks for keeping track of me.
> 
> But the original GSoC project description and the paper[1]  both mention
> *compiler provided* *static data*.
> From my belief this cannot be acquired from HPX performance counters
> (excuse me if they actually do)
> If this project should be independent of compiler (or libray), than I
> suppose I may not be bothered?
> 
> /> If you collect data and try to generate a model and use the > trained
> model without any machine learning during run time,/
> 
> In case of not doing any machine learning during run time,
> What form of implementation are you expecting?
> A separate program that does prediction and sets all the parameters?
> Or a meta program that does the job in compile time?
> Or is this up to my proposition?
> 
> Thanks for all
> Ray Kim
> 
> [1] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf, p4 fig2
> 

-- 
Patrick Diehl
diehlpk.github.io



signature.asc
Description: OpenPGP digital signature
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[김규래]

​Hi again Patrick,​Thanks for keeping track of me.

But the original GSoC project description and the paper[1]  both mention 
compiler provided static data.From my belief this cannot be acquired from HPX 
performance counters (excuse me if they actually do)If this project should be 
independent of compiler (or libray), than I suppose I may not be bothered?> 
If you collect data and try to generate a model and use the
> trained model without any machine learning during run time,In case of not 
doing any machine learning during run time,What form of implementation are you 
expecting?A separate program that does prediction and sets all the 
parameters?Or a meta program that does the job in compile time?Or is this up to 
my proposition?
Thanks for allRay Kim
[1] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf, p4 fig2___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Patrick Diehl]

Hi Ray Kim,

>> The literature mostly talks about feature acquisition through libclang.
>> 
>> Than under this project, is the HPX distribution including tooling based
>> on libclang?

No, the project's solution should be independent on any library. One
requirement would be, that it works independent on the compiler. HPX
itself provide performance counters [0]. These ones could be used for
acquisition of data. Or just data you could measure during run time.

>> And I guess part of a machine learning framework -such as xgboost,
>> tinydnn, etc...
>> 
>>  will also need to be included in the distribution.

No, I think this would be not needed. It really depends on your
approach. If you collect data and try to generate a model and use the
trained model without any machine learning during run time, I would
recommend to use scikit-learn [1]. It is easy to use and you can easily
play around with different models.

For the case when you want to use machine learning during run time, I
would recommend to use scikit-learn to find a suitable model. Once, you
found this model, you should have a look into the model and implement
these algorithms by yourself. I think that we do not need a very
sophisticated model and it would be easy to implement this model.

In addition, I recommend to read the previous mentioned paper to get
some more details.

Best,

Patrick


[0]
http://stellar.cct.lsu.edu/files/hpx_0.9.5/html/hpx/manual/performance_counters/counters.html
[1] http://scikit-learn.org/stable/

On 02/17/2018 12:14 AM, 김규래 wrote:
> Hello Patrick,
> 
> Thank you for your guidance.
> 
> I have few more questions on the subject.
> 
>  
> 
> The literature mostly talks about feature acquisition through libclang.
> 
> Than under this project, is the HPX distribution including tooling based
> on libclang?
> 
> (And custom build system stuff for the additional compile time
> computations?)
> 
>  
> 
> And I guess part of a machine learning framework -such as xgboost,
> tinydnn, etc...
> 
>  will also need to be included in the distribution.
> 
> Am I understanding this project correctly?
> 
>  
> 
> Great regards,
> 
> Ray Kim
> 
>  
> 
> -Original Message-
> *From:* "Patrick Diehl"
> *To:* "김규래"; ;
> *Cc:*
> *Sent:* 2018-02-16 (금) 07:17:52
> *Subject:* Re: [hpx-users] GSoC 2018, on "applying machine learning
> technques ..." project
>  
> 
> Hi Ray,
> 
> welcome to the community. A good starting point for this project would
> be to read this publication [0]:
> 
> Zahra Khatami, Lukas Troska, Hartmut Kaiser, J. Ramanujan and Adrian
> Serio, “HPX Smart Executors”, In Proceedings of ESPM2’17: Third
> International Workshop on Extreme Scale Programming Models and
> Middleware (ESPM2’17), 2017. doi: 10.1145/3152041.3152084,
> 
>>> Then is the goal to analyze data? or also implement the algorithms?
> 
> The goal is to provide a new execution policy [1], which utilizes
> machine learning techniques to optimize the computational time.
> 
> So the first step would be to analyze the data.
> 
> In my opinion there are two different ways, one can integrate machine
> learning.
> 
> 1) You could collect the data and train a model to obtain parameters for
> your function f(x,y,z) -> chunk size. In this case you could use any
> existing machine learning library to get these parameters for your function.
> 
> Here, you will implement this function in the execution policy to
> estimate e.g. the "best" chunk size for given x,y,z.
> 
> 2) You could train your model at run time to obtain e.g. the "best"
> chunk size. In this case you have to implement your chosen machine
> learning algorithm for the integration in hpx.
> 
> Best,
> 
> Patrick
> 
> 
> [0] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf
> [1]
> https://stellar-group.github.io/hpx/docs/html/hpx/manual/parallel/executor_parameters.html
> 
> On 15/02/18 01:53 PM, 김규래 wrote:
>> HI, my name is Ray Kim.
>>
>> I'm a junior EE student in Sogang Univ. Korea.
>>
>> I have a little experience in C++ and HPC applications and machine
> learning.
>>
>> Here is a link to my github profile for some of my personal projects.
>>
>> https://github.com/Red-Portal
>>
>>  
>>
>> I'm interested in the project "Applying Machine Learning Techniques on
>> HPX Parallel Algorithms",
>>
>> however I would like to have more details about it.
>>
>> The description talks about implementing the algorithms and analyzing
>> the performance of these algorithms.
>>
>> Then is the goal to analyze d

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[김규래]

Hello Patrick,
Thank you for your guidance.
I have few more questions on the subject.
 
The literature mostly talks about feature acquisition through libclang.
Than under this project, is the HPX distribution including tooling based on 
libclang?
(And custom build system stuff for the additional compile time computations?)
 
And I guess part of a machine learning framework -such as xgboost, tinydnn, 
etc...
 will also need to be included in the distribution.
Am I understanding this project correctly?
 
Great regards,
Ray Kim
 
-Original Message-
From: "Patrick Diehl"<patrickdie...@gmail.com> 
To: "김규래"<msc...@naver.com>; <hpx-users@stellar.cct.lsu.edu>; 
Cc: 
Sent: 2018-02-16 (금) 07:17:52
Subject: Re: [hpx-users] GSoC 2018, on "applying machine learning technques 
..." project
 
Hi Ray,

welcome to the community. A good starting point for this project would
be to read this publication [0]:

Zahra Khatami, Lukas Troska, Hartmut Kaiser, J. Ramanujan and Adrian
Serio, “HPX Smart Executors”, In Proceedings of ESPM2’17: Third
International Workshop on Extreme Scale Programming Models and
Middleware (ESPM2’17), 2017. doi: 10.1145/3152041.3152084,

>> Then is the goal to analyze data? or also implement the algorithms?

The goal is to provide a new execution policy [1], which utilizes
machine learning techniques to optimize the computational time.

So the first step would be to analyze the data.

In my opinion there are two different ways, one can integrate machine
learning.

1) You could collect the data and train a model to obtain parameters for
your function f(x,y,z) -> chunk size. In this case you could use any
existing machine learning library to get these parameters for your function.

Here, you will implement this function in the execution policy to
estimate e.g. the "best" chunk size for given x,y,z.

2) You could train your model at run time to obtain e.g. the "best"
chunk size. In this case you have to implement your chosen machine
learning algorithm for the integration in hpx.

Best,

Patrick


[0] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf
[1]
https://stellar-group.github.io/hpx/docs/html/hpx/manual/parallel/executor_parameters.html

On 15/02/18 01:53 PM, 김규래 wrote:
> HI, my name is Ray Kim.
> 
> I'm a junior EE student in Sogang Univ. Korea.
> 
> I have a little experience in C++ and HPC applications and machine 
learning.
> 
> Here is a link to my github profile for some of my personal projects. 
> 
> https://github.com/Red-Portal 
> 
>  
> 
> I'm interested in the project "Applying Machine Learning Techniques on
> HPX Parallel Algorithms",
> 
> however I would like to have more details about it.
> 
> The description talks about implementing the algorithms and analyzing
> the performance of these algorithms.
> 
> Then is the goal to analyze data? or also implement the algorithms?
> 
>  
> 
> Great admirations for everyone working on HPX.
> 
> It would be an honor if I could work with you all.
> 
> msca8h at naver dot com
> 
> msca8h at sogang dot ac dot kr
> 
> Ray Kim
> 
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

Re: [hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[Patrick Diehl]

Hi Ray,

welcome to the community. A good starting point for this project would
be to read this publication [0]:

Zahra Khatami, Lukas Troska, Hartmut Kaiser, J. Ramanujan and Adrian
Serio, “HPX Smart Executors”, In Proceedings of ESPM2’17: Third
International Workshop on Extreme Scale Programming Models and
Middleware (ESPM2’17), 2017. doi: 10.1145/3152041.3152084,

>> Then is the goal to analyze data? or also implement the algorithms?

The goal is to provide a new execution policy [1], which utilizes
machine learning techniques to optimize the computational time.

So the first step would be to analyze the data.

In my opinion there are two different ways, one can integrate machine
learning.

1) You could collect the data and train a model to obtain parameters for
your function f(x,y,z) -> chunk size. In this case you could use any
existing machine learning library to get these parameters for your function.

Here, you will implement this function in the execution policy to
estimate e.g. the "best" chunk size for given x,y,z.

2) You could train your model at run time to obtain e.g. the "best"
chunk size. In this case you have to implement your chosen machine
learning algorithm for the integration in hpx.

Best,

Patrick


[0] http://stellar.cct.lsu.edu/pubs/khatami_espm2_2017.pdf
[1]
https://stellar-group.github.io/hpx/docs/html/hpx/manual/parallel/executor_parameters.html

On 15/02/18 01:53 PM, 김규래 wrote:
> HI, my name is Ray Kim.
> 
> I'm a junior EE student in Sogang Univ. Korea.
> 
> I have a little experience in C++ and HPC applications and machine learning.
> 
> Here is a link to my github profile for some of my personal projects. 
> 
> https://github.com/Red-Portal 
> 
>  
> 
> I'm interested in the project "Applying Machine Learning Techniques on
> HPX Parallel Algorithms",
> 
> however I would like to have more details about it.
> 
> The description talks about implementing the algorithms and analyzing
> the performance of these algorithms.
> 
> Then is the goal to analyze data? or also implement the algorithms?
> 
>  
> 
> Great admirations for everyone working on HPX.
> 
> It would be an honor if I could work with you all.
> 
> msca8h at naver dot com
> 
> msca8h at sogang dot ac dot kr
> 
> Ray Kim
> 
> 
> 
> ___
> hpx-users mailing list
> hpx-users@stellar.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/hpx-users
> 
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users

[hpx-users] GSoC 2018, on "applying machine learning technques ..." project

[김규래]

HI, my name is Ray Kim.
I'm a junior EE student in Sogang Univ. Korea.
I have a little experience in C++ and HPC applications and machine learning.
Here is a link to my github profile for some of my personal projects. 
https://github.com/Red-Portal 
 
I'm interested in the project "Applying Machine Learning Techniques on HPX 
Parallel Algorithms",
however I would like to have more details about it.
The description talks about implementing the algorithms and analyzing the 
performance of these algorithms.
Then is the goal to analyze data? or also implement the algorithms?
 
Great admirations for everyone working on HPX.
It would be an honor if I could work with you all.
msca8h at naver dot com
msca8h at sogang dot ac dot kr
Ray Kim
___
hpx-users mailing list
hpx-users@stellar.cct.lsu.edu
https://mail.cct.lsu.edu/mailman/listinfo/hpx-users