Re: [OSM-dev] [GSoC] Video based speed limit detector
Hi, I'd be quite interestd in following this task. Am 22.03.2011 08:33, schrieb Kai Krueger: great to see that someone is interested in the project idea and I'll be interested to see the proposal draft. There are a number of standard object detection algorithms that should be able to detect speed limit signs on a frame by frame basis in real time. Just recently I saw the results of a German Traffic Sign Recognition Benchmark at http://benchmark.ini.rub.de . This might be interesting for the recognition task after the detection task. Just my 2c, regards Franz ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
2011/3/31 Kai Krueger kakrue...@gmail.com Hi, I had a short look at the proposal. Looking at some of the sample project proposals on the GSoC page, it looks comparable in detail. first of all Thank you for the response.. Some thoughts of things you could consider mentioning in the proposal. - You might want to mention a thing about data collection. For one you will need some sample video to play around with and test how well things work. More importantly though, you will likely need data to train the detection and recognition algorithms on. As you will likely use some form of supervised learning algorithm for those, you will need a training set of labeled examples, which you will need to create. I'd hope that the community will help collecting some raw video material that can be used, but it will then need to be labeled. Alternatively, or in addition, there might be some standard training sets for street signs and speed limits, given that there appears to be a reasonable set of research literature on the topic. - It might be good to mention if once you have some basics going, if you want to take to project either more in the direction of building something that is fully integrated into the OSM editing ecosystem, or if you would rather take it more in the research direction of improving the quality of the detection algorithm, for example using more rich queues that the video gives you over the single image processing. I would like to fully integrate this to OSM and also develop and improve the quality of the algorithms in a different components but latter will be done after GSoC. within this time frame i will totally focus in integrating this system to OSM ecosystem. In that respect, it might be good to be slightly more specific on the deliverables, although you want to make sure that you don't over promise and leave enough freedom for inevitable changes along the line. Since this is a quite a big project and can be extended further i am trying to stick with few goals that means the main and the core idea.i mentioned them in the proposal but i will extend this project even after GSoC to accomplish other tasks such as improving the quality of the algorithms extending the system to identify other signals. - You could also add a section to the end with a more speculative part of various possibilities of how the project could be extended in the future. Even though you are likely not going to be able to implement (all of) it, it might show that you have a good understanding of the topics involved and enough ideas to independently adapt if some of the things don't work out. i will surely update my proposal within this weekend. You might also want to put the project related parts of the application on a public facing page to give more people a possibility to give suggestions and comments. But those are just some thoughts and it should be a good fun project to work on. Kai On 03/28/2011 09:08 PM, Keshan Sodimana | කේෂාන් සෝදිමාන wrote: Hi all, As i mentioned above. i drafted a project proposal and submitted it to the GSoC site. so it would be great if any potential mentor can review my proposal.feedbacks are welcome. here's the link to my proposal : http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/keshansanjaya/1# (i didn't make this proposal publicly visible) Thanks !!! - Keshan On Tue, Mar 22, 2011 at 11:49 PM, Stefan de Konink ste...@konink.dewrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 22-03-11 08:33, Kai Krueger schreef: I'll possibly be able to mentor such a project, although I know little about the code of any of the editors, so I'd be less able to help on that side of things. Since I was the mentor of the last project, there is a great number of test material available to even build a recognizer. Video segmentation is step two, not the first step. Yes, the first step approach (and potentially even sufficient step) would be to treat each video frame as an independent still image. Do you still have the material and write up for last years project, as that project is clearly very relevant to this one and thus should be a good source of inspiration. If someone isn't able to even find a sign on a still image, it is even harder to do it on motion pictures. Depending on what you mean by harder, not necessarily. Video gives you a lot of redundancy that you don't have in a still image. And so you can potentially accept a much higher false positive rate on the individual frames, as you combine the various predictions on the frames to reach a higher confidence, and thus you potentially can get away with a weaker detector. For Dutch signs, and most likely many international ones on Wikipedia SVG images do exist showing signs in the highest details possible. So first things first: - sign is present (x,y,w,h) - classify sign - segment video - enhance
Re: [OSM-dev] [GSoC] Video based speed limit detector
Hi, I had a short look at the proposal. Looking at some of the sample project proposals on the GSoC page, it looks comparable in detail. Some thoughts of things you could consider mentioning in the proposal. - You might want to mention a thing about data collection. For one you will need some sample video to play around with and test how well things work. More importantly though, you will likely need data to train the detection and recognition algorithms on. As you will likely use some form of supervised learning algorithm for those, you will need a training set of labeled examples, which you will need to create. I'd hope that the community will help collecting some raw video material that can be used, but it will then need to be labeled. Alternatively, or in addition, there might be some standard training sets for street signs and speed limits, given that there appears to be a reasonable set of research literature on the topic. - It might be good to mention if once you have some basics going, if you want to take to project either more in the direction of building something that is fully integrated into the OSM editing ecosystem, or if you would rather take it more in the research direction of improving the quality of the detection algorithm, for example using more rich queues that the video gives you over the single image processing. In that respect, it might be good to be slightly more specific on the deliverables, although you want to make sure that you don't over promise and leave enough freedom for inevitable changes along the line. - You could also add a section to the end with a more speculative part of various possibilities of how the project could be extended in the future. Even though you are likely not going to be able to implement (all of) it, it might show that you have a good understanding of the topics involved and enough ideas to independently adapt if some of the things don't work out. You might also want to put the project related parts of the application on a public facing page to give more people a possibility to give suggestions and comments. But those are just some thoughts and it should be a good fun project to work on. Kai On 03/28/2011 09:08 PM, Keshan Sodimana | කේෂාන් සෝදිමාන wrote: Hi all, As i mentioned above. i drafted a project proposal and submitted it to the GSoC site. so it would be great if any potential mentor can review my proposal.feedbacks are welcome. here's the link to my proposal : http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/keshansanjaya/1# (i didn't make this proposal publicly visible) Thanks !!! - Keshan On Tue, Mar 22, 2011 at 11:49 PM, Stefan de Konink ste...@konink.de mailto:ste...@konink.de wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 22-03-11 08:33, Kai Krueger schreef: I'll possibly be able to mentor such a project, although I know little about the code of any of the editors, so I'd be less able to help on that side of things. Since I was the mentor of the last project, there is a great number of test material available to even build a recognizer. Video segmentation is step two, not the first step. Yes, the first step approach (and potentially even sufficient step) would be to treat each video frame as an independent still image. Do you still have the material and write up for last years project, as that project is clearly very relevant to this one and thus should be a good source of inspiration. If someone isn't able to even find a sign on a still image, it is even harder to do it on motion pictures. Depending on what you mean by harder, not necessarily. Video gives you a lot of redundancy that you don't have in a still image. And so you can potentially accept a much higher false positive rate on the individual frames, as you combine the various predictions on the frames to reach a higher confidence, and thus you potentially can get away with a weaker detector. For Dutch signs, and most likely many international ones on Wikipedia SVG images do exist showing signs in the highest details possible. So first things first: - sign is present (x,y,w,h) - classify sign - segment video - enhance recognitionrate on multiple images - pinpoint the location of the sign in 3D Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.16 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEAREKAAYFAk2I6C8ACgkQYH1+F2Rqwn3u/wCggw+qJzPbUuR60IzOclFlz3f8 i7gAnRm2+D2cBPWT3+Fd2hKIKdKghJqS =reZv -END PGP SIGNATURE- ___ dev mailing list dev@openstreetmap.org mailto:dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org
Re: [OSM-dev] [GSoC] Video based speed limit detector
Hi all, As i mentioned above. i drafted a project proposal and submitted it to the GSoC site. so it would be great if any potential mentor can review my proposal.feedbacks are welcome. here's the link to my proposal : http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/keshansanjaya/1# http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/keshansanjaya/1#(i didn't make this proposal publicly visible) Thanks !!! - Keshan On Tue, Mar 22, 2011 at 11:49 PM, Stefan de Konink ste...@konink.de wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 22-03-11 08:33, Kai Krueger schreef: I'll possibly be able to mentor such a project, although I know little about the code of any of the editors, so I'd be less able to help on that side of things. Since I was the mentor of the last project, there is a great number of test material available to even build a recognizer. Video segmentation is step two, not the first step. If someone isn't able to even find a sign on a still image, it is even harder to do it on motion pictures. For Dutch signs, and most likely many international ones on Wikipedia SVG images do exist showing signs in the highest details possible. So first things first: - sign is present (x,y,w,h) - classify sign - segment video - enhance recognitionrate on multiple images - pinpoint the location of the sign in 3D Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.16 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEAREKAAYFAk2I6C8ACgkQYH1+F2Rqwn3u/wCggw+qJzPbUuR60IzOclFlz3f8 i7gAnRm2+D2cBPWT3+Fd2hKIKdKghJqS =reZv -END PGP SIGNATURE- ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
This proposal is not made public, and you are not the student who submitted the proposal, nor are you a mentor for the organization it was submitted to. Am 29.03.2011 um 05:08 schrieb Keshan Sodimana | කේෂාන් සෝදිමාන: Hi all, As i mentioned above. i drafted a project proposal and submitted it to the GSoC site. so it would be great if any potential mentor can review my proposal.feedbacks are welcome. here's the link to my proposal : http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/keshansanjaya/1# http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/keshansanjaya/1#(i didn't make this proposal publicly visible) Thanks !!! - Keshan On Tue, Mar 22, 2011 at 11:49 PM, Stefan de Konink ste...@konink.de wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 22-03-11 08:33, Kai Krueger schreef: I'll possibly be able to mentor such a project, although I know little about the code of any of the editors, so I'd be less able to help on that side of things. Since I was the mentor of the last project, there is a great number of test material available to even build a recognizer. Video segmentation is step two, not the first step. If someone isn't able to even find a sign on a still image, it is even harder to do it on motion pictures. For Dutch signs, and most likely many international ones on Wikipedia SVG images do exist showing signs in the highest details possible. So first things first: - sign is present (x,y,w,h) - classify sign - segment video - enhance recognitionrate on multiple images - pinpoint the location of the sign in 3D Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.16 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEAREKAAYFAk2I6C8ACgkQYH1+F2Rqwn3u/wCggw+qJzPbUuR60IzOclFlz3f8 i7gAnRm2+D2cBPWT3+Fd2hKIKdKghJqS =reZv -END PGP SIGNATURE- ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
Hi Gehling, I dindn't make it publicly visible but i think any mentor of OSM can review it. anyway thanks for the response. -Keshan 2011/3/29 Gehling Marc mgehling.os...@googlemail.com This proposal is not made public, and you are not the student who submitted the proposal, nor are you a mentor for the organization it was submitted to. Am 29.03.2011 um 05:08 schrieb Keshan Sodimana | කේෂාන් සෝදිමාන: Hi all, As i mentioned above. i drafted a project proposal and submitted it to the GSoC site. so it would be great if any potential mentor can review my proposal.feedbacks are welcome. here's the link to my proposal : http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/keshansanjaya/1# http://www.google-melange.com/gsoc/proposal/review/google/gsoc2011/keshansanjaya/1# (i didn't make this proposal publicly visible) Thanks !!! - Keshan On Tue, Mar 22, 2011 at 11:49 PM, Stefan de Konink ste...@konink.de wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 22-03-11 08:33, Kai Krueger schreef: I'll possibly be able to mentor such a project, although I know little about the code of any of the editors, so I'd be less able to help on that side of things. Since I was the mentor of the last project, there is a great number of test material available to even build a recognizer. Video segmentation is step two, not the first step. If someone isn't able to even find a sign on a still image, it is even harder to do it on motion pictures. For Dutch signs, and most likely many international ones on Wikipedia SVG images do exist showing signs in the highest details possible. So first things first: - sign is present (x,y,w,h) - classify sign - segment video - enhance recognitionrate on multiple images - pinpoint the location of the sign in 3D Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.16 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEAREKAAYFAk2I6C8ACgkQYH1+F2Rqwn3u/wCggw+qJzPbUuR60IzOclFlz3f8 i7gAnRm2+D2cBPWT3+Fd2hKIKdKghJqS =reZv -END PGP SIGNATURE- ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
Hi, great to see that someone is interested in the project idea and I'll be interested to see the proposal draft. There are a number of standard object detection algorithms that should be able to detect speed limit signs on a frame by frame basis in real time. Once a sign is located in the image, one then has to interpret it. One can either try and do a full OCR style approach, or given the limited number of speed limit signs, one can probably simply throw a multi class classifier at it with a class per speed limit. These algorithms are reasonably robust, so they should be able to cope with the difficult conditions of changing lighting conditions and size of the signs in the images. (After all traffic signs are designed to be well detectable and readable) For both aspects there are ready made libraries like the OpenCV library that implement most of the algorithmic side of things. So I am reasonably confident that the minimum goal of analyzing a video stream and identifying the speed limits, spitting out the gps coordinates of the video frames for those signs is achievable in the time scope of GSoC. My guess would be that quite a bit of the initial project would be to experiment with various algorithms to see which work best and combine them in ways to make it as robust as possible. Once that basic goal is achieved, there are nearly limitless (at least with respect to a three month project) options to extend the project in various directions, either be it from a usability perspective, or from an algorithmic computer vision perspective, giving it the flexibility to be a challenging and interesting, yet achievable project. Furthermore, I think one can achieve something in the time that is genuinely useful to the project and helps improve an important aspect of tagging for routing that has so far been comparatively neglected. I possibly still have some code lying around to interface the C library OpenCV with java through JNI from my undergraduate thesis (which was to build an eye tracker from a standard webcam), in case that would be of any use. So I am excited to see someone willing to pick up the project. I'll possibly be able to mentor such a project, although I know little about the code of any of the editors, so I'd be less able to help on that side of things. Kai -- View this message in context: http://gis.638310.n2.nabble.com/GSoC-Video-based-speed-limit-detector-tp6192971p6195251.html Sent from the Developer Discussion mailing list archive at Nabble.com. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
Having a quick look on google scholar shows that there actually appears to be quite a large set of research literature on exactly this problem. I.e. How to detect traffic signs in real time from a front facing vehicle camera. I guess it isn't too surprising given that driver assistant systems appear to be one of the next big things in the car industry, so I guess they have pored quite a bit of money into funding research into this. Some of those articles should give a good indication of what is likely to work and how difficult these things are and again might have some ready implemented algorithms. I don't know what the journal subscription is like at Sri Lankan Universities and if the relevant journals are open access or not. But if you (or anyone else) has troubles getting at interesting papers I might be able to help get them. -- View this message in context: http://gis.638310.n2.nabble.com/GSoC-Video-based-speed-limit-detector-tp6192971p6197127.html Sent from the Developer Discussion mailing list archive at Nabble.com. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
Hi, due to my experiences on VideoMapping I'm a bit critical if this would work on our amateur scenario. I have no clue about image processing but noticed that even for Humans it can be hard to find all signs along a street. But anyway, we will only know if it works, if somebody tries :D Matthias ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 22-03-11 08:33, Kai Krueger schreef: I'll possibly be able to mentor such a project, although I know little about the code of any of the editors, so I'd be less able to help on that side of things. Since I was the mentor of the last project, there is a great number of test material available to even build a recognizer. Video segmentation is step two, not the first step. If someone isn't able to even find a sign on a still image, it is even harder to do it on motion pictures. For Dutch signs, and most likely many international ones on Wikipedia SVG images do exist showing signs in the highest details possible. So first things first: - sign is present (x,y,w,h) - classify sign - segment video - enhance recognitionrate on multiple images - pinpoint the location of the sign in 3D Stefan -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.16 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEAREKAAYFAk2I6C8ACgkQYH1+F2Rqwn3u/wCggw+qJzPbUuR60IzOclFlz3f8 i7gAnRm2+D2cBPWT3+Fd2hKIKdKghJqS =reZv -END PGP SIGNATURE- ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] [GSoC] Video based speed limit detector
Hi all, I have been following this mailing list for quite a while but this is my first post. so let me introduce myself. I am Keshan Sanjaya from a tiny island called Sri Lanka. a 3rd year Computer Science student. i went through the GSoC idea page of OSM and i am interested in Video based speed limit detector idea because i have done several projects with image processing. also i have used open layers and mapping for one of my projects. so OSM seems interesting for me. i will come up with a draft proposal in this weekend and will submit to GSoC main page. any comments or feedbacks will be appreciated.. Thanks, Keshan.. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
Hi Keshan, I'm currently working on the videomapping plugin as my bachelor thesis. I guess this would be a good starting point. http://wiki.openstreetmap.org/wiki/JOSM/Plugins/VideoMapping Personaly I'm not that sure, how a detection of signs can be added in the workflow but let's see ;) Matthias ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
Personally I think that any tool that can process a video recording in a reasonable amount of time and detect most street signs will be a significant accomplishment. Even if it does not integrate with an editor. Let's suppose your video stream is of high quality and the lighting conditions are good. Now there is some stationary object like a pole that obscures the street sign during some of the frames. For the tool to be useful, it needs to handle it correctly. 2011/3/21 Matthias Meißer dig...@arcor.de: Hi Keshan, I'm currently working on the videomapping plugin as my bachelor thesis. I guess this would be a good starting point. http://wiki.openstreetmap.org/wiki/JOSM/Plugins/VideoMapping Personaly I'm not that sure, how a detection of signs can be added in the workflow but let's see ;) Matthias ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] [GSoC] Video based speed limit detector
Yes I guess it would be great to have a tool that finds the signs. Of course interpretation would be great, but if it automates e.g. the review of a 4h highway trip, that would be brilliant! Matthias ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
