Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
Hi, I have updated readme in both the repos with instructions to use plugins. Also now source code is documented with explanations and javadoc for same can be found in 'doc' directory Training process is explained on wikipage. Training tools can be found at [1] with instructions in readme -- Nikhil [1] http://github.com/nikhil9/Training-Tools On Tue, Aug 21, 2012 at 12:01 PM, Graham Jones wrote: > Thanks Nikhil, > You have been very quiet, so I have not been following this project! > > I don't use JOSM much, so am a bit lost with what to do with this. I see > that your project wiki page talks about completing the documentation - can > you point me to that please? > > There are two things I would like to see documented - how to use the > plugin (including how to teach it to recognise signs if that is necessary), > and how it works (to give other people a chance of modifying it to detect > other features they may be interested in). > > Regards > > Graham. > > On 21 August 2012 01:46, Nikhil Upadhye wrote: > >> Hi, >> >> I have uploaded plugins on github at [1] and [2]. >> wikipage of the project is at [3] >> >> >> [1] https://github.com/nikhil9/ImageProcessor >> [2] https://github.com/nikhil9/videoplayer >> [3] >> http://wiki.openstreetmap.org/wiki/Google_Summer_of_Code/2012/Video_Based_Speed_Limit_and_Road_Sign_Detector_plugin_for_JOSM >> >> >> -- >> Nikhil >> >> >> >> >> ___ >> dev mailing list >> dev@openstreetmap.org >> http://lists.openstreetmap.org/listinfo/dev >> >> > > > -- > Graham Jones > Hartlepool, UK. > > ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
Thanks Nikhil, You have been very quiet, so I have not been following this project! I don't use JOSM much, so am a bit lost with what to do with this. I see that your project wiki page talks about completing the documentation - can you point me to that please? There are two things I would like to see documented - how to use the plugin (including how to teach it to recognise signs if that is necessary), and how it works (to give other people a chance of modifying it to detect other features they may be interested in). Regards Graham. On 21 August 2012 01:46, Nikhil Upadhye wrote: > Hi, > > I have uploaded plugins on github at [1] and [2]. > wikipage of the project is at [3] > > > [1] https://github.com/nikhil9/ImageProcessor > [2] https://github.com/nikhil9/videoplayer > [3] > http://wiki.openstreetmap.org/wiki/Google_Summer_of_Code/2012/Video_Based_Speed_Limit_and_Road_Sign_Detector_plugin_for_JOSM > > > -- > Nikhil > > > > > ___ > dev mailing list > dev@openstreetmap.org > http://lists.openstreetmap.org/listinfo/dev > > -- Graham Jones Hartlepool, UK. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
Are there installation instructions or a getting started guide? Also, I use photos taken every few seconds. Will this also work with them or would I need to convert them into a movie? With the last update to dev@ being about two months ago this project kind of fell off my radar of projects to watch, I wasn't sure if it was still going on. From: Nikhil Upadhye [mailto:nikhil.spitf...@gmail.com] Sent: Monday, August 20, 2012 5:47 PM To: dev@openstreetmap.org Subject: Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping Hi, I have uploaded plugins on github at [1] and [2]. wikipage of the project is at [3] [1] https://github.com/nikhil9/ImageProcessor [2] https://github.com/nikhil9/videoplayer [3] http://wiki.openstreetmap.org/wiki/Google_Summer_of_Code/2012/Video_Based_Sp eed_Limit_and_Road_Sign_Detector_plugin_for_JOSM -- Nikhil ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
Hi, I have uploaded plugins on github at [1] and [2]. wikipage of the project is at [3] [1] https://github.com/nikhil9/ImageProcessor [2] https://github.com/nikhil9/videoplayer [3] http://wiki.openstreetmap.org/wiki/Google_Summer_of_Code/2012/Video_Based_Speed_Limit_and_Road_Sign_Detector_plugin_for_JOSM -- Nikhil ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
Toby Murray-2 wrote > > Well if you really want harsh lighting, you might look at the video I > just uploaded the other day from biking across Kansas. > Wow, those really are difficult lighting conditions! Even as a human one has trouble reading the speed limit signs in those videos. Apart from the Sun, those videos seem like some ideal test cases for this system. High quality, and the type of rural road where this system could be most useful. Very few POIs and then the odd road sign every couple of minutes. So automatically condensing those 18 minutes into a few relevant frames that have interesting content could really be a time saver. Toby Murray-2 wrote > > It is full > motion video too, not timelapse. > I think under these conditions, the benefit of full motion video vs timelapse can be particularly striking. Most of the time the road signs are not readable due to the sun and only at very specific angles can you discern the writing on the signs. With time laps video, chances are that one would miss the short time frame where one can comparatively easily read the signs. The full motion pictures might also allow for some other tricks to be played. With the help of optical flow one can probably determine the depth / distance from the camera and thus the size of objects. As street signs have a well defined size, one could potentially use that as extra heuristics to better identify road signs under these difficult conditions. Once one has locked onto a sign and can track it through the video one can either choose the best frames, or use classifiers that average across the multiple frames in which the sign is viewable, hopefully increasing the accuracy of the system. Depending on how Nikhil gets along, these kind of fancy computer vision tricks are probably beyond the scope of the project though. But it would be cool if one could try some of this out... Kai -- View this message in context: http://gis.19327.n5.nabble.com/GSoC-Video-based-speed-limit-and-roadsign-detector-and-Request-for-videos-of-videomapping-tp5709573p5714254.html Sent from the Developer Discussion mailing list archive at Nabble.com. ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
On Tue, Jun 26, 2012 at 4:17 AM, Nikhil Upadhye wrote: > Hi, > > Thanks everyone for videos. > Here is update of my project. My repositories can be found > at http://github.com/nikhil9/ > I have developed code using javacv for surf based sample matching. It > matches given sample image with provided image. This code is working good > for similar light condition images. I am working on varying light > conditions. I am also preparing sample datasets for haartraining. I have > created sample test plugin 'videoprocessor' which I will further develop to > process images/videos from josm. Well if you really want harsh lighting, you might look at the video I just uploaded the other day from biking across Kansas. It is full motion video too, not timelapse. It was shot while heading directly into a sunrise so the lighting is terrible. Good luck :) I don't think there are any interesting signs past the 65 mph sign at just after the 2 minute mark. http://www.youtube.com/watch?v=rT499J-C4wM Toby ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
Hi, Thanks everyone for videos. Here is update of my project. My repositories can be found at http://github.com/nikhil9/ I have developed code using javacv for surf based sample matching. It matches given sample image with provided image. This code is working good for similar light condition images. I am working on varying light conditions. I am also preparing sample datasets for haartraining. I have created sample test plugin 'videoprocessor' which I will further develop to process images/videos from josm. -- Nikhil On Sun, May 20, 2012 at 2:49 PM, Nikhil Upadhye wrote: > Hello Everyone, > > I am Nikhil Upadhye. I will be developing plugin for JOSM for Video based > speed limit and roadsign detection as a part of Google Summer of Code this > year. I will be using OpenCV java bindings - JavaCV for video processing > purpose. > I have setup wiki page at following link > > > http://wiki.openstreetmap.org/wiki/Google_Summer_of_Code/2012/Video_Based_Speed_Limit_and_Road_Sign_Detector_plugin_for_JOSM > > I would like to request mappers to share videos which they have recorded > for video-mapping. Variety of such videos will be required to test > and develop plugin. So it would be great if someone could share such videos. > > Any suggestions regarding project are welcome. > > > Regards > Nikhil > ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
Hello Nikhil, Am 20.05.2012 um 11:19 schrieb Nikhil Upadhye: > I would like to request mappers to share videos which they have recorded for > video-mapping. Variety of such videos will be required to test and develop > plugin. So it would be great if someone could share such videos. I recorded some video for mapping by car, bicycle and foot. Here is one sample per type. If you need more just ask, then I will upload them on an web or ftp server. They were all recorded with an Nexus S Android Phone. The three samples are stabilised via the YouTube postprocessing. Car: http://www.youtube.com/watch?v=K9Qz3LdX5rg Bicycle: http://www.youtube.com/watch?v=nAvJN1FMG6c Foot: http://www.youtube.com/watch?v=WKO8xFnDAzE Greets, Andi ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
While looking for photo/video + location info, I found this app which does both on Android devices. https://play.google.com/store/apps/details?id=ru.sitis.android.geocam&hl=en Something like this may be useful to get good raw data? Pete On 4 June 2012 19:44, Toby Murray wrote: > On Sun, May 20, 2012 at 4:19 AM, Nikhil Upadhye > wrote: > > Hello Everyone, > > > > I am Nikhil Upadhye. I will be developing plugin for JOSM for Video based > > speed limit and roadsign detection as a part of Google Summer of Code > this > > year. I will be using OpenCV java bindings - JavaCV for video processing > > purpose. > > I have setup wiki page at following link > > > > > http://wiki.openstreetmap.org/wiki/Google_Summer_of_Code/2012/Video_Based_Speed_Limit_and_Road_Sign_Detector_plugin_for_JOSM > > > > I would like to request mappers to share videos which they have recorded > > for video-mapping. Variety of such videos will be required to test > > and develop plugin. So it would be great if someone could share such > videos. > > > > Any suggestions regarding project are welcome. > > I was going to reply to this earlier but didn't get to it immediately > and now I've been gone for a few days. Just had a conversation on IRC > that reminded me of this topic. > > I do have some videos that might be of use to you. They are time-lapse > videos that I made using a GoPro camera mounted on my bicycle on some > longer rides. Pictures were taken at 5 second intervals and then > stitched into a 10 fps video. Any given sign is only going to be > visible for maybe 2-5 frames, depending on how fast I was going. > > The videos are on youtube in 1080p, under a CC license so I think it > should give you the option to download to a .mp4 file for local use. I > also still have the original 11 megapixel stills if that would be of > help. > > The two videos are here: > http://www.youtube.com/watch?v=Q8I7H8qwtqI > http://www.youtube.com/watch?v=h43tsSNqYRA > > I also have a shorter ride in the city that I did in full motion video > with the camera mounted on my helmet and then sped up. It is kind of > shaky. I could supply the original speed video if that would help. I > believe it is only 720p. > http://www.youtube.com/watch?v=pJ_OkzGBoek > > I'm doing Bike Across Kansas next week so I will probably be posting > more similar videos in the future :) > > Toby > > ___ > dev mailing list > dev@openstreetmap.org > http://lists.openstreetmap.org/listinfo/dev > ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
On Sun, May 20, 2012 at 4:19 AM, Nikhil Upadhye wrote: > Hello Everyone, > > I am Nikhil Upadhye. I will be developing plugin for JOSM for Video based > speed limit and roadsign detection as a part of Google Summer of Code this > year. I will be using OpenCV java bindings - JavaCV for video processing > purpose. > I have setup wiki page at following link > > http://wiki.openstreetmap.org/wiki/Google_Summer_of_Code/2012/Video_Based_Speed_Limit_and_Road_Sign_Detector_plugin_for_JOSM > > I would like to request mappers to share videos which they have recorded > for video-mapping. Variety of such videos will be required to test > and develop plugin. So it would be great if someone could share such videos. > > Any suggestions regarding project are welcome. I was going to reply to this earlier but didn't get to it immediately and now I've been gone for a few days. Just had a conversation on IRC that reminded me of this topic. I do have some videos that might be of use to you. They are time-lapse videos that I made using a GoPro camera mounted on my bicycle on some longer rides. Pictures were taken at 5 second intervals and then stitched into a 10 fps video. Any given sign is only going to be visible for maybe 2-5 frames, depending on how fast I was going. The videos are on youtube in 1080p, under a CC license so I think it should give you the option to download to a .mp4 file for local use. I also still have the original 11 megapixel stills if that would be of help. The two videos are here: http://www.youtube.com/watch?v=Q8I7H8qwtqI http://www.youtube.com/watch?v=h43tsSNqYRA I also have a shorter ride in the city that I did in full motion video with the camera mounted on my helmet and then sped up. It is kind of shaky. I could supply the original speed video if that would help. I believe it is only 720p. http://www.youtube.com/watch?v=pJ_OkzGBoek I'm doing Bike Across Kansas next week so I will probably be posting more similar videos in the future :) Toby ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] GSoC-Video based speed limit and roadsign detector and Request for videos of videomapping
2012/5/20 Nikhil Upadhye : > Hello Everyone, > > I am Nikhil Upadhye. I will be developing plugin for JOSM for Video based > speed limit and roadsign detection as a part of Google Summer of Code this > year. I will be using OpenCV java bindings - JavaCV for video processing > purpose. > I have setup wiki page at following link > > http://wiki.openstreetmap.org/wiki/Google_Summer_of_Code/2012/Video_Based_Speed_Limit_and_Road_Sign_Detector_plugin_for_JOSM > > I would like to request mappers to share videos which they have recorded > for video-mapping. Variety of such videos will be required to test > and develop plugin. So it would be great if someone could share such videos. > > Any suggestions regarding project are welcome. This is a pretty cool project, but also very ambitious for the given time frame. In case you haven't seen it, there is an earlier GSoC project, that aimed to create a JOSM plugin that reads the street names off road signs, so you don't have to type it [1]. I think the result is a proof of concept in C, that works all-right under good conditions (certain colour scheme, latin script, ...). Another starting point could be the videomapping plugin by Matthias Meißer. As far as I know, it aims to have a marker on the gps track and synchronize it with the video. Then you can move the marker and jump to the corresponding video frame (or play the video and see the marker move). If you need help with the josm code, you are welcome to join the mailing list! Best, Paul ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
