Re: [mapserver-users] Processing JP2000 files
Hi, From your other mail I concluded that your images are converted into JPEG2000 with some Lizardtech product so it is not a surprise that MrSID/MrSIG JPEG2000 driver is happy with the SOT markers. I do not know if it is a real error in file structure or only a different JPEG2000 dialect. JPEG2000 is very feature rich and complicated. It seems that OpenJPEG driver is not most happy with the JPEG2000 structure in your images. It could be happier if the data streams inside JP2 file were organized in some other way. There are tools (for example Kakadu kdu_transcode) for re-organizing JPEG2000 files without recompression and data loss but that would still mean a rewrite for all your images. OpenJPEG is as its best is rather fast and almost usable for production but it depends on how much load you wait for your server. However, myself I would not follow that route. I would consider two alternatives: - Acquire Mapserver + GDAL with some fast JPEG2000 driver: JPKAK, JP2ECW, or JP2MrSID. Test with your images and take care of a license. Those SDKs are not free and you can't use them on server without paying. - Convert your images into GeoTIFF format (tiled, jpeg compressed, with compressed overviews). You need a fast JPEG200O driver also for that but for example JP2ECW license allows desktop use without payed license (check it!). Conversion will take some time because there are 1440 minutes in a day and you said you have 40 images. With one computer it would take several months so I suggest to gather lots of computers and lots of USB drives so that you can read from one drive and write converted images into another. There is lots of computing power around nowadays and from any medium scaled office you can find 100 laptops which are idle for all nights and weekends. They could handle your data within a week or two. GeoTIFFs will take a bit more disk space mainly because of overviews (JPEG2000 streams are progressive and overviews are unnecessary) but they will be faster with your Mapserver and other GDAL based software like QGIS and with Geoserver too. -Jukka Rahkonen- EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE wrote: Hi Jukka, The MS4W version says it is using Driver: JP2MrSID/MrSID JPEG2000, and the GISInternals version is using Driver: JP2OpenJPEG/JPEG-2000 driver based on OpenJPEG library. I tried to do a gdal_translate on the same file, using the each of the drivers. They both translated the file into a 512x512 jpg, but the JP2OpenJPEG driver listed over a 1000 of these warnings before it stopped listing warnings: Warning 1: Empty SOT marker detected: Psot=12. So, I have 400,000 of these JP2000 images, equally 4.3TBs of data. Should I consider a massive batch conversion to JPG or Geotiff, or is there some way to get the JP2OpenJPEG driver to play nice with these files? Thanks, James From: Rahkonen Jukka (Tike) [jukka.rahko...@mmmtike.fi] Sent: Thursday, March 20, 2014 7:44 AM To: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE; mapserver- us...@lists.osgeo.org Subject: VS: [mapserver-users] Processing JP2000 files Hi, Are your JPEG2000 images the same? SOT marker is JPEG2000 stuff and it means start of tilepart. If images are the same then the message means that something has changed in GDAL part. GDAL has several JPEG200 drivers and they all behave in a bit different way. Check which driver you have in your old system and which one you have now with gdalinfo --formats. I warn that from the free alternatives only OpenJPEG driver is something that can be considered for real use. -Jukka Rahkonen- James_in_Utah wrote: There must have been something wrong with my shapefile, because I tried this at home and I was able to get the same data to work. Now the problem is that the image I see on my client is all washed out, not a variant RGB image but mostly brownish with weak greens. None of the reds or blues are making it through. Plus, where the tiles overlap I can see the edges are blended from the overlapping tiles. This wasn't the case with the older GDAL from MS4W. Has something changed? Is there some directive in the layer that I'm missing? Thanks, James -- View this message in context: http://osgeo- org.1560.x6.nabble.com/Processing-JP2000-files-tp5129997p5130136.html Sent from the Mapserver - User mailing list archive at Nabble.com. ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Processing JP2000 files
Hi Jukka, I have Global Mapper, and used it to do a batch convert to geotiff on a test set of images. The converted files work fine with the OpenJPEG drive, but the size almost doubles and on my 10 year old pc at home it takes about 3 minutes per file to convert. I will look at all the options you mentioned below. Thanks! James From: Rahkonen Jukka (Tike) [jukka.rahko...@mmmtike.fi] Sent: Friday, March 21, 2014 3:33 AM To: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE; 'mapserver-users@lists.osgeo.org' Subject: Re: [mapserver-users] Processing JP2000 files Hi, From your other mail I concluded that your images are converted into JPEG2000 with some Lizardtech product so it is not a surprise that MrSID/MrSIG JPEG2000 driver is happy with the SOT markers. I do not know if it is a real error in file structure or only a different JPEG2000 dialect. JPEG2000 is very feature rich and complicated. It seems that OpenJPEG driver is not most happy with the JPEG2000 structure in your images. It could be happier if the data streams inside JP2 file were organized in some other way. There are tools (for example Kakadu kdu_transcode) for re-organizing JPEG2000 files without recompression and data loss but that would still mean a rewrite for all your images. OpenJPEG is as its best is rather fast and almost usable for production but it depends on how much load you wait for your server. However, myself I would not follow that route. I would consider two alternatives: - Acquire Mapserver + GDAL with some fast JPEG2000 driver: JPKAK, JP2ECW, or JP2MrSID. Test with your images and take care of a license. Those SDKs are not free and you can't use them on server without paying. - Convert your images into GeoTIFF format (tiled, jpeg compressed, with compressed overviews). You need a fast JPEG200O driver also for that but for example JP2ECW license allows desktop use without payed license (check it!). Conversion will take some time because there are 1440 minutes in a day and you said you have 40 images. With one computer it would take several months so I suggest to gather lots of computers and lots of USB drives so that you can read from one drive and write converted images into another. There is lots of computing power around nowadays and from any medium scaled office you can find 100 laptops which are idle for all nights and weekends. They could handle your data within a week or two. GeoTIFFs will take a bit more disk space mainly because of overviews (JPEG2000 streams are progressive and overviews are unnecessary) but they will be faster with your Mapserver and other GDAL based software like QGIS and with Geoserver too. -Jukka Rahkonen- EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE wrote: Hi Jukka, The MS4W version says it is using Driver: JP2MrSID/MrSID JPEG2000, and the GISInternals version is using Driver: JP2OpenJPEG/JPEG-2000 driver based on OpenJPEG library. I tried to do a gdal_translate on the same file, using the each of the drivers. They both translated the file into a 512x512 jpg, but the JP2OpenJPEG driver listed over a 1000 of these warnings before it stopped listing warnings: Warning 1: Empty SOT marker detected: Psot=12. So, I have 400,000 of these JP2000 images, equally 4.3TBs of data. Should I consider a massive batch conversion to JPG or Geotiff, or is there some way to get the JP2OpenJPEG driver to play nice with these files? Thanks, James From: Rahkonen Jukka (Tike) [jukka.rahko...@mmmtike.fi] Sent: Thursday, March 20, 2014 7:44 AM To: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE; mapserver- us...@lists.osgeo.org Subject: VS: [mapserver-users] Processing JP2000 files Hi, Are your JPEG2000 images the same? SOT marker is JPEG2000 stuff and it means start of tilepart. If images are the same then the message means that something has changed in GDAL part. GDAL has several JPEG200 drivers and they all behave in a bit different way. Check which driver you have in your old system and which one you have now with gdalinfo --formats. I warn that from the free alternatives only OpenJPEG driver is something that can be considered for real use. -Jukka Rahkonen- James_in_Utah wrote: There must have been something wrong with my shapefile, because I tried this at home and I was able to get the same data to work. Now the problem is that the image I see on my client is all washed out, not a variant RGB image but mostly brownish with weak greens. None of the reds or blues are making it through. Plus, where the tiles overlap I can see the edges are blended from the overlapping tiles. This wasn't the case with the older GDAL from MS4W. Has something changed? Is there some directive in the layer that I'm missing? Thanks, James -- View this message in context: http://osgeo-
Re: [mapserver-users] Processing JP2000 files
Hi James, It has been a while since I have done any experiments with JPEG2000 and stopwatch but I happened to have a rather recent versions of Kakadu demo executables on my machine (version 7.3.2, the very latest is 7.3.3). We do not have a license for the Kakadu speed pack, but even without it the conversion from lossless JPEG2000 into lossless GeoTIFF feels quite speedy. Here comes the facts: Hardware is a Windows 7 laptop with Intel i7, 8 cores and 8 GB RAM. Test image is 12000 x 12000 pixel 3-band aerial image, 443 MB as uncompressed, 170 MB as lossless JPEG2000 Here is the kdu_expand command and conversion log: Kakadu_732\bin_x64\kdu_expand -i test_in.JP2 -o test_out.tif -cpu 0 -mem Copying Geo box info, size = 389 End-to-end CPU time = 6.317000 seconds (0.014623 us/sample) Consumed 8 tile-part(s) from a total of 1 tile(s). Consumed 174,371,002 codestream bytes (excluding any file format) = 9.687278 bits/pel. Processed using the multi-threaded environment, with 8 parallel threads of execution Native Kakadu application used only 6.3 seconds CPU time for this task. I also made a comparison with GDAL 64-bit with driver JP2ECW (rov): ERDAS JPEG2000 (SDK 5.0) End-to-end time including disk write was 21 second. Kadudu timing was 6.3 seconds but I took timing also to include disk write and it was still under 7 seconds. It may be that file system was still doing some delayed writing but the scale should be about right. My test image was compressed as one tile and JP2OpenJPEG driver could not convert it. Final comparison: gdal_translate from uncompressed tif to uncompressed tif: 3 seconds. TIFF to TIFF with GDAL: 3 seconds JP2 to TIFF with native Kakadu: 7 seconds JP2 to TIFF with GDAL ECWJP2 (SDK 5.0): 21 seconds Your Global Mapper timing with much smaller image was 3 minutes. You have 40 files... -Jukka Rahkonen- -Alkuperäinen viesti- Lähettäjä: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE [mailto:james.evan...@us.af.mil] Lähetetty: 21. maaliskuuta 2014 14:22 Vastaanottaja: Rahkonen Jukka (Tike); 'mapserver-users@lists.osgeo.org' Aihe: RE: [mapserver-users] Processing JP2000 files Hi Jukka, I have Global Mapper, and used it to do a batch convert to geotiff on a test set of images. The converted files work fine with the OpenJPEG drive, but the size almost doubles and on my 10 year old pc at home it takes about 3 minutes per file to convert. I will look at all the options you mentioned below. Thanks! James From: Rahkonen Jukka (Tike) [jukka.rahko...@mmmtike.fi] Sent: Friday, March 21, 2014 3:33 AM To: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE; 'mapserver- us...@lists.osgeo.org' Subject: Re: [mapserver-users] Processing JP2000 files Hi, From your other mail I concluded that your images are converted into JPEG2000 with some Lizardtech product so it is not a surprise that MrSID/MrSIG JPEG2000 driver is happy with the SOT markers. I do not know if it is a real error in file structure or only a different JPEG2000 dialect. JPEG2000 is very feature rich and complicated. It seems that OpenJPEG driver is not most happy with the JPEG2000 structure in your images. It could be happier if the data streams inside JP2 file were organized in some other way. There are tools (for example Kakadu kdu_transcode) for re-organizing JPEG2000 files without recompression and data loss but that would still mean a rewrite for all your images. OpenJPEG is as its best is rather fast and almost usable for production but it depends on how much load you wait for your server. However, myself I would not follow that route. I would consider two alternatives: - Acquire Mapserver + GDAL with some fast JPEG2000 driver: JPKAK, JP2ECW, or JP2MrSID. Test with your images and take care of a license. Those SDKs are not free and you can't use them on server without paying. - Convert your images into GeoTIFF format (tiled, jpeg compressed, with compressed overviews). You need a fast JPEG200O driver also for that but for example JP2ECW license allows desktop use without payed license (check it!). Conversion will take some time because there are 1440 minutes in a day and you said you have 40 images. With one computer it would take several months so I suggest to gather lots of computers and lots of USB drives so that you can read from one drive and write converted images into another. There is lots of computing power around nowadays and from any medium scaled office you can find 100 laptops which are idle for all nights and weekends. They could handle your data within a week or two. GeoTIFFs will take a bit more disk space mainly because of overviews (JPEG2000 streams are progressive and overviews are unnecessary) but they will be faster with your Mapserver and other GDAL based software like QGIS and with Geoserver too. -Jukka Rahkonen- EVANS, JAMES R GS-13 USAF ACC 84
[mapserver-users] WFS filter creates a query using a number instead of text
The problem is when we send a string that represents a number, example: Filter=FilterPropertyIsEqualToPropertyNamecode_cs /PropertyNameLiteral864000/Literal/PropertyIsEqualTo/Filter I get: ERROR: operator does not exist: character varying = integer code_cs= 864000 DescribeFeatureType returns element name=code_cs type=string / In posgis, code_cs is defined as character varying(18) My workaround is using Like instead of EqualTo Filter=FilterPropertyIsLike wildcard='*' singleChar='.' escape='!'PropertyNamecode_cs/PropertyNameLiteral864000/Literal/PropertyIsLike/Filter Is this a bug in mapserver, creating the query using a number, even if DescribeFeatureType returns 'string' as type? thanks Steve ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
[mapserver-users] Converting PDF files to GeoTiff
On a perhaps related subject, I was wondering if there was a preferred way to convert PDF map files to georeferenced GeoTiffs? I have thousands (many thousands) of these to convert. The tools I would like to use in order of preference are: Perl QGIS Any open source software Global Mapper I am on Win7. Here is an example of a file I want to convert: http://www.mflan.com/temp/ny_west point_140214_1941_62500_geo.pdf I am also not adverse to downloading the entire country (USA) of GeoTiff 15 minute topos if they exist somewhere, but I have not found a location that serves them up for free. Mike Houston, TX On 3/21/2014 8:53 AM, mapserver-users-requ...@lists.osgeo.org wrote: Date: Fri, 21 Mar 2014 12:21:30 + From: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE james.evan...@us.af.mil To: Rahkonen Jukka (Tike)jukka.rahko...@mmmtike.fi, 'mapserver-users@lists.osgeo.org' mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] Processing JP2000 files Message-ID: 20ea793b1bc710448656bdc9bd25c4a104c5b...@52zhtx-d07-04d.area52.afnoapps.usaf.mil Content-Type: text/plain; charset=us-ascii Hi Jukka, I have Global Mapper, and used it to do a batch convert to geotiff on a test set of images. The converted files work fine with the OpenJPEG drive, but the size almost doubles and on my 10 year old pc at home it takes about 3 minutes per file to convert. I will look at all the options you mentioned below. Thanks! James ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Converting PDF files to GeoTiff
Hi Mike, I have GM 15. If you send me a couple of your .PDFs I could benchmark converting them with GM. GM is good at tiling, if you want the output broken up, or put in a pyramid. James -Original Message- From: Mike Flannigan [mailto:mikef...@att.net] Sent: Friday, March 21, 2014 9:06 AM To: mapserver-users@lists.osgeo.org Cc: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE; jukka.rahko...@mmmtike.fi Subject: Converting PDF files to GeoTiff On a perhaps related subject, I was wondering if there was a preferred way to convert PDF map files to georeferenced GeoTiffs? I have thousands (many thousands) of these to convert. The tools I would like to use in order of preference are: Perl QGIS Any open source software Global Mapper I am on Win7. Here is an example of a file I want to convert: http://www.mflan.com/temp/ny_west point_140214_1941_62500_geo.pdf I am also not adverse to downloading the entire country (USA) of GeoTiff 15 minute topos if they exist somewhere, but I have not found a location that serves them up for free. Mike Houston, TX On 3/21/2014 8:53 AM, mapserver-users-requ...@lists.osgeo.org wrote: Date: Fri, 21 Mar 2014 12:21:30 + From: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE james.evan...@us.af.mil To: Rahkonen Jukka (Tike)jukka.rahko...@mmmtike.fi, 'mapserver-users@lists.osgeo.org' mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] Processing JP2000 files Message-ID: 20EA793B1BC710448656BDC9BD25C4A104C5B771@52ZHTX-D07-04D.area52.afnoap ps.usaf.mil Content-Type: text/plain; charset=us-ascii Hi Jukka, I have Global Mapper, and used it to do a batch convert to geotiff on a test set of images. The converted files work fine with the OpenJPEG drive, but the size almost doubles and on my 10 year old pc at home it takes about 3 minutes per file to convert. I will look at all the options you mentioned below. Thanks! James smime.p7s Description: S/MIME cryptographic signature ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Converting PDF files to GeoTiff
Hi, GDAL of course. C:\data\tempgdal_translate -of GTiff -co tiled=yes ny_west point_140214_1941_62500_geo.pdf geotiff_out.tif Conversion takes a few seconds only. -Jukka Rahkonen- Mike Flannigan wrote: On a perhaps related subject, I was wondering if there was a preferred way to convert PDF map files to georeferenced GeoTiffs? I have thousands (many thousands) of these to convert. The tools I would like to use in order of preference are: Perl QGIS Any open source software Global Mapper I am on Win7. Here is an example of a file I want to convert: http://www.mflan.com/temp/ny_west point_140214_1941_62500_geo.pdf I am also not adverse to downloading the entire country (USA) of GeoTiff 15 minute topos if they exist somewhere, but I have not found a location that serves them up for free. Mike Houston, TX On 3/21/2014 8:53 AM, mapserver-users-requ...@lists.osgeo.org wrote: Date: Fri, 21 Mar 2014 12:21:30 + From: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE james.evan...@us.af.mil To: Rahkonen Jukka (Tike)jukka.rahko...@mmmtike.fi, 'mapserver-users@lists.osgeo.org' mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] Processing JP2000 files Message-ID: 20EA793B1BC710448656BDC9BD25C4A104C5B771@52ZHTX-D07- 04D.area52.afnoap ps.usaf.mil Content-Type: text/plain; charset=us-ascii Hi Jukka, I have Global Mapper, and used it to do a batch convert to geotiff on a test set of images. The converted files work fine with the OpenJPEG drive, but the size almost doubles and on my 10 year old pc at home it takes about 3 minutes per file to convert. I will look at all the options you mentioned below. Thanks! James ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Converting PDF files to GeoTiff
GDAL 1.8 or newer http://www.gdal.org/frmt_pdf.html Mike Smith Augusta ME -Original Message- From: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] On Behalf Of Mike Flannigan Sent: Friday, March 21, 2014 11:06 AM To: mapserver-users@lists.osgeo.org Subject: [mapserver-users] Converting PDF files to GeoTiff On a perhaps related subject, I was wondering if there was a preferred way to convert PDF map files to georeferenced GeoTiffs? I have thousands (many thousands) of these to convert. The tools I would like to use in order of preference are: Perl QGIS Any open source software Global Mapper I am on Win7. Here is an example of a file I want to convert: http://www.mflan.com/temp/ny_west point_140214_1941_62500_geo.pdf I am also not adverse to downloading the entire country (USA) of GeoTiff 15 minute topos if they exist somewhere, but I have not found a location that serves them up for free. Mike Houston, TX On 3/21/2014 8:53 AM, mapserver-users-requ...@lists.osgeo.org wrote: Date: Fri, 21 Mar 2014 12:21:30 + From: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE james.evan...@us.af.mil To: Rahkonen Jukka (Tike)jukka.rahko...@mmmtike.fi, 'mapserver-users@lists.osgeo.org' mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] Processing JP2000 files Message-ID: 20EA793B1BC710448656BDC9BD25C4A104C5B771@52ZHTX-D07-04D.area52.afnoap ps.usaf.mil Content-Type: text/plain; charset=us-ascii Hi Jukka, I have Global Mapper, and used it to do a batch convert to geotiff on a test set of images. The converted files work fine with the OpenJPEG drive, but the size almost doubles and on my 10 year old pc at home it takes about 3 minutes per file to convert. I will look at all the options you mentioned below. Thanks! James ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Converting PDF files to GeoTiff
You're working with the USGS historic topo map collection. In the long run it might be helpful to communicate to the appropriate office of USGS your need for these to be provided directly in GeoTiff rather than in GeoPDF. I'm sure that our people discussed the format issue and came to their current decision based on many factors, including the demand they foresaw for specific formats. But if there is a much larger demand for GeoTiff than they had anticipated, I imagine that might enable them to revisit the decision. Of course the conversion would entail a cost, but if the number of realistic users is large enough, it would seem efficient to do this conversion once for everyone rather than separately by each user. The key issue, I suspect, is balancing the number of people who would benefit against the cost of creating and maintaining an accessible archive of converted GeoPDFs. But the information needed by the current maintainers is the extent of the demand. This is just my opinion, and I'm in no position to promise anything, but I do encourage you to communicate your needs to the current maintainers. Peter On Fri, Mar 21, 2014 at 11:06 AM, Smith, Michael michael.sm...@maine.gov wrote: GDAL 1.8 or newer http://www.gdal.org/frmt_pdf.html Mike Smith Augusta ME -Original Message- From: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] On Behalf Of Mike Flannigan Sent: Friday, March 21, 2014 11:06 AM To: mapserver-users@lists.osgeo.org Subject: [mapserver-users] Converting PDF files to GeoTiff On a perhaps related subject, I was wondering if there was a preferred way to convert PDF map files to georeferenced GeoTiffs? I have thousands (many thousands) of these to convert. The tools I would like to use in order of preference are: Perl QGIS Any open source software Global Mapper I am on Win7. Here is an example of a file I want to convert: http://www.mflan.com/temp/ny_west point_140214_1941_62500_geo.pdf I am also not adverse to downloading the entire country (USA) of GeoTiff 15 minute topos if they exist somewhere, but I have not found a location that serves them up for free. Mike Houston, TX On 3/21/2014 8:53 AM, mapserver-users-requ...@lists.osgeo.org wrote: Date: Fri, 21 Mar 2014 12:21:30 + From: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE james.evan...@us.af.mil To: Rahkonen Jukka (Tike)jukka.rahko...@mmmtike.fi, 'mapserver-users@lists.osgeo.org' mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] Processing JP2000 files Message-ID: 20EA793B1BC710448656BDC9BD25C4A104C5B771@52ZHTX-D07-04D.area52.afnoap ps.usaf.mil Content-Type: text/plain; charset=us-ascii Hi Jukka, I have Global Mapper, and used it to do a batch convert to geotiff on a test set of images. The converted files work fine with the OpenJPEG drive, but the size almost doubles and on my 10 year old pc at home it takes about 3 minutes per file to convert. I will look at all the options you mentioned below. Thanks! James ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users -- Peter N. Schweitzer (U.S. Geological Survey, Reston, VA 20192) (703) 648-6533 email: pschweit...@usgs.gov http://geology.usgs.gov/peter/ ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Converting PDF files to GeoTiff
Thank you. Give me some time and I'll post a few of these maps. I'll try GDAL. I'm not sure if I want them tiled or not. Whatever makes the most sense. Generally my GeoTiffs have the border on them, so I guess that is my preference. Execution time is not really a concern for me either. I always have at least one computer running and doing things like this. I'm in no big hurry. It would be nice if GDAL could do one map in under 3 minutes. Lets see: MO has 650. 650 * 48 = 31,200. 31,200 * 3 / 1440 = 65 days. That should not be a problem. I'll be surprised if the finished product is georeferenced. If it is I'm really in business. Mike On 3/21/2014 10:08 AM, EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE wrote: Hi Mike, I have GM 15. If you send me a couple of your .PDFs I could benchmark converting them with GM. GM is good at tiling, if you want the output broken up, or put in a pyramid. James -Original Message- From: Mike Flannigan [mailto:mikef...@att.net] Sent: Friday, March 21, 2014 9:06 AM To: mapserver-users@lists.osgeo.org Cc: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE; jukka.rahko...@mmmtike.fi Subject: Converting PDF files to GeoTiff On a perhaps related subject, I was wondering if there was a preferred way to convert PDF map files to georeferenced GeoTiffs? I have thousands (many thousands) of these to convert. The tools I would like to use in order of preference are: Perl QGIS Any open source software Global Mapper I am on Win7. Here is an example of a file I want to convert: http://www.mflan.com/temp/ny_west point_140214_1941_62500_geo.pdf I am also not adverse to downloading the entire country (USA) of GeoTiff 15 minute topos if they exist somewhere, but I have not found a location that serves them up for free. Mike Houston, TX On 3/21/2014 8:53 AM, mapserver-users-requ...@lists.osgeo.org wrote: Date: Fri, 21 Mar 2014 12:21:30 + From: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE james.evan...@us.af.mil To: Rahkonen Jukka (Tike)jukka.rahko...@mmmtike.fi, 'mapserver-users@lists.osgeo.org' mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] Processing JP2000 files Message-ID: 20EA793B1BC710448656BDC9BD25C4A104C5B771@52ZHTX-D07-04D.area52.afnoap ps.usaf.mil Content-Type: text/plain; charset=us-ascii Hi Jukka, I have Global Mapper, and used it to do a batch convert to geotiff on a test set of images. The converted files work fine with the OpenJPEG drive, but the size almost doubles and on my 10 year old pc at home it takes about 3 minutes per file to convert. I will look at all the options you mentioned below. Thanks! James ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Converting PDF files to GeoTiff
Thank you. I should have known that, but I didn't. Mike On 3/21/2014 10:06 AM, Smith, Michael wrote: GDAL 1.8 or newer http://www.gdal.org/frmt_pdf.html Mike Smith Augusta ME -Original Message- From: mapserver-users-boun...@lists.osgeo.org [mailto:mapserver-users-boun...@lists.osgeo.org] On Behalf Of Mike Flannigan Sent: Friday, March 21, 2014 11:06 AM To: mapserver-users@lists.osgeo.org Subject: [mapserver-users] Converting PDF files to GeoTiff On a perhaps related subject, I was wondering if there was a preferred way to convert PDF map files to georeferenced GeoTiffs? I have thousands (many thousands) of these to convert. The tools I would like to use in order of preference are: Perl QGIS Any open source software Global Mapper I am on Win7. Here is an example of a file I want to convert: http://www.mflan.com/temp/ny_west point_140214_1941_62500_geo.pdf I am also not adverse to downloading the entire country (USA) of GeoTiff 15 minute topos if they exist somewhere, but I have not found a location that serves them up for free. Mike Houston, TX On 3/21/2014 8:53 AM, mapserver-users-requ...@lists.osgeo.org wrote: Date: Fri, 21 Mar 2014 12:21:30 + From: EVANS, JAMES R GS-13 USAF ACC 84 RADES/SCZE james.evan...@us.af.mil To: Rahkonen Jukka (Tike)jukka.rahko...@mmmtike.fi, 'mapserver-users@lists.osgeo.org' mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] Processing JP2000 files Message-ID: 20EA793B1BC710448656BDC9BD25C4A104C5B771@52ZHTX-D07-04D.area52.afnoap ps.usaf.mil Content-Type: text/plain; charset=us-ascii Hi Jukka, I have Global Mapper, and used it to do a batch convert to geotiff on a test set of images. The converted files work fine with the OpenJPEG drive, but the size almost doubles and on my 10 year old pc at home it takes about 3 minutes per file to convert. I will look at all the options you mentioned below. Thanks! James ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Converting PDF files to GeoTiff
Thank you. That is a great idea. I need to make some friends at the USGS anyway. I went to school in Rolla, MO, and I have had friends at that office in the distant past. One was Hal Baker. I love these 15' topos. They are a real gem. I'm surprised they are so hard to come by electronically. Mike On 3/21/2014 10:37 AM, Schweitzer, Peter wrote: You're working with the USGS historic topo map collection. In the long run it might be helpful to communicate to the appropriate office of USGS your need for these to be provided directly in GeoTiff rather than in GeoPDF. I'm sure that our people discussed the format issue and came to their current decision based on many factors, including the demand they foresaw for specific formats. But if there is a much larger demand for GeoTiff than they had anticipated, I imagine that might enable them to revisit the decision. Of course the conversion would entail a cost, but if the number of realistic users is large enough, it would seem efficient to do this conversion once for everyone rather than separately by each user. The key issue, I suspect, is balancing the number of people who would benefit against the cost of creating and maintaining an accessible archive of converted GeoPDFs. But the information needed by the current maintainers is the extent of the demand. This is just my opinion, and I'm in no position to promise anything, but I do encourage you to communicate your needs to the current maintainers. Peter ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
[mapserver-users] Running a .aspx script
HI, I'm trying to get mapserver (from GISInternals) running under IIS7. I need to figure out how to get it to execute a .aspx script that I'm using as a tile server. I use the gdal-minidrivers to call the script, and that part seems to be working fine, but I get an error 404 from what looks like a valid URL. Under MS4W under Apache, I added .aspx to the list of .php extensions in the httpd.conf for application type application/x-httpd-php which ran /cgi-bin/php-cgi.exe. What's the equivalent under IIS? Any clues would be appreciated! Thanks, James ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
