subject:"Re\: \[Xastir\] GeoPDF try"

Re: [Xastir] GeoPDF try

2015-12-21 Thread ZPO

I used: http://geonames.usgs.gov/apex/f?p=262:1:0

Which allowed me to easily request a listing for a full state, 24K scale,
and USTopo. From there you can download a CSV and strip it down to only the
current release (sort on "Version") and delete all the fields other than
the download link. From there I fed it into wget as: "wget -i filename -nd"
to download all the current GeoPDF USTopo files for a given state. I let it
run overnight. The map downloads ran at about 1.2-1.5Mb/s whether I had 1
state downloading or 5 states downloading concurrently. I let them run
overnight. 5 states completed in something around 10 hours (WA, OR, ID, MT,
UT)

I've been reading all the GeoPDF conversion threads with interest and
thought it should make a good project to leave running in the background
over the holidays. My end goal is a set of just the DRGs and a set of just
the Orthophotos converted to GeoTIFF. I will then publish them via
bittorrent and a private tracker so they can be downloaded by everyone and
used without having to go through all the steps.

Question - should I make them available as state-level bundles (single huge
file to download), or as individual files (1K-2K torrent files for larger
states)? Perhaps both? I'd like to make them efficient for others to grab
and seed once they've downloaded them.

Onward! :)

73-KY9K/Brian

On Mon, Dec 14, 2015 at 8:34 AM, Lee Bengston <lee.bengs...@gmail.com>
wrote:

> First go here: http://nationalmap.gov/ustopo/index.html
>
> Then select "Download Maps (map store)"
>
> For now leave the map selection at '7.5 and 15 minute', and leave the
> bullet selection to "Navigate".  Zoom in and drag the US map to your
> desired location.  When you zoom in far enough, you will see a rectangular
> grid; each rectangle represents a separate map.  At that point you should
> be able to see which maps you want.  Change the bullet selection to "Mark
> Points".  Click anywhere inside a rectangle to create a red marker for that
> map.  Then click the red marker itself, which will pull up a list of maps
> to download.  Generally you will want to download the first map (top of the
> list).
>
> So far I have only downloaded 7.5 minute maps, but I may try some of the
> other larger maps and have Xastir use those at higher zoom levels.
>
> Lee - K5DAT
>
>
> On Mon, Dec 14, 2015 at 11:08 AM, Kurt <ksav...@sbcglobal.net> wrote:
>
> > Any tips on map selection would be appreciated too say like downloading
> > one's state of residence for example.  Clicked on the selection and there
> > are a lot of maps/types there.
> > It's like anything else, there's a learning curve.   Kurt KC9LDH :-)
> >
>
>
> >   From: Lee Bengston <lee.bengs...@gmail.com>
> >  To: Xastir - APRS client software discussion <xastir@lists.xastir.org>
> >  Sent: Monday, December 14, 2015 9:29 AM
> >  Subject: Re: [Xastir] GeoPDF try
> >
> > LOL - I already said I would do that.  I'm not exactly sure how long it
> > will take.  In the meantime, anyone interested in these maps can download
> > them via the link below.  Might as well find and download the maps you
> > intend to convert for use with Xastir.
> >
> > http://nationalmap.gov/ustopo/index.html
> >
> > Select the "Download Maps/Map Store" link.
> >
> > Lee - K5DAT
> >
> >
> > On Sun, Dec 13, 2015 at 11:54 PM, David Ranch <xas...@trinnet.net>
> wrote:
> >
> > > That looks REALLY nice Lee!  For a Christmas present.. could you write
> up
> > > a doc of the steps to get that fully working?  Though the online OSM
> > work,
> > > they are pretty dark and blurry for my tastes.  These would be a major
> > > upgrade!
> > >
> > > --David
> > > KI6ZHD
> > >
> > >
> > >
> > > On 12/13/2015 08:38 PM, Lee Bengston wrote:
> > >
> > >> OK, got the conversions working.  Some screen shots are available via
> > the
> > >> links below:
> > >>
> > >> Screen shot 1 - the geotiff file for Leesburg, VA as displayed in the
> > >> ristretto image viewer in Xubuntu 15.04.
> > >> www.175moonlight.com/xastir/pics/GeoTIFF-ristretto-screenshot.png
> > >>
> > >> Screen shot 2 - the same geotiff file displayed in Xastir.  Still a
> > decent
> > >> offline map, but it doesn't display the text as clearly.
> > >> www.175moonlight.com/xastir/pics/GeoTIFF-xastir-screenshot.png
> > >>
> > >> I'll plan to provide detailed instructions for the following:
> > >>
> > >> - where to download the geoPDF maps
>

Re: [Xastir] GeoPDF try

2015-12-14 Thread Kurt

Any tips on map selection would be appreciated too say like downloading one's 
state of residence for example.  Clicked on the selection and there are a lot 
of maps/types there.
It's like anything else, there's a learning curve.   Kurt KC9LDH :-)
  From: Lee Bengston <lee.bengs...@gmail.com>
 To: Xastir - APRS client software discussion <xastir@lists.xastir.org> 
 Sent: Monday, December 14, 2015 9:29 AM
 Subject: Re: [Xastir] GeoPDF try
   
LOL - I already said I would do that.  I'm not exactly sure how long it
will take.  In the meantime, anyone interested in these maps can download
them via the link below.  Might as well find and download the maps you
intend to convert for use with Xastir.

http://nationalmap.gov/ustopo/index.html

Select the "Download Maps/Map Store" link.

Lee - K5DAT


On Sun, Dec 13, 2015 at 11:54 PM, David Ranch <xas...@trinnet.net> wrote:

> That looks REALLY nice Lee!  For a Christmas present.. could you write up
> a doc of the steps to get that fully working?  Though the online OSM work,
> they are pretty dark and blurry for my tastes.  These would be a major
> upgrade!
>
> --David
> KI6ZHD
>
>
>
> On 12/13/2015 08:38 PM, Lee Bengston wrote:
>
>> OK, got the conversions working.  Some screen shots are available via the
>> links below:
>>
>> Screen shot 1 - the geotiff file for Leesburg, VA as displayed in the
>> ristretto image viewer in Xubuntu 15.04.
>> www.175moonlight.com/xastir/pics/GeoTIFF-ristretto-screenshot.png
>>
>> Screen shot 2 - the same geotiff file displayed in Xastir.  Still a decent
>> offline map, but it doesn't display the text as clearly.
>> www.175moonlight.com/xastir/pics/GeoTIFF-xastir-screenshot.png
>>
>> I'll plan to provide detailed instructions for the following:
>>
>> - where to download the geoPDF maps
>> - what Xastir needs in order to support geoTiff maps
>> - how to install what is required to convert the USGS geoPDF files to
>> geoTiff files
>> - how to convert the files with the applicable perl script
>> - where to put the maps so Xastir can use them
>>
>>
>> Best,
>> Lee - K5DAT
>>
>>
>> On Sun, Dec 13, 2015 at 10:43 AM, Lee Bengston <lee.bengs...@gmail.com>
>> wrote:
>>
>>
>>> On Sun, Dec 13, 2015 at 10:11 AM, Lee Bengston <lee.bengs...@gmail.com>
>>> wrote:
>>>
>>> On Sun, Dec 13, 2015 at 12:23 AM, Tom Russo <ru...@bogodyn.org> wrote:
>>>>
>>>> 
>>>>>
>>>>
>>> Without the imagery, you don't need the high DPI that will be used by
>>>>> default,
>>>>> and so the thing processes much, much quicker (less than a minute, vs.
>>>>> more
>>>>> than 40 minutes).  And instead of a 100+MB file, you get a 26MB file.
>>>>> The result looks very, very nice.
>>>>>
>>>>>
>>>>> 
>>>> Thanks, Tom, for all the detailed feedback, which is not out of
>>>> character
>>>> :-)
>>>>
>>>> I thought building gdal from source might be required given I had to do
>>>> that last time.
>>>>
>>>>  Back then I had aspirations of documenting step by step what it took
>>>> to
>>>> convert and use those maps but never got to it.  At that time they came
>>>> out
>>>> a little dark but were still very usable.  It sounds like the newer
>>>> geoPDF's may convert into nicer looking maps.  I'm off to try the FTP
>>>> site
>>>> from your other message so I can take a look.
>>>>
>>>> I took a look, and the map does look great.  The goal now is to get
>>> conversion working for me and plug them into Xastir.  I'll post a link
>>> to a
>>> screen shot of Xastir using them when
>>>
>>> I have it up and running.
>>>
>>> 
>>>
>>> BR,
>>> Lee - K5DAT
>>>
>>>
>>> ___
>> Xastir mailing list
>> Xastir@lists.xastir.org
>> http://xastir.org/mailman/listinfo/xastir


>>
>
> ___
> Xastir mailing list
> Xastir@lists.xastir.org
> http://xastir.org/mailman/listinfo/xastir
>
___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir


 
___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

2015-12-14 Thread Lee Bengston

LOL - I already said I would do that.  I'm not exactly sure how long it
will take.  In the meantime, anyone interested in these maps can download
them via the link below.  Might as well find and download the maps you
intend to convert for use with Xastir.

http://nationalmap.gov/ustopo/index.html

Select the "Download Maps/Map Store" link.

Lee - K5DAT


On Sun, Dec 13, 2015 at 11:54 PM, David Ranch  wrote:

> That looks REALLY nice Lee!  For a Christmas present.. could you write up
> a doc of the steps to get that fully working?  Though the online OSM work,
> they are pretty dark and blurry for my tastes.  These would be a major
> upgrade!
>
> --David
> KI6ZHD
>
>
>
> On 12/13/2015 08:38 PM, Lee Bengston wrote:
>
>> OK, got the conversions working.  Some screen shots are available via the
>> links below:
>>
>> Screen shot 1 - the geotiff file for Leesburg, VA as displayed in the
>> ristretto image viewer in Xubuntu 15.04.
>> www.175moonlight.com/xastir/pics/GeoTIFF-ristretto-screenshot.png
>>
>> Screen shot 2 - the same geotiff file displayed in Xastir.  Still a decent
>> offline map, but it doesn't display the text as clearly.
>> www.175moonlight.com/xastir/pics/GeoTIFF-xastir-screenshot.png
>>
>> I'll plan to provide detailed instructions for the following:
>>
>> - where to download the geoPDF maps
>> - what Xastir needs in order to support geoTiff maps
>> - how to install what is required to convert the USGS geoPDF files to
>> geoTiff files
>> - how to convert the files with the applicable perl script
>> - where to put the maps so Xastir can use them
>>
>>
>> Best,
>> Lee - K5DAT
>>
>>
>> On Sun, Dec 13, 2015 at 10:43 AM, Lee Bengston 
>> wrote:
>>
>>
>>> On Sun, Dec 13, 2015 at 10:11 AM, Lee Bengston 
>>> wrote:
>>>
>>> On Sun, Dec 13, 2015 at 12:23 AM, Tom Russo  wrote:

 
>

>>> Without the imagery, you don't need the high DPI that will be used by
> default,
> and so the thing processes much, much quicker (less than a minute, vs.
> more
> than 40 minutes).  And instead of a 100+MB file, you get a 26MB file.
> The result looks very, very nice.
>
>
> 
 Thanks, Tom, for all the detailed feedback, which is not out of
 character
 :-)

 I thought building gdal from source might be required given I had to do
 that last time.

  Back then I had aspirations of documenting step by step what it took
 to
 convert and use those maps but never got to it.  At that time they came
 out
 a little dark but were still very usable.  It sounds like the newer
 geoPDF's may convert into nicer looking maps.  I'm off to try the FTP
 site
 from your other message so I can take a look.

 I took a look, and the map does look great.  The goal now is to get
>>> conversion working for me and plug them into Xastir.  I'll post a link
>>> to a
>>> screen shot of Xastir using them when
>>>
>>> I have it up and running.
>>>
>>> 
>>>
>>> BR,
>>> Lee - K5DAT
>>>
>>>
>>> ___
>> Xastir mailing list
>> Xastir@lists.xastir.org
>> http://xastir.org/mailman/listinfo/xastir
>>
>
> ___
> Xastir mailing list
> Xastir@lists.xastir.org
> http://xastir.org/mailman/listinfo/xastir
>
___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

2015-12-14 Thread Kurt

Looks very promising Lee.  This script kiddie setup Xastir until 
./configuresaid support for everything was in there before hitting make.
Looking forward to the helpfile.  Thanks heavens for a high speed connectionat 
work I can get volumes across off hours.
Kurt KC9LDH

  From: Lee Bengston <lee.bengs...@gmail.com>
 To: Xastir - APRS client software discussion <xas...@xastir.org> 
 Sent: Sunday, December 13, 2015 10:38 PM
 Subject: Re: [Xastir] GeoPDF try

OK, got the conversions working.  Some screen shots are available via the
links below:

Screen shot 1 - the geotiff file for Leesburg, VA as displayed in the
ristretto image viewer in Xubuntu 15.04.
www.175moonlight.com/xastir/pics/GeoTIFF-ristretto-screenshot.png

Screen shot 2 - the same geotiff file displayed in Xastir.  Still a decent
offline map, but it doesn't display the text as clearly.
www.175moonlight.com/xastir/pics/GeoTIFF-xastir-screenshot.png

I'll plan to provide detailed instructions for the following:

- where to download the geoPDF maps
- what Xastir needs in order to support geoTiff maps
- how to install what is required to convert the USGS geoPDF files to
geoTiff files
- how to convert the files with the applicable perl script
- where to put the maps so Xastir can use them

Best,
Lee - K5DAT

___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

2015-12-14 Thread Lee Bengston

First go here: http://nationalmap.gov/ustopo/index.html

Then select "Download Maps (map store)"

For now leave the map selection at '7.5 and 15 minute', and leave the
bullet selection to "Navigate".  Zoom in and drag the US map to your
desired location.  When you zoom in far enough, you will see a rectangular
grid; each rectangle represents a separate map.  At that point you should
be able to see which maps you want.  Change the bullet selection to "Mark
Points".  Click anywhere inside a rectangle to create a red marker for that
map.  Then click the red marker itself, which will pull up a list of maps
to download.  Generally you will want to download the first map (top of the
list).

So far I have only downloaded 7.5 minute maps, but I may try some of the
other larger maps and have Xastir use those at higher zoom levels.

Lee - K5DAT


On Mon, Dec 14, 2015 at 11:08 AM, Kurt <ksav...@sbcglobal.net> wrote:

> Any tips on map selection would be appreciated too say like downloading
> one's state of residence for example.  Clicked on the selection and there
> are a lot of maps/types there.
> It's like anything else, there's a learning curve.   Kurt KC9LDH :-)
>


>   From: Lee Bengston <lee.bengs...@gmail.com>
>  To: Xastir - APRS client software discussion <xastir@lists.xastir.org>
>  Sent: Monday, December 14, 2015 9:29 AM
>  Subject: Re: [Xastir] GeoPDF try
>
> LOL - I already said I would do that.  I'm not exactly sure how long it
> will take.  In the meantime, anyone interested in these maps can download
> them via the link below.  Might as well find and download the maps you
> intend to convert for use with Xastir.
>
> http://nationalmap.gov/ustopo/index.html
>
> Select the "Download Maps/Map Store" link.
>
> Lee - K5DAT
>
>
> On Sun, Dec 13, 2015 at 11:54 PM, David Ranch <xas...@trinnet.net> wrote:
>
> > That looks REALLY nice Lee!  For a Christmas present.. could you write up
> > a doc of the steps to get that fully working?  Though the online OSM
> work,
> > they are pretty dark and blurry for my tastes.  These would be a major
> > upgrade!
> >
> > --David
> > KI6ZHD
> >
> >
> >
> > On 12/13/2015 08:38 PM, Lee Bengston wrote:
> >
> >> OK, got the conversions working.  Some screen shots are available via
> the
> >> links below:
> >>
> >> Screen shot 1 - the geotiff file for Leesburg, VA as displayed in the
> >> ristretto image viewer in Xubuntu 15.04.
> >> www.175moonlight.com/xastir/pics/GeoTIFF-ristretto-screenshot.png
> >>
> >> Screen shot 2 - the same geotiff file displayed in Xastir.  Still a
> decent
> >> offline map, but it doesn't display the text as clearly.
> >> www.175moonlight.com/xastir/pics/GeoTIFF-xastir-screenshot.png
> >>
> >> I'll plan to provide detailed instructions for the following:
> >>
> >> - where to download the geoPDF maps
> >> - what Xastir needs in order to support geoTiff maps
> >> - how to install what is required to convert the USGS geoPDF files to
> >> geoTiff files
> >> - how to convert the files with the applicable perl script
> >> - where to put the maps so Xastir can use them
> >>
> >>
> >> Best,
> >> Lee - K5DAT
> >>
> >>
> >> On Sun, Dec 13, 2015 at 10:43 AM, Lee Bengston <lee.bengs...@gmail.com>
> >> wrote:
> >>
> >>
> >>> On Sun, Dec 13, 2015 at 10:11 AM, Lee Bengston <lee.bengs...@gmail.com
> >
> >>> wrote:
> >>>
> >>> On Sun, Dec 13, 2015 at 12:23 AM, Tom Russo <ru...@bogodyn.org> wrote:
> >>>>
> >>>> 
> >>>>>
> >>>>
> >>> Without the imagery, you don't need the high DPI that will be used by
> >>>>> default,
> >>>>> and so the thing processes much, much quicker (less than a minute,
> vs.
> >>>>> more
> >>>>> than 40 minutes).  And instead of a 100+MB file, you get a 26MB file.
> >>>>> The result looks very, very nice.
> >>>>>
> >>>>>
> >>>>> 
> >>>> Thanks, Tom, for all the detailed feedback, which is not out of
> >>>> character
> >>>> :-)
> >>>>
> >>>> I thought building gdal from source might be required given I had to
> do
> >>>> that last time.
> >>>>
> >>>>  Back then I had aspirations of documenting step by step what it took
> >>>> to
> >>>>

Re: [Xastir] GeoPDF try

2015-12-13 Thread David Ranch

That looks REALLY nice Lee!  For a Christmas present.. could you write 
up a doc of the steps to get that fully working?  Though the online OSM 
work, they are pretty dark and blurry for my tastes.  These would be a 
major upgrade!


--David
KI6ZHD


On 12/13/2015 08:38 PM, Lee Bengston wrote:

OK, got the conversions working.  Some screen shots are available via the
links below:

Screen shot 1 - the geotiff file for Leesburg, VA as displayed in the
ristretto image viewer in Xubuntu 15.04.
www.175moonlight.com/xastir/pics/GeoTIFF-ristretto-screenshot.png

Screen shot 2 - the same geotiff file displayed in Xastir.  Still a decent
offline map, but it doesn't display the text as clearly.
www.175moonlight.com/xastir/pics/GeoTIFF-xastir-screenshot.png

I'll plan to provide detailed instructions for the following:

- where to download the geoPDF maps
- what Xastir needs in order to support geoTiff maps
- how to install what is required to convert the USGS geoPDF files to
geoTiff files
- how to convert the files with the applicable perl script
- where to put the maps so Xastir can use them


Best,
Lee - K5DAT


On Sun, Dec 13, 2015 at 10:43 AM, Lee Bengston 
wrote:



On Sun, Dec 13, 2015 at 10:11 AM, Lee Bengston 
wrote:


On Sun, Dec 13, 2015 at 12:23 AM, Tom Russo  wrote:






Without the imagery, you don't need the high DPI that will be used by
default,
and so the thing processes much, much quicker (less than a minute, vs.
more
than 40 minutes).  And instead of a 100+MB file, you get a 26MB file.
The result looks very, very nice.




Thanks, Tom, for all the detailed feedback, which is not out of character
:-)

I thought building gdal from source might be required given I had to do
that last time.

 Back then I had aspirations of documenting step by step what it took to
convert and use those maps but never got to it.  At that time they came out
a little dark but were still very usable.  It sounds like the newer
geoPDF's may convert into nicer looking maps.  I'm off to try the FTP site
from your other message so I can take a look.


I took a look, and the map does look great.  The goal now is to get
conversion working for me and plug them into Xastir.  I'll post a link to a
screen shot of Xastir using them when

I have it up and running.



BR,
Lee - K5DAT



___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir


___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

2015-12-13 Thread Lee Bengston

On Sun, Dec 13, 2015 at 12:23 AM, Tom Russo  wrote:

> On Sat, Dec 12, 2015 at 09:32:17PM -0700, we recorded a bogon-computron
> collision of the  flavor, containing:
> > You can experiment with compression to see if it works for you.  Look at
> > the bottom of geopdf2gtiff.pl and you'll see two commented out
> > lines:
>
> I just experimented with this and found very little benefit from
> compression.
> No matter what compression algorithm I chose, I still got a file bigger
> than
> 110MB.  Not worth bothering.  I didn't try any of the compressed versions
> in
> Xastir.
>
> If you would like to try generating the GeoTIFF without imagery, find the
> line towards the end of the script where the code sets up the gdalwarp
> command and add
>   -oo 'LAYERS_OFF=Images,Images.Orthoimage' -oo 'DPI=250.0'
> to the command line options.
>
> Without the imagery, you don't need the high DPI that will be used by
> default,
> and so the thing processes much, much quicker (less than a minute, vs. more
> than 40 minutes).  And instead of a 100+MB file, you get a 26MB file.
> The result looks very, very nice.
>
>

Thanks, Tom, for all the detailed feedback, which is not out of character
:-)

I thought building gdal from source might be required given I had to do
that last time.

 Back then I had aspirations of documenting step by step what it took to
convert and use those maps but never got to it.  At that time they came out
a little dark but were still very usable.  It sounds like the newer
geoPDF's may convert into nicer looking maps.  I'm off to try the FTP site
from your other message so I can take a look.

Thanks again.
Lee - K5DAT
___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

2015-12-13 Thread Lee Bengston

On Sun, Dec 13, 2015 at 10:11 AM, Lee Bengston 
wrote:

> On Sun, Dec 13, 2015 at 12:23 AM, Tom Russo  wrote:
>
>>
>> 


>
>> Without the imagery, you don't need the high DPI that will be used by
>> default,
>> and so the thing processes much, much quicker (less than a minute, vs.
>> more
>> than 40 minutes).  And instead of a 100+MB file, you get a 26MB file.
>> The result looks very, very nice.
>>
>>
> 
> Thanks, Tom, for all the detailed feedback, which is not out of character
> :-)
>
> I thought building gdal from source might be required given I had to do
> that last time.
>
>  Back then I had aspirations of documenting step by step what it took to
> convert and use those maps but never got to it.  At that time they came out
> a little dark but were still very usable.  It sounds like the newer
> geoPDF's may convert into nicer looking maps.  I'm off to try the FTP site
> from your other message so I can take a look.
>

I took a look, and the map does look great.  The goal now is to get
conversion working for me and plug them into Xastir.  I'll post a link to a
screen shot of Xastir using them when

I have it up and running.



BR,
Lee - K5DAT
___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

2015-12-13 Thread Lee Bengston

OK, got the conversions working.  Some screen shots are available via the
links below:

Screen shot 1 - the geotiff file for Leesburg, VA as displayed in the
ristretto image viewer in Xubuntu 15.04.
www.175moonlight.com/xastir/pics/GeoTIFF-ristretto-screenshot.png

Screen shot 2 - the same geotiff file displayed in Xastir.  Still a decent
offline map, but it doesn't display the text as clearly.
www.175moonlight.com/xastir/pics/GeoTIFF-xastir-screenshot.png

I'll plan to provide detailed instructions for the following:

- where to download the geoPDF maps
- what Xastir needs in order to support geoTiff maps
- how to install what is required to convert the USGS geoPDF files to
geoTiff files
- how to convert the files with the applicable perl script
- where to put the maps so Xastir can use them


Best,
Lee - K5DAT


On Sun, Dec 13, 2015 at 10:43 AM, Lee Bengston 
wrote:

>
>
> On Sun, Dec 13, 2015 at 10:11 AM, Lee Bengston 
> wrote:
>
>> On Sun, Dec 13, 2015 at 12:23 AM, Tom Russo  wrote:
>>
>>>
>>> 
>
>
>>
>>> Without the imagery, you don't need the high DPI that will be used by
>>> default,
>>> and so the thing processes much, much quicker (less than a minute, vs.
>>> more
>>> than 40 minutes).  And instead of a 100+MB file, you get a 26MB file.
>>> The result looks very, very nice.
>>>
>>>
>> 
>> Thanks, Tom, for all the detailed feedback, which is not out of character
>> :-)
>>
>> I thought building gdal from source might be required given I had to do
>> that last time.
>>
>>  Back then I had aspirations of documenting step by step what it took to
>> convert and use those maps but never got to it.  At that time they came out
>> a little dark but were still very usable.  It sounds like the newer
>> geoPDF's may convert into nicer looking maps.  I'm off to try the FTP site
>> from your other message so I can take a look.
>>
>
> I took a look, and the map does look great.  The goal now is to get
> conversion working for me and plug them into Xastir.  I'll post a link to a
> screen shot of Xastir using them when
>
> I have it up and running.
>
> 
>
> BR,
> Lee - K5DAT
>
>
___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

2015-12-12 Thread Tom Russo

On Sat, Dec 12, 2015 at 08:55:58PM -0500, we recorded a bogon-computron 
collision of the  flavor, containing:
> 
> $ ./geopdf2gtiff.pl -f VA_Leesburg_20130613_TM_geo.pdf
> User asked us to fudge the neatline, finding nearest 7.5 minute quad
> boundaries
> Warning 1: libXML: 0: Element 'GeometryField': Character content other than
> whitespace is not allowed because the content type is 'element-only'.
> Creating output file that is 12245P x 12245L.
> Processing input file VA_Leesburg_20130613_TM_geo.pdf.
> Using band 4 of source image as alpha.
> Using band 4 of destination image as alpha.
> ERROR 1: Bad color space dict'
> ERROR 1: Pos = 9046254, Bad image parameters
[...]
> 
> I aborted the script at this point.  Oh well, it appears the latest
> geoPDF's have issues.  I could try building gdal from source including
> compiling in the required poppler support, but if the issue was gdal or
> poppler related I think the errors would be different.  [...]

This is interesting, because I recently had reason to process a very large
number of GeoPDF files from the USGS store into TIF, and used geopdf2tiff.pl
as a basis for what I was doing (which was for use in ArcGIS and did not 
require warping the files to WGS84 lat/lon, nor did it require dithering the 
3-band imagery down to a pseudocolor table image).  I did not use geopdf2gtiff 
directly, but made a very similar script based on it.

I encountered no such problems when I did that, and these were all very recent 
GeoPDF files.  But then again, I was doing some other tricks with it, such as 
saving the aerial photo and topo map layers into separate geotiffs.  So it is 
certainly *possible* that there's something wrong with geopdf2gtiff.pl

It's also possible that my install of GDAL from their SVN repo is sufficiently
different from yours.

To test this, I downloaded the VA_Leesburg_20130613_TM_geo.pdf file from 
store.usgs.gov and tried to process it with the script.  

I do not see any of the ERROR 1 messages that you see.  The script gets to its 
gdalwarp phase with no error and prints out its progress strings (which phase 
your attempt clearly did not get to).  Processing of the file took a *very* 
long time, and at this point is only 45% finished after having worked for 23
minutes.  I'll report more when it's finished, but I am confident that
it'll complete without error.

This is on Ubuntu 14.04, using a version of GDAL built from SVN back in April
(I don't track their HEAD development as closely as I used to, but still don't 
use Ubuntu repository installs).  It identifies itself as version 2.0.0dev.
I used exactly the same command line that you did.

Since it worked for me, it is entirely possible that building GDAL from source 
might be the path forward for you.  But I can certainly confirm that it is 
neither an issue with the geopdf files *nor* with geopdf2gtiff itself.

However, geopdf2gtiff.pl was written when the US Topo program was still in its
infancy, and I have not modified it since.  Since then, US Topo GeoPDF files
have made the aerial photo layer default to invisible, which makes for a much
cleaner looking topo layer IMHO.  GDAL has also improved its support for
GeoPDF to let you turn on and off feature layers more easily.   

I gave up using GeoPDFs in Xastir and stuck with my old stash of USGS GeoTIFF
files, because when the US Topos came out that aerial photo layer made my 
topos look so muddy and unreadable that I found them useless.  Since then, 
they've gotten much better, especially now that I can exclude that layer.  So 
I might update the script when I find a stash of Round Tuits.

In the meantime (since Round Tuits are in short supply), you probably
*will* benefit from building GDAL from source.  Just make sure to install
poppler and its devel package first, and to choose "--with-poppler" and 
"--with-python" when you configure GDAL.  Poppler support is required to
get proper GeoPDF support.

FWIW, if you don't want to wait for me to hack on geopdf2gtiff and want to
do that splitting of orthoimagery and topo map, it's a simple matter of adding
extra gdalwarp runs to the script, with different output options.  
"-oo 'LAYERS=Images,Images.Orthoimage'" will output *only* the orthoimagery.
"-oo 'LAYERS_OFF=Images,Images.Orthoimage'" will output everything *but* the
orthoimagery.  
-- 
Tom RussoKM5VY   SAR502   DM64ux  http://www.swcp.com/~russo/
Tijeras, NM  QRPL#1592 K2#398  SOC#236http://kevan.org/brain.cgi?DDTNM
 echo "prpv_a'rfg_cnf_har_cvcr" | sed -e 's/_/ /g' | tr [a-m][n-z] [n-z][a-m]

 


___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

2015-12-12 Thread Tom Russo

On Sat, Dec 12, 2015 at 09:32:17PM -0700, we recorded a bogon-computron 
collision of the  flavor, containing:
> You can experiment with compression to see if it works for you.  Look at
> the bottom of geopdf2gtiff.pl and you'll see two commented out 
> lines:

I just experimented with this and found very little benefit from compression.
No matter what compression algorithm I chose, I still got a file bigger than
110MB.  Not worth bothering.  I didn't try any of the compressed versions in
Xastir.

If you would like to try generating the GeoTIFF without imagery, find the
line towards the end of the script where the code sets up the gdalwarp
command and add 
  -oo 'LAYERS_OFF=Images,Images.Orthoimage' -oo 'DPI=250.0'
to the command line options.  

Without the imagery, you don't need the high DPI that will be used by default,
and so the thing processes much, much quicker (less than a minute, vs. more 
than 40 minutes).  And instead of a 100+MB file, you get a 26MB file.
The result looks very, very nice.

-- 
Tom RussoKM5VY   SAR502   DM64ux  http://www.swcp.com/~russo/
Tijeras, NM  QRPL#1592 K2#398  SOC#236http://kevan.org/brain.cgi?DDTNM
 echo "prpv_a'rfg_cnf_har_cvcr" | sed -e 's/_/ /g' | tr [a-m][n-z] [n-z][a-m]

 


___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

2015-12-12 Thread Kurt

Thanks for giving it a shot Lee.  I'm not educated enough to even know where to 
start.Kurt KC9LDH

  From: Lee Bengston 
 To: Xastir - APRS client software discussion  
 Sent: Saturday, December 12, 2015 7:55 PM
 Subject: [Xastir] GeoPDF try

All the talk lately about offline maps prompted me to try converting the
latest USGS Topo maps from geoPDF format to geoTiff using the
geopdf2gtiff.pl script.  I did this back in 2011 or 2012 after Tom KM5VY
created the script.  At that time it was a requirement (at least in the
Ubuntu/Debian world) to install gdal from source because the version in the
repository was too old.

The binary version of gdal in today's Ubuntu repo's is newer than the one I
had to compile 3-4 years ago, so I thought I would give it a go using
that.  I downloaded a geoPDF map for my area, and ran the script.

$ ./geopdf2gtiff.pl -f VA_Leesburg_20130613_TM_geo.pdf
User asked us to fudge the neatline, finding nearest 7.5 minute quad
boundaries
Warning 1: libXML: 0: Element 'GeometryField': Character content other than
whitespace is not allowed because the content type is 'element-only'.
Creating output file that is 12245P x 12245L.
Processing input file VA_Leesburg_20130613_TM_geo.pdf.
Using band 4 of source image as alpha.
Using band 4 of destination image as alpha.
ERROR 1: Bad color space dict'
ERROR 1: Pos = 9046254, Bad image parameters
ERROR 1: Bad color space dict'
ERROR 1: Pos = 9046254, Bad image parameters
ERROR 1: Bad color space dict'
ERROR 1: Pos = 9046254, Bad image parameters
ERROR 1: Bad color space dict'
ERROR 1: Pos = 9046254, Bad image parameters
ERROR 1: Bad color space dict'
ERROR 1: Pos = 9046254, Bad image parameters
ERROR 1: Bad color space dict'

I aborted the script at this point.  Oh well, it appears the latest
geoPDF's have issues.  I could try building gdal from source including
compiling in the required poppler support, but if the issue was gdal or
poppler related I think the errors would be different.  Also I was trying
to find an offline map solution that did not require building a package
like gdal from source.

BR,
Lee - K5DAT
___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

___
Xastir mailing list
Xastir@lists.xastir.org
http://xastir.org/mailman/listinfo/xastir

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

Re: [Xastir] GeoPDF try

12 matches

Site Navigation

Mail list logo

Footer information