Yeah, I made a mistake. The link I sent is to the 1_9 arcsecond (~3m) elevation dataset which is difficult to find and cannot be easily scraped from the USGS site. The best way to get that dataset right now is to grab the data from the Google Cloud Storage link I sent.
The 1_3 arc can be easily scraped with Eric's script. It took less than a day to get the entire 10m dataset. If you need that dataset, just run the script. Best, - Ragi On Wed, Feb 20, 2013 at 7:09 PM, Mike <[email protected]> wrote: > I'm a little confused by this email. > "Nevertheless, I never got a response on how to download the 1/9 arc > second dataset (~3m) until this morning." > This got my attention. > Then you say > "FrankW from GDAL posted the entire NED 1/3 arc second dataset in the > public Google Earth-Engine Cloud Drive. The link is below for those that > are interested in getting this dataset." > So back to 1/3 - but the link says 1_9arcsecond > I looked at the data - it's all 1/3 (as you said). Is there a place to > download the 1/9 or do we have to wait until april? > > -Mike > > > On Tue, Feb 19, 2013 at 3:57 PM, Ragi Burhum <[email protected]> wrote: > >> Hello everyone, I wanted to do a follow up about this (x-posted to >> GeoMeetup google group). >> >> I managed to download all the NED dataset at 1/3 arc second (~10m) using >> the scraping code from Eric R. Nevertheless, I never got a response on how >> to download the 1/9 arc second dataset (~3m) until this morning. >> >> FrankW from GDAL posted the entire NED 1/3 arc second dataset in the >> public Google Earth-Engine Cloud Drive. The link is below for those that >> are interested in getting this dataset. >> >> >> https://storage.cloud.google.com/?arg=earthengine-public#earthengine-public%2Fned%2F1_9arcsecond >> >> Of course, coverage is only in a few places, but those places will look >> awesome :) >> >> Thanks, >> >> - Ragi >> >> >> On Thu, Feb 7, 2013 at 9:08 AM, Ragi Burhum <[email protected]> wrote: >> >>> Works for me :) >>> >>> >>> On Thu, Feb 7, 2013 at 8:57 AM, David Percy <[email protected]> wrote: >>> >>>> site seems to be down, did you crash it by running that script? >>>> :-) >>>> >>>> On Wed, Feb 6, 2013 at 3:17 PM, Ragi Burhum <[email protected]> wrote: >>>> > Thank you Eric W., Eric R. Colin and Nicolas. >>>> > >>>> > All your links have been extremely useful in a particular way. >>>> > >>>> > I ended up tweaking Eric R's script to fit my needs. Great to know >>>> that at >>>> > least the 1/3 arcsecond files are available in a web accessible >>>> folder. >>>> > Nevertheless it would be nice if >>>> > http://tdds.cr.usgs.gov/ned/13arcsec/grid/grid_zips/ just listed all >>>> the >>>> > files instead of having to guess the file naming convention. >>>> > >>>> > For those interested, according to this announcement, the 1/9 >>>> arcsecond >>>> > datasets will be available from there soon. >>>> > >>>> > Thank you all again, >>>> > >>>> > - Ragi >>>> > >>>> > >>>> > On Wed, Feb 6, 2013 at 7:22 AM, Eric Wolf <[email protected]> wrote: >>>> >> >>>> >> USGS Eros has a service where you can ship hard drives to them to >>>> get bulk >>>> >> data, including NED: >>>> >> >>>> >> http://cumulus.cr.usgs.gov/bulk.php >>>> >> >>>> >> As a friend once said, "Never underestimate the bandwidth of a >>>> station >>>> >> wagon filled with backup tapes!" >>>> >> >>>> >> -Eric >>>> >> >>>> >> -=--=---=----=----=---=--=-=--=---=----=---=--=-=- >>>> >> Eric B. Wolf 720-334-7734 >>>> >> >>>> >> >>>> >> >>>> >> >>>> >> On Wed, Feb 6, 2013 at 7:31 AM, Eric Russell <[email protected]> >>>> >> wrote: >>>> >>> >>>> >>> Hi Ragi, >>>> >>> >>>> >>> Here's my Python code for downloading and unzipping the 1/3 >>>> arcsecond NED >>>> >>> from tdds.cr.usgs.gov: >>>> >>> >>>> >>> def download_zips (): >>>> >>> for x in xrange(99, 66, -1): >>>> >>> for y in xrange(48, 24, -1): >>>> >>> try: >>>> >>> url = >>>> >>> "http://tdds.cr.usgs.gov/ned/13arcsec/grid/grid_zips/n%sw0%s.zip"; >>>> % (y, x) >>>> >>> dest = "D:\\ned\\zip\\n%sw%s.zip" % (y, x) >>>> >>> opener = urllib.URLopener() >>>> >>> opener.retrieve(url, dest) >>>> >>> print "downloaded /n%sw%s.zip" % (y, x) >>>> >>> except IOError: >>>> >>> print "skipped /n%sw%s.zip" % (y, x) >>>> >>> >>>> >>> def unzip_files (): >>>> >>> for zip_file in glob.iglob("D:\\ned\\zip\\*.zip"): >>>> >>> print zip_file >>>> >>> with zipfile.ZipFile(zip_file, 'r') as zip: >>>> >>> for f in zip.infolist(): >>>> >>> name_index = f.filename.find('/grd') >>>> >>> if name_index < 0: >>>> >>> continue >>>> >>> dest = os.path.join('E:', f.filename[name_index:]) >>>> >>> if dest.endswith('/'): >>>> >>> os.makedirs(dest) >>>> >>> else: >>>> >>> with open(dest, 'wb') as fout: >>>> >>> fout.write(zip.read(f)) >>>> >>> >>>> >>> Eric >>>> >>> >>>> >>> >>>> >>> On 2/5/13 11:33 PM, Ragi Burhum wrote: >>>> >>> >>>> >>> Hello all, >>>> >>> >>>> >>> I am trying to bulk download the entire 1/9 arc and 1/3 arc NED >>>> dataset >>>> >>> (I have the rest). I have a server with gigabit connection and >>>> several >>>> >>> terabytes of space - so space/network speed is not an issue. Any >>>> pointers on >>>> >>> how to get a hold of that dataset? I could write a scraping script, >>>> but I >>>> >>> would rather not go there. >>>> >>> >>>> >>> Thanks! >>>> >>> >>>> >>> - Ragi >>>> >>> >>>> >>> >>>> >>> _______________________________________________ >>>> >>> Geowanking mailing list >>>> >>> [email protected] >>>> >>> http://geowanking.org/mailman/listinfo/geowanking_geowanking.org >>>> >>> >>>> >>> >>>> >>> >>>> >>> _______________________________________________ >>>> >>> Geowanking mailing list >>>> >>> [email protected] >>>> >>> http://geowanking.org/mailman/listinfo/geowanking_geowanking.org >>>> >>> >>>> >> >>>> > >>>> > >>>> > _______________________________________________ >>>> > Geowanking mailing list >>>> > [email protected] >>>> > http://geowanking.org/mailman/listinfo/geowanking_geowanking.org >>>> > >>>> >>>> >>>> >>>> -- >>>> David Percy ("Percy") >>>> -Geospatial Data Manager >>>> -Web Map Wrangler >>>> -GIS Instructor >>>> Portland State University >>>> -gisgeek.pdx.edu >>>> -geology.pdx.edu >>>> -portlandpulse.org >>>> >>> >>> >> >> _______________________________________________ >> Geowanking mailing list >> [email protected] >> http://geowanking.org/mailman/listinfo/geowanking_geowanking.org >> >> >
_______________________________________________ Geowanking mailing list [email protected] http://geowanking.org/mailman/listinfo/geowanking_geowanking.org
