Hi Zhan, SPDPySeqWriter does not create a file which has been indexed (in the SPDLib paper, I think we referred to this as an unsorted pulse data (UPD) file). To create the spatial index use spdtranslate. If the file will fit into memory then just use the following command:
spdtranslate --if SPD --of SPD --scan -b 1 -x MAX_INTENSITY -i ./input.spd -o output_idxed.spd This will indexed on the scan geometry, if you want to use the azimuth and zenith angles then change —scan to --spherical, the unit for the bin size (i.e., -b) is what unit of the field on which the data is being indexed (i.e., --spherical is radians). If the file does not fit within memory then you need to use the --temppath option with will sorted the input file into a number of temporary files from which the indexed spd file will then be built, the --numofcols and --numofrows options define the size of the temporary files (which need to be small enough to fit into memory), the values are the number of ‘bins’, i.e., spatial index bins. There are examples of using spdtranslate in the documentation: https://bitbucket.org/petebunting/spdlib-documentation/downloads John hasn’t committed the updated yet (last commit was a couple of days ago: https://bitbucket.org/petebunting/spdlib/commits/all), he’ll probably be travelling over the UK now but I’m picking him from Heathrow tomorrow morning and once we get Aberystwyth we’ll get that commit up on bitbucket and let you know to update. Cheers, Pete **************************************************** * Dr Pete Bunting * Senior Lecturer in Remote Sensing * Earth Observation and Ecosystem Dynamics Group * Department of Geography and Earth Sciences * Aberystwyth University * Aberystwyth * Ceredigion * SY23 3DB * UK * * Ph: +44 (0) 1970 622615 * Mob: +44 (0) 7917 842743 * Email: [email protected] * ORCID: http://orcid.org/0000-0002-7435-0148 **************************************************** On 10 Jun 2014, at 05:15, Zhan Li <[email protected]> wrote: > Hi Pete and John, > > Thanks for your helps. I have only converted a couple of test scans to spd > files. Now I'm using spdlib in python to convert all envi cubes to spd files. > I assume I need to download the new code file and rebuild spdlid on my > system? Also it seems when I'm creating the spd file with SPDPySeqWriter, it > takes care of the quick look image generation and I don't have to worry about > it by myself? Once I use the new code that uses waveform maximum intensities, > I should be able to see a valid quick look image instead of all pixels of > one. Is it right? I'm still on a learning curve here. Thanks for any help. > > Zhan. > > > On Mon, Jun 9, 2014 at 4:33 PM, Pete Bunting [pfb] <[email protected]> wrote: > Hi John, > > Sounds good to me, I should have probably done that to begin with. Go ahead > and commit it. > > Zhan, once John has committed the updated you will have to re-build your > files - spdcopy or spdtranslate should do it - as the quicklook image is > created as the file is written to the disk. > > Cheers, Pete > > **************************************************** > * Dr Pete Bunting > * Senior Lecturer in Remote Sensing > * Earth Observation and Ecosystem Dynamics Group > * Department of Geography and Earth Sciences > * Aberystwyth University > * Aberystwyth > * Ceredigion > * SY23 3DB > * UK > * > * Ph: +44 (0) 1970 622615 > * Mob: +44 (0) 7917 842743 > * Email: [email protected] > * ORCID: http://orcid.org/0000-0002-7435-0148 > **************************************************** > > On 9 Jun 2014, at 19:21, ARMSTON John > <[email protected]> wrote: > > > Hi Zhan, > > > > Agree that maximum intensity is a better general choice for waveforms, for > > the Reigl as well. > > > > The quicklook generation code does not have configurable options. Easiest > > solution is to just change it to maximum. > > Pete - you have any objections to this? I've changed the source code > > (SPDFileWrite.cpp) - so will commit if not. > > > > cheers, > > John. > > > > From: Zhan Li [mailto:[email protected]] > > Sent: Sunday, 8 June 2014 8:13 AM > > To: [email protected] > > Subject: [spdlib-develop] Use pulse maximum intensity to create quick look > > image > > > > Hi, > > > > After I created a spd file from ENVI data cube with a python file and > > inspected it as an HDF5 file with Matlab's hdf5 functions, the quick look > > image is not right. All the pixel values are simply 1. How should I create > > the quick look image with python bindings of spdlib? > > > > Also in Pete's paper in Computers & Geosciences it mentions the quick look > > image is the mean waveform intensity if only pulse data is stored. However > > for our pulse data, the mean image is not good due to high background noise > > level. The maximum intensity is a better choice. Can I ask the spdlib to > > create the quick look image with maximum intensity instead of default mean > > intensity? > > > > Thanks, > > > > Zhan. > > > > -- > > Zhan Li, 李展; > > Earth & Environment, Boston University, USA; > > > > 2008 - 2011, in Chinese Academy of Sciences, China; > > 2004 - 2008, in Nanjing University, China; > > ***************************** Disclaimer ***************************** > > > > The contents of this electronic message and any attachments are intended > > only for the addressee and may contain privileged or confidential > > information. They may only be used for the purposes for which they were > > supplied. If you are not the addressee, you are notified that any > > transmission, distribution, downloading, printing or photocopying of the > > contents of this message or attachments is strictly prohibited. > > The privilege of confidentiality attached to this message and attachments > > is not waived, lost or destroyed by reason of mistaken delivery to you. If > > you receive this message in error please notify the sender by return e-mail > > or telephone. > > > > Please note: the Department of Science, Information Technology, Innovation > > and the Arts carries out automatic software scanning, filtering and > > blocking of E-mails and attachments (including emails of a personal nature) > > for detection of viruses, malicious code, SPAM, executable programs or > > content it deems unacceptable. All reasonable precautions will be taken to > > respect the privacy of individuals in accordance with the Information > > Privacy Act 2009 (Qld). Personal information will only be used for official > > purposes, e.g. monitoring Departmental Personnel's compliance with > > Departmental Policies. Personal information will not be divulged or > > disclosed to others, unless authorised or required by Departmental Policy > > and/or law. > > > > > > > -- > Zhan Li, 李展; > Earth & Environment, Boston University, USA; > > 2008 - 2011, in Chinese Academy of Sciences, China; > 2004 - 2008, in Nanjing University, China; > ------------------------------------------------------------------------------ > HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions > Find What Matters Most in Your Big Data with HPCC Systems > Open Source. Fast. Scalable. Simple. Ideal for Dirty Data. > Leverages Graph Analysis for Fast Processing & Easy Data Exploration > http://p.sf.net/sfu/hpccsystems_______________________________________________ > spdlib-develop mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/spdlib-develop ------------------------------------------------------------------------------ HPCC Systems Open Source Big Data Platform from LexisNexis Risk Solutions Find What Matters Most in Your Big Data with HPCC Systems Open Source. Fast. Scalable. Simple. Ideal for Dirty Data. Leverages Graph Analysis for Fast Processing & Easy Data Exploration http://p.sf.net/sfu/hpccsystems _______________________________________________ spdlib-develop mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/spdlib-develop
