On Thu, Nov 22, 2012 at 11:23:29PM +0100, Martin Engler wrote:
> this seems specific for your piezo constant and gain setting in the
> amplifier. For me calculating the factor using the following formula
> yields the correct result:
>
> q = 20.0/2^DAC_bits * ZPiezoconst * GainZ * Angstrom/DAC_Unit
Thanks, this appears to be quite similar to the original formula which,
reordered to look the same as yours, reads
q = 20.0/2¹⁶ * ZPiezoconst * GainZ * Angstrom;
So the big difference is that is contains 2¹⁶ even though DAC-Type is
invariably 20bits in all files I have ever seen. Fixing the power to
the actual number of bits seems to do the trick.
I am not sure what you mean by DAC_unit in the formula; is it meant to
be numerically 1 (and just making the units of the resulting quantity
correct)?
Regards,
Yeti
------------------------------------------------------------------------------
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
_______________________________________________
Gwyddion-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/gwyddion-users
