On Thu, 3 Apr 2014, dave wrote: > Date: Thu, 03 Apr 2014 08:28:22 -0700 > From: dave <dengv...@charter.net> > To: EMC developers <emc-developers@lists.sourceforge.net> > Subject: Re: [Emc-developers] Another query on numerical formats > > On Thu, 2014-04-03 at 12:02 +0100, andy pugh wrote: >> This thread raised an interesting question >> http://linuxcnc.org/index.php/english/forum/49-basic-configuration/27669-following-error-and-velocity/45528 >> >> The user was seeing the f-error switch to exponential notation, not >> seeing the e in the middle, and assuming e-error spikes. >> >> As the hal-status watch tab displays to many places of decimals, I >> wonder if 1e-6 should actually display as 0.00000 instead? >> >> I can't decide. >> > Hi Andy, > > It is still early morning but shouldn't the decision point for 0.00000 > be <= 5 E-6? > > Dave >
Since the range of FP data shown in the watch tab is unknown, scientific notation makes sense in the general case but an option for a fixed format would be nice say, 8.8 (as changing formats from fixed to scientific notation in mid stream makes it difficult to watch) Peter Wallace Mesa Electronics ------------------------------------------------------------------------------ _______________________________________________ Emc-developers mailing list Emc-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/emc-developers