In the last episode (Aug 05), Jeff Mathis said:
> after lokking at this, it appears that our float(11,9) columns cannot
> store an number larger than 100 or smaller than -100. the database is
> rounding the number! If we insert numbers -100 < x < 100, then its fine.
>
> is there a configuration setting somewhere, or is this a known bug?
It's doing exactly what you asked for.
`FLOAT[(M,D)] [UNSIGNED] [ZEROFILL]'
`M' is the display width and `D' is the number of decimals.
You asked for a field 11 digits wide, with 9 of them being to the right
of the decimal point. 11-9 = 2, so you really should only be able to
store -99 through 99, since 100 is 3 digits and puts you over the edge.
So you did find a mysql bug, but not the one you thought you had :)
mysql> create table test ( f1 float(11,9) );
Query OK, 0 rows affected (0.07 sec)
mysql> insert into test values (1.1234567890123),(100.1234567890123),(200.123456789);
Query OK, 3 rows affected, 2 warnings (0.09 sec)
Records: 3 Duplicates: 0 Warnings: 2
mysql> show warnings;
+---------+------+-------------------------------------------------------+
| Level | Code | Message |
+---------+------+-------------------------------------------------------+
| Warning | 1264 | Data truncated; out of range for column 'f1' at row 2 |
| Warning | 1264 | Data truncated; out of range for column 'f1' at row 3 |
+---------+------+-------------------------------------------------------+
2 rows in set (0.00 sec)
mysql> select * from test;
+---------------+
| f1 |
+---------------+
| 1.123456836 |
| 100.000000000 |
| 100.000000000 |
+---------------+
3 rows in set (0.00 sec)
This odd rounding is due to the low precision of a 'float' type
(usually around 6 decimal digits).
--
Dan Nelson
[EMAIL PROTECTED]
--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED]
