Why, when I enter certain values into registers or TP code (like 304.8 or 152.6) do they change?
304.8 = 304.799 ???
-
pdl -
June 28, 2017 at 5:00 PM -
Thread is Resolved
-
Numeric registers are 32 Bit Floating Point numbers. In that data type there is no exact representation for 304.8, so it sets the register to the closest value 304.79998779296875. The screen only displays the last 3 decimal points so you see 304.799, but in reality the register is the longer number above.
If you want to know more google "single precision floating point"
Advertising from our partners
