Searched refs:PRECISION (Results 1 – 6 of 6) sorted by relevance
27 #define PRECISION 5 /* Change this value to change the number of decimal places in the final output… macro381 scaledReal.full = GetReal(A) * uPow(10, PRECISION-1); /* DOUBLE CHECK THISSSS!!! */ in ConvertBackToInteger()511 int dec[PRECISION]; in uGetScaledDecimal()514 for (i = 0; i < PRECISION; i++) { in uGetScaledDecimal()518 scaledDecimal = scaledDecimal + dec[i]*uPow(10, PRECISION - 1 - i); in uGetScaledDecimal()
16 This system uses 8 bytes per DOUBLE PRECISION word.57 This system uses 8 bytes per DOUBLE PRECISION word.
292 |--NOTE THAT B4 THROUGH B8 ARE STORED IN DOUBLE PRECISION294 |--AND IS THEREFORE STORED AS SINGLE PRECISION.
5133 #--NOTE THAT B4 THROUGH B8 ARE STORED IN DOUBLE PRECISION5135 #--AND IS THEREFORE STORED AS SINGLE PRECISION.
5186 #--NOTE THAT A3 THROUGH A7 ARE STORED IN DOUBLE PRECISION
9674 + * IN NO EVENT SHALL PRECISION INSIGHT AND/OR ITS SUPPLIERS BE LIABLE FOR11485 + * IN NO EVENT SHALL PRECISION INSIGHT AND/OR ITS SUPPLIERS BE LIABLE FOR