Searched refs:DecimalBPP (Results 1 – 3 of 3) sorted by relevance
3271 double DecimalBPP, in TruncToValidBPP() argument3313 if (DecimalBPP < 6) in TruncToValidBPP()3318 return dml_floor(16 * DecimalBPP, 1) / 16.0; in TruncToValidBPP()3320 if (DecimalBPP < 6 in TruncToValidBPP()3323 || DecimalBPP < DesiredBPP) { in TruncToValidBPP()3331 if (DecimalBPP < 7) in TruncToValidBPP()3338 if (DecimalBPP < 7 in TruncToValidBPP()3341 || DecimalBPP < DesiredBPP) { in TruncToValidBPP()3349 if (DecimalBPP < 8) in TruncToValidBPP()3356 if (DecimalBPP < 8 in TruncToValidBPP()[all …]
3265 double DecimalBPP, in TruncToValidBPP() argument3307 if (DecimalBPP < 6) in TruncToValidBPP()3312 return dml_floor(16 * DecimalBPP, 1) / 16.0; in TruncToValidBPP()3314 if (DecimalBPP < 6 in TruncToValidBPP()3317 || DecimalBPP < DesiredBPP) { in TruncToValidBPP()3325 if (DecimalBPP < 7) in TruncToValidBPP()3332 if (DecimalBPP < 7 in TruncToValidBPP()3335 || DecimalBPP < DesiredBPP) { in TruncToValidBPP()3343 if (DecimalBPP < 8) in TruncToValidBPP()3350 if (DecimalBPP < 8 in TruncToValidBPP()[all …]
3192 double DecimalBPP, in TruncToValidBPP() argument3200 if (DecimalBPP >= 18) in TruncToValidBPP()3202 else if (DecimalBPP >= 15) in TruncToValidBPP()3204 else if (DecimalBPP >= 12) in TruncToValidBPP()3209 if (DecimalBPP >= 36) in TruncToValidBPP()3232 if (DecimalBPP < 6) in TruncToValidBPP()3239 if (DecimalBPP < 7) in TruncToValidBPP()3246 if (DecimalBPP < 8) in TruncToValidBPP()3254 if (DecimalBPP >= 18) in TruncToValidBPP()3263 if (DecimalBPP >= 24) in TruncToValidBPP()[all …]