Searched refs:ulp (Results 1 – 4 of 4) sorted by relevance
28 uint64_t ulp = UINT64_MAX; in compare() local37 ulp = real.i - soft.i; in compare()39 ulp = soft.i - real.i; in compare()44 if (!exact && ulp <= 4) { in compare()59 printf("Error in fraction: %" PRIu64 " ulp\n\n", ulp); in compare()
1020 /* s < sqrt(m) < s + 1ulp */
[all...]