Displaying 1 result from an estimated 1 matches for "abs_tol".
Did you mean:
abs_pos
2016 Sep 29
4
a proposed script to help with test-suite programs that output _lots_ of FP numbers
...9178782.5878
Compiler WITH FP-contraction patch
----------------------------------
286720
9178782.58444
I think this output format should be acceptable for further processing by "fpcmp", since the #
of FPs read will always be an integer. At least with absolute tolerances, as long as abs_tol<1
I think it should be OK. Relative tolerances have me a little nervous; is there a way to tell
"fpcmp" that integers that are output as such -- i.e. "13", not "13.0" -- are to be evaluated
without any regard to tolerance? Or maybe it already does it that way?...