Displaying 1 result from an estimated 1 matches for "michelso".
Did you mean:
michelson
2005 Mar 23
2
R accuracy
Hello,
I am trying to test the precision of R on datasets from The Statistical Reference Datasets Project http://www.itl.nist.gov/div898/strd/index.html and I don't manage to understand how R is storing its results.
For example, I calculate a mean on the michelso dataset (100 values) and find:
> m=mean(michel)
> m
V1
299.8524
> print(m,digits=15)
V1
299.8524
> print(m,digits=22)
V1
299.85239999999993
The certified value of the mean is 299.85240, so I try
> print(m-299.8524)
V1
-5.684342e...