Displaying 2 results from an estimated 2 matches for "shouldt".
Did you mean:
should
2009 Apr 20
8
bug when subtracting decimals?
Try this:
0.7-0.3==0.4
(We get FALSE)
0.7-0.3<0.4
(We get TRUE)
but
0.8-0.3==0.5
(TRUE)
0.8-0.3<0.5
(FALSE)
Funny, he?
There is a way around:
round(0.7-0.3,1)==0.4
(TRUE)
Obviously there is a problem with some combinations of decimal subtractions,
that - we have the feeling - shouldt be solved.
Best regards
Sven & Wolfgang
--
View this message in context: http://www.nabble.com/bug-when-subtracting-decimals--tp23136337p23136337.html
Sent from the R help mailing list archive at Nabble.com.
2009 Apr 20
8
bug when subtracting decimals?
Try this:
0.7-0.3==0.4
(We get FALSE)
0.7-0.3<0.4
(We get TRUE)
but
0.8-0.3==0.5
(TRUE)
0.8-0.3<0.5
(FALSE)
Funny, he?
There is a way around:
round(0.7-0.3,1)==0.4
(TRUE)
Obviously there is a problem with some combinations of decimal subtractions,
that - we have the feeling - shouldt be solved.
Best regards
Sven & Wolfgang
--
View this message in context: http://www.nabble.com/bug-when-subtracting-decimals--tp23136337p23136337.html
Sent from the R help mailing list archive at Nabble.com.