Displaying 1 result from an estimated 1 matches for "myt_nc".
Did you mean:
myfunc
2019 Jan 09
1
Bug in dt() function in stats - accuracy only 6 dp.
Hi
I believe the dt() function in stats has small areas of inaccuracy.
SmallRangeMostDetaileddf150.png shows this occurring in the 10-11th decimal place.
MyD4 is computed using Myt_NC(), at the bottom of BugL.R - my function is very slow due to using mpfr, but i believe
accurate to the accuracy of genhypergeo() which it uses - 14-15 dp.
LargeRangeDiffdf150.png, which is difference between dt() and my function, shows spikes across -1.5 < x < 1.5.
I assumed probably o...