search for: confidence_interval

Displaying 4 results from an estimated 4 matches for "confidence_interval".

2013 Jun 24
5
[LLVMdev] [LNT] Question about results reliability in LNT infrustructure
...are two testings, each of which is run with three samples, how would LNT show whether the comparison is reliable or not? I have seen that the function get_value_status in reporting/analysis.py uses a very simple algorithm to infer data status. For example, if abs(self.delta) <= (self.stddev * confidence_interval), then the data status is set as UNCHANGED. However, it is obviously not enough. For example, assuming both self.delta (e.g. 60%) and self.stddev (e.g. 50%) are huge, but self.delta is slightly larger than self.stddev, LNT will report to readers that the performance improvement is huge without con...
2011 Jan 28
5
Mean from confidence intervals
Dear List, I am not sure if A) this is possible or B) the correct place to ask. I am looking to find the mean - i have n, and the two-tailed confidence intervals 0.95 & 0.25 with a p-value of 0.05. Can i find the mean from this data ? Thanks Peter
2013 Jul 01
0
[LLVMdev] [LNT] Question about results reliability in LNT infrustructure
...ings, each of which is run with three samples, how would LNT show whether the comparison is reliable or not? > > > I have seen that the function get_value_status in reporting/analysis.py uses a very simple algorithm to infer data status. For example, if abs(self.delta) <= (self.stddev * confidence_interval), then the data status is set as UNCHANGED. However, it is obviously not enough. For example, assuming both self.delta (e.g. 60%) and self.stddev (e.g. 50%) are huge, but self.delta is slightly larger than self.stddev, LNT will report to readers that the performance improvement is huge without con...
2013 Jun 27
0
[LLVMdev] [LNT] Question about results reliability in LNT infrustructure
...ings, each of which is run with three samples, how would LNT show whether the comparison is reliable or not? > > > I have seen that the function get_value_status in reporting/analysis.py uses a very simple algorithm to infer data status. For example, if abs(self.delta) <= (self.stddev * confidence_interval), then the data status is set as UNCHANGED. However, it is obviously not enough. For example, assuming both self.delta (e.g. 60%) and self.stddev (e.g. 50%) are huge, but self.delta is slightly larger than self.stddev, LNT will report to readers that the performance improvement is huge without con...