----- Original Message -----> From: "Renato Golin" <renato.golin at linaro.org> > To: "Marshall Clow" <mclow.lists at gmail.com> > Cc: "LLVM Dev" <llvmdev at cs.uiuc.edu> > Sent: Tuesday, March 12, 2013 10:22:41 AM > Subject: Re: [LLVMdev] LNT BenchmarkGame > > > > On 12 March 2013 14:53, Marshall Clow < mclow.lists at gmail.com > > wrote: > > > > > > > I agree; I'm pretty sure that the only guarantee is that for a given > implementation of stand, if you initialize it with the same seed, > you get the same sequence. > > There is no "correct" sequence. > > > > I'm not suggesting a correct sequence, I'm just looking for a way to > turn off the verification against the reference output and force LNT > to run GCC for the "native" output.Can't we just paste in a RNG so that we'll get the same output on all systems (and can still use the reference output)? -Hal> > > cheers, > --renato > _______________________________________________ > LLVM Developers mailing list > LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu > http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev >
On 12 March 2013 15:28, Hal Finkel <hfinkel at anl.gov> wrote:> Can't we just paste in a RNG so that we'll get the same output on all > systems (and can still use the reference output)? >We can, though other tests suffer from the same issue. Would be good to have a solution to all of them without pasting the same code on all of them. I really thought that the native output was always generated by the "native compiler" which is normally GCC. Removing the reference output doesn't work, since it just creates an empty file instead. The Makefile is too simple to mean anything, but maybe there's some environment variable that needs setting to make LNT get the result from a GCC run... --renato -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20130312/29d511e2/attachment.html>
On Tue, Mar 12, 2013 at 9:19 AM, Renato Golin <renato.golin at linaro.org>wrote:> On 12 March 2013 15:28, Hal Finkel <hfinkel at anl.gov> wrote: > >> Can't we just paste in a RNG so that we'll get the same output on all >> systems (and can still use the reference output)? >> > > We can, though other tests suffer from the same issue. Would be good to > have a solution to all of them without pasting the same code on all of them. > > I really thought that the native output was always generated by the > "native compiler" which is normally GCC. Removing the reference output > doesn't work, since it just creates an empty file instead. The Makefile is > too simple to mean anything, but maybe there's some environment variable > that needs setting to make LNT get the result from a GCC run... >The test suite supports multiple modes, one mode in which the native output is generated by an executable built by the native compiler, another in which the output is compared to a reference compiler. The former mode is historically what the test suite did, the latter mode is substantially faster (and independent of bugs in the native CC). - Daniel> --renato > > _______________________________________________ > LLVM Developers mailing list > LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu > http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20130312/f96a0bfc/attachment.html>