similar to: Testing Best Practices/Goals (in the context of compiler-rt)

On Wed, Feb 10, 2016 at 2:11 PM, Justin Bogner via llvm-dev < llvm-dev at lists.llvm.org> wrote: > David Blaikie via cfe-dev <cfe-dev at lists.llvm.org> writes: > > Recently had a bit of a digression in a review thread related to some > tests > > going in to compiler-rt ( > > > http://lists.llvm.org/pipermail/llvm-commits/Week-of-Mon-20160208/330759.html

On Wed, Feb 10, 2016 at 3:55 PM, Alexey Samsonov via cfe-dev < cfe-dev at lists.llvm.org> wrote: > I mostly agree with what Richard and Justin said. Adding a few notes about > the general strategy we use: > > (1) lit tests which look "end-to-end" proved to be way more convenient for > testing runtime libraries than unit tests. > We do have > the latter, and

On Fri, Feb 12, 2016 at 5:43 PM, Alexey Samsonov via cfe-dev < cfe-dev at lists.llvm.org> wrote: > > > On Thu, Feb 11, 2016 at 1:50 PM, David Blaikie <dblaikie at gmail.com> wrote: > >> >> >> On Wed, Feb 10, 2016 at 3:55 PM, Alexey Samsonov via cfe-dev < >> cfe-dev at lists.llvm.org> wrote: >> >>> I mostly agree with what

On Fri, Feb 12, 2016 at 5:43 PM, Alexey Samsonov <vonosmas at gmail.com> wrote: > > > On Thu, Feb 11, 2016 at 1:50 PM, David Blaikie <dblaikie at gmail.com> wrote: > >> >> >> On Wed, Feb 10, 2016 at 3:55 PM, Alexey Samsonov via cfe-dev < >> cfe-dev at lists.llvm.org> wrote: >> >>> I mostly agree with what Richard and Justin

On Fri, Feb 26, 2016 at 1:07 PM, Sean Silva <chisophugis at gmail.com> wrote: > > > On Wed, Feb 17, 2016 at 8:45 AM, David Blaikie via cfe-dev < > cfe-dev at lists.llvm.org> wrote: > >> >> >> On Fri, Feb 12, 2016 at 5:43 PM, Alexey Samsonov <vonosmas at gmail.com> >> wrote: >> >>> >>> >>> On Thu, Feb 11,

On Fri, Feb 12, 2016 at 5:48 PM, Sean Silva <chisophugis at gmail.com> wrote: > > > On Fri, Feb 12, 2016 at 5:43 PM, Alexey Samsonov via cfe-dev < > cfe-dev at lists.llvm.org> wrote: > >> >> >> On Thu, Feb 11, 2016 at 1:50 PM, David Blaikie <dblaikie at gmail.com> >> wrote: >> >>> >>> >>> On Wed, Feb 10,

On Fri, Feb 26, 2016 at 1:31 PM, Sean Silva <chisophugis at gmail.com> wrote: > > > On Fri, Feb 26, 2016 at 1:11 PM, David Blaikie <dblaikie at gmail.com> wrote: > >> >> >> On Fri, Feb 26, 2016 at 1:07 PM, Sean Silva <chisophugis at gmail.com> >> wrote: >> >>> >>> >>> On Wed, Feb 17, 2016 at 8:45 AM, David

On Wed, Feb 17, 2016 at 8:45 AM, David Blaikie via cfe-dev < cfe-dev at lists.llvm.org> wrote: > > > On Fri, Feb 12, 2016 at 5:43 PM, Alexey Samsonov <vonosmas at gmail.com> > wrote: > >> >> >> On Thu, Feb 11, 2016 at 1:50 PM, David Blaikie <dblaikie at gmail.com> >> wrote: >> >>> >>> >>> On Wed, Feb 10,

Sorry, lost track of this thread. On Wed, Feb 17, 2016 at 8:45 AM, David Blaikie <dblaikie at gmail.com> wrote: > > > On Fri, Feb 12, 2016 at 5:43 PM, Alexey Samsonov <vonosmas at gmail.com> > wrote: > >> >> >> On Thu, Feb 11, 2016 at 1:50 PM, David Blaikie <dblaikie at gmail.com> >> wrote: >> >>> >>> >>>

On Fri, Feb 26, 2016 at 1:34 PM, David Blaikie <dblaikie at gmail.com> wrote: > > > On Fri, Feb 26, 2016 at 1:31 PM, Sean Silva <chisophugis at gmail.com> wrote: > >> >> >> On Fri, Feb 26, 2016 at 1:11 PM, David Blaikie <dblaikie at gmail.com> >> wrote: >> >>> >>> >>> On Fri, Feb 26, 2016 at 1:07 PM, Sean Silva

> On Feb 26, 2016, at 2:10 PM, Alexey Samsonov via llvm-dev <llvm-dev at lists.llvm.org> wrote: > > > On Fri, Feb 26, 2016 at 1:34 PM, David Blaikie <dblaikie at gmail.com <mailto:dblaikie at gmail.com>> wrote: > > > On Fri, Feb 26, 2016 at 1:31 PM, Sean Silva <chisophugis at gmail.com <mailto:chisophugis at gmail.com>> wrote: > > >

On Fri, Feb 26, 2016 at 1:11 PM, David Blaikie <dblaikie at gmail.com> wrote: > > > On Fri, Feb 26, 2016 at 1:07 PM, Sean Silva <chisophugis at gmail.com> wrote: > >> >> >> On Wed, Feb 17, 2016 at 8:45 AM, David Blaikie via cfe-dev < >> cfe-dev at lists.llvm.org> wrote: >> >>> >>> >>> On Fri, Feb 12, 2016 at

On Sat, Feb 27, 2016 at 3:13 PM, Anna Zaks <ganna at apple.com> wrote: > > On Feb 26, 2016, at 2:10 PM, Alexey Samsonov via llvm-dev < > llvm-dev at lists.llvm.org> wrote: > > > On Fri, Feb 26, 2016 at 1:34 PM, David Blaikie <dblaikie at gmail.com> wrote: > >> >> >> On Fri, Feb 26, 2016 at 1:31 PM, Sean Silva <chisophugis at

> On Feb 28, 2016, at 7:57 AM, David Blaikie <dblaikie at gmail.com> wrote: > > > > On Sat, Feb 27, 2016 at 3:13 PM, Anna Zaks <ganna at apple.com <mailto:ganna at apple.com>> wrote: > >> On Feb 26, 2016, at 2:10 PM, Alexey Samsonov via llvm-dev <llvm-dev at lists.llvm.org <mailto:llvm-dev at lists.llvm.org>> wrote: >> >>

On Fri, Feb 26, 2016 at 2:10 PM, Alexey Samsonov <vonosmas at gmail.com> wrote: > > On Fri, Feb 26, 2016 at 1:34 PM, David Blaikie <dblaikie at gmail.com> wrote: > >> >> >> On Fri, Feb 26, 2016 at 1:31 PM, Sean Silva <chisophugis at gmail.com> >> wrote: >> >>> >>> >>> On Fri, Feb 26, 2016 at 1:11 PM, David Blaikie

On Tue, Mar 1, 2016 at 11:05 AM, David Blaikie via cfe-dev < cfe-dev at lists.llvm.org> wrote: > > > On Mon, Feb 29, 2016 at 10:26 AM, Anna Zaks <ganna at apple.com> wrote: > >> >> On Feb 28, 2016, at 7:57 AM, David Blaikie <dblaikie at gmail.com> wrote: >> >> >> >> On Sat, Feb 27, 2016 at 3:13 PM, Anna Zaks <ganna at

Sean and Alexey have said a lot on this topic. Here is my version of explanation that LLVM testing is not suitable to replace end to end testing. - The most important reason being that LLVM tests tend to test 'implementation details'. This has many drawbacks: a) by only writing test cases like this, it is hard to expose bugs inherited in the implementation itself; b) the connection

On Fri, Feb 26, 2016 at 3:17 PM, Xinliang David Li <davidxl at google.com> wrote: > Sean and Alexey have said a lot on this topic. Here is my version of > explanation that LLVM testing is not suitable to replace end to end testing. > > - The most important reason being that LLVM tests tend to test > 'implementation details'. This has many drawbacks: > a) by

On Fri, Feb 26, 2016 at 4:28 PM, David Blaikie <dblaikie at gmail.com> wrote: > > > On Fri, Feb 26, 2016 at 3:17 PM, Xinliang David Li <davidxl at google.com> > wrote: > >> Sean and Alexey have said a lot on this topic. Here is my version of >> explanation that LLVM testing is not suitable to replace end to end testing. >> >> - The most

On Fri, Feb 26, 2016 at 4:28 PM, David Blaikie via llvm-dev < llvm-dev at lists.llvm.org> wrote: > > > On Fri, Feb 26, 2016 at 3:17 PM, Xinliang David Li <davidxl at google.com> > wrote: > >> Sean and Alexey have said a lot on this topic. Here is my version of >> explanation that LLVM testing is not suitable to replace end to end testing. >> >>