llvm dev - Jul 2013 - [LLVMdev] Script for stressing llc

Hi,

I wrote a small script in order to stress test llc using test cases generated by
llvm-stress. When it finds a case where llc seems to have crashed, it greps the
output for Assertion, LLVM ERROR, etc., removes things that look like hex
numbers and ID numbers, and then checksums the resulting text. In this way, it
can automatically categorize different bugs into different subdirectories.

I found this useful, and maybe you will too :)

 -Hal

-- 
Hal Finkel
Assistant Computational Scientist
Leadership Computing Facility
Argonne National Laboratory
-------------- next part --------------
A non-text attachment was scrubbed...
Name: stress.sh
Type: application/x-shellscript
Size: 846 bytes
Desc: not available
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20130709/8b758e62/attachment.bin>

A few people have requested features; I've implemented them in this updated
version (attached). Do you think this is worth putting in the repo somewhere?

 -Hal

----- Original Message -----
> Hi,
> 
> I wrote a small script in order to stress test llc using test cases
> generated by llvm-stress. When it finds a case where llc seems to
> have crashed, it greps the output for Assertion, LLVM ERROR, etc.,
> removes things that look like hex numbers and ID numbers, and then
> checksums the resulting text. In this way, it can automatically
> categorize different bugs into different subdirectories.
> 
> I found this useful, and maybe you will too :)
> 
>  -Hal
> 
> --
> Hal Finkel
> Assistant Computational Scientist
> Leadership Computing Facility
> Argonne National Laboratory
> 
> _______________________________________________
> LLVM Developers mailing list
> LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
> 
-- 
Hal Finkel
Assistant Computational Scientist
Leadership Computing Facility
Argonne National Laboratory
-------------- next part --------------
A non-text attachment was scrubbed...
Name: stress-v2.sh
Type: application/x-shellscript
Size: 1436 bytes
Desc: not available
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20130710/6fb51ac7/attachment.bin>

The only precedent I have seen in recent years for shell scripts is the
(absolutely insanely amazingly well-written) utils/TableGen/tdtags.

Ignoring the issue of whether this kind of tool belongs in the repo, IMO it
would be nice if you used tdtags as a "template" for this script;
there's a
large amount of shell-fu (not clever "tricks", but actual "how to
make a
robust, readable, portable shell script"-fu) in there that you will want to
imitate.
> LLVMHOME=/home/projects/llvm/upstream/llvm-trunk-build/Release+Asserts/bin
> SOPTS="-generate-ppc-fp128"
> TOPTS="-mtriple=powerpc64-unknown-linux-gnu -mcpu=pwr7"
Hardcoding these seems a bit "wrong". Are there any reasonable
defaults we
can use? ((pwd, empty, host triple) for the three options, respectively,
might be reasonable?).

-- Sean Silva



On Wed, Jul 10, 2013 at 7:14 PM, Hal Finkel <hfinkel at anl.gov> wrote:
> A few people have requested features; I've implemented them in this
> updated version (attached). Do you think this is worth putting in the repo
> somewhere?
>
>  -Hal
>
> ----- Original Message -----
> > Hi,
> >
> > I wrote a small script in order to stress test llc using test cases
> > generated by llvm-stress. When it finds a case where llc seems to
> > have crashed, it greps the output for Assertion, LLVM ERROR, etc.,
> > removes things that look like hex numbers and ID numbers, and then
> > checksums the resulting text. In this way, it can automatically
> > categorize different bugs into different subdirectories.
> >
> > I found this useful, and maybe you will too :)
> >
> >  -Hal
> >
> > --
> > Hal Finkel
> > Assistant Computational Scientist
> > Leadership Computing Facility
> > Argonne National Laboratory
> >
> > _______________________________________________
> > LLVM Developers mailing list
> > LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
> > http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
> >
>
> --
> Hal Finkel
> Assistant Computational Scientist
> Leadership Computing Facility
> Argonne National Laboratory
>
> _______________________________________________
> LLVM Developers mailing list
> LLVMdev at cs.uiuc.edu         http://llvm.cs.uiuc.edu
> http://lists.cs.uiuc.edu/mailman/listinfo/llvmdev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20130710/d9c31d57/attachment.html>