llvm dev - Nov 2012 - [LLVMdev] Incorrect values of GCC/LLC, GCC/LLC-BETA and LLC/LLC-BETA columns in the report.html

Hi,

I run LLVM test suite using the following command and get
report.nightly.html successfully.

% make report.html TEST=nightly

But GCC/LLC, GCC/LLC-BETA and LLC/LLC-BETA columns look strange. Here
is for example snippet of "clamscan" test result:
[[
Program                 MultiSource/Applications/ClamAV/clamscan
GCC                      0.2360
LLC                        0.2360
LLC-BETA               *
GCC/LLC               17.92
GCC/LLC-BETA      17.92
LLC/LLC-BETA        1.00
]]

Obviously the last free values should be as follows because GCC and
LLC execution times are equal and LLC-BETA test does not run at all:
[[
GCC/LLC               1
GCC/LLC-BETA      *
LLC/LLC-BETA       *
]]

What is the reason of this problem?
a) I make a mistake.
b) It's old and unsupported functionality. Should we remove it?
c) It's a bug. The patch fixes the bug is attached.

Thanks.

--
Simon
-------------- next part --------------
A non-text attachment was scrubbed...
Name: test-nightly-report.patch
Type: application/octet-stream
Size: 1621 bytes
Desc: not available
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20121112/8edcf4ef/attachment.obj>

On Mon, Nov 12, 2012 at 11:15 PM, Simon Atanasyan <satanasyan at mips.com>
wrote:
> I run LLVM test suite using the following command and get
> report.nightly.html successfully.
>
> % make report.html TEST=nightly
>
> But GCC/LLC, GCC/LLC-BETA and LLC/LLC-BETA columns look strange. Here
> is for example snippet of "clamscan" test result:
> [[
> Program                 MultiSource/Applications/ClamAV/clamscan
> GCC                      0.2360
> LLC                        0.2360
> LLC-BETA               *
> GCC/LLC               17.92
> GCC/LLC-BETA      17.92
> LLC/LLC-BETA        1.00
> ]]
>
> Obviously the last free values should be as follows because GCC and
> LLC execution times are equal and LLC-BETA test does not run at all:
> [[
> GCC/LLC               1
> GCC/LLC-BETA      *
> LLC/LLC-BETA       *
> ]]
>
> What is the reason of this problem?
> a) I make a mistake.
> b) It's old and unsupported functionality. Should we remove it?
> c) It's a bug. The patch fixes the bug is attached.
Ping.

--
Simon

On Thu, Nov 15, 2012 at 12:50 AM, Simon Atanasyan <satanasyan at mips.com>
wrote:
> On Mon, Nov 12, 2012 at 11:15 PM, Simon Atanasyan <satanasyan at
mips.com> wrote:
>> I run LLVM test suite using the following command and get
>> report.nightly.html successfully.
>>
>> % make report.html TEST=nightly
>>
>> But GCC/LLC, GCC/LLC-BETA and LLC/LLC-BETA columns look strange. Here
>> is for example snippet of "clamscan" test result:
>> [[
>> Program                 MultiSource/Applications/ClamAV/clamscan
>> GCC                      0.2360
>> LLC                        0.2360
>> LLC-BETA               *
>> GCC/LLC               17.92
>> GCC/LLC-BETA      17.92
>> LLC/LLC-BETA        1.00
>> ]]
>>
>> Obviously the last free values should be as follows because GCC and
>> LLC execution times are equal and LLC-BETA test does not run at all:
>> [[
>> GCC/LLC               1
>> GCC/LLC-BETA      *
>> LLC/LLC-BETA       *
>> ]]
>>
>> What is the reason of this problem?
>> a) I make a mistake.
>> b) It's old and unsupported functionality. Should we remove it?
>> c) It's a bug. The patch fixes the bug is attached.
>
> Ping.
And one more ping after a very long delay.
If nobody have any objections I plan to commit this patch soon.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: test-nightly-report.patch
Type: application/octet-stream
Size: 1563 bytes
Desc: not available
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20130207/ad4e28f0/attachment.obj>