llvm dev - Jan 2021 - Some questions re tracking LLD for Mach-O's performance using LNT

Hi,

I understand that the `link` test suite schema at https://lnt.llvm.org/ is
being used to record profiling results for LLD for ELF. I would like to do
the same with LLD's Mach-O implementation by running the profiling jobs on
an internal server & submitting the results to the public LNT instance. A
few questions:

1. I don't see the `link` schema under `schemas/` in the `lnt` repo. Where
can I find it?

2. Should I reuse the schema or create a new one? I expect that we can
stick to the same set of perf data fields, so reusing should be fine as
long as we create one more column to indicate whether we're running the ELF
or Mach-O suite.

3. I would also like to reuse the lld/utils/benchmark.py script. Currently,
it invokes the LLD for ELF process via a hard-coded name, so I would like
to make that configurable via a CLI flag. But that would involve updating
the current job on the `as-worker` machines to specify the ELF back-end.
Who owns those machines and would be able to do this update? (That said,
it's hardly a blocker, since I can still have the script default the ELF
backend for now.)

Thanks,
Jez
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20210119/049c748b/attachment.html>

I forget when that was setup, but here is a copy of the schema from the
lnt.llvm.org <http://lnt.llvm.org/> server:

```
format_version: '2'
name: link
run_fields:
  - name: llvm_project_revision
    order: true
machine_fields:
  - name: hardware
  - name: os
metrics:
 - name: branch-misses
   bigger_is_better: false
   type: Real
 - name: stalled-cycles-frontend
   bigger_is_better: false
   type: Real
 - name: branches
   bigger_is_better: false
   type: Real
 - name: context-switches
   bigger_is_better: false
   type: Real
 - name: cpu-migrations
   bigger_is_better: false
   type: Real
 - name: cycles
   bigger_is_better: false
   type: Real
 - name: instructions
   bigger_is_better: false
   type: Real
 - name: seconds-elapsed
   bigger_is_better: false
   type: Real
 - name: page-faults
   bigger_is_better: false
   type: Real
 - name: task-clock
   bigger_is_better: false
   type: Real
```
> On Jan 19, 2021, at 1:49 PM, Jez via llvm-dev <llvm-dev at
lists.llvm.org> wrote:
> 
> Hi,
> 
> I understand that the `link` test suite schema at https://lnt.llvm.org/
<https://lnt.llvm.org/> is being used to record profiling results for LLD
for ELF. I would like to do the same with LLD's Mach-O implementation by
running the profiling jobs on an internal server & submitting the results to
the public LNT instance. A few questions:
> 
> 1. I don't see the `link` schema under `schemas/` in the `lnt` repo.
Where can I find it?
> 
> 2. Should I reuse the schema or create a new one? I expect that we can
stick to the same set of perf data fields, so reusing should be fine as long as
we create one more column to indicate whether we're running the ELF or
Mach-O suite.
> 
> 3. I would also like to reuse the lld/utils/benchmark.py script. Currently,
it invokes the LLD for ELF process via a hard-coded name, so I would like to
make that configurable via a CLI flag. But that would involve updating the
current job on the `as-worker` machines to specify the ELF back-end. Who owns
those machines and would be able to do this update? (That said, it's hardly
a blocker, since I can still have the script default the ELF backend for now.)
> 
> Thanks,
> Jez
> _______________________________________________
> LLVM Developers mailing list
> llvm-dev at lists.llvm.org
> https://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.llvm.org/pipermail/llvm-dev/attachments/20210119/891a3d5f/attachment.html>