Hello, I am trying to run benchmark test for llvm with llvm-test-suite, but failed. I do not have an arm-linux board, but an android userdebug phone. So I planned to run on PC with qemu-arm. My step (on ubuntu 18.04) 1. git clone https://github.com/llvm/llvm-test-suite 2. apt-get install qemu arm-linux-gnueabihf-gcc -y 3. cd llvm-test-suite 4. mkdir build & cd build 5. cmake -DCMAKE_C_COMPILER=/home/llvm-dev-3/build/bin/clang -DCMAKE_C_FLAGS=" -O2 --target=arm-linux-gnueabihf -I/usr/arm-linux-gnueabihf/include/ " -DCMAKE_BUILD_TYPE=Release -DTEST_SUITE_RUN_UNDER=qemu-arm -DTEST_SUITE_BENCHMARKING_ONLY=On -DTEST_SUITE_RUN_BENCHMARKS=On -DCMAKE_INCLUDE_PATH=/usr/arm-linux-gnueabihf/include ../ But got errors like, CMake Error at /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:137 (message): Could NOT find Threads (missing: Threads_FOUND) Call Stack (most recent call first): /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE) /usr/share/cmake-3.10/Modules/FindThreads.cmake:205 (FIND_PACKAGE_HANDLE_STANDARD_ARGS) MicroBenchmarks/libs/benchmark-1.3.0/CMakeLists.txt:189 (find_package) -- Configuring incomplete, errors occurred! The pthread.h does exist in /usr/arm-linux-gnueabihf/include/, why cmake still can not find it? Or any other suggestion to run benchmark on arm? Do I need to by a raspberry-pi board? Or qemu and anrdoird dev phone are OK enough? Ben -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20200728/1d227a47/attachment.html>
Sjoerd Meijer via llvm-dev
2020-Jul-28 11:11 UTC
[llvm-dev] Help run benchmark test for arm
Hi Ben, I didn't quite understand this:> I do not have an arm-linux board, but an android userdebug phone. So I planned to run on PC with qemu-arm.But it looks like you want to benchmark on qemu, but I don't think qemu will give you representative performance numbers. So yeah, for benchmarking I think a dev board would be best. A phone could work too, but then you need to be really careful in setting up the environment (frequency scaling etc.), but then I'm guessing running the llvm-suite might be tricky. Alternatively, there are a few cloud services available that you can use to generate numbers, but I don't have any experience in setting that up, so don't know how easy/convenient that is. But I think I know which phab diff your query is related to, so will leave a comment there too. Cheers, Sjoerd. ________________________________ From: llvm-dev <llvm-dev-bounces at lists.llvm.org> on behalf of Ben Shi via llvm-dev <llvm-dev at lists.llvm.org> Sent: 28 July 2020 10:58 To: llvm-dev <llvm-dev at lists.llvm.org> Subject: [llvm-dev] Help run benchmark test for arm Hello, I am trying to run benchmark test for llvm with llvm-test-suite, but failed. I do not have an arm-linux board, but an android userdebug phone. So I planned to run on PC with qemu-arm. My step (on ubuntu 18.04) 1. git clone https://github.com/llvm/llvm-test-suite 2. apt-get install qemu arm-linux-gnueabihf-gcc -y 3. cd llvm-test-suite 4. mkdir build & cd build 5. cmake -DCMAKE_C_COMPILER=/home/llvm-dev-3/build/bin/clang -DCMAKE_C_FLAGS=" -O2 --target=arm-linux-gnueabihf -I/usr/arm-linux-gnueabihf/include/ " -DCMAKE_BUILD_TYPE=Release -DTEST_SUITE_RUN_UNDER=qemu-arm -DTEST_SUITE_BENCHMARKING_ONLY=On -DTEST_SUITE_RUN_BENCHMARKS=On -DCMAKE_INCLUDE_PATH=/usr/arm-linux-gnueabihf/include ../ But got errors like, CMake Error at /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:137 (message): Could NOT find Threads (missing: Threads_FOUND) Call Stack (most recent call first): /usr/share/cmake-3.10/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE) /usr/share/cmake-3.10/Modules/FindThreads.cmake:205 (FIND_PACKAGE_HANDLE_STANDARD_ARGS) MicroBenchmarks/libs/benchmark-1.3.0/CMakeLists.txt:189 (find_package) -- Configuring incomplete, errors occurred! The pthread.h does exist in /usr/arm-linux-gnueabihf/include/, why cmake still can not find it? Or any other suggestion to run benchmark on arm? Do I need to by a raspberry-pi board? Or qemu and anrdoird dev phone are OK enough? Ben -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20200728/54dfa0fb/attachment.html>