search for: llvm_parallel_compile_jobs

...switched from "configure and make" to "cmake" build-system and >> wanted to speedup my build. >> >> In my build-script I use... >> >> CMAKE_JOBS="1" >> ##CMAKE_JOBS=$(($(getconf _NPROCESSORS_ONLN)+1)) >> JOBS_CMAKE_OPTS="-DLLVM_PARALLEL_COMPILE_JOBS=$CMAKE_JOBS >> -DLLVM_PARALLEL_LINK_JOBS=$CMAKE_JOBS" >> >> [1] says in "LLVM-specific variables" section... >> >> *** LLVM_PARALLEL_COMPILE_JOBS:STRING >> >> Define the maximum number of concurrent compilation jobs. >> >> *** LLV...

...ith this combination I could reduce build-time down from approx. 3h down to 01h20m. $ egrep -i 'jobs|ninja' llvm-build/CMakeCache.txt //Program used to build from build.ninja files. CMAKE_MAKE_PROGRAM:FILEPATH=/opt/cmake/bin/ninja //Define the maximum number of concurrent compilation jobs. LLVM_PARALLEL_COMPILE_JOBS:STRING=3 //Define the maximum number of concurrent link jobs. LLVM_PARALLEL_LINK_JOBS:STRING=1 CMAKE_GENERATOR:INTERNAL=Ninja $ LC_ALL=C ls -alt logs/3.8.0rc3_clang-3-8-0-rc3_cmake-3-4-3_ninja-1-6-0/ total 360 drwxr-xr-x 2 wearefam wearefam 4096 Feb 25 19:58 . drwxr-xr-x 6 wearefam wearefam 40...

.... 3h >> down to 01h20m. >> >> $ egrep -i 'jobs|ninja' llvm-build/CMakeCache.txt >> //Program used to build from build.ninja files. >> CMAKE_MAKE_PROGRAM:FILEPATH=/opt/cmake/bin/ninja >> //Define the maximum number of concurrent compilation jobs. >> LLVM_PARALLEL_COMPILE_JOBS:STRING=3 >> //Define the maximum number of concurrent link jobs. >> LLVM_PARALLEL_LINK_JOBS:STRING=1 >> CMAKE_GENERATOR:INTERNAL=Ninja >> >> $ LC_ALL=C ls -alt logs/3.8.0rc3_clang-3-8-0-rc3_cmake-3-4-3_ninja-1-6-0/ >> total 360 >> drwxr-xr-x 2 wearefam wea...

...t; > Hi, > > I switched from "configure and make" to "cmake" build-system and > wanted to speedup my build. > > In my build-script I use... > > CMAKE_JOBS="1" > ##CMAKE_JOBS=$(($(getconf _NPROCESSORS_ONLN)+1)) > JOBS_CMAKE_OPTS="-DLLVM_PARALLEL_COMPILE_JOBS=$CMAKE_JOBS > -DLLVM_PARALLEL_LINK_JOBS=$CMAKE_JOBS" > > [1] says in "LLVM-specific variables" section... > > *** LLVM_PARALLEL_COMPILE_JOBS:STRING > > Define the maximum number of concurrent compilation jobs. > > *** LLVM_PARALLEL_LINK_JOBS:STRING >...

Hi, unfortunately, my build somehow hangs when linking clang binary and my system is in an unusable state. My toolchain is clang-3.8, gold-1.11 and LLVMgold.so from binutils v2.26.1 (both selfmade) and LTO-flag is enabled. My buildsystem uses cmake-3.6.0 and ninja-1.7.1 (both prebuilt). I have 52 last steps left in my 3rd build. My Linux-kernel is v3.13.0-92 from official Ubuntu repositories.

...e and make" to "cmake" build-system and >>> wanted to speedup my build. >>> >>> In my build-script I use... >>> >>> CMAKE_JOBS="1" >>> ##CMAKE_JOBS=$(($(getconf _NPROCESSORS_ONLN)+1)) >>> JOBS_CMAKE_OPTS="-DLLVM_PARALLEL_COMPILE_JOBS=$CMAKE_JOBS >>> -DLLVM_PARALLEL_LINK_JOBS=$CMAKE_JOBS" >>> >>> [1] says in "LLVM-specific variables" section... >>> >>> *** LLVM_PARALLEL_COMPILE_JOBS:STRING >>> >>> Define the maximum number of concurrent compilation job...

...>>> $ egrep -i 'jobs|ninja' llvm-build/CMakeCache.txt > >>> //Program used to build from build.ninja files. > >>> CMAKE_MAKE_PROGRAM:FILEPATH=/opt/cmake/bin/ninja > >>> //Define the maximum number of concurrent compilation jobs. > >>> LLVM_PARALLEL_COMPILE_JOBS:STRING=3 > >>> //Define the maximum number of concurrent link jobs. > >>> LLVM_PARALLEL_LINK_JOBS:STRING=1 > >>> CMAKE_GENERATOR:INTERNAL=Ninja > >>> > >>> $ LC_ALL=C ls -alt > logs/3.8.0rc3_clang-3-8-0-rc3_cmake-3-4-3_ninja-1-6-0/ >...

...build with > '-flto'. > > > > - EOT - > > Hi, > > in the meantime I tried with Linux v4.4.y LTS and 2GiB swap-space. > So I have 4 GiB RAM and 2GiB SWAP in total 6GiB. > > Paul Rouschal recommended to reduce parallel-compile-jobs from 2 to 1... > > LLVM_PARALLEL_COMPILE_JOBS=1 > LLVM_PARALLEL_LINK_JOBS=1 > > ...but that did not help. > > My Ubuntu/precise hangs and looking at top shows MEM/SWAP to be eaten. > > Anyone has experiences how much RAM or SWAP I need when building a > LTO-optimized llvm-toolchain with Clang, GNU/gold and LLVMgold-Plug...

Hi, I switched from "configure and make" to "cmake" build-system and wanted to speedup my build. In my build-script I use... CMAKE_JOBS="1" ##CMAKE_JOBS=$(($(getconf _NPROCESSORS_ONLN)+1)) JOBS_CMAKE_OPTS="-DLLVM_PARALLEL_COMPILE_JOBS=$CMAKE_JOBS -DLLVM_PARALLEL_LINK_JOBS=$CMAKE_JOBS" [1] says in "LLVM-specific variables" section... *** LLVM_PARALLEL_COMPILE_JOBS:STRING Define the maximum number of concurrent compilation jobs. *** LLVM_PARALLEL_LINK_JOBS:STRING Define the maximum number of concurrent link job...

...grep -i 'jobs|ninja' llvm-build/CMakeCache.txt >> >>> //Program used to build from build.ninja files. >> >>> CMAKE_MAKE_PROGRAM:FILEPATH=/opt/cmake/bin/ninja >> >>> //Define the maximum number of concurrent compilation jobs. >> >>> LLVM_PARALLEL_COMPILE_JOBS:STRING=3 >> >>> //Define the maximum number of concurrent link jobs. >> >>> LLVM_PARALLEL_LINK_JOBS:STRING=1 >> >>> CMAKE_GENERATOR:INTERNAL=Ninja >> >>> >> >>> $ LC_ALL=C ls -alt >> logs/3.8.0rc3_clang-3-8-0-rc3_cmake...

...llvm-build/CMakeCache.txt >>>>>>> //Program used to build from build.ninja files. >>>>>>> CMAKE_MAKE_PROGRAM:FILEPATH=/opt/cmake/bin/ninja >>>>>>> //Define the maximum number of concurrent compilation jobs. >>>>>>> LLVM_PARALLEL_COMPILE_JOBS:STRING=3 >>>>>>> //Define the maximum number of concurrent link jobs. >>>>>>> LLVM_PARALLEL_LINK_JOBS:STRING=1 >>>>>>> CMAKE_GENERATOR:INTERNAL=Ninja >>>>>>> >>>>>>> $ LC_ALL=C ls -alt >>...

...How to check available cmake-options? # EXAMPLE #3: cd $BUILD_DIR ; cmake ../llvm -LA | egrep $CMAKE_OPTS # # CMake binary CMAKE="cmake" # CMake compiler options COMPILERS_CMAKE_OPTS="-DCMAKE_C_COMPILER=$COMPILER_CC -DCMAKE_CXX_COMPILER=$COMPILER_CXX" # NOTE-1: cmake/ninja: Use LLVM_PARALLEL_COMPILE_JOBS and LLVM_PARALLEL_LINK_JOBS options # NOTE-2: For fast builds use available (online) CPUs +1 or set values explicitly # NOTE-3: For fast and safe linking use bintils-gold and LINK_JOBS="1" COMPILE_JOBS="2" ##COMPILE_JOBS=$(($(getconf _NPROCESSORS_ONLN)+1)) LINK_JOBS="1&quot...

...ake" build-system and >>>> wanted to speedup my build. >>>> >>>> In my build-script I use... >>>> >>>> CMAKE_JOBS="1" >>>> ##CMAKE_JOBS=$(($(getconf _NPROCESSORS_ONLN)+1)) >>>> JOBS_CMAKE_OPTS="-DLLVM_PARALLEL_COMPILE_JOBS=$CMAKE_JOBS >>>> -DLLVM_PARALLEL_LINK_JOBS=$CMAKE_JOBS" >>>> >>>> [1] says in "LLVM-specific variables" section... >>>> >>>> *** LLVM_PARALLEL_COMPILE_JOBS:STRING >>>> >>>> Define the maximum number o...

...INJA v1.6.0 ] $ egrep -i 'jobs|ninja' logs/3.8.0rc3_clang-3-8-0-rc3_cmake-3-4-3_ninja-1-6-0_compile-jobs-2_link-jobs-1/CMakeCache.txt //Program used to build from build.ninja files. CMAKE_MAKE_PROGRAM:FILEPATH=/opt/cmake/bin/ninja //Define the maximum number of concurrent compilation jobs. LLVM_PARALLEL_COMPILE_JOBS:STRING=2 //Define the maximum number of concurrent link jobs. LLVM_PARALLEL_LINK_JOBS:STRING=1 CMAKE_GENERATOR:INTERNAL=Ninja $ cd statistics/3.8.0rc3_clang-3-8-0-rc3_cmake-3-4-3_ninja-1-6-0_compile-jobs-2_link-jobs-1/ $ cat disc-usage_llvm-toolchain-3.8.0rc3_clang-3-8-0-rc3_cmake-3-4-3_ninja-1-6...

...gt;>>>>>>> //Program used to build from build.ninja files. >>>>>>>>> CMAKE_MAKE_PROGRAM:FILEPATH=/opt/cmake/bin/ninja >>>>>>>>> //Define the maximum number of concurrent compilation jobs. >>>>>>>>> LLVM_PARALLEL_COMPILE_JOBS:STRING=3 >>>>>>>>> //Define the maximum number of concurrent link jobs. >>>>>>>>> LLVM_PARALLEL_LINK_JOBS:STRING=1 >>>>>>>>> CMAKE_GENERATOR:INTERNAL=Ninja >>>>>>>>> >>>>>>&...

...>>> Hi, >>> >>> in the meantime I tried with Linux v4.4.y LTS and 2GiB swap-space. >>> So I have 4 GiB RAM and 2GiB SWAP in total 6GiB. >>> >>> Paul Rouschal recommended to reduce parallel-compile-jobs from 2 to 1... >>> >>> LLVM_PARALLEL_COMPILE_JOBS=1 >>> LLVM_PARALLEL_LINK_JOBS=1 >>> >>> ...but that did not help. >>> >>> My Ubuntu/precise hangs and looking at top shows MEM/SWAP to be eaten. >>> >>> Anyone has experiences how much RAM or SWAP I need when building a >>>...

On Thu, Mar 17, 2016 at 11:45 AM, Sedat Dilek <sedat.dilek at gmail.com> wrote: > On Thu, Mar 17, 2016 at 10:05 AM, Sedat Dilek <sedat.dilek at gmail.com> wrote: >> On Mon, Mar 14, 2016 at 5:30 PM, Chris Bieneman <cbieneman at apple.com> wrote: >> [ brutal-snip ] >> ... >>> [ TODO#S: Before doing a 2nd build (and in a 3rd run using more >>>

On Mon, Mar 14, 2016 at 5:30 PM, Chris Bieneman <cbieneman at apple.com> wrote: [ brutal-snip ] ... > [ TODO#S: Before doing a 2nd build (and in a 3rd run using more > optimized binaries) ] > > How do I anable LTO via CMAKE? > > > LLVM_ENALBLE_LTO=On > [ v4 of my build-script attached ] Hi Chris, thanks for the response! That seems to work (see below). $ cd

Trying to run a self host "ninja check-clang" with ASan enabled I hit a /lot/ of errors like this (strangely I hit none of these in check-llvm, only in check-clang): Any ideas? ==10525==ERROR: AddressSanitizer failed to deallocate 0x10800 (67584) bytes at address 0x631000014800 ==10525==AddressSanitizer CHECK failed:

...LVM_LIBDIR_SUFFIX:STRING= //Link tools against the libllvm dynamic library LLVM_LINK_LLVM_DYLIB:BOOL=OFF //Default options for lit LLVM_LIT_ARGS:STRING=-sv //Force TableGen to be built with optimization LLVM_OPTIMIZED_TABLEGEN:BOOL=OFF //Define the maximum number of concurrent compilation jobs. LLVM_PARALLEL_COMPILE_JOBS:STRING= //Define the maximum number of concurrent link jobs. LLVM_PARALLEL_LINK_JOBS:STRING= //Build LLVM with Polly LLVM_POLLY_BUILD:BOOL=ON //Statically link Polly into tools (if available) LLVM_POLLY_LINK_INTO_TOOLS:BOOL=ON //Profiling data file to use when compiling in order to improve // r...