hi all, well, i have set up proper command line parameters for for C-Shootout tests to get reasonable running time for benchmarking. I have compared "gcc -O3" and "llvmgcc -Wl,-native-cbe" here goes output (which shows that llvm is already better for test with intensive function calls): time -p ./gcc_ackermann 11 user 2.36 time -p ./llvm_ackermann 11 user 1.07 ---- time -p ./gcc_ary3 300000 user 2.86 time -p ./llvm_ary3 300000 user 3.19 ---- time -p ./gcc_fib2 39 user 2.32 time -p ./llvm_fib2 39 user 1.61 ---- time -p ./gcc_hash 1000000 user 2.26 time -p ./llvm_hash 1000000 user 2.30 ---- time -p ./gcc_heapsort 2000000 user 2.57 time -p ./llvm_heapsort 2000000 user 3.26 ---- time -p ./gcc_lists 500000 user 2.70 time -p ./llvm_lists 500000 user 3.27 ---- time -p ./gcc_matrix 500000 user 2.61 time -p ./llvm_matrix 500000 user 4.17 ---- time -p ./gcc_methcall 90000000 user 2.83 time -p ./llvm_methcall 90000000 user 2.89 ---- time -p ./gcc_nestedloop 33 user 2.40 time -p ./llvm_nestedloop 33 user 3.66 ---- time -p ./gcc_objinst 10000000 user 2.25 time -p ./llvm_objinst 10000000 user 2.12 ---- time -p ./gcc_random 60000000 user 2.42 time -p ./llvm_random 60000000 user 2.42 ---- time -p ./gcc_sieve 25000 user 2.41 time -p ./llvm_sieve 25000 user 4.36 ---- time -p ./gcc_strcat 50000000 user 2.77 time -p ./llvm_strcat 50000000 user 3.98
On Wed, 5 May 2004, [koi8-r] "Valery A.Khamenya[koi8-r] " wrote:> hi all, > > well, i have set up proper command line parameters for > for C-Shootout tests to get reasonable running time > for benchmarking. I have compared "gcc -O3" and > "llvmgcc -Wl,-native-cbe"Cool. Each of these benchmarks has a default problem size for when no arguments are specified (take a look in the main for each benchmark). If you could modify the benchmark programs to default to the sizes you specified, and send me the diff, I would be happy to apply it. :) -Chris> here goes output (which shows that llvm is already > better for test with intensive function calls): > > time -p ./gcc_ackermann 11 > user 2.36 > time -p ./llvm_ackermann 11 > user 1.07 > > ---- > time -p ./gcc_ary3 300000 > user 2.86 > time -p ./llvm_ary3 300000 > user 3.19 > > ---- > time -p ./gcc_fib2 39 > user 2.32 > time -p ./llvm_fib2 39 > user 1.61 > > ---- > time -p ./gcc_hash 1000000 > user 2.26 > time -p ./llvm_hash 1000000 > user 2.30 > > ---- > time -p ./gcc_heapsort 2000000 > user 2.57 > time -p ./llvm_heapsort 2000000 > user 3.26 > > ---- > time -p ./gcc_lists 500000 > user 2.70 > time -p ./llvm_lists 500000 > user 3.27 > > ---- > time -p ./gcc_matrix 500000 > user 2.61 > time -p ./llvm_matrix 500000 > user 4.17 > > ---- > time -p ./gcc_methcall 90000000 > user 2.83 > time -p ./llvm_methcall 90000000 > user 2.89 > > ---- > time -p ./gcc_nestedloop 33 > user 2.40 > time -p ./llvm_nestedloop 33 > user 3.66 > > ---- > time -p ./gcc_objinst 10000000 > user 2.25 > time -p ./llvm_objinst 10000000 > user 2.12 > > ---- > time -p ./gcc_random 60000000 > user 2.42 > time -p ./llvm_random 60000000 > user 2.42 > > ---- > time -p ./gcc_sieve 25000 > user 2.41 > time -p ./llvm_sieve 25000 > user 4.36 > > ---- > time -p ./gcc_strcat 50000000 > user 2.77 > time -p ./llvm_strcat 50000000 > user 3.98 > > _______________________________________________ > LLVM Developers mailing list > LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu > http://mail.cs.uiuc.edu/mailman/listinfo/llvmdev >-Chris -- http://llvm.cs.uiuc.edu/ http://www.nondot.org/~sabre/Projects/
> > well, i have set up proper command line parameters for > > for C-Shootout tests to get reasonable running time > > for benchmarking. [...] > > Each of these benchmarks has a default problem size for when no > arguments are specified (take a look in the main for each benchmark). If > you could modify the benchmark programs to default to the sizes you > specified, and send me the diff, I would be happy to apply it. :)If you do so, I would like to suggest that there be some kind of flag for running Shootout with the tiny, default problem sizes, which are appropriate for the kind of "smoke tests" that I like to run. Thanks! -- gaeke at uiuc.edu
> Cool. Each of these benchmarks has a default problem size for whenno> arguments are specified (take a look in the main for eachbenchmark). If> you could modify the benchmark programs to default to the sizes you > specified, and send me the diff, I would be happy to apply it. :)done. check your email, please. -- Valery