From llvm-testresults at cs.uiuc.edu Wed Aug 1 00:23:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 00:23:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801052325.7E3082A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2547?compare_to=2545&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2547, Order: 161099, Start Time: 2012-08-01 04:05:27, End Time: 2012-08-01 05:23:53 To: 2545, Order: 161097, Start Time: 2012-08-01 02:18:52, End Time: 2012-08-01 03:37:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (81 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.57% (13.0159 => 13.3504, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.68% (54.9857 => 56.4617, std. dev.: 0.1184) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.20% (78.4485 => 80.1717, std. dev.: 0.1567) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.77% (10.3673 => 13.3504, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.66% (1.1194 => 1.2499, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.63% (0.3473 => 0.3877, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std. dev.: 0.0056) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.65% (2.2022 => 2.3927, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (1.7609 => 1.8980, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.29% (0.1622 => 0.1724, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2065 => 0.2191, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.67% (0.5925 => 0.6261, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 5.64% (0.6030 => 0.6370, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.15% (7.0540 => 7.4173, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 4.84% (10.4361 => 10.9416, std. dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.72% (0.4615 => 0.4833, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.53% (0.7326 => 0.7658, std. dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 4.48% (0.7433 => 0.7766, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.09% (9.4845 => 9.8721, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.9449 => 5.1335, std. dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.80% (5.0018 => 5.1921, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.66% (0.8172 => 0.8471, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.46% (0.5860 => 0.6063, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3121 => 0.3226, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (4.2646 => 4.4071, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.15% (0.7835 => 0.8082, std. dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 3.14% (5.7591 => 5.9400, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.13% (8.1363 => 8.3906, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8024, std. dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.03% (1.1861 => 1.2220, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4636 => 0.4772, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.92% (1.3050 => 1.3431, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.88% (1.5603 => 1.6053, std. dev.: 0.0049) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4273, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.74% (2.0273 => 2.0828, std. dev.: 0.0123) MultiSource/Applications/Burg/burg: 2.66% (1.1642 => 1.1952, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5809, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9681, std. dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5105 => 0.5230, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.44% (0.8067 => 0.8264, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.4299 => 0.4402, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.35% (1.5859 => 1.6231, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.28% (2.2024 => 2.2527, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.19% (0.9765 => 0.9979, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.14% (0.6456 => 0.6594, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (0.6675 => 0.6810, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.96% (17.1811 => 17.5174, std. dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.95% (2.0665 => 2.1068, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.82% (1.4186 => 1.4444, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/football/football: 1.73% (0.8921 => 0.9075, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.72% (0.5981 => 0.6084, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.62% (0.7115 => 0.7230, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.60% (1.2842 => 1.3048, std. dev.: 0.0014) MultiSource/Applications/siod/siod: 1.53% (2.2969 => 2.3321, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 1.38% (1.1840 => 1.2003, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9734, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.60% (4.2280 => 4.4224, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (3.6395 => 3.7570, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2146, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8336, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (1.5086 => 1.5329, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2033, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2246, std. dev.: 0.0207) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.18% (5.2763 => 3.1564, std. dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.07% (5.3855 => 3.7123, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.48% (5.3526 => 3.7210, std. dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0949, std. dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.12% (2.9384 => 2.5530, std. dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.15% (22.1758 => 19.9242, std. dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std. dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.65% (1.2373 => 1.1055, std. dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -7.44% (1.5373 => 1.4230, std. dev.: 0.0151) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.30% (19.9488 => 18.4925, std. dev.: 0.0559) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std. dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -4.69% (1.9577 => 1.8658, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4806, std. dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (8.1563 => 7.9023, std. dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.6802 => 8.4217, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0018, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2013, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3136, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4181, std. dev.: 0.0079) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.39% (1.8329 => 1.8074, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/8bf87942/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 00:23:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 00:23:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801052330.3C8EA2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2548?compare_to=2546&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2548, Order: 161099, Start Time: 2012-08-01 04:10:10, End Time: 2012-08-01 05:23:54 To: 2546, Order: 161097, Start Time: 2012-08-01 02:28:28, End Time: 2012-08-01 03:42:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (144 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.55% (78.3546 => 81.1344, std. dev.: 0.3990) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.28% (2.0176 => 2.3057, std. dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference-object: 9.13% (0.5818 => 0.6349, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5748 => 0.6256, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.52% (0.3663 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.42% (0.3646 => 0.3953, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.27% (0.3650 => 0.3952, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7061 => 0.7632, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1986 => 0.2141, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.08% (1.3693 => 1.4663, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.7710 => 0.8239, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.77% (3.9660 => 4.2343, std. dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.67% (0.5265 => 0.5616, std. dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 6.65% (0.7038 => 0.7506, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4328 => 0.4608, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.36% (0.2721 => 0.2894, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.22% (0.2782 => 0.2955, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4062 => 0.4297, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4379 => 0.4627, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.2193 => 1.2879, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.59% (0.3022 => 0.3191, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.57% (0.3899 => 0.4116, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2607 => 0.2752, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.6959 => 0.7344, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.51% (0.2760 => 0.2912, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.50% (0.2726 => 0.2876, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.39% (1.9828 => 2.0896, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.37% (0.3485 => 0.3672, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3580 => 0.3771, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.33% (0.5577 => 0.5874, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9199 => 0.9686, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.3107 => 0.3271, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.28% (0.2937 => 0.3092, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.21% (0.3149 => 0.3313, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.19% (0.3489 => 0.3670, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.03% (13.8202 => 14.5160, std. dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 5.01% (16.6129 => 17.4456, std. dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.93% (0.4016 => 0.4214, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3192 => 0.3346, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.81% (0.3453 => 0.3619, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.77% (0.5637 => 0.5906, std. dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.74% (0.4390 => 0.4598, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 4.74% (0.3293 => 0.3449, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.74% (0.2914 => 0.3052, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.64% (0.7506 => 0.7854, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.63% (0.3868 => 0.4047, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (13.2842 => 13.8921, std. dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.55% (0.3756 => 0.3927, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.54% (7.2180 => 7.5455, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.53% (1.4563 => 1.5223, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.44% (1.1364 => 1.1869, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0013) MultiSource/Applications/Burg/burg: 4.36% (1.1061 => 1.1543, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.32% (1.0594 => 1.1052, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.3245 => 1.3817, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0094, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.21% (3.8646 => 4.0273, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.12% (0.7460 => 0.7767, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.06% (1.3819 => 1.4380, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.92% (1.2292 => 1.2774, std. dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.85% (1.3813 => 1.4345, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.84% (4.3801 => 4.5481, std. dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (3.6692 => 3.8095, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.75% (4.4433 => 4.6099, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (4.9865 => 5.1655, std. dev.: 0.0253) MultiSource/Applications/siod/siod: 3.54% (2.1791 => 2.2562, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.32% (1.1333 => 1.1709, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.22% (0.6283 => 0.6485, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.19% (0.3131 => 0.3231, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.95% (0.8698 => 0.8955, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.4961 => 8.7433, std. dev.: 0.0038) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2798, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.71% (3.2742 => 3.3629, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.66% (2.1007 => 2.1566, std. dev.: 0.0216) MultiSource/Applications/JM/ldecod/ldecod: 2.59% (6.5754 => 6.7457, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (1.5188 => 1.5574, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 2.49% (14.8535 => 15.2240, std. dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 2.48% (16.2614 => 16.6642, std. dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: 2.43% (14.5298 => 14.8832, std. dev.: 0.0145) MultiSource/Applications/oggenc/oggenc: 2.14% (4.6629 => 4.7625, std. dev.: 0.0160) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.66% (0.9108 => 0.9259, std. dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.43% (1.0313 => 1.0460, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7859, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2640, std. dev.: 0.0181) SingleSource/Benchmarks/Misc/mandel-2: 7.80% (1.2998 => 1.4012, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.09% (0.9996 => 1.0505, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7551, std. dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7036, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4515, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.45% (1.9290 => 1.9570, std. dev.: 0.0093) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5071, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.29% (4.5928 => 4.6519, std. dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.18% (1.0310 => 1.0432, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.57% (0.4657 => 0.4025, std. dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.5627 => 21.1475, std. dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.25% (0.2670 => 0.2503, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.15% (0.0997 => 0.0816, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.34% (1.2308 => 1.1035, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (20.3410 => 18.6083, std. dev.: 0.0221) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.03% (1.3780 => 1.3087, std. dev.: 0.0181) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9185, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9447, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5886, std. dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.35% (0.6589 => 0.6434, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2241, std. dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.90% (6.6320 => 6.5063, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7682, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.35% (5.3167 => 5.2449, std. dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.3305 => 7.2349, std. dev.: 0.0181) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std. dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2319, std. dev.: 0.0351) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/bf4a874b/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 02:07:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 02:07:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801070720.4B66E2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2549?compare_to=2548&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2549, Order: 161100, Start Time: 2012-08-01 05:51:57, End Time: 2012-08-01 07:07:47 To: 2548, Order: 161099, Start Time: 2012-08-01 04:10:10, End Time: 2012-08-01 05:23:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (128 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (730 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (54.8420 => 56.3668, std. dev.: 0.1034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.35% (2.0176 => 2.3071, std. dev.: 0.0582) SingleSource/UnitTests/ObjC++/property-reference-object: 10.26% (0.5818 => 0.6415, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.17% (0.3578 => 0.3942, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.02% (0.5748 => 0.6324, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.02% (0.3623 => 0.3986, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.00% (0.3601 => 0.3961, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3663 => 0.4027, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3646 => 0.4008, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.90% (0.3789 => 0.4164, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.84% (0.3650 => 0.4009, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 9.58% (0.3914 => 0.4289, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.4003 => 0.4382, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.34% (0.3940 => 0.4308, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.21% (0.7061 => 0.7711, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 8.00% (1.3693 => 1.4789, std. dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.57% (0.1413 => 0.1520, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2781 => 0.2988, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.44% (0.4328 => 0.4650, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2782 => 0.2987, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.16% (0.2596 => 0.2782, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.06% (3.9660 => 4.2461, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.06% (0.2607 => 0.2791, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.03% (0.5265 => 0.5635, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 6.96% (0.7038 => 0.7528, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.89% (0.4062 => 0.4342, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.85% (0.2655 => 0.2837, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.81% (0.2628 => 0.2807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2726 => 0.2910, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.73% (0.2765 => 0.2951, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.70% (0.2760 => 0.2945, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.57% (0.3107 => 0.3311, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.51% (0.3149 => 0.3354, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.49% (0.2696 => 0.2871, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.46% (0.3485 => 0.3710, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.2988 => 0.3177, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 6.20% (0.3192 => 0.3390, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.14% (0.3453 => 0.3665, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3534 => 0.3749, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.6959 => 0.7370, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 5.86% (0.3293 => 0.3486, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (0.3756 => 0.3971, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.69% (0.4390 => 0.4640, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.68% (1.2193 => 1.2886, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.68% (0.4016 => 0.4244, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.56% (0.3868 => 0.4083, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.47% (0.1865 => 0.1967, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.45% (0.5577 => 0.5881, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.44% (16.6129 => 17.5162, std. dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9199 => 0.9696, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.36% (13.8202 => 14.5615, std. dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.2945 => 0.3102, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.26% (0.2243 => 0.2361, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.22% (0.2914 => 0.3066, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.14% (0.2023 => 0.2127, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.2925 => 0.3074, std. dev.: 0.0020) MultiSource/Applications/spiff/spiff: 4.98% (0.7506 => 0.7880, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2292 => 1.2895, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.89% (7.2180 => 7.5711, std. dev.: 0.0075) MultiSource/Applications/Burg/burg: 4.87% (1.1061 => 1.1600, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.84% (0.3246 => 0.3403, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.77% (0.5637 => 0.5906, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.63% (1.1364 => 1.1890, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.61% (1.3245 => 1.3856, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.60% (3.8646 => 4.0425, std. dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/football/football: 4.51% (0.8310 => 0.8685, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.49% (1.9270 => 2.0136, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.39% (0.3755 => 0.3920, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.7460 => 0.7786, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.36% (1.0594 => 1.1056, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.3813 => 1.4385, std. dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6240, std. dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 4.04% (0.3220 => 0.3350, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 3.90% (2.1791 => 2.2641, std. dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.88% (0.4791 => 0.4977, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.86% (4.9865 => 5.1789, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.71% (0.8698 => 0.9021, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.65% (1.1333 => 1.1747, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.36% (0.6283 => 0.6494, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.31% (0.6135 => 0.6338, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.05% (3.1889 => 3.2861, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.97% (2.1007 => 2.1630, std. dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.5754 => 6.7584, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (3.2742 => 3.3651, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 2.74% (14.8535 => 15.2600, std. dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 2.64% (16.2614 => 16.6915, std. dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: 2.56% (14.5298 => 14.9024, std. dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.6250 => 0.6397, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.33% (4.6629 => 4.7717, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (0.9108 => 0.9268, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.56% (1.0313 => 1.0474, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.54% (0.6744 => 0.6848, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 1.29% (3.7467 => 3.7950, std. dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std. dev.: 0.0096) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2661, std. dev.: 0.0548) SingleSource/Benchmarks/Misc/mandel-2: 8.96% (1.2998 => 1.4163, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.31% (0.9996 => 1.0527, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7523, std. dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7063, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9769, std. dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.68% (1.7688 => 1.8162, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9602, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.39% (8.3908 => 8.5074, std. dev.: 0.0261) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1942, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.27% (4.5928 => 4.6512, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1387, std. dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -12.93% (0.4657 => 0.4055, std. dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.22% (0.2670 => 0.2504, std. dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.05% (22.5627 => 21.1968, std. dev.: 0.3937) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.65% (0.0997 => 0.0831, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1106, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.77% (20.3410 => 18.5573, std. dev.: 0.0233) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.85% (1.3780 => 1.3112, std. dev.: 0.0128) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9202, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9486, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -2.08% (6.3560 => 6.2241, std. dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.96% (6.6320 => 6.5017, std. dev.: 0.0127) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7672, std. dev.: 0.1254) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.9173 => 3.8579, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2300, std. dev.: 0.0354) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2482, std. dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8495, std. dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/2c5644db/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 02:12:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 02:12:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801071250.5148F2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2550?compare_to=2547&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2550, Order: 161100, Start Time: 2012-08-01 05:51:57, End Time: 2012-08-01 07:13:17 To: 2547, Order: 161099, Start Time: 2012-08-01 04:05:27, End Time: 2012-08-01 05:23:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (60 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (778 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.42% (0.7658 => 0.7767, std. dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.17% (1.4230 => 1.4539, std. dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (13.3504 => 13.1883, std. dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.21% (10.3673 => 13.1883, std. dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 12.99% (0.3473 => 0.3924, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 12.61% (0.3497 => 0.3938, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.48% (0.3543 => 0.3985, std. dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: 12.46% (0.3516 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3543 => 0.3982, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.38% (0.3561 => 0.4002, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.18% (0.3694 => 0.4144, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.76% (0.3828 => 0.4278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.29% (1.1194 => 1.2458, std. dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.62% (2.2022 => 2.3921, std. dev.: 0.0466) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.53% (1.7609 => 1.8935, std. dev.: 0.0262) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.65% (0.5925 => 0.6319, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.60% (0.1622 => 0.1729, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.43% (0.6030 => 0.6418, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.02% (0.7326 => 0.7767, std. dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (0.4615 => 0.4843, std. dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 4.75% (10.4361 => 10.9316, std. dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.71% (0.4879 => 0.5109, std. dev.: 0.0084) SingleSource/Benchmarks/Misc/oourafft: 4.63% (0.3282 => 0.3434, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.55% (0.7433 => 0.7771, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 4.15% (9.4845 => 9.8785, std. dev.: 0.0113) MultiSource/Applications/spiff/spiff: 3.42% (0.7835 => 0.8103, std. dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 3.35% (0.3109 => 0.3213, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.32% (0.4636 => 0.4790, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 3.19% (1.5603 => 1.6100, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.05% (5.7591 => 5.9347, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.97% (0.4103 => 0.4225, std. dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.96% (1.1642 => 1.1987, std. dev.: 0.0085) MultiSource/Applications/treecc/treecc: 2.93% (2.0273 => 2.0867, std. dev.: 0.0027) MultiSource/Applications/d/make_dparser: 2.88% (3.3354 => 3.4314, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.80% (0.3826 => 0.3933, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.62% (2.0665 => 2.1206, std. dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/hash: 2.56% (0.4289 => 0.4399, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.45% (0.4203 => 0.4306, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.35% (0.5105 => 0.5225, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.32% (0.6456 => 0.6606, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (0.4620 => 0.4721, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.16% (1.5859 => 1.6202, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.04% (17.1811 => 17.5308, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.02% (0.6675 => 0.6810, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3101, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.61% (2.2969 => 2.3338, std. dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.20% (1.0722 => 1.0851, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9742, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.32% (4.2280 => 4.4106, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7512, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (3.1578 => 3.2097, std. dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 1.64% (11.6436 => 11.8342, std. dev.: 0.0244) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2048, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.23% (5.2763 => 3.1539, std. dev.: 0.0525) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6989, std. dev.: 0.0565) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7091, std. dev.: 0.0537) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0365, std. dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.60% (2.9384 => 2.5389, std. dev.: 0.0615) MultiSource/Applications/ClamAV/clamscan: -10.05% (22.1758 => 19.9481, std. dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.06% (3.8922 => 3.8511, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.03% (0.0998 => 0.0848, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.83% (1.2373 => 1.1157, std. dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.18% (19.9488 => 18.5161, std. dev.: 0.0709) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -5.43% (1.5373 => 1.4539, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.53% (1.9577 => 1.8691, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4810, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9065, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (8.6802 => 8.4182, std. dev.: 0.0811) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0054, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std. dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2005, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3233, std. dev.: 0.0057) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.54% (9.5636 => 9.4166, std. dev.: 0.0553) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: -1.01% (1.1333 => 1.1219, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/db5f3d91/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 04:26:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 04:26:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801092628.9415E2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2551?compare_to=2549&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2551, Order: 161101, Start Time: 2012-08-01 08:12:59, End Time: 2012-08-01 09:26:56 To: 2549, Order: 161100, Start Time: 2012-08-01 05:51:57, End Time: 2012-08-01 07:07:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (151 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (706 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.06% (1.4942 => 1.5100, std. dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.29% (2.0176 => 2.3059, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 10.24% (0.5818 => 0.6414, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.12% (0.3578 => 0.3940, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.04% (0.5748 => 0.6325, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.94% (0.3601 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.87% (0.3646 => 0.4006, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.83% (0.3623 => 0.3979, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.81% (0.3650 => 0.4008, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3663 => 0.4021, std. dev.: 0.0035) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3789 => 0.4156, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.63% (0.3914 => 0.4291, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.39% (0.4003 => 0.4379, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.39% (0.3940 => 0.4310, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.19% (0.7061 => 0.7710, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.1986 => 0.2157, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3130 => 0.3394, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 7.87% (1.3693 => 1.4770, std. dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 7.55% (0.2781 => 0.2991, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.47% (0.7710 => 0.8286, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4328 => 0.4648, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.36% (0.1413 => 0.1517, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2782 => 0.2986, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3022 => 0.3240, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5265 => 0.5637, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.06% (3.9660 => 4.2461, std. dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2596 => 0.2779, std. dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 7.05% (0.7038 => 0.7534, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.02% (0.2607 => 0.2790, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4062 => 0.4344, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2655 => 0.2839, std. dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 6.89% (0.2628 => 0.2809, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.88% (0.2690 => 0.2875, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2726 => 0.2912, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.80% (1.9828 => 2.1177, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.80% (0.2765 => 0.2953, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.78% (0.2760 => 0.2947, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.74% (0.2966 => 0.3166, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.67% (0.2937 => 0.3133, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.67% (0.3899 => 0.4159, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 6.63% (0.2761 => 0.2944, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.54% (0.3149 => 0.3355, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.53% (0.2696 => 0.2872, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3107 => 0.3309, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.48% (0.3485 => 0.3711, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.42% (0.3580 => 0.3810, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.3489 => 0.3712, std. dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.2988 => 0.3178, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3192 => 0.3392, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.26% (0.4379 => 0.4653, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists1: 6.14% (0.3534 => 0.3751, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.08% (0.3453 => 0.3663, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.6959 => 0.7380, std. dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1789 => 0.1896, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 5.95% (0.3293 => 0.3489, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.83% (1.2193 => 1.2904, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.79% (0.4390 => 0.4644, std. dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.70% (0.3756 => 0.3970, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.66% (0.2243 => 0.2370, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.65% (0.4016 => 0.4243, std. dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.64% (16.6129 => 17.5500, std. dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.61% (0.5577 => 0.5890, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 5.51% (0.3868 => 0.4081, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.50% (0.9199 => 0.9705, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.47% (0.1865 => 0.1967, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.37% (13.8202 => 14.5621, std. dev.: 0.0108) MultiSource/Benchmarks/McCat/09-vor/vor: 5.37% (0.2925 => 0.3082, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.2945 => 0.3103, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.11% (0.2914 => 0.3063, std. dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.05% (1.2292 => 1.2913, std. dev.: 0.0039) MultiSource/Applications/spiff/spiff: 5.01% (0.7506 => 0.7882, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.00% (0.5637 => 0.5919, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.95% (7.2180 => 7.5754, std. dev.: 0.0027) MultiSource/Applications/Burg/burg: 4.81% (1.1061 => 1.1593, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.81% (1.4563 => 1.5263, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.81% (0.3246 => 0.3402, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (13.2842 => 13.9177, std. dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.77% (0.2140 => 0.2242, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.74% (1.3245 => 1.3873, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 4.65% (3.8646 => 4.0442, std. dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.62% (1.1364 => 1.1889, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.56% (1.9270 => 2.0148, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.7460 => 0.7795, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.48% (1.0594 => 1.1069, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.48% (0.8310 => 0.8682, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.45% (0.3755 => 0.3922, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.19% (4.3801 => 4.5637, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.3819 => 1.4397, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.3813 => 1.4385, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.11% (4.4433 => 4.6258, std. dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 4.11% (0.2995 => 0.3118, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 4.10% (0.3220 => 0.3352, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.04% (3.6692 => 3.8176, std. dev.: 0.0137) MultiSource/Applications/siod/siod: 3.99% (2.1791 => 2.2661, std. dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.9865 => 5.1775, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.76% (0.4791 => 0.4971, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.74% (0.8698 => 0.9023, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.70% (1.1333 => 1.1752, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.50% (0.4113 => 0.4257, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.39% (0.6283 => 0.6496, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.34% (0.6135 => 0.6340, std. dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 3.26% (0.3131 => 0.3233, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.4961 => 8.7587, std. dev.: 0.0036) MultiSource/Applications/d/make_dparser: 3.07% (3.1889 => 3.2868, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.85% (2.1007 => 2.1605, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.5754 => 6.7612, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.2742 => 3.3656, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2669, std. dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 2.61% (16.2614 => 16.6860, std. dev.: 0.0222) MultiSource/Applications/ClamAV/clamscan: 2.55% (14.5298 => 14.9004, std. dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6250 => 0.6400, std. dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.30% (4.6629 => 4.7703, std. dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.76% (0.9108 => 0.9268, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: 1.57% (0.6744 => 0.6850, std. dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.54% (1.0313 => 1.0472, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 1.34% (3.7467 => 3.7968, std. dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.17% (6.2785 => 6.3521, std. dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.14% (33.2944 => 33.6731, std. dev.: 0.0313) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5215, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2615, std. dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel-2: 8.29% (1.2998 => 1.4075, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 4.42% (7.4271 => 7.7554, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7077, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.67% (2.8606 => 2.9656, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.83% (1.9199 => 1.9743, std. dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.73% (1.7688 => 1.8171, std. dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.35% (1.9290 => 1.9551, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.24% (4.5928 => 4.6496, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.18% (0.2670 => 0.2505, std. dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.16% (22.5627 => 21.1729, std. dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.3511 => 0.3409, std. dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -17.35% (0.0997 => 0.0824, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.22% (1.2308 => 1.1050, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.29% (20.3410 => 18.4507, std. dev.: 0.0532) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.66% (1.3780 => 1.3138, std. dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.86% (1.9762 => 1.9197, std. dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.68% (8.8259 => 8.5898, std. dev.: 0.0114) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9480, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2369, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.86% (6.6320 => 6.5088, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7686, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.38% (7.3305 => 7.2295, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8662, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2487, std. dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2292, std. dev.: 0.0205) MultiSource/Applications/lua/lua: -1.02% (26.5159 => 26.2450, std. dev.: 0.0129) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/e9159428/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 04:31:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 04:31:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801093137.18B732A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2552?compare_to=2550&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2552, Order: 161101, Start Time: 2012-08-01 08:13:03, End Time: 2012-08-01 09:32:04 To: 2550, Order: 161100, Start Time: 2012-08-01 05:51:57, End Time: 2012-08-01 07:13:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (90 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (746 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.24% (7.9457 => 8.0439, std. dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -2.06% (1.4539 => 1.4239, std. dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.20% (10.3673 => 13.1872, std. dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3473 => 0.3917, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.47% (0.3497 => 0.3933, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.44% (0.3561 => 0.4004, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.33% (0.3543 => 0.3980, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.15% (0.3694 => 0.4143, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.36% (1.1194 => 1.2466, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.72% (2.2022 => 2.3943, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.52% (1.7609 => 1.8933, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 7.19% (0.1432 => 0.1535, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 6.57% (0.5925 => 0.6314, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 6.40% (0.6030 => 0.6416, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std. dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 5.38% (0.7326 => 0.7720, std. dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.05% (0.4615 => 0.4848, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.94% (7.0540 => 7.4022, std. dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.4879 => 0.5113, std. dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.4361 => 10.9261, std. dev.: 0.0327) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (0.7433 => 0.7775, std. dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (9.4845 => 9.8821, std. dev.: 0.0179) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.15% (5.0018 => 5.2093, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.15% (0.8172 => 0.8511, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1476, std. dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.5569 => 0.5796, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.70% (0.5860 => 0.6077, std. dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.67% (4.2646 => 4.4209, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/18-imp/imp: 3.62% (0.3423 => 0.3547, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.62% (0.3180 => 0.3295, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.51% (14.3668 => 14.8707, std. dev.: 0.0126) MultiSource/Applications/spiff/spiff: 3.50% (0.7835 => 0.8109, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.43% (8.1363 => 8.4150, std. dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1861 => 1.2252, std. dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 3.18% (1.5603 => 1.6099, std. dev.: 0.0111) MultiSource/Applications/oggenc/oggenc: 3.18% (5.7591 => 5.9420, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.3050 => 1.3461, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.02% (0.4103 => 0.4227, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 2.99% (3.3354 => 3.4352, std. dev.: 0.0048) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1986, std. dev.: 0.0094) MultiSource/Applications/treecc/treecc: 2.95% (2.0273 => 2.0872, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.79% (0.3650 => 0.3752, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.77% (1.5415 => 1.5842, std. dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (0.3935 => 0.4044, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 2.70% (0.4289 => 0.4405, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.64% (0.5105 => 0.5240, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.64% (0.3865 => 0.3967, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.4636 => 0.4758, std. dev.: 0.0029) MultiSource/Applications/lua/lua: 2.59% (3.8723 => 3.9726, std. dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.57% (2.0665 => 2.1197, std. dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 2.44% (0.4299 => 0.4404, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9765 => 1.0003, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.43% (0.4203 => 0.4305, std. dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.32% (2.2024 => 2.2535, std. dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.6456 => 0.6605, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6213, std. dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 2.12% (1.2842 => 1.3114, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.09% (17.1811 => 17.5401, std. dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.08% (1.4186 => 1.4481, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 2.05% (0.8921 => 0.9104, std. dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6675 => 0.6808, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.99% (0.5981 => 0.6100, std. dev.: 0.0037) MultiSource/Applications/siod/siod: 1.75% (2.2969 => 2.3370, std. dev.: 0.0088) MultiSource/Applications/minisat/minisat: 1.71% (0.7115 => 0.7237, std. dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.42% (1.1840 => 1.2008, std. dev.: 0.0057) MultiSource/Applications/lemon/lemon: 1.37% (1.0722 => 1.0869, std. dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.64% (4.2280 => 4.3817, std. dev.: 0.0182) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7509, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8339, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.56% (1.5086 => 1.5322, std. dev.: 0.0013) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2206, std. dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9196, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.48% (0.8651 => 0.1689, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.24% (5.2763 => 3.1530, std. dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6989, std. dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.71% (5.3526 => 3.7088, std. dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -15.07% (54.1659 => 46.0019, std. dev.: 0.0306) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.35% (2.9384 => 2.5461, std. dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -10.08% (22.1758 => 19.9407, std. dev.: 0.0537) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.02% (3.8922 => 3.8526, std. dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.2373 => 1.1127, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -7.38% (1.5373 => 1.4239, std. dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.74% (19.9488 => 18.6040, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.03% (1.9577 => 1.8593, std. dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4816, std. dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (8.1563 => 7.9054, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4229, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0019, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2009, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3253, std. dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4170, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.02% (3.2827 => 3.2493, std. dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/04bd1194/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 04:36:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 04:36:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801093611.D81482A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2553?compare_to=2544&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2553, Order: 161100, Start Time: 2012-08-01 06:51:46, End Time: 2012-08-01 09:36:39 To: 2544, Order: 161093, Start Time: 2012-08-01 00:28:52, End Time: 2012-08-01 03:12:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (75 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (807 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.20% (0.9914 => 1.0033, std. dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.10% (54.2556 => 54.8499, std. dev.: 0.0606) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.70% (0.3488 => 0.3966, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 13.68% (0.3442 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3496 => 0.3972, std. dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 13.58% (0.3460 => 0.3930, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.52% (0.3469 => 0.3938, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.23% (0.3643 => 0.4125, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.12% (0.3650 => 0.4129, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.70% (0.3724 => 0.4197, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.36% (0.5826 => 0.6255, std. dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.06% (0.5889 => 0.6305, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.11% (0.5026 => 0.5333, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.89% (0.4994 => 0.5288, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.82% (1.6211 => 1.7154, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.82% (3.5627 => 3.7699, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 5.81% (1.5932 => 1.6857, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.75% (0.5900 => 0.6239, std. dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 5.58% (0.7171 => 0.7571, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.38% (1.3152 => 1.3860, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.34% (0.5000 => 0.5267, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.11% (0.4361 => 0.4584, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.83% (0.3930 => 0.4120, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.77% (0.4029 => 0.4221, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 4.73% (1.0781 => 1.1291, std. dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 4.55% (4.2109 => 4.4025, std. dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 4.44% (0.2566 => 0.2680, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.43% (0.2866 => 0.2993, std. dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.40% (2.7292 => 2.8492, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (1.9694 => 2.0494, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.95% (0.4658 => 0.4842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.91% (0.2738 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.90% (1.9966 => 2.0745, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.84% (0.3903 => 0.4053, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.83% (0.3890 => 0.4039, std. dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.80% (0.9909 => 1.0286, std. dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 3.76% (5.5417 => 5.7498, std. dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (2.1013 => 2.1761, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 3.50% (1.8794 => 1.9452, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.47% (4.4195 => 4.5728, std. dev.: 0.0098) MultiSource/Applications/hbd/hbd: 3.46% (0.9697 => 1.0033, std. dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.43% (0.4139 => 0.4281, std. dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (2.1653 => 2.2387, std. dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 3.36% (0.3004 => 0.3105, std. dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 3.35% (4.6177 => 4.7722, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.20% (2.0673 => 2.1334, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.09% (0.3267 => 0.3368, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.3845 => 0.3958, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.85% (1.4269 => 1.4675, std. dev.: 0.0026) MultiSource/Applications/treecc/treecc: 2.79% (0.7875 => 0.8095, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 2.75% (0.3678 => 0.3779, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.69% (23.5202 => 24.1530, std. dev.: 0.0083) MultiSource/Applications/Burg/burg: 2.63% (0.5546 => 0.5692, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (0.4251 => 0.4351, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.36% (2.0346 => 2.0623, std. dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 14.23% (2.5769 => 2.9436, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6560, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1705, std. dev.: 0.0281) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8868, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6366, std. dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1896, std. dev.: 0.0156) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4979, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5909, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2209, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.31% (2.4764 => 2.4193, std. dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: -1.37% (11.9555 => 11.7920, std. dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5230, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary2: -9.03% (0.2402 => 0.2185, std. dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -8.80% (17.2379 => 15.7210, std. dev.: 0.1313) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7975, std. dev.: 0.1363) SingleSource/Benchmarks/Shootout-C++/moments: -3.90% (0.4438 => 0.4265, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -3.66% (14.0481 => 13.5337, std. dev.: 0.0120) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7996, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/dfbe3b43/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 06:08:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 06:08:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801110824.AD3A82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2554?compare_to=2551&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2554, Order: 161107, Start Time: 2012-08-01 09:55:11, End Time: 2012-08-01 11:08:54 To: 2551, Order: 161101, Start Time: 2012-08-01 08:12:59, End Time: 2012-08-01 09:26:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (148 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (707 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.58% (2.0176 => 2.3117, std. dev.: 0.0171) SingleSource/UnitTests/ObjC/trivial-interface: 9.89% (0.3578 => 0.3932, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5818 => 0.6391, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3601 => 0.3951, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.71% (0.5748 => 0.6306, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3646 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.61% (0.3663 => 0.4015, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.56% (0.3650 => 0.3999, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3789 => 0.4150, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.52% (0.3623 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.30% (0.3914 => 0.4278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.19% (0.4003 => 0.4371, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.09% (0.3940 => 0.4298, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.84% (0.7061 => 0.7685, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.18% (0.3130 => 0.3386, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.46% (1.3693 => 1.4715, std. dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1413 => 0.1515, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.16% (0.7710 => 0.8262, std. dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.93% (3.9660 => 4.2410, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.90% (0.2596 => 0.2775, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4328 => 0.4626, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.83% (0.2781 => 0.2971, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.78% (0.5265 => 0.5622, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.78% (0.7038 => 0.7515, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.69% (0.2782 => 0.2968, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.43% (0.4062 => 0.4323, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.30% (0.2966 => 0.3153, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2690 => 0.2858, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.22% (0.3022 => 0.3210, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.21% (0.2607 => 0.2769, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.2655 => 0.2818, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.11% (1.9828 => 2.1040, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.11% (0.2765 => 0.2934, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.10% (0.3899 => 0.4137, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.2937 => 0.3116, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.09% (0.2726 => 0.2892, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2628 => 0.2788, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.05% (0.2760 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2761 => 0.2927, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.94% (0.4379 => 0.4639, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.87% (0.3580 => 0.3790, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.86% (0.2696 => 0.2854, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.86% (0.3107 => 0.3289, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.85% (0.3485 => 0.3689, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.79% (0.3489 => 0.3691, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.59% (1.2193 => 1.2875, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.57% (0.3534 => 0.3731, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.37% (0.9199 => 0.9693, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.31% (0.4390 => 0.4623, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.25% (13.8202 => 14.5457, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 5.13% (16.6129 => 17.4652, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.2243 => 0.2358, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.3756 => 0.3945, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2127 => 0.2234, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.2925 => 0.3071, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.98% (0.2914 => 0.3059, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3868 => 0.4057, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.84% (0.5637 => 0.5910, std. dev.: 0.0009) MultiSource/Applications/spiff/spiff: 4.77% (0.7506 => 0.7864, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (1.4563 => 1.5254, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.74% (7.2180 => 7.5598, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.68% (1.1364 => 1.1896, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 4.62% (0.2945 => 0.3081, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.60% (13.2842 => 13.8948, std. dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 4.55% (0.8310 => 0.8688, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.54% (1.1061 => 1.1563, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (3.8646 => 4.0368, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.41% (1.2292 => 1.2834, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.39% (1.3245 => 1.3827, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.38% (1.3819 => 1.4424, std. dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 4.36% (1.0594 => 1.1056, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.26% (1.3813 => 1.4401, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 4.26% (1.9270 => 2.0090, std. dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 4.14% (0.2995 => 0.3119, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.3801 => 4.5598, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.07% (0.3755 => 0.3908, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (4.4433 => 4.6227, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (3.6692 => 3.8150, std. dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.4791 => 0.4972, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.64% (2.1791 => 2.2584, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.61% (4.9865 => 5.1663, std. dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.58% (1.1333 => 1.1739, std. dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: 3.38% (0.4113 => 0.4252, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6283 => 0.6495, std. dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.28% (0.8698 => 0.8983, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.07% (8.4961 => 8.7572, std. dev.: 0.0031) MultiSource/Applications/d/make_dparser: 3.04% (3.1889 => 3.2858, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7592, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.2742 => 3.3657, std. dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.8535 => 15.2571, std. dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.69% (2.1007 => 2.1572, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.59% (16.2614 => 16.6827, std. dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9050, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.49% (1.5188 => 1.5566, std. dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.48% (4.6629 => 4.7787, std. dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.6250 => 0.6369, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.9108 => 0.9275, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.44% (1.0313 => 1.0461, std. dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.14% (6.2785 => 6.3498, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7869, std. dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5134, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/fbench: 25.88% (1.8175 => 2.2879, std. dev.: 0.0329) SingleSource/Benchmarks/Misc/mandel-2: 7.21% (1.2998 => 1.3935, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.21% (0.9996 => 1.0517, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7513, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7044, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.96% (1.9199 => 1.9767, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8146, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5340, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: 1.46% (1.9290 => 1.9571, std. dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.36% (4.5928 => 4.6552, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1948, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.23% (10.7476 => 10.8799, std. dev.: 0.0184) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.09% (3.6469 => 3.6865, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1390, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.79% (0.4657 => 0.4015, std. dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (22.5627 => 21.1605, std. dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.03% (0.2670 => 0.2509, std. dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.93% (0.3511 => 0.3408, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.46% (0.0997 => 0.0813, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.86% (1.2308 => 1.1094, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.57% (20.3410 => 18.5983, std. dev.: 0.0304) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.05% (1.3780 => 1.3084, std. dev.: 0.0077) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.96% (1.9762 => 1.9177, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5900, std. dev.: 0.0120) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9484, std. dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -2.13% (6.3560 => 6.2207, std. dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.84% (6.6320 => 6.5101, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7686, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8651, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.28% (7.3305 => 7.2366, std. dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2207, std. dev.: 0.0246) MultiSource/Applications/lua/lua: -1.03% (26.5159 => 26.2436, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.01% (3.8887 => 3.8494, std. dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/72179290/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 06:19:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 06:19:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801111900.96DC62A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2555?compare_to=2552&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2555, Order: 161107, Start Time: 2012-08-01 10:00:40, End Time: 2012-08-01 11:19:30 To: 2552, Order: 161101, Start Time: 2012-08-01 08:13:03, End Time: 2012-08-01 09:32:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (97 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (741 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.57% (2.3452 => 2.3084, std. dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 28.33% (10.3673 => 13.3044, std. dev.: 0.0105) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3473 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.25% (0.3516 => 0.3982, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.24% (0.3497 => 0.3960, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.18% (0.3543 => 0.4010, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.12% (0.3543 => 0.4008, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3561 => 0.4027, std. dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 12.94% (0.3694 => 0.4172, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3828 => 0.4302, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.12% (0.3886 => 0.4357, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2455, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (2.2022 => 2.3907, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.25% (1.7609 => 1.8886, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5925 => 0.6347, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 7.03% (0.6030 => 0.6454, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.61% (0.3177 => 0.3387, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.94% (0.7326 => 0.7761, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.09% (0.4615 => 0.4850, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.91% (7.0540 => 7.4004, std. dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 4.76% (10.4361 => 10.9327, std. dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.69% (0.4879 => 0.5108, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 4.69% (0.3282 => 0.3436, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (0.7433 => 0.7775, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 4.54% (0.2554 => 0.2670, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.23% (4.9449 => 5.1541, std. dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (9.4845 => 9.8759, std. dev.: 0.0156) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.12% (5.0018 => 5.2081, std. dev.: 0.0110) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.91% (0.5569 => 0.5787, std. dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.3121 => 0.3240, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.67% (0.2891 => 0.2997, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.62% (0.7835 => 0.8119, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.61% (0.3162 => 0.3276, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.56% (4.2646 => 4.4166, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.56% (0.4103 => 0.4249, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3423 => 0.3543, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 3.49% (0.3180 => 0.3291, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.38% (8.1363 => 8.4110, std. dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1861 => 1.2243, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.19% (14.3668 => 14.8253, std. dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.18% (0.3935 => 0.4060, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.16% (1.5603 => 1.6096, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.14% (0.3826 => 0.3946, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.12% (0.3650 => 0.3764, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.11% (5.7591 => 5.9380, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 3.10% (0.3422 => 0.3528, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.05% (0.3865 => 0.3983, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.02% (1.5415 => 1.5880, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.3050 => 1.3439, std. dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.98% (0.4636 => 0.4774, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.92% (2.0665 => 2.1269, std. dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/lists1: 2.90% (0.3684 => 0.3791, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (0.4064 => 0.4182, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.89% (0.3603 => 0.3707, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.89% (1.1642 => 1.1978, std. dev.: 0.0062) MultiSource/Applications/d/make_dparser: 2.85% (3.3354 => 3.4306, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.75% (2.0273 => 2.0830, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4203 => 0.4317, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 2.65% (0.4299 => 0.4413, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6456 => 0.6618, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.48% (0.8067 => 0.8267, std. dev.: 0.0065) MultiSource/Applications/lua/lua: 2.41% (3.8723 => 3.9658, std. dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5105 => 0.5222, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.27% (1.2842 => 1.3134, std. dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (0.4620 => 0.4725, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.26% (0.9765 => 0.9986, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.16% (0.5981 => 0.6110, std. dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.11% (0.6450 => 0.6586, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6188, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.05% (2.2024 => 2.2475, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.98% (1.4186 => 1.4467, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (0.6675 => 0.6800, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.86% (17.1811 => 17.5009, std. dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/football/football: 1.83% (0.8921 => 0.9084, std. dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.53% (0.7115 => 0.7224, std. dev.: 0.0031) MultiSource/Applications/siod/siod: 1.47% (2.2969 => 2.3306, std. dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.12% (1.0722 => 1.0842, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.54% (4.2280 => 4.4200, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (3.6395 => 3.7578, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 1.77% (3.1578 => 3.2136, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.63% (11.6436 => 11.8337, std. dev.: 0.0010) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2036, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.37% (2.2771 => 2.3084, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2320, std. dev.: 0.0412) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.06% (2.3135 => 2.3381, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.27% (5.2763 => 3.1515, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6907, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7093, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -15.00% (54.1659 => 46.0418, std. dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.61% (2.9384 => 2.5385, std. dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: -10.14% (22.1758 => 19.9263, std. dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std. dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.59% (1.2373 => 1.1063, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -8.41% (1.5373 => 1.4080, std. dev.: 0.0212) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.92% (19.9488 => 18.5687, std. dev.: 0.0892) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.59% (1.9577 => 1.8678, std. dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4799, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (8.6802 => 8.4064, std. dev.: 0.0217) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (8.1563 => 7.9044, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0031, std. dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2015, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std. dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4168, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.39% (1.8329 => 1.8074, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/ff050bcb/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 07:48:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 07:48:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801124812.1CEEB3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2556?compare_to=2553&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2556, Order: 161107, Start Time: 2012-08-01 10:05:17, End Time: 2012-08-01 12:48:41 To: 2553, Order: 161100, Start Time: 2012-08-01 06:51:46, End Time: 2012-08-01 09:36:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (82 on baseline) Performance Improvements: 1 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (801 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.15% (0.2147 => 0.2279, std. dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.07% (1.0033 => 0.9926, std. dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.96% (0.3446 => 0.3927, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.93% (0.3496 => 0.3983, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.88% (0.3465 => 0.3946, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.88% (0.3488 => 0.3972, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.83% (0.3442 => 0.3918, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.78% (0.3469 => 0.3947, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.37% (0.3650 => 0.4138, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.23% (0.5826 => 0.6247, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.05% (0.5889 => 0.6304, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.04% (3.5627 => 3.7780, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.03% (0.4994 => 0.5295, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (0.5026 => 0.5327, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 5.85% (1.5932 => 1.6864, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.78% (1.6211 => 1.7148, std. dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.50% (1.3152 => 1.3876, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 5.49% (0.7171 => 0.7565, std. dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.19% (0.5900 => 0.6206, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.17% (0.3930 => 0.4133, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.5000 => 0.5250, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 4.89% (0.4029 => 0.4226, std. dev.: 0.0022) MultiSource/Applications/d/make_dparser: 4.80% (1.0781 => 1.1299, std. dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (2.7292 => 2.8527, std. dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 4.51% (4.2109 => 4.4007, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.13% (0.2736 => 0.2849, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (1.9694 => 2.0466, std. dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.91% (1.9966 => 2.0746, std. dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 3.80% (5.5417 => 5.7522, std. dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (0.3890 => 0.4035, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (2.1013 => 2.1793, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.70% (0.3004 => 0.3115, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.62% (0.2875 => 0.2979, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (0.4658 => 0.4825, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.54% (0.3195 => 0.3308, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (4.4195 => 4.5742, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.46% (0.9909 => 1.0252, std. dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 3.39% (2.1653 => 2.2386, std. dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 3.37% (4.6177 => 4.7732, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.33% (0.3903 => 0.4033, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (2.0673 => 2.1351, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.24% (0.3267 => 0.3373, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.10% (0.3258 => 0.3359, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.3271 => 0.3372, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 3.02% (0.3348 => 0.3449, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (1.8794 => 1.9360, std. dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.4139 => 0.4262, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.95% (0.7875 => 0.8107, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.3678 => 0.3781, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 2.76% (0.3726 => 0.3829, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.73% (1.4269 => 1.4659, std. dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 2.71% (23.5202 => 24.1584, std. dev.: 0.0114) MultiSource/Applications/Burg/burg: 2.70% (0.5546 => 0.5696, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.53% (0.4146 => 0.4251, std. dev.: 0.0015) MultiSource/Applications/siod/siod: 2.52% (0.6634 => 0.6801, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.40% (0.4251 => 0.4353, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.36% (0.9697 => 0.9926, std. dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.08% (0.6435 => 0.6569, std. dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.37% (2.0346 => 2.0625, std. dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 14.90% (2.5769 => 2.9608, std. dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6736, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6596, std. dev.: 0.0243) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1890, std. dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4933, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5913, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std. dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.29% (11.9555 => 11.8012, std. dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5222, std. dev.: 0.0198) SingleSource/Benchmarks/Dhrystone/fldry: -7.89% (17.2379 => 15.8781, std. dev.: 0.1099) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7941, std. dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: -4.01% (0.4438 => 0.4260, std. dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7943, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -3.65% (14.0481 => 13.5356, std. dev.: 0.0190) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5756, std. dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/bb16eb2a/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 08:55:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 08:55:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801135554.6EE8A3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2557?compare_to=2554&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2557, Order: 161110, Start Time: 2012-08-01 12:42:43, End Time: 2012-08-01 13:56:24 To: 2554, Order: 161107, Start Time: 2012-08-01 09:55:11, End Time: 2012-08-01 11:08:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (31 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (713 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.05% (1.3935 => 1.4081, std. dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.32% (2.0176 => 2.3066, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.20% (0.3578 => 0.3943, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 10.11% (0.3601 => 0.3965, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.02% (0.3623 => 0.3986, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.01% (0.3646 => 0.4011, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.99% (0.5818 => 0.6399, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.95% (0.3650 => 0.4013, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3663 => 0.4027, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.82% (0.3789 => 0.4161, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.78% (0.5748 => 0.6310, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.66% (0.3914 => 0.4292, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.52% (0.4003 => 0.4384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.44% (0.3940 => 0.4312, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.88% (0.7061 => 0.7688, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.33% (1.3693 => 1.4697, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.7710 => 0.8260, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.08% (0.2782 => 0.2979, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.05% (0.2781 => 0.2977, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.05% (0.4328 => 0.4633, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.97% (3.9660 => 4.2424, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2607 => 0.2779, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2721 => 0.2898, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 6.41% (0.7038 => 0.7489, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.38% (0.4062 => 0.4321, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.30% (0.2761 => 0.2935, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.18% (0.3899 => 0.4140, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.17% (0.2966 => 0.3149, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.16% (0.2628 => 0.2790, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.14% (0.3485 => 0.3699, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.12% (0.2760 => 0.2929, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.05% (1.9828 => 2.1028, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.02% (0.3022 => 0.3204, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.02% (0.2726 => 0.2890, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.4379 => 0.4642, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3149 => 0.3338, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.99% (0.6959 => 0.7376, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.98% (0.3580 => 0.3794, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.90% (0.2696 => 0.2855, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.86% (0.3107 => 0.3289, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3192 => 0.3378, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3489 => 0.3690, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.76% (0.2988 => 0.3160, std. dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.63% (1.2193 => 1.2879, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 5.50% (0.3293 => 0.3474, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3453 => 0.3641, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9199 => 0.9686, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.26% (0.3534 => 0.3720, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.20% (0.5577 => 0.5867, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.17% (0.3868 => 0.4068, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.13% (13.8202 => 14.5293, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.10% (0.4390 => 0.4614, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.89% (7.2180 => 7.5708, std. dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4244, std. dev.: 0.0181) MultiSource/Benchmarks/McCat/09-vor/vor: 4.85% (0.2925 => 0.3067, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.81% (0.2140 => 0.2243, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.72% (0.7506 => 0.7860, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.2945 => 0.3083, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.66% (1.4563 => 1.5241, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.57% (1.3813 => 1.4444, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.55% (1.1364 => 1.1881, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (13.2842 => 13.8882, std. dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.48% (1.3819 => 1.4438, std. dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.42% (1.1061 => 1.1550, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.40% (1.3245 => 1.3828, std. dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (3.8646 => 4.0333, std. dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.35% (1.0594 => 1.1055, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.30% (1.2292 => 1.2820, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.29% (0.7460 => 0.7780, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.22% (1.9270 => 2.0084, std. dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.14% (4.3801 => 4.5615, std. dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.14% (3.6692 => 3.8210, std. dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.02% (4.4433 => 4.6217, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 3.94% (0.2995 => 0.3113, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.81% (0.3755 => 0.3898, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.63% (0.4791 => 0.4965, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.56% (1.1333 => 1.1737, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 3.46% (2.1791 => 2.2544, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.45% (4.9865 => 5.1585, std. dev.: 0.0137) MultiSource/Benchmarks/sim/sim: 3.39% (0.3131 => 0.3237, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.37% (0.8698 => 0.8991, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.24% (0.6135 => 0.6334, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4113 => 0.4246, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.13% (3.1889 => 3.2887, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (8.4961 => 8.7544, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.5754 => 6.7660, std. dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: 2.81% (14.8535 => 15.2702, std. dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.71% (3.2742 => 3.3629, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.70% (2.1007 => 2.1574, std. dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 2.64% (14.5298 => 14.9131, std. dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2614 => 16.6836, std. dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.5188 => 1.5564, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.19% (4.6629 => 4.7650, std. dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.83% (0.9108 => 0.9275, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6250 => 0.6354, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.37% (1.0313 => 1.0454, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.17% (6.2785 => 6.3522, std. dev.: 0.0053) MultiSource/Applications/lua/lua: 1.11% (3.7467 => 3.7883, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 25.27% (1.8175 => 2.2767, std. dev.: 0.0464) SingleSource/Benchmarks/Misc/mandel-2: 8.33% (1.2998 => 1.4081, std. dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.13% (0.9996 => 1.0509, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7508, std. dev.: 0.0105) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7064, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 2.90% (1.9199 => 1.9756, std. dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4519, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5945, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.44% (1.9290 => 1.9567, std. dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.33% (4.5928 => 4.6538, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1955, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.18% (10.7476 => 10.8744, std. dev.: 0.0357) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1392, std. dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.10% (0.4657 => 0.4047, std. dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.5627 => 21.1525, std. dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.65% (0.0997 => 0.0831, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.93% (20.3410 => 18.5251, std. dev.: 0.0776) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3085, std. dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9460, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (8.8259 => 8.5950, std. dev.: 0.0263) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2351, std. dev.: 0.0079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.79% (6.6320 => 6.5134, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7689, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0043, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.20% (7.3305 => 7.2428, std. dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std. dev.: 0.0047) MultiSource/Applications/minisat/minisat: -1.03% (9.3358 => 9.2392, std. dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/fb5dc365/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 09:00:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 09:00:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801140056.8D5CF3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2558?compare_to=2555&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2558, Order: 161110, Start Time: 2012-08-01 12:42:50, End Time: 2012-08-01 14:01:26 To: 2555, Order: 161107, Start Time: 2012-08-01 10:00:40, End Time: 2012-08-01 11:19:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (92 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (743 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.07% (13.3044 => 13.9788, std. dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.84% (10.3673 => 13.9788, std. dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 14.11% (0.3473 => 0.3963, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3497 => 0.3979, std. dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 13.69% (0.3543 => 0.4028, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.68% (0.3516 => 0.3997, std. dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.63% (0.3543 => 0.4026, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 13.59% (0.3561 => 0.4045, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.26% (0.3694 => 0.4184, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3828 => 0.4325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.63% (0.3927 => 0.4423, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.32% (1.1194 => 1.2461, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/richards_benchmark: 9.62% (0.1622 => 0.1778, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.40% (2.2022 => 2.3872, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.34% (1.7609 => 1.8901, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.12% (0.5925 => 0.6347, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.84% (0.7326 => 0.7754, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (7.0540 => 7.3992, std. dev.: 0.0112) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.86% (0.4879 => 0.5116, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (10.4361 => 10.9207, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 4.54% (0.3282 => 0.3431, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.37% (0.7433 => 0.7758, std. dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.27% (0.8172 => 0.8521, std. dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 4.27% (0.2554 => 0.2663, std. dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8886, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1474, std. dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.97% (5.0018 => 5.2005, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.88% (0.5569 => 0.5785, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.78% (4.2646 => 4.4258, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3121 => 0.3237, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.57% (8.1363 => 8.4270, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5860 => 0.6068, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.53% (0.2891 => 0.2993, std. dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3423 => 0.3542, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.46% (0.7835 => 0.8106, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3180 => 0.3288, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.30% (0.4636 => 0.4789, std. dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1861 => 1.2234, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7949, std. dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.96% (0.3650 => 0.3758, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.93% (1.3050 => 1.3433, std. dev.: 0.0011) MultiSource/Applications/hbd/hbd: 2.92% (1.5603 => 1.6059, std. dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.88% (0.4103 => 0.4221, std. dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 2.87% (5.7591 => 5.9243, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 2.80% (2.0273 => 2.0841, std. dev.: 0.0029) MultiSource/Applications/d/make_dparser: 2.80% (3.3354 => 3.4288, std. dev.: 0.0096) MultiSource/Applications/Burg/burg: 2.79% (1.1642 => 1.1967, std. dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash: 2.77% (0.4289 => 0.4408, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.74% (0.3826 => 0.3931, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (2.0665 => 2.1227, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.69% (1.5415 => 1.5829, std. dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.59% (0.4203 => 0.4312, std. dev.: 0.0003) MultiSource/Applications/lua/lua: 2.55% (3.8723 => 3.9710, std. dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.8067 => 0.8269, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (0.4064 => 0.4164, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.25% (0.9765 => 0.9985, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.19% (0.5105 => 0.5217, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.2024 => 2.2479, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.2842 => 1.3102, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.96% (0.5981 => 0.6098, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.88% (1.4186 => 1.4452, std. dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.84% (17.1811 => 17.4980, std. dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.81% (0.6675 => 0.6796, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.78% (2.2969 => 2.3377, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 1.69% (0.8921 => 0.9072, std. dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.47% (1.1840 => 1.2014, std. dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (4.2280 => 4.4151, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.08% (3.6395 => 3.7515, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5086 => 1.5348, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 1.64% (3.1578 => 3.2096, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8328, std. dev.: 0.0018) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.30% (1.0313 => 1.0447, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2277, std. dev.: 0.0403) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1264, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -80.50% (0.8651 => 0.1687, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.30% (5.2763 => 3.1499, std. dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.49% (5.3855 => 3.6898, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.92% (5.3526 => 3.6975, std. dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0620, std. dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.44% (2.9384 => 2.5436, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -10.15% (22.1758 => 19.9259, std. dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (3.8922 => 3.8500, std. dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.23% (0.0998 => 0.0836, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.01% (1.2373 => 1.1134, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -9.49% (1.5373 => 1.3914, std. dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.35% (19.9488 => 18.4832, std. dev.: 0.0692) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -4.84% (1.9577 => 1.8629, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4780, std. dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (8.1563 => 7.8975, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (8.6802 => 8.4165, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0005, std. dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.39% (0.4808 => 0.4693, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2011, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -1.78% (12.5348 => 12.3122, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std. dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8089, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7063, std. dev.: 0.0002) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2494, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/489d3945/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 10:59:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 10:59:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801155949.5E4C03524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2559?compare_to=2556&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2559, Order: 161110, Start Time: 2012-08-01 13:16:52, End Time: 2012-08-01 16:00:19 To: 2556, Order: 161107, Start Time: 2012-08-01 10:05:17, End Time: 2012-08-01 12:48:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.54% (0.3442 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 11.47% (0.3792 => 0.4227, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.26% (0.5826 => 0.6249, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.01% (0.5889 => 0.6302, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.15% (0.4994 => 0.5301, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.03% (0.5026 => 0.5329, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.92% (3.5627 => 3.7735, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.82% (1.6211 => 1.7155, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.70% (1.5932 => 1.6840, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.55% (0.7171 => 0.7569, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.51% (0.4029 => 0.4251, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.46% (0.4361 => 0.4599, std. dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.25% (0.5900 => 0.6210, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (1.3152 => 1.3830, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.14% (0.5000 => 0.5257, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.04% (0.3930 => 0.4128, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 4.81% (1.0781 => 1.1300, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.78% (4.2109 => 4.4123, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.75% (0.2866 => 0.3002, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.69% (2.7292 => 2.8571, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.62% (0.2792 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.49% (0.2875 => 0.3004, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.21% (0.2566 => 0.2674, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 4.19% (0.3004 => 0.3130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 4.05% (0.2813 => 0.2927, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 4.04% (0.2725 => 0.2835, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (1.9694 => 2.0486, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 4.02% (0.2714 => 0.2823, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 4.00% (0.2803 => 0.2915, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.99% (0.9909 => 1.0304, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3267 => 0.3396, std. dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 3.94% (2.1013 => 2.1840, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.2823 => 0.2933, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 3.89% (0.2750 => 0.2857, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.89% (1.9966 => 2.0742, std. dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.87% (5.5417 => 5.7560, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (0.4658 => 0.4838, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.85% (0.2729 => 0.2834, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.80% (2.0673 => 2.1459, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 3.74% (0.3317 => 0.3441, std. dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.73% (0.3890 => 0.4035, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 3.71% (0.3096 => 0.3211, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.68% (0.3726 => 0.3863, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.65% (4.4195 => 4.5808, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.64% (0.2911 => 0.3017, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 3.62% (0.3477 => 0.3603, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3258 => 0.3376, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.59% (0.3060 => 0.3170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3678 => 0.3810, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.50% (0.3282 => 0.3397, std. dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 3.46% (2.1653 => 2.2402, std. dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 3.44% (4.6177 => 4.7766, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.42% (0.3362 => 0.3477, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.38% (0.3903 => 0.4035, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.35% (0.3348 => 0.3460, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.29% (0.9697 => 1.0016, std. dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.29% (0.4139 => 0.4275, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.28% (0.3625 => 0.3744, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.24% (0.3981 => 0.4110, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 3.19% (1.8794 => 1.9393, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 3.15% (0.4251 => 0.4385, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.06% (0.3690 => 0.3803, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 3.03% (0.7875 => 0.8114, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.95% (0.6634 => 0.6830, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.93% (1.4269 => 1.4687, std. dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 2.90% (23.5202 => 24.2025, std. dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.81% (0.3845 => 0.3953, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.55% (0.6435 => 0.6599, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.47% (0.5546 => 0.5683, std. dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.5012 => 0.5130, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.51% (2.0346 => 2.0654, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9640, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8956, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1751, std. dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (105.3826 => 107.6362, std. dev.: 0.0374) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2087, std. dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4975, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2239, std. dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.87% (2.4764 => 2.4053, std. dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: -1.16% (11.9555 => 11.8171, std. dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.99% (25.4195 => 16.5264, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary2: -9.41% (0.2402 => 0.2176, std. dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: -8.47% (17.2379 => 15.7784, std. dev.: 0.2549) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7871, std. dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/moments: -4.06% (0.4438 => 0.4258, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7942, std. dev.: 0.0148) SingleSource/Benchmarks/Dhrystone/dry: -3.56% (14.0481 => 13.5482, std. dev.: 0.0099) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5822, std. dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/46c9a675/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 11:42:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 11:42:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801164202.5D7713524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2560?compare_to=2557&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2560, Order: 161112, Start Time: 2012-08-01 15:28:50, End Time: 2012-08-01 16:42:31 To: 2557, Order: 161110, Start Time: 2012-08-01 12:42:43, End Time: 2012-08-01 13:56:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 1 (33 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (710 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.62% (3.8288 => 3.7667, std. dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.23% (2.0176 => 2.3047, std. dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3578 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.16% (0.3601 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.09% (0.3646 => 0.4014, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.95% (0.3789 => 0.4166, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 9.94% (0.3623 => 0.3983, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.92% (0.5818 => 0.6395, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.86% (0.3650 => 0.4010, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3663 => 0.4024, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.73% (0.5748 => 0.6307, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.56% (0.3914 => 0.4288, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.39% (0.4003 => 0.4379, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 9.37% (0.3940 => 0.4309, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.92% (0.3130 => 0.3378, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.27% (1.3693 => 1.4688, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.25% (0.7710 => 0.8269, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.00% (0.4328 => 0.4631, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.94% (0.2781 => 0.2974, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.87% (3.9660 => 4.2383, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.87% (0.2782 => 0.2973, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.59% (0.2596 => 0.2767, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 6.33% (0.2607 => 0.2772, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.33% (0.4062 => 0.4319, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.32% (0.7038 => 0.7483, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.32% (0.2628 => 0.2794, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.29% (0.2655 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2760 => 0.2932, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.20% (0.2966 => 0.3150, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.18% (0.2765 => 0.2936, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.13% (0.2726 => 0.2893, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.10% (1.9828 => 2.1038, std. dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.06% (0.3580 => 0.3797, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.2937 => 0.3115, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3485 => 0.3693, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.92% (0.3022 => 0.3201, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3107 => 0.3291, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.90% (0.2696 => 0.2855, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3192 => 0.3379, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.81% (0.3149 => 0.3332, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2988 => 0.3159, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.67% (0.3489 => 0.3687, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.54% (1.2193 => 1.2869, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 5.50% (0.3453 => 0.3643, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 5.50% (0.3293 => 0.3474, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.38% (0.3534 => 0.3724, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.26% (0.9199 => 0.9683, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.24% (0.4390 => 0.4620, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.17% (0.2127 => 0.2237, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.16% (0.5577 => 0.5865, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.14% (13.8202 => 14.5307, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.14% (0.2140 => 0.2250, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.13% (0.4016 => 0.4222, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.2243 => 0.2357, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.97% (16.6129 => 17.4393, std. dev.: 0.0060) MultiSource/Benchmarks/McCat/09-vor/vor: 4.92% (0.2925 => 0.3069, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.90% (0.7506 => 0.7874, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.87% (7.2180 => 7.5694, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (1.4563 => 1.5256, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5637 => 0.5894, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (13.2842 => 13.8874, std. dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.50% (1.3813 => 1.4435, std. dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.42% (1.1061 => 1.1550, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.36% (0.8310 => 0.8672, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3819 => 1.4420, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.33% (1.3245 => 1.3819, std. dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 4.33% (3.8646 => 4.0320, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0087, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2292 => 1.2810, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.20% (3.6692 => 3.8232, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.3801 => 4.5611, std. dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (4.4433 => 4.6200, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.91% (0.3755 => 0.3902, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.77% (0.2995 => 0.3108, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 3.51% (2.1791 => 2.2556, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.1333 => 1.1729, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.44% (0.4791 => 0.4956, std. dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 3.42% (0.3131 => 0.3238, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1523, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8698 => 0.8975, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.14% (0.4113 => 0.4242, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.13% (0.6135 => 0.6327, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.12% (0.6283 => 0.6479, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 3.08% (3.1889 => 3.2872, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (8.4961 => 8.7507, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.89% (6.5754 => 6.7656, std. dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 2.78% (14.8535 => 15.2661, std. dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.71% (3.2742 => 3.3628, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1556, std. dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.54% (16.2614 => 16.6749, std. dev.: 0.0462) MultiSource/Applications/ClamAV/clamscan: 2.54% (14.5298 => 14.8989, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5188 => 1.5549, std. dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 2.20% (4.6629 => 4.7654, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 1.73% (0.6250 => 0.6358, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.9108 => 0.9264, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.2785 => 6.3507, std. dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5190, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2721, std. dev.: 0.0410) SingleSource/Benchmarks/Misc/mandel-2: 7.82% (1.2998 => 1.4015, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7548, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7029, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9658, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.94% (1.9199 => 1.9764, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.69% (1.5089 => 1.5344, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std. dev.: 0.0061) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5951, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: 1.43% (1.9290 => 1.9566, std. dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.33% (4.5928 => 4.6541, std. dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1957, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.21% (1.0310 => 1.0435, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std. dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1400, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.46% (0.4657 => 0.4030, std. dev.: 0.0170) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1232, std. dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.15% (0.0997 => 0.0836, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.75% (1.2308 => 1.0985, std. dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.66% (20.3410 => 18.5794, std. dev.: 0.0488) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.09% (1.3780 => 1.3217, std. dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9191, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9447, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.52% (8.8259 => 8.6035, std. dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.33% (0.8342 => 0.8148, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.20% (0.6589 => 0.6444, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.11% (6.3560 => 6.2218, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5056, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7687, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.3305 => 7.2284, std. dev.: 0.0154) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8651, std. dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2469, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2217, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8486, std. dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/e6c39f32/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 11:47:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 11:47:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801164706.B6CB63524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2561?compare_to=2558&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2561, Order: 161112, Start Time: 2012-08-01 15:28:59, End Time: 2012-08-01 16:47:37 To: 2558, Order: 161110, Start Time: 2012-08-01 12:42:50, End Time: 2012-08-01 14:01:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (92 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (744 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 3.95% (1.3914 => 1.4464, std. dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 2.58% (0.5354 => 0.5492, std. dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.39% (81.0705 => 79.9470, std. dev.: 0.3300) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.76% (10.3673 => 13.9707, std. dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 13.99% (0.3473 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3543 => 0.4031, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.75% (0.3497 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.75% (0.3543 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.71% (0.3516 => 0.3998, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.65% (0.3561 => 0.4047, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 13.21% (0.3694 => 0.4182, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3828 => 0.4322, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.66% (0.3886 => 0.4378, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.53% (0.3927 => 0.4419, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.10% (1.1194 => 1.2437, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.68% (0.1622 => 0.1779, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.38% (0.3817 => 0.4175, std. dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.43% (2.2022 => 2.3878, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.42% (1.7609 => 1.8915, std. dev.: 0.0088) SingleSource/UnitTests/ObjC++/Hello: 7.14% (0.5925 => 0.6348, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 7.00% (0.6030 => 0.6452, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 5.84% (0.7326 => 0.7754, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4615 => 0.4869, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.86% (7.0540 => 7.3966, std. dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: 4.64% (10.4361 => 10.9201, std. dev.: 0.0107) SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.3282 => 0.3430, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.42% (4.9449 => 5.1637, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.39% (0.2554 => 0.2666, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.36% (0.8172 => 0.8528, std. dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.7433 => 0.7752, std. dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.29% (9.4845 => 9.8912, std. dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.18% (0.5569 => 0.5802, std. dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.04% (5.0018 => 5.2041, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.87% (0.5860 => 0.6087, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (4.2646 => 4.4297, std. dev.: 0.0071) MultiSource/Applications/spiff/spiff: 3.77% (0.7835 => 0.8130, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.74% (0.2756 => 0.2859, std. dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.54% (8.1363 => 8.4244, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (0.4636 => 0.4794, std. dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 3.38% (0.3109 => 0.3214, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.17% (0.4289 => 0.4425, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1861 => 1.2234, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.04% (0.3684 => 0.3796, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7989, std. dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.00% (1.3050 => 1.3441, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 2.98% (1.5603 => 1.6068, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.95% (1.5415 => 1.5869, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 2.92% (5.7591 => 5.9270, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.90% (0.3650 => 0.3756, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3826 => 0.3937, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 2.89% (2.0273 => 2.0859, std. dev.: 0.0103) MultiSource/Applications/Burg/burg: 2.84% (1.1642 => 1.1973, std. dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.82% (3.3354 => 3.4293, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.78% (2.0665 => 2.1240, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.72% (0.3865 => 0.3970, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.62% (0.4203 => 0.4313, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.59% (0.8067 => 0.8276, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 2.54% (0.4299 => 0.4408, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.51% (3.8723 => 3.9695, std. dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6212, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9765 => 0.9980, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5105 => 0.5213, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.07% (1.4186 => 1.4479, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (2.2024 => 2.2477, std. dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 2.04% (1.2842 => 1.3104, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.02% (0.6450 => 0.6580, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.01% (0.5981 => 0.6101, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8921 => 0.9093, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6675 => 0.6802, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.80% (17.1811 => 17.4910, std. dev.: 0.0055) MultiSource/Applications/siod/siod: 1.59% (2.2969 => 2.3335, std. dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 1.36% (1.1840 => 1.2001, std. dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.05% (1.0722 => 1.0835, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.07% (4.2280 => 4.4001, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (3.1578 => 3.2162, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (1.5086 => 1.5332, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8327, std. dev.: 0.0014) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2040, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2318, std. dev.: 0.0310) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.36% (5.2763 => 3.1470, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6906, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6955, std. dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0940, std. dev.: 0.0479) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.55% (2.9384 => 2.5403, std. dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.09% (22.1758 => 19.9393, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (3.8922 => 3.8501, std. dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std. dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.63% (0.0998 => 0.0842, std. dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -10.13% (1.2373 => 1.1119, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.88% (19.9488 => 18.5770, std. dev.: 0.0393) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -5.91% (1.5373 => 1.4464, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -4.44% (1.9577 => 1.8708, std. dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4767, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (8.1563 => 7.8994, std. dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.00% (8.6802 => 8.4195, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9994, std. dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4808 => 0.4702, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2003, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.66% (12.5348 => 12.3272, std. dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std. dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8096, std. dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/3522dc79/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 13:23:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 13:23:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801182349.074073524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2562?compare_to=2560&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2562, Order: 161115, Start Time: 2012-08-01 17:10:32, End Time: 2012-08-01 18:24:18 To: 2560, Order: 161112, Start Time: 2012-08-01 15:28:50, End Time: 2012-08-01 16:42:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (712 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.09% (1.0985 => 1.1105, std. dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.23% (2.0176 => 2.3048, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3578 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.29% (0.3646 => 0.4021, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.25% (0.3601 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.19% (0.5818 => 0.6411, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3623 => 0.3989, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.03% (0.3650 => 0.4016, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.02% (0.3663 => 0.4030, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.92% (0.5748 => 0.6318, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.90% (0.3789 => 0.4164, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.68% (0.3914 => 0.4293, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.52% (0.4003 => 0.4384, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.52% (0.3940 => 0.4315, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 9.38% (0.7061 => 0.7723, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.1986 => 0.2148, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.7710 => 0.8274, std. dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.24% (1.3693 => 1.4685, std. dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2781 => 0.2981, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4328 => 0.4637, std. dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.12% (0.2782 => 0.2980, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2388, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.76% (0.5265 => 0.5621, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2607 => 0.2781, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.58% (0.2628 => 0.2801, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.44% (0.2937 => 0.3126, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2760 => 0.2937, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.39% (0.7038 => 0.7488, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.37% (0.2966 => 0.3155, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2765 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.34% (0.2761 => 0.2936, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.31% (0.2726 => 0.2898, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.26% (1.9828 => 2.1069, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.25% (0.3022 => 0.3211, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.20% (0.3580 => 0.3802, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.11% (0.3485 => 0.3698, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.10% (0.3149 => 0.3341, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.09% (0.2988 => 0.3170, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.3107 => 0.3296, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.3192 => 0.3384, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.96% (0.3489 => 0.3697, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.92% (0.4390 => 0.4650, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.6959 => 0.7364, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 5.80% (0.3293 => 0.3484, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.62% (0.3453 => 0.3647, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.59% (0.1789 => 0.1889, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (1.2193 => 1.2864, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 5.46% (0.3534 => 0.3727, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (0.3756 => 0.3957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.33% (0.4016 => 0.4230, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.29% (0.5577 => 0.5872, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.16% (0.9199 => 0.9674, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2127 => 0.2236, std. dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 5.08% (13.8202 => 14.5221, std. dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/moments: 5.07% (0.3868 => 0.4064, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.04% (16.6129 => 17.4494, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (0.2945 => 0.3092, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.87% (0.2914 => 0.3056, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (7.2180 => 7.5666, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.2925 => 0.3065, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 4.68% (0.7506 => 0.7857, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.65% (0.3246 => 0.3397, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.61% (1.4563 => 1.5235, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.53% (1.1364 => 1.1879, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.52% (1.3813 => 1.4438, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.51% (13.2842 => 13.8831, std. dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: 4.47% (1.2292 => 1.2842, std. dev.: 0.0064) MultiSource/Applications/Burg/burg: 4.44% (1.1061 => 1.1552, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.42% (1.3819 => 1.4430, std. dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 4.40% (3.8646 => 4.0345, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8310 => 0.8671, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0094, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.3245 => 1.3802, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.0594 => 1.1036, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.13% (0.3755 => 0.3910, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (4.3801 => 4.5575, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.92% (4.4433 => 4.6174, std. dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.92% (3.6692 => 3.8129, std. dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.57% (0.4791 => 0.4962, std. dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 3.51% (0.3131 => 0.3241, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.46% (2.1791 => 2.2546, std. dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.43% (4.9865 => 5.1576, std. dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1333 => 1.1721, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.39% (0.8698 => 0.8993, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 3.09% (3.1889 => 3.2873, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6283 => 0.6474, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 3.04% (0.4113 => 0.4238, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.98% (0.6135 => 0.6318, std. dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.97% (8.4961 => 8.7483, std. dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.5754 => 6.7597, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.64% (14.8535 => 15.2457, std. dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9047, std. dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.54% (3.2742 => 3.3574, std. dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6549, std. dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5526, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.05% (4.6629 => 4.7586, std. dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.9108 => 0.9254, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.26% (1.0313 => 1.0443, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (6.2785 => 6.3448, std. dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5133, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 25.53% (1.8175 => 2.2815, std. dev.: 0.0379) SingleSource/Benchmarks/Misc/mandel-2: 8.24% (1.2998 => 1.4069, std. dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.90% (1.5824 => 1.6758, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: 4.39% (7.4271 => 7.7535, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7017, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 2.93% (1.9199 => 1.9762, std. dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8149, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5351, std. dev.: 0.0101) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std. dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/fldry: 1.37% (1.9290 => 1.9555, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1949, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.29% (4.5928 => 4.6521, std. dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.27% (2.0152 => 2.0408, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 1.04% (10.7476 => 10.8589, std. dev.: 0.0183) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.5627 => 21.1280, std. dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.05% (0.0997 => 0.0837, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.64% (20.3410 => 18.5826, std. dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std. dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.18% (0.3139 => 0.2945, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.15% (1.3780 => 1.3070, std. dev.: 0.0160) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.89% (1.9762 => 1.9190, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.74% (8.8259 => 8.5844, std. dev.: 0.0081) MultiSource/Applications/spiff/spiff: -2.65% (3.0263 => 2.9460, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (0.8342 => 0.8152, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -2.10% (6.3560 => 6.2227, std. dev.: 0.0083) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -2.05% (6.6320 => 6.4961, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7680, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0052, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std. dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2472, std. dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2223, std. dev.: 0.0312) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/9bf21250/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 13:33:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 13:33:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801183353.329FA3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2563?compare_to=2561&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2563, Order: 161115, Start Time: 2012-08-01 17:15:48, End Time: 2012-08-01 18:34:20 To: 2561, Order: 161112, Start Time: 2012-08-01 15:28:59, End Time: 2012-08-01 16:47:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (94 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (742 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.67% (10.3673 => 14.0651, std. dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 13.99% (0.3473 => 0.3959, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.70% (0.3561 => 0.4049, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3497 => 0.3975, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.60% (0.3543 => 0.4025, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions-3: 13.59% (0.3516 => 0.3994, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.58% (0.3543 => 0.4024, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 13.35% (0.3694 => 0.4187, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.77% (0.3828 => 0.4317, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.58% (0.3886 => 0.4375, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.45% (0.3927 => 0.4416, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.22% (1.1194 => 1.2450, std. dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.34% (2.2022 => 2.4079, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.30% (1.7609 => 1.9070, std. dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 7.54% (0.1432 => 0.1540, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.19% (0.1892 => 0.2028, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 7.15% (0.1622 => 0.1738, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5925 => 0.6337, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.6030 => 0.6445, std. dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 6.16% (0.7326 => 0.7777, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.84% (0.4879 => 0.5164, std. dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4615 => 0.4871, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.45% (0.3282 => 0.3461, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.31% (10.4361 => 10.9906, std. dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.26% (7.0540 => 7.4250, std. dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 4.53% (9.4845 => 9.9138, std. dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.46% (4.9449 => 5.1655, std. dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.39% (0.8172 => 0.8531, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 4.39% (0.2554 => 0.2666, std. dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.33% (5.0018 => 5.2185, std. dev.: 0.0096) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.01% (4.2646 => 4.4354, std. dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.95% (0.5569 => 0.5789, std. dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.83% (0.3109 => 0.3228, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.81% (0.2758 => 0.2863, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 3.77% (0.7835 => 0.8130, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.74% (0.5860 => 0.6079, std. dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 3.71% (0.3423 => 0.3550, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.69% (8.1363 => 8.4365, std. dev.: 0.0105) MultiSource/Benchmarks/McCat/09-vor/vor: 3.58% (0.3180 => 0.3294, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.54% (1.1642 => 1.2054, std. dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.50% (1.1861 => 1.2276, std. dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 3.48% (0.2905 => 0.3006, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.30% (1.3050 => 1.3480, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.23% (14.3668 => 14.8304, std. dev.: 0.0093) MultiSource/Applications/oggenc/oggenc: 3.22% (5.7591 => 5.9447, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.21% (0.5105 => 0.5269, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.21% (0.3650 => 0.3767, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.4636 => 0.4783, std. dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4299 => 0.4435, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 3.13% (0.3422 => 0.3529, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.11% (1.5415 => 1.5895, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 3.09% (3.3354 => 3.4384, std. dev.: 0.0017) MultiSource/Applications/hbd/hbd: 3.06% (1.5603 => 1.6081, std. dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 3.04% (0.3387 => 0.3490, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.03% (0.3826 => 0.3942, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.4103 => 0.4226, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.92% (0.3865 => 0.3978, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.4289 => 0.4412, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.86% (2.0273 => 2.0852, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (2.0665 => 2.1245, std. dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.81% (2.2024 => 2.2642, std. dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (0.3935 => 0.4045, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.8067 => 0.8285, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 2.70% (3.8723 => 3.9769, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.57% (0.4203 => 0.4311, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.51% (0.6456 => 0.6618, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.9765 => 1.0010, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.34% (0.6675 => 0.6831, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.4186 => 1.4510, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.27% (0.5981 => 0.6117, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6450 => 0.6594, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5859 => 1.6213, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (0.4620 => 0.4723, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.12% (17.1811 => 17.5451, std. dev.: 0.0206) MultiSource/Applications/hexxagon/hexxagon: 2.09% (1.2842 => 1.3111, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8921 => 0.9096, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.83% (0.7115 => 0.7245, std. dev.: 0.0017) MultiSource/Applications/siod/siod: 1.76% (2.2969 => 2.3374, std. dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 1.70% (1.1840 => 1.2041, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.00% (4.2280 => 4.3971, std. dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.14% (3.6395 => 3.7539, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.77% (1.5086 => 1.5353, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2125, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.65% (11.6436 => 11.8359, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.65% (9.1159 => 9.2660, std. dev.: 0.0289) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1290, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.45% (0.8651 => 0.1691, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1616, std. dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6991, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.78% (5.3526 => 3.7051, std. dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0644, std. dev.: 0.0514) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5464, std. dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -9.95% (22.1758 => 19.9702, std. dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4271, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2373 => 1.1158, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -6.83% (1.5373 => 1.4323, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.70% (19.9488 => 18.6121, std. dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.85% (1.9577 => 1.8628, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4770, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4097, std. dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (8.1563 => 7.9185, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0014, std. dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2010, std. dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.76% (12.5348 => 12.3144, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.28% (1.8329 => 1.8095, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0003) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2494, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 3.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/1a1e7a7d/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 14:12:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 14:12:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801191212.EFF013524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2564?compare_to=2559&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2564, Order: 161114, Start Time: 2012-08-01 16:28:59, End Time: 2012-08-01 19:12:42 To: 2559, Order: 161110, Start Time: 2012-08-01 13:16:52, End Time: 2012-08-01 16:00:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.54% (54.0436 => 54.8748, std. dev.: 0.0718) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.45% (0.3488 => 0.3957, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.32% (0.3469 => 0.3931, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.93% (0.3650 => 0.4122, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.21% (0.5826 => 0.6246, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.98% (0.5889 => 0.6300, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.1619 => 0.1721, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.26% (0.7171 => 0.7620, std. dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.00% (1.6211 => 1.7184, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.95% (3.5627 => 3.7746, std. dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.81% (0.4994 => 0.5284, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.73% (0.5026 => 0.5314, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.65% (1.5932 => 1.6832, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.5900 => 0.6228, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 5.53% (0.4029 => 0.4252, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.51% (1.3152 => 1.3877, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.48% (0.4361 => 0.4600, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (0.5000 => 0.5264, std. dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.94% (1.0781 => 1.1314, std. dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.94% (0.3930 => 0.4124, std. dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.73% (2.7292 => 2.8583, std. dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 4.69% (4.2109 => 4.4082, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.41% (0.2792 => 0.2915, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.31% (0.2736 => 0.2854, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.28% (0.2875 => 0.2998, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 4.23% (0.3004 => 0.3131, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 4.18% (0.2725 => 0.2839, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.05% (1.9694 => 2.0491, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.03% (0.2729 => 0.2839, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.03% (0.9909 => 1.0308, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 3.98% (0.2714 => 0.2822, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.97% (0.3195 => 0.3322, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.91% (0.3890 => 0.4042, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.89% (5.5417 => 5.7574, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (1.9966 => 2.0738, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 3.85% (0.2750 => 0.2856, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.85% (2.0673 => 2.1469, std. dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.2780 => 0.2886, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.81% (0.3726 => 0.3868, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (2.1013 => 2.1812, std. dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/methcall: 3.77% (0.2813 => 0.2919, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3258 => 0.3380, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.74% (0.4658 => 0.4832, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 3.72% (0.2823 => 0.2928, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.68% (0.2911 => 0.3018, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 3.65% (0.3096 => 0.3209, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.64% (2.1653 => 2.2441, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (4.4195 => 4.5761, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 3.52% (0.3267 => 0.3382, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.46% (0.3060 => 0.3166, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.46% (0.3903 => 0.4038, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 3.42% (4.6177 => 4.7755, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 3.41% (0.3348 => 0.3462, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.39% (0.7875 => 0.8142, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.4139 => 0.4277, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 3.32% (0.3678 => 0.3800, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3477 => 0.3592, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 3.30% (0.9697 => 1.0017, std. dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 3.27% (1.8794 => 1.9409, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.26% (0.3282 => 0.3389, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.20% (0.3625 => 0.3741, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.19% (0.3981 => 0.4108, std. dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.3845 => 0.3962, std. dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 2.99% (23.5202 => 24.2237, std. dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3690 => 0.3800, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.4146 => 0.4269, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.82% (1.4269 => 1.4671, std. dev.: 0.0016) MultiSource/Applications/siod/siod: 2.76% (0.6634 => 0.6817, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.69% (0.5546 => 0.5695, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.5012 => 0.5131, std. dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.56% (2.0346 => 2.0664, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.04% (0.2162 => 0.3525, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.06% (0.5917 => 0.6690, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.25% (12.0509 => 12.6840, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8956, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1661, std. dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6550, std. dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1983, std. dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4981, std. dev.: 0.0218) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5912, std. dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std. dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.79% (2.4764 => 2.4073, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: -1.20% (11.9555 => 11.8126, std. dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.95% (25.4195 => 16.5343, std. dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/fldry: -9.25% (17.2379 => 15.6436, std. dev.: 0.3482) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std. dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8054, std. dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/moments: -3.88% (0.4438 => 0.4266, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7917, std. dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -3.56% (14.0481 => 13.5486, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5184, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5746, std. dev.: 0.0047) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/b85a5984/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 15:06:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 15:06:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801200602.2500D3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2565?compare_to=2562&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2565, Order: 161121, Start Time: 2012-08-01 18:52:43, End Time: 2012-08-01 20:06:30 To: 2562, Order: 161115, Start Time: 2012-08-01 17:10:32, End Time: 2012-08-01 18:24:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (708 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.31% (2.0176 => 2.3063, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.17% (0.3578 => 0.3942, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.11% (0.3601 => 0.3965, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.10% (0.3663 => 0.4033, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 10.00% (0.5818 => 0.6400, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.98% (0.3646 => 0.4010, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.94% (0.3623 => 0.3983, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.92% (0.3650 => 0.4012, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.88% (0.5748 => 0.6316, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.79% (0.3789 => 0.4160, std. dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 9.68% (0.3914 => 0.4293, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.4003 => 0.4382, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7061 => 0.7724, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 9.34% (0.3940 => 0.4308, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3130 => 0.3383, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.60% (0.7710 => 0.8296, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2782 => 0.2982, std. dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.15% (0.1413 => 0.1514, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.13% (1.3693 => 1.4669, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 7.00% (0.4328 => 0.4631, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.98% (0.2781 => 0.2975, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2387, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2596 => 0.2772, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.75% (0.2607 => 0.2783, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.51% (0.2690 => 0.2865, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.48% (0.2655 => 0.2827, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 6.47% (0.2628 => 0.2798, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.2966 => 0.3157, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.33% (0.2765 => 0.2940, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2760 => 0.2933, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.27% (0.2761 => 0.2934, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.2937 => 0.3120, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.20% (0.2726 => 0.2895, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2696 => 0.2862, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.14% (1.9828 => 2.1045, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3580 => 0.3798, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.09% (0.3022 => 0.3206, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.05% (0.3899 => 0.4135, std. dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 6.05% (0.3107 => 0.3295, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.00% (0.3485 => 0.3694, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3149 => 0.3337, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3192 => 0.3381, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.85% (0.4390 => 0.4647, std. dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (0.4379 => 0.4634, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.79% (0.2988 => 0.3161, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.71% (0.3453 => 0.3650, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.70% (0.1789 => 0.1891, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.6959 => 0.7351, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.60% (1.2193 => 1.2876, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 5.59% (0.3293 => 0.3477, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.55% (0.3534 => 0.3730, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.48% (0.9199 => 0.9703, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.40% (0.4016 => 0.4233, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.27% (0.5577 => 0.5871, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.22% (0.2127 => 0.2238, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (0.3756 => 0.3952, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.11% (13.8202 => 14.5266, std. dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: 5.09% (0.3868 => 0.4065, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.00% (16.6129 => 17.4438, std. dev.: 0.0131) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.2243 => 0.2355, std. dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 4.96% (0.2925 => 0.3070, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.2914 => 0.3058, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.89% (1.4563 => 1.5275, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.86% (7.2180 => 7.5685, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.2945 => 0.3086, std. dev.: 0.0036) MultiSource/Applications/spiff/spiff: 4.73% (0.7506 => 0.7861, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.62% (0.3246 => 0.3396, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.61% (1.1364 => 1.1888, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5637 => 0.5894, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (13.2842 => 13.8813, std. dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 4.46% (1.2292 => 1.2840, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.3245 => 1.3825, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.37% (3.8646 => 4.0333, std. dev.: 0.0032) MultiSource/Applications/treecc/treecc: 4.35% (1.9270 => 2.0108, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8310 => 0.8671, std. dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.7460 => 0.7784, std. dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.33% (1.1061 => 1.1540, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.31% (1.0594 => 1.1051, std. dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.21% (1.3819 => 1.4401, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (4.3801 => 4.5623, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.05% (0.3755 => 0.3907, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.99% (3.6692 => 3.8156, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6193, std. dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.65% (4.9865 => 5.1687, std. dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.60% (1.1333 => 1.1741, std. dev.: 0.0093) MultiSource/Applications/siod/siod: 3.51% (2.1791 => 2.2555, std. dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.44% (0.4791 => 0.4956, std. dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.28% (0.4113 => 0.4248, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6135 => 0.6333, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.22% (0.8698 => 0.8978, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.12% (3.1889 => 3.2884, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6283 => 0.6476, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (8.4961 => 8.7491, std. dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.5754 => 6.7559, std. dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.5298 => 14.9174, std. dev.: 0.0139) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.8535 => 15.2448, std. dev.: 0.0166) MultiSource/Applications/sqlite3/sqlite3: 2.61% (16.2614 => 16.6860, std. dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.61% (3.2742 => 3.3595, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.1007 => 2.1536, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.26% (1.5188 => 1.5531, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 2.13% (4.6629 => 4.7620, std. dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.62% (0.9108 => 0.9256, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.41% (1.0313 => 1.0458, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.08% (6.2785 => 6.3464, std. dev.: 0.0028) MultiSource/Applications/lua/lua: 1.07% (3.7467 => 3.7868, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5124, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std. dev.: 0.0124) SingleSource/Benchmarks/Misc/mandel-2: 7.61% (1.2998 => 1.3987, std. dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.24% (0.9996 => 1.0520, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7545, std. dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7055, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9879, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.63% (1.7688 => 1.8153, std. dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5083, std. dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.36% (4.5928 => 4.6551, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1941, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/fldry: 1.04% (1.9290 => 1.9491, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.1560 => 1.1678, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.46% (0.4657 => 0.4170, std. dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.5627 => 21.1226, std. dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.43% (0.2670 => 0.2525, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.65% (0.0997 => 0.0831, std. dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.03% (1.2308 => 1.1073, std. dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.74% (20.3410 => 18.5636, std. dev.: 0.0340) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9192, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5903, std. dev.: 0.0084) MultiSource/Applications/spiff/spiff: -2.61% (3.0263 => 2.9473, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2267, std. dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.87% (6.6320 => 6.5083, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7684, std. dev.: 0.0256) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2323, std. dev.: 0.0171) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std. dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2505, std. dev.: 0.0046) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2386, std. dev.: 0.0128) MultiSource/Applications/lua/lua: -1.03% (26.5159 => 26.2429, std. dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.03% (3.8887 => 3.8487, std. dev.: 0.0106) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/e45fd61d/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 15:20:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 15:20:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801202044.35E3E3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2566?compare_to=2563&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2566, Order: 161121, Start Time: 2012-08-01 19:02:46, End Time: 2012-08-01 20:21:13 To: 2563, Order: 161115, Start Time: 2012-08-01 17:15:48, End Time: 2012-08-01 18:34:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (84 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.46% (10.3673 => 14.0435, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: 13.62% (0.3473 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.33% (0.3497 => 0.3963, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.25% (0.3516 => 0.3982, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.24% (0.3543 => 0.4012, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.24% (0.3543 => 0.4012, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 13.11% (0.3561 => 0.4028, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.80% (0.3694 => 0.4167, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3828 => 0.4306, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.25% (0.3886 => 0.4362, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.15% (0.3927 => 0.4404, std. dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.57% (1.1194 => 1.2489, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.37% (0.1622 => 0.1774, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.82% (2.2022 => 2.3965, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.80% (1.7609 => 1.8983, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 7.61% (0.1432 => 0.1541, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.09% (0.5925 => 0.6345, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.10% (0.7326 => 0.7773, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.3282 => 0.3452, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.4879 => 0.5128, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4615 => 0.4844, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.96% (7.0540 => 7.4036, std. dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (10.4361 => 10.9211, std. dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.64% (0.2758 => 0.2886, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.12% (9.4845 => 9.8752, std. dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1474, std. dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.95% (0.8172 => 0.8495, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (5.0018 => 5.1958, std. dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 3.83% (0.3109 => 0.3228, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.73% (0.5569 => 0.5777, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (4.2646 => 4.4180, std. dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.56% (0.3121 => 0.3232, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.45% (0.5860 => 0.6062, std. dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.40% (0.7835 => 0.8101, std. dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (8.1363 => 8.4089, std. dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 3.18% (0.3180 => 0.3281, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.06% (1.1861 => 1.2224, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.04% (0.4636 => 0.4777, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.96% (5.7591 => 5.9297, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (1.3050 => 1.3427, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (14.3668 => 14.7661, std. dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash: 2.68% (0.4289 => 0.4404, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.62% (1.1642 => 1.1947, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.61% (0.3865 => 0.3966, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6009, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.53% (0.8067 => 0.8271, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.52% (3.3354 => 3.4193, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.51% (2.0273 => 2.0782, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.5415 => 1.5800, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 2.49% (0.4299 => 0.4406, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.43% (2.0665 => 2.1167, std. dev.: 0.0009) MultiSource/Applications/lua/lua: 2.27% (3.8723 => 3.9601, std. dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6456 => 0.6601, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.5105 => 0.5218, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.99% (0.6675 => 0.6808, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.98% (0.9765 => 0.9958, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.95% (0.6450 => 0.6576, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.2024 => 2.2436, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.4186 => 1.4442, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5981 => 0.6088, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.69% (1.2842 => 1.3059, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 1.55% (0.8921 => 0.9059, std. dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.50% (0.7115 => 0.7222, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 1.50% (2.2969 => 2.3313, std. dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.39% (17.1811 => 17.4196, std. dev.: 0.0156) MultiSource/Benchmarks/nbench/nbench: 1.32% (1.1840 => 1.1996, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9734, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (4.2280 => 4.3968, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.21% (3.6395 => 3.7565, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 1.69% (3.1578 => 3.2113, std. dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8322, std. dev.: 0.0007) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2045, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.20% (1.3045 => 1.3201, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1265, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.46% (0.8651 => 0.1690, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.10% (5.2763 => 3.1603, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6992, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7065, std. dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0796, std. dev.: 0.0278) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.08% (2.9384 => 2.5541, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -10.31% (22.1758 => 19.8902, std. dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (3.8922 => 3.8494, std. dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.13% (0.0998 => 0.0837, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std. dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -10.48% (1.2373 => 1.1076, std. dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -6.97% (1.5373 => 1.4301, std. dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.89% (19.9488 => 18.5737, std. dev.: 0.0713) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7609, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5106, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -4.60% (1.9577 => 1.8676, std. dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4741, std. dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.07% (8.6802 => 8.4140, std. dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (8.1563 => 7.9099, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -2.75% (10.2830 => 10.0006, std. dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3304, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.43% (0.4808 => 0.4691, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -2.17% (12.4730 => 12.2019, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.68% (12.5348 => 12.3240, std. dev.: 0.0030) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4183, std. dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8093, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0004) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2495, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/4d065277/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 16:47:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 16:47:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801214744.6C93C3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2567?compare_to=2565&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2567, Order: 161124, Start Time: 2012-08-01 20:34:31, End Time: 2012-08-01 21:48:11 To: 2565, Order: 161121, Start Time: 2012-08-01 18:52:43, End Time: 2012-08-01 20:06:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (147 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.31% (2.0176 => 2.3063, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.23% (0.3578 => 0.3944, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.06% (0.5818 => 0.6403, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.03% (0.3650 => 0.4016, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.02% (0.3601 => 0.3962, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.98% (0.3646 => 0.4010, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3663 => 0.4026, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.88% (0.3623 => 0.3981, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.85% (0.5748 => 0.6314, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3789 => 0.4159, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.71% (0.3914 => 0.4294, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.49% (0.4003 => 0.4383, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.37% (0.3940 => 0.4309, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.02% (0.7061 => 0.7698, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.99% (0.3130 => 0.3380, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.34% (0.2781 => 0.2985, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.30% (0.7710 => 0.8273, std. dev.: 0.0014) MultiSource/Applications/hbd/hbd: 7.14% (1.3693 => 1.4671, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.12% (0.2782 => 0.2980, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4328 => 0.4628, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2375, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.65% (0.2690 => 0.2869, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.64% (0.2607 => 0.2780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.52% (0.2655 => 0.2828, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4062 => 0.4326, std. dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.45% (0.7038 => 0.7492, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.2966 => 0.3156, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.40% (0.2765 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2628 => 0.2796, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.38% (0.2760 => 0.2936, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.35% (0.2726 => 0.2899, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.33% (0.2937 => 0.3123, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.25% (1.9828 => 2.1068, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2696 => 0.2863, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.19% (0.3022 => 0.3209, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.16% (0.3899 => 0.4139, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2761 => 0.2930, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.08% (0.3485 => 0.3697, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.02% (0.2988 => 0.3168, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.02% (0.3192 => 0.3384, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3580 => 0.3795, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.99% (0.3107 => 0.3293, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3149 => 0.3335, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.90% (0.4390 => 0.4649, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.85% (0.3489 => 0.3693, std. dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.85% (0.4379 => 0.4635, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.80% (0.3534 => 0.3739, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.76% (0.1789 => 0.1892, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.65% (0.3293 => 0.3479, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.59% (0.6959 => 0.7348, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.56% (0.3453 => 0.3645, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.50% (1.2193 => 1.2864, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.44% (0.9199 => 0.9699, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.27% (0.5577 => 0.5871, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.25% (0.4016 => 0.4227, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.17% (13.8202 => 14.5345, std. dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/moments: 5.14% (0.3868 => 0.4067, std. dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.3756 => 0.3947, std. dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.08% (0.2914 => 0.3062, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.08% (0.2127 => 0.2235, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (0.2945 => 0.3094, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.99% (0.2023 => 0.2124, std. dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 4.99% (16.6129 => 17.4419, std. dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (7.2180 => 7.5669, std. dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.77% (1.4563 => 1.5258, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.74% (0.7506 => 0.7862, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.71% (0.3246 => 0.3399, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.61% (0.5637 => 0.5897, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.59% (1.1364 => 1.1886, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (13.2842 => 13.8812, std. dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.43% (1.3245 => 1.3832, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.43% (1.2292 => 1.2836, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.33% (0.8310 => 0.8670, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 4.28% (3.8646 => 4.0299, std. dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 4.28% (1.0594 => 1.1047, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 4.25% (1.1061 => 1.1531, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.18% (1.3819 => 1.4396, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.17% (1.3813 => 1.4389, std. dev.: 0.0046) MultiSource/Applications/treecc/treecc: 4.14% (1.9270 => 2.0068, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.13% (0.3755 => 0.3910, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (4.3801 => 4.5552, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.96% (4.4433 => 4.6193, std. dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.94% (3.6692 => 3.8139, std. dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.82% (0.3220 => 0.3343, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.61% (4.9865 => 5.1664, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.53% (0.4791 => 0.4960, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 3.52% (2.1791 => 2.2558, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.48% (1.1333 => 1.1727, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.32% (0.3131 => 0.3235, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.30% (0.8698 => 0.8985, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.28% (0.6135 => 0.6336, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4113 => 0.4243, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.15% (0.6283 => 0.6481, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 3.10% (3.1889 => 3.2876, std. dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 3.03% (8.4961 => 8.7536, std. dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 2.86% (6.5754 => 6.7633, std. dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.5298 => 14.9114, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.61% (2.1007 => 2.1556, std. dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 2.61% (14.8535 => 15.2408, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (3.2742 => 3.3593, std. dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6733, std. dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.44% (1.5188 => 1.5559, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.13% (4.6629 => 4.7621, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.35% (1.0313 => 1.0452, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.09% (6.2785 => 6.3469, std. dev.: 0.0122) MultiSource/Applications/lua/lua: 1.06% (3.7467 => 3.7863, std. dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5182, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2720, std. dev.: 0.0440) SingleSource/Benchmarks/Misc/mandel-2: 7.34% (1.2998 => 1.3952, std. dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.15% (0.9996 => 1.0511, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: 4.38% (7.4271 => 7.7521, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7048, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9662, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.84% (1.9199 => 1.9744, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8146, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.30% (0.9692 => 0.9915, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5089 => 1.5351, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5952, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.47% (1.9290 => 1.9574, std. dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5090, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1937, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.25% (4.5928 => 4.6504, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.20% (1.0310 => 1.0434, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 1.06% (1.1560 => 1.1683, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (3.1071 => 3.1387, std. dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.5627 => 21.1254, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.47% (0.2670 => 0.2524, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.99% (0.3511 => 0.3406, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8629, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.02% (1.2308 => 1.1075, std. dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.91% (20.3410 => 18.5287, std. dev.: 0.0228) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.84% (1.3780 => 1.3113, std. dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.8259 => 8.5604, std. dev.: 0.0242) MultiSource/Benchmarks/Olden/bh/bh: -2.88% (1.9762 => 1.9193, std. dev.: 0.0103) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2288, std. dev.: 0.0075) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.97% (6.6320 => 6.5015, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7670, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0061) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2168, std. dev.: 0.0157) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std. dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.13% (7.3305 => 7.2476, std. dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/ec634104/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 17:07:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 17:07:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801220716.DAB2D3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2568?compare_to=2566&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2568, Order: 161124, Start Time: 2012-08-01 20:49:13, End Time: 2012-08-01 22:07:46 To: 2566, Order: 161121, Start Time: 2012-08-01 19:02:46, End Time: 2012-08-01 20:21:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (89 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (748 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.36% (78.2610 => 80.8930, std. dev.: 0.3901) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 35.31% (10.3673 => 14.0284, std. dev.: 0.0117) SingleSource/UnitTests/ObjC/trivial-interface: 13.73% (0.3473 => 0.3950, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.47% (0.3497 => 0.3968, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 13.41% (0.3543 => 0.4018, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.29% (0.3543 => 0.4014, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.25% (0.3516 => 0.3982, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3561 => 0.4030, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.89% (0.3694 => 0.4170, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.43% (0.3828 => 0.4304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.25% (0.3927 => 0.4408, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.22% (0.3886 => 0.4361, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.68% (1.1194 => 1.2501, std. dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 9.49% (0.1622 => 0.1776, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.21% (2.2022 => 2.4051, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.43% (1.7609 => 1.9094, std. dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.00% (0.5925 => 0.6340, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.92% (0.6030 => 0.6447, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.17% (0.7326 => 0.7778, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4615 => 0.4869, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3282 => 0.3457, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.27% (0.4879 => 0.5136, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.13% (7.0540 => 7.4156, std. dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 4.65% (10.4361 => 10.9214, std. dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (9.4845 => 9.8857, std. dev.: 0.0094) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.2554 => 0.2660, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.13% (4.9449 => 5.1493, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 4.10% (0.7433 => 0.7738, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (5.0018 => 5.1985, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.85% (0.4103 => 0.4261, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (4.2646 => 4.4182, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.55% (0.5860 => 0.6068, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.36% (8.1363 => 8.4094, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.24% (0.3423 => 0.3534, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.23% (0.3162 => 0.3264, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.22% (0.3109 => 0.3209, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.22% (0.7835 => 0.8087, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3180 => 0.3282, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.1861 => 1.2221, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.00% (0.4636 => 0.4775, std. dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.96% (5.7591 => 5.9293, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.89% (1.3050 => 1.3427, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (14.3668 => 14.7754, std. dev.: 0.0127) MultiSource/Applications/Burg/burg: 2.78% (1.1642 => 1.1966, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.77% (0.3650 => 0.3751, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.74% (1.5603 => 1.6031, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.66% (0.3865 => 0.3968, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.4289 => 0.4398, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.8067 => 0.8272, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.54% (3.3354 => 3.4201, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.54% (2.0665 => 2.1189, std. dev.: 0.0012) MultiSource/Applications/treecc/treecc: 2.54% (2.0273 => 2.0787, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 2.42% (0.4299 => 0.4403, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.5415 => 1.5781, std. dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 2.28% (0.6456 => 0.6603, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.26% (3.8723 => 3.9597, std. dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.21% (0.5105 => 0.5218, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.07% (0.9765 => 0.9967, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6187, std. dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.2024 => 2.2460, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.95% (0.6675 => 0.6805, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4462, std. dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.92% (0.6450 => 0.6574, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.79% (0.5981 => 0.6088, std. dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.74% (1.2842 => 1.3066, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 1.56% (0.8921 => 0.9060, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4352, std. dev.: 0.0079) MultiSource/Applications/siod/siod: 1.45% (2.2969 => 2.3303, std. dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.41% (0.7115 => 0.7215, std. dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.35% (1.1840 => 1.2000, std. dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.59% (4.2280 => 4.3797, std. dev.: 0.0160) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7497, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 1.83% (3.1578 => 3.2157, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5086 => 1.5338, std. dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 1.61% (11.6436 => 11.8313, std. dev.: 0.0018) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2042, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2224, std. dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9197, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.17% (5.2763 => 3.1570, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.01% (5.3855 => 3.7155, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.47% (5.3526 => 3.7216, std. dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0553, std. dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.30% (2.9384 => 2.5476, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -10.29% (22.1758 => 19.8935, std. dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.18% (1.2373 => 1.1114, std. dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.03% (19.9488 => 18.5456, std. dev.: 0.0495) SingleSource/Benchmarks/Misc/mandel-2: -6.91% (1.5373 => 1.4311, std. dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.62% (1.9577 => 1.8673, std. dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.32% (1.5835 => 1.5151, std. dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4839, std. dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (8.1563 => 7.9019, std. dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (8.6802 => 8.4173, std. dev.: 0.0141) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0035, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.18% (0.4808 => 0.4703, std. dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2014, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3149, std. dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std. dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4182, std. dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.25% (1.8329 => 1.8099, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0001) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2495, std. dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/a0a3ac3b/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 17:24:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 17:24:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120801222404.1D7CD3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2569?compare_to=2564&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2569, Order: 161124, Start Time: 2012-08-01 19:40:53, End Time: 2012-08-01 22:24:33 To: 2564, Order: 161114, Start Time: 2012-08-01 16:28:59, End Time: 2012-08-01 19:12:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (777 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.57% (0.3442 => 0.3909, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.56% (0.3465 => 0.3935, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.53% (0.3496 => 0.3969, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.47% (0.3488 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3469 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.18% (0.3643 => 0.4123, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.99% (0.3650 => 0.4124, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3724 => 0.4199, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5826 => 0.6256, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.5889 => 0.6298, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.24% (0.1619 => 0.1720, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (1.6211 => 1.7157, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.78% (3.5627 => 3.7686, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.77% (0.5026 => 0.5316, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.61% (1.5932 => 1.6825, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 5.56% (0.7171 => 0.7570, std. dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (0.4994 => 0.5262, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (0.4361 => 0.4593, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.31% (0.2014 => 0.2121, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.21% (1.3152 => 1.3837, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.20% (0.5900 => 0.6207, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.08% (0.5000 => 0.5254, std. dev.: 0.0013) MultiSource/Applications/d/make_dparser: 4.95% (1.0781 => 1.1315, std. dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.91% (0.4029 => 0.4227, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.91% (0.3930 => 0.4123, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 4.57% (4.2109 => 4.4035, std. dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.57% (0.2866 => 0.2997, std. dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.51% (2.7292 => 2.8524, std. dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.24% (0.2875 => 0.2997, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.23% (0.2792 => 0.2910, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.20% (0.2736 => 0.2851, std. dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 4.19% (0.3004 => 0.3130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 4.11% (0.2725 => 0.2837, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.08% (0.9909 => 1.0313, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.06% (1.9694 => 2.0494, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.94% (0.2738 => 0.2846, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 3.93% (0.2750 => 0.2858, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.93% (1.9966 => 2.0750, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 3.92% (0.2780 => 0.2889, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.87% (2.0673 => 2.1474, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 3.87% (0.2714 => 0.2819, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.82% (0.3060 => 0.3177, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 3.81% (0.3096 => 0.3214, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.81% (0.2811 => 0.2918, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.78% (0.3890 => 0.4037, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.77% (0.2729 => 0.2832, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.75% (0.2823 => 0.2929, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 3.75% (0.2803 => 0.2908, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.71% (5.5417 => 5.7471, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 3.70% (0.2813 => 0.2917, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (2.1013 => 2.1775, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.61% (0.3267 => 0.3385, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.61% (0.3271 => 0.3389, std. dev.: 0.0026) MultiSource/Applications/hbd/hbd: 3.59% (0.9697 => 1.0045, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (4.4195 => 4.5776, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3258 => 0.3374, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.55% (0.3124 => 0.3235, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 3.54% (0.3726 => 0.3858, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 3.44% (0.3317 => 0.3431, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.42% (0.3362 => 0.3477, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.42% (2.1653 => 2.2393, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3282 => 0.3394, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.38% (0.3903 => 0.4035, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 3.34% (0.3678 => 0.3801, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 3.32% (0.3348 => 0.3459, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.31% (0.3625 => 0.3745, std. dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 3.31% (4.6177 => 4.7705, std. dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.26% (0.4139 => 0.4274, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (1.8794 => 1.9402, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 3.22% (0.3477 => 0.3589, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.09% (0.3981 => 0.4104, std. dev.: 0.0001) MultiSource/Applications/treecc/treecc: 3.00% (0.7875 => 0.8111, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 2.97% (0.4146 => 0.4269, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.95% (0.3690 => 0.3799, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4251 => 0.4376, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.3845 => 0.3958, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.79% (23.5202 => 24.1772, std. dev.: 0.0196) MultiSource/Applications/lua/lua: 2.76% (1.4269 => 1.4663, std. dev.: 0.0034) MultiSource/Applications/Burg/burg: 2.56% (0.5546 => 0.5688, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.55% (0.5012 => 0.5140, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 2.52% (0.6634 => 0.6801, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.6435 => 0.6590, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.41% (2.0346 => 2.0632, std. dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1639, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.58% (1.8057 => 1.8884, std. dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6500, std. dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2094, std. dev.: 0.0504) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4978, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2208, std. dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.25% (1.0927 => 1.1064, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.83% (2.4764 => 2.4063, std. dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: -1.11% (11.9555 => 11.8224, std. dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.03% (25.4195 => 16.5139, std. dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/fldry: -8.09% (17.2379 => 15.8440, std. dev.: 0.1145) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8073, std. dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -6.20% (0.2402 => 0.2253, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -3.90% (0.4438 => 0.4265, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8025, std. dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -3.61% (14.0481 => 13.5407, std. dev.: 0.0095) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/ecbee45c/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 18:29:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 18:29:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120801232936.963DC3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2570?compare_to=2567&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2570, Order: 161135, Start Time: 2012-08-01 22:16:24, End Time: 2012-08-01 23:30:06 To: 2567, Order: 161124, Start Time: 2012-08-01 20:34:31, End Time: 2012-08-01 21:48:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (144 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (711 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -2.71% (0.5489 => 0.5340, std. dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.21% (2.0176 => 2.3044, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.14% (0.5818 => 0.6408, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.09% (0.3578 => 0.3939, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.02% (0.5748 => 0.6324, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.91% (0.3601 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3646 => 0.4003, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.77% (0.3623 => 0.3977, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.73% (0.3650 => 0.4005, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.72% (0.3663 => 0.4019, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3789 => 0.4156, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.58% (0.3914 => 0.4289, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.29% (0.4003 => 0.4375, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.24% (0.3940 => 0.4304, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.96% (0.7061 => 0.7694, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.83% (0.3130 => 0.3375, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.05% (1.3693 => 1.4659, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.02% (0.7710 => 0.8251, std. dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.2781 => 0.2969, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.75% (3.9660 => 4.2337, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4328 => 0.4620, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.2782 => 0.2969, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5265 => 0.5607, std. dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 6.46% (0.7038 => 0.7493, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2690 => 0.2860, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.30% (0.4379 => 0.4655, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.2607 => 0.2770, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.2721 => 0.2890, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2655 => 0.2817, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.08% (0.2765 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.05% (0.2628 => 0.2787, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.03% (0.3899 => 0.4134, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.00% (0.2966 => 0.3144, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.96% (0.3022 => 0.3202, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.94% (0.2760 => 0.2924, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.93% (1.9828 => 2.1004, std. dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 5.91% (0.2726 => 0.2887, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2761 => 0.2923, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.79% (0.2937 => 0.3107, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3485 => 0.3685, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3107 => 0.3283, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.59% (0.3580 => 0.3780, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.58% (0.3192 => 0.3370, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.56% (0.3149 => 0.3324, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.2988 => 0.3152, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.6959 => 0.7340, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 5.44% (0.3293 => 0.3472, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.40% (1.2193 => 1.2852, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.32% (0.3534 => 0.3722, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.15% (0.5577 => 0.5864, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.03% (0.4016 => 0.4218, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.94% (13.8202 => 14.5033, std. dev.: 0.0153) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 4.91% (16.6129 => 17.4294, std. dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/moments: 4.89% (0.3868 => 0.4057, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.85% (0.3756 => 0.3938, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.80% (0.7506 => 0.7866, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 4.73% (0.2243 => 0.2349, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.4563 => 1.5244, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.67% (0.2140 => 0.2240, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.67% (0.2914 => 0.3050, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.61% (7.2180 => 7.5504, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.52% (0.2945 => 0.3078, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.46% (13.2842 => 13.8764, std. dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.38% (0.5637 => 0.5884, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.34% (0.3246 => 0.3387, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.33% (1.1364 => 1.1856, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.8310 => 0.8668, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2292 => 1.2808, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.19% (1.1061 => 1.1525, std. dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.17% (1.9270 => 2.0074, std. dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.16% (1.3245 => 1.3796, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.14% (0.7460 => 0.7769, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 4.14% (3.8646 => 4.0245, std. dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.07% (1.3813 => 1.4375, std. dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.07% (1.0594 => 1.1025, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.92% (1.3819 => 1.4361, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.83% (4.3801 => 4.5478, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.77% (4.4433 => 4.6109, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.73% (0.3755 => 0.3895, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.72% (3.6692 => 3.8057, std. dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 3.70% (0.3220 => 0.3339, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 3.39% (2.1791 => 2.2530, std. dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.35% (4.9865 => 5.1533, std. dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1712, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.30% (0.4791 => 0.4949, std. dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 3.23% (0.3131 => 0.3232, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.11% (0.4113 => 0.4241, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.05% (0.8698 => 0.8963, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.93% (0.6135 => 0.6315, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.91% (0.6283 => 0.6466, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.84% (3.1889 => 3.2794, std. dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.4961 => 8.7360, std. dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.1007 => 2.1557, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.56% (3.2742 => 3.3579, std. dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 2.52% (6.5754 => 6.7409, std. dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 2.49% (16.2614 => 16.6670, std. dev.: 0.0253) MultiSource/Applications/ClamAV/clamscan: 2.47% (14.5298 => 14.8893, std. dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 2.47% (14.8535 => 15.2208, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.27% (1.5188 => 1.5533, std. dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 1.83% (4.6629 => 4.7483, std. dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 1.60% (0.6250 => 0.6350, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.50% (0.9108 => 0.9245, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.13% (1.0313 => 1.0430, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std. dev.: 0.0140) SingleSource/Benchmarks/Misc/mandel-2: 8.05% (1.2998 => 1.4044, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6750, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.40% (0.9996 => 1.0536, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 4.46% (7.4271 => 7.7584, std. dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7060, std. dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.57% (1.7688 => 1.8143, std. dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5089 => 1.5334, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 1.53% (1.9290 => 1.9585, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5947, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5111, std. dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.5928 => 4.6562, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1945, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9674, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.16% (1.0310 => 1.0430, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.07% (3.1071 => 3.1404, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 1.03% (10.7476 => 10.8578, std. dev.: 0.0184) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -10.69% (0.4657 => 0.4159, std. dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.56% (22.5627 => 21.0820, std. dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.69% (0.2670 => 0.2518, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3511 => 0.3411, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.95% (0.0997 => 0.0838, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.94% (1.2308 => 1.1084, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.52% (20.3410 => 18.4052, std. dev.: 0.1197) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2654, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.18% (0.3139 => 0.2945, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std. dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (8.8259 => 8.5633, std. dev.: 0.0179) MultiSource/Benchmarks/Olden/bh/bh: -2.92% (1.9762 => 1.9184, std. dev.: 0.0061) MultiSource/Applications/spiff/spiff: -2.69% (3.0263 => 2.9449, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2277, std. dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: -2.00% (0.5449 => 0.5340, std. dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0069) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7687, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0047, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.3305 => 7.2361, std. dev.: 0.0104) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8711, std. dev.: 0.0056) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2272, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.08% (3.8887 => 3.8467, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/71117839/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 18:53:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 18:53:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120801235349.768723524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2571?compare_to=2568&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2571, Order: 161135, Start Time: 2012-08-01 22:35:53, End Time: 2012-08-01 23:54:19 To: 2568, Order: 161124, Start Time: 2012-08-01 20:49:13, End Time: 2012-08-01 22:07:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 3 (37 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (749 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.04% (10.9214 => 11.0348, std. dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.98% (19.8935 => 19.4987, std. dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.28% (2.4051 => 2.3743, std. dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (14.0284 => 13.8494, std. dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.59% (10.3673 => 13.8494, std. dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 13.88% (0.3473 => 0.3955, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.74% (0.3516 => 0.3999, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.72% (0.3543 => 0.4029, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3497 => 0.3971, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.52% (0.3543 => 0.4022, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.48% (0.3561 => 0.4041, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.18% (0.3694 => 0.4181, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.88% (0.3828 => 0.4321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.50% (1.1194 => 1.2481, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.81% (2.2022 => 2.3743, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.72% (1.7609 => 1.8969, std. dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 7.68% (0.1432 => 0.1542, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5925 => 0.6337, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.90% (0.6030 => 0.6446, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (0.1622 => 0.1730, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 6.05% (0.7326 => 0.7769, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std. dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (10.4361 => 11.0348, std. dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (7.0540 => 7.3838, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/oourafft: 4.66% (0.3282 => 0.3435, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 4.48% (0.7433 => 0.7766, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 4.42% (0.2554 => 0.2667, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.39% (0.8172 => 0.8531, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 4.26% (9.4845 => 9.8883, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.10% (4.9449 => 5.1474, std. dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.0018 => 5.2054, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.91% (0.3121 => 0.3243, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.80% (4.2646 => 4.4268, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/18-imp/imp: 3.77% (0.3423 => 0.3552, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 3.74% (0.3180 => 0.3299, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.64% (0.7835 => 0.8120, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.2758 => 0.2858, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.58% (8.1363 => 8.4277, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.37% (1.1861 => 1.2261, std. dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.08% (0.4636 => 0.4779, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4299 => 0.4429, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.3050 => 1.3438, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.90% (0.4103 => 0.4222, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (14.3668 => 14.7809, std. dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.84% (5.7591 => 5.9229, std. dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.84% (1.5603 => 1.6046, std. dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.79% (2.0273 => 2.0838, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.78% (0.8067 => 0.8291, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.64% (3.3354 => 3.4235, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.59% (1.5415 => 1.5814, std. dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.59% (0.5105 => 0.5237, std. dev.: 0.0010) MultiSource/Applications/lua/lua: 2.56% (3.8723 => 3.9714, std. dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash: 2.52% (0.4289 => 0.4397, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.37% (0.9765 => 0.9996, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (2.0665 => 2.1153, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 2.29% (0.6456 => 0.6604, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.26% (2.2024 => 2.2521, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.25% (1.5859 => 1.6216, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.11% (0.6675 => 0.6816, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.11% (1.4186 => 1.4485, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6450 => 0.6585, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.04% (0.5981 => 0.6103, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.85% (0.8921 => 0.9086, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.77% (1.2842 => 1.3069, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.75% (2.2969 => 2.3370, std. dev.: 0.0089) MultiSource/Applications/minisat/minisat: 1.49% (0.7115 => 0.7221, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.48% (17.1811 => 17.4346, std. dev.: 0.0127) MultiSource/Benchmarks/nbench/nbench: 1.37% (1.1840 => 1.2002, std. dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.01% (1.0722 => 1.0830, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.30% (4.2280 => 4.4098, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.92% (3.6395 => 3.7458, std. dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2125, std. dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8324, std. dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2512, std. dev.: 0.0295) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.45% (1.5086 => 1.5305, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.38% (3.1595 => 3.2032, std. dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.46% (5.2763 => 3.1416, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7073, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7036, std. dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -15.04% (54.1659 => 46.0211, std. dev.: 0.0286) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.53% (2.9384 => 2.5407, std. dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -12.07% (22.1758 => 19.4987, std. dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.06% (1.2373 => 1.1004, std. dev.: 0.0081) SingleSource/Benchmarks/Misc/mandel-2: -8.42% (1.5373 => 1.4078, std. dev.: 0.0170) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5729, std. dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.15% (1.9577 => 1.8569, std. dev.: 0.0115) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4790, std. dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.12% (8.6802 => 8.4096, std. dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (8.1563 => 7.9029, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -2.77% (10.2830 => 9.9982, std. dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3315, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2012, std. dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.78% (12.5348 => 12.3112, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4181, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8085, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7061, std. dev.: 0.0013) MultiSource/Applications/siod/siod: -1.01% (3.2827 => 3.2497, std. dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/63268116/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 20:11:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 20:11:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802011119.103F23524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2572?compare_to=2570&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2572, Order: 161141, Start Time: 2012-08-01 23:58:07, End Time: 2012-08-02 01:11:47 To: 2570, Order: 161135, Start Time: 2012-08-01 22:16:24, End Time: 2012-08-01 23:30:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (140 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.87% (2.0176 => 2.3177, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.21% (0.5818 => 0.6412, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.11% (0.7061 => 0.7775, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.00% (0.5748 => 0.6323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3578 => 0.3925, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3601 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.49% (0.3623 => 0.3967, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.46% (0.3646 => 0.3991, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.42% (0.3650 => 0.3994, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.34% (0.3663 => 0.4005, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.26% (0.3789 => 0.4140, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3914 => 0.4276, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.11% (0.3940 => 0.4299, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.36% (0.1986 => 0.2152, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.12% (0.3130 => 0.3384, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2781 => 0.2983, std. dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.26% (1.3693 => 1.4687, std. dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.20% (0.7710 => 0.8265, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.4328 => 0.4639, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.97% (0.4062 => 0.4345, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2389, std. dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.83% (0.2782 => 0.2972, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.74% (0.2596 => 0.2771, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.65% (0.5265 => 0.5615, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2607 => 0.2774, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.36% (0.2690 => 0.2861, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.23% (0.3899 => 0.4142, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.23% (0.2761 => 0.2933, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.21% (0.2655 => 0.2820, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2628 => 0.2791, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.16% (0.2760 => 0.2930, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.11% (0.3485 => 0.3698, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.08% (0.2765 => 0.2933, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.07% (0.2966 => 0.3146, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.06% (0.3022 => 0.3205, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.05% (0.2726 => 0.2891, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.99% (1.9828 => 2.1015, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.2937 => 0.3112, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.93% (0.2696 => 0.2856, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.92% (0.3580 => 0.3792, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.90% (0.3489 => 0.3695, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.3107 => 0.3290, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.78% (0.3149 => 0.3331, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.6959 => 0.7359, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: 5.69% (0.2988 => 0.3158, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.66% (0.4379 => 0.4627, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.58% (0.4390 => 0.4635, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.48% (0.3192 => 0.3367, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.43% (1.2193 => 1.2855, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.42% (0.3453 => 0.3640, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.35% (0.3534 => 0.3723, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: 5.31% (0.3293 => 0.3468, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.25% (0.4016 => 0.4227, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.25% (16.6129 => 17.4846, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.19% (0.9199 => 0.9676, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.13% (13.8202 => 14.5288, std. dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.98% (0.3756 => 0.3943, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.89% (0.2127 => 0.2231, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.86% (0.3868 => 0.4056, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.2243 => 0.2352, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2945 => 0.3087, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.2925 => 0.3066, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0000) MultiSource/Applications/spiff/spiff: 4.69% (0.7506 => 0.7858, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.68% (1.4563 => 1.5244, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.67% (0.5637 => 0.5900, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (7.2180 => 7.5522, std. dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (1.1364 => 1.1875, std. dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 4.39% (1.2292 => 1.2832, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8656, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3246 => 0.3388, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.36% (1.1061 => 1.1543, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 4.29% (3.8646 => 4.0302, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.7460 => 0.7777, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.24% (1.9270 => 2.0088, std. dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0594 => 1.1039, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.19% (0.8310 => 0.8658, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.16% (1.3813 => 1.4387, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3245 => 1.3794, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.00% (1.3819 => 1.4372, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.97% (0.3755 => 0.3904, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (3.6692 => 3.8084, std. dev.: 0.0106) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.73% (4.4433 => 4.6091, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.69% (4.3801 => 4.5416, std. dev.: 0.0021) MultiSource/Applications/siod/siod: 3.66% (2.1791 => 2.2588, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 3.64% (0.2995 => 0.3104, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.39% (1.1333 => 1.1717, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.27% (4.9865 => 5.1496, std. dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.26% (0.4791 => 0.4947, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8698 => 0.8974, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.02% (0.6135 => 0.6320, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.99% (0.4113 => 0.4236, std. dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2799, std. dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.81% (8.4961 => 8.7351, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.80% (0.6283 => 0.6459, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.65% (2.1007 => 2.1563, std. dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: 2.63% (6.5754 => 6.7484, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 2.58% (14.5298 => 14.9048, std. dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 2.53% (16.2614 => 16.6735, std. dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.52% (3.2742 => 3.3566, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.8535 => 15.2137, std. dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.21% (1.5188 => 1.5524, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.15% (4.6629 => 4.7632, std. dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/bigfib: 1.82% (0.6250 => 0.6364, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (0.9108 => 0.9238, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.19% (1.0313 => 1.0436, std. dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.40% (5.7573 => 7.5074, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2633, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std. dev.: 0.0133) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.35% (0.9996 => 1.0531, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: 4.53% (7.4271 => 7.7634, std. dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7046, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.85% (1.9144 => 1.9881, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.78% (1.5089 => 1.5358, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5942, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5084, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.28% (4.5928 => 4.6517, std. dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0310 => 1.0438, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -13.16% (0.4657 => 0.4044, std. dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.49% (22.5627 => 21.0985, std. dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.51% (0.2670 => 0.2523, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3511 => 0.3397, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.25% (0.0997 => 0.0845, std. dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.79% (1.2308 => 1.0980, std. dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.04% (20.3410 => 18.5026, std. dev.: 0.0819) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.93% (1.9762 => 1.9183, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.67% (8.8259 => 8.5904, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.03% (6.3560 => 6.2268, std. dev.: 0.0099) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.94% (6.6320 => 6.5033, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (28.2225 => 27.7688, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -1.34% (7.3305 => 7.2323, std. dev.: 0.0339) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2468, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std. dev.: 0.0163) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.02% (5.5401 => 5.4834, std. dev.: 0.0151) MultiSource/Applications/lua/lua: -1.01% (26.5159 => 26.2485, std. dev.: 0.0139) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/5ce7dccb/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 20:35:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 20:35:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802013551.6C5E73524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2573?compare_to=2569&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2573, Order: 161135, Start Time: 2012-08-01 22:52:44, End Time: 2012-08-02 01:36:19 To: 2569, Order: 161124, Start Time: 2012-08-01 19:40:53, End Time: 2012-08-01 22:24:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (786 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.44% (2.0862 => 2.1163, std. dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.41% (0.3460 => 0.3924, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.39% (0.3496 => 0.3964, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.35% (0.3469 => 0.3932, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.30% (0.3488 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.96% (0.3643 => 0.4115, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.79% (0.3650 => 0.4117, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.51% (0.3724 => 0.4190, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1620 => 0.1740, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.38% (0.3792 => 0.4072, std. dev.: 0.0106) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5826 => 0.6251, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.11% (0.5889 => 0.6308, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.58% (1.6211 => 1.7116, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.50% (3.5627 => 3.7585, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 5.47% (0.7171 => 0.7563, std. dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 5.39% (1.5932 => 1.6791, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.01% (0.4994 => 0.5244, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.99% (0.5026 => 0.5277, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.98% (1.3152 => 1.3807, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.86% (0.4361 => 0.4573, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.81% (0.5900 => 0.6184, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (0.5000 => 0.5237, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.59% (0.4029 => 0.4214, std. dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.55% (0.3930 => 0.4109, std. dev.: 0.0004) MultiSource/Applications/d/make_dparser: 4.44% (1.0781 => 1.1260, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.40% (4.2109 => 4.3963, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.38% (0.2738 => 0.2858, std. dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (2.7292 => 2.8486, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.19% (0.2866 => 0.2986, std. dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 4.09% (0.3004 => 0.3127, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.93% (0.2875 => 0.2988, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.90% (0.9909 => 1.0295, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.83% (0.2792 => 0.2899, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2750 => 0.2854, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 3.71% (0.2725 => 0.2826, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.67% (1.9694 => 2.0417, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3195 => 0.3312, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.59% (2.0673 => 2.1415, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.58% (1.9966 => 2.0680, std. dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (0.3890 => 0.4024, std. dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.44% (2.1013 => 2.1736, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.43% (0.3124 => 0.3231, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.42% (0.3625 => 0.3749, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.41% (0.3258 => 0.3369, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3267 => 0.3377, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 3.36% (0.3096 => 0.3200, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.35% (0.3726 => 0.3851, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.33% (0.4658 => 0.4813, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.29% (0.3282 => 0.3390, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.27% (0.3060 => 0.3160, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.22% (5.5417 => 5.7204, std. dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (4.4195 => 4.5617, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.12% (0.3362 => 0.3467, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.11% (0.3317 => 0.3420, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 3.04% (0.9697 => 0.9992, std. dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.02% (0.4139 => 0.4264, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.02% (0.3477 => 0.3582, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 2.96% (0.3678 => 0.3787, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.3903 => 0.4018, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (1.8794 => 1.9347, std. dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.94% (0.3845 => 0.3958, std. dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (2.1653 => 2.2288, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.84% (0.3981 => 0.4094, std. dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.83% (4.6177 => 4.7482, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3690 => 0.3794, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4146 => 0.4260, std. dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.69% (0.7875 => 0.8087, std. dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 2.68% (23.5202 => 24.1504, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash2: 2.61% (0.4251 => 0.4362, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 2.52% (1.4269 => 1.4629, std. dev.: 0.0018) MultiSource/Applications/siod/siod: 2.34% (0.6634 => 0.6789, std. dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.16% (0.5546 => 0.5666, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.5012 => 0.5115, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.6435 => 0.6562, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 14.99% (2.5769 => 2.9632, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.16% (0.2122 => 0.2274, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6771, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 5.15% (1.8057 => 1.8987, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (105.3826 => 107.6318, std. dev.: 0.0624) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1959, std. dev.: 0.0619) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4584, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4930, std. dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5907, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.65% (2.0820 => 2.1163, std. dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std. dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.49% (2.4764 => 2.4148, std. dev.: 0.0215) MultiSource/Applications/kimwitu++/kc: -1.46% (11.9555 => 11.7812, std. dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5404, std. dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: -8.87% (17.2379 => 15.7087, std. dev.: 0.1802) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7885, std. dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.2402 => 0.2255, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -3.92% (0.4438 => 0.4264, std. dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7977, std. dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: -3.60% (14.0481 => 13.5421, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5682, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/11da768c/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 20:40:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 20:40:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802014011.6EC9A3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2574?compare_to=2571&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2574, Order: 161145, Start Time: 2012-08-02 00:22:21, End Time: 2012-08-02 01:40:40 To: 2571, Order: 161135, Start Time: 2012-08-01 22:35:53, End Time: 2012-08-01 23:54:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (92 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (745 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.47% (1.1004 => 1.1166, std. dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 34.24% (10.3673 => 13.9174, std. dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3473 => 0.3913, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.44% (0.3497 => 0.3932, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3516 => 0.3953, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.39% (0.3543 => 0.3982, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.30% (0.3561 => 0.3999, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.10% (0.3694 => 0.4141, std. dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.72% (1.1194 => 1.2506, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.33% (1.7609 => 1.9075, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.93% (2.2022 => 2.3769, std. dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: 7.89% (0.1432 => 0.1545, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.40% (0.1892 => 0.2032, std. dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 7.02% (0.5925 => 0.6341, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 6.97% (0.6030 => 0.6450, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.14% (0.7326 => 0.7776, std. dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std. dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.89% (10.4361 => 11.0512, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.4879 => 0.5150, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 5.09% (0.3282 => 0.3449, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.69% (7.0540 => 7.3848, std. dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 4.36% (0.7433 => 0.7757, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (9.4845 => 9.8861, std. dev.: 0.0106) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.22% (0.8172 => 0.8517, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.16% (4.9449 => 5.1508, std. dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1947, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.65% (0.3121 => 0.3235, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5569 => 0.5769, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.57% (4.2646 => 4.4167, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.5860 => 0.6064, std. dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.28% (0.3109 => 0.3211, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.28% (0.4636 => 0.4788, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.20% (8.1363 => 8.3970, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.20% (1.5603 => 1.6102, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.16% (0.3423 => 0.3531, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 3.14% (0.3180 => 0.3280, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.11% (0.7835 => 0.8079, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.08% (1.1861 => 1.2226, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.04% (0.3650 => 0.3761, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.00% (0.4103 => 0.4226, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.90% (5.7591 => 5.9261, std. dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.90% (1.3050 => 1.3428, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (2.0665 => 2.1259, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.80% (0.3826 => 0.3933, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.79% (1.1642 => 1.1967, std. dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 2.79% (0.4299 => 0.4419, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.77% (0.3865 => 0.3972, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7600, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.59% (0.5105 => 0.5237, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.57% (0.4203 => 0.4311, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6456 => 0.6621, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.53% (0.4064 => 0.4167, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.53% (3.3354 => 3.4197, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5803, std. dev.: 0.0000) MultiSource/Applications/treecc/treecc: 2.49% (2.0273 => 2.0777, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.45% (0.4620 => 0.4733, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.31% (0.8067 => 0.8253, std. dev.: 0.0012) MultiSource/Applications/lua/lua: 2.27% (3.8723 => 3.9601, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.14% (0.6675 => 0.6818, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.14% (0.9765 => 0.9974, std. dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 2.10% (1.2842 => 1.3112, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.5859 => 1.6190, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.07% (2.2024 => 2.2479, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 1.85% (0.8921 => 0.9086, std. dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.80% (0.6450 => 0.6566, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.76% (1.4186 => 1.4435, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.52% (0.7115 => 0.7223, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.46% (17.1811 => 17.4320, std. dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 1.43% (1.1840 => 1.2009, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.19% (2.2969 => 2.3243, std. dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.03% (2.6778 => 2.9732, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.85% (4.2280 => 4.3907, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.16% (3.6395 => 3.7545, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 1.76% (3.1578 => 3.2133, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.62% (11.6436 => 11.8324, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 1.52% (2.2771 => 2.3117, std. dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5086 => 1.5313, std. dev.: 0.0017) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2308, std. dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.13% (1.0313 => 1.0430, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1269, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.15% (5.2763 => 3.1578, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6950, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.99% (5.3526 => 3.6936, std. dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.97% (54.1659 => 46.0549, std. dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.47% (2.9384 => 2.5427, std. dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: -12.18% (22.1758 => 19.4745, std. dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.19% (1.6925 => 1.4185, std. dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std. dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1166, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -7.79% (1.5373 => 1.4176, std. dev.: 0.0179) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.10% (19.9488 => 18.5333, std. dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std. dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -4.84% (1.9577 => 1.8630, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (8.1563 => 7.8980, std. dev.: 0.0096) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4839, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.96% (8.6802 => 8.4230, std. dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.72% (1.3677 => 1.3305, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0058, std. dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2004, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.78% (12.5348 => 12.3114, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4181, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.33% (1.8329 => 1.8086, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/24ad942a/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 21:53:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 21:53:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802025329.3F8763524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2575?compare_to=2572&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2575, Order: 161152, Start Time: 2012-08-02 01:40:11, End Time: 2012-08-02 02:53:58 To: 2572, Order: 161141, Start Time: 2012-08-01 23:58:07, End Time: 2012-08-02 01:11:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (134 on baseline) Performance Improvements: 4 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 946 (727 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.11% (0.0845 => 0.0998, std. dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.38% (55.2453 => 56.5576, std. dev.: 0.0354) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.0980 => 1.1105, std. dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (27.7688 => 28.0656, std. dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.81% (0.7775 => 0.7634, std. dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -1.76% (0.6412 => 0.6299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.64% (0.6323 => 0.6219, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.20% (2.1015 => 2.0763, std. dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 13.91% (2.0176 => 2.2983, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.78% (0.3578 => 0.3892, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3601 => 0.3912, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.56% (0.3646 => 0.3958, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.49% (0.3663 => 0.3974, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 8.31% (0.3789 => 0.4104, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.28% (0.3914 => 0.4238, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.27% (0.5818 => 0.6299, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5748 => 0.6219, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.11% (0.7061 => 0.7634, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.76% (0.3130 => 0.3373, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.7710 => 0.8214, std. dev.: 0.0022) MultiSource/Applications/hbd/hbd: 6.52% (1.3693 => 1.4586, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.48% (3.9660 => 4.2230, std. dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.32% (0.2596 => 0.2760, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.27% (0.5265 => 0.5595, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.14% (0.2721 => 0.2888, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.7038 => 0.7456, std. dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 5.93% (0.2781 => 0.2946, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.85% (0.4328 => 0.4581, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.68% (0.2782 => 0.2940, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.62% (0.4379 => 0.4625, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.47% (0.2760 => 0.2911, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.34% (0.4062 => 0.4279, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 5.29% (0.2607 => 0.2745, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.24% (1.2193 => 1.2832, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/random: 5.20% (0.2690 => 0.2830, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.20% (0.6959 => 0.7321, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.18% (0.2628 => 0.2764, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2655 => 0.2791, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.10% (0.2765 => 0.2906, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.00% (0.3899 => 0.4094, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.00% (0.3022 => 0.3173, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.96% (0.3485 => 0.3658, std. dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.96% (0.2966 => 0.3113, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.93% (0.2696 => 0.2829, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.92% (0.9199 => 0.9652, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.91% (0.5577 => 0.5851, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 4.90% (0.2937 => 0.3081, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 4.84% (0.2726 => 0.2858, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.2988 => 0.3132, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 4.82% (0.2761 => 0.2894, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 4.78% (13.8202 => 14.4804, std. dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.72% (1.9828 => 2.0763, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.68% (0.2925 => 0.3062, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 4.67% (0.3149 => 0.3296, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.60% (0.3107 => 0.3250, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.59% (0.3489 => 0.3649, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.58% (1.4563 => 1.5230, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.5637 => 0.5891, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.46% (0.3453 => 0.3607, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.45% (0.3192 => 0.3334, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.38% (16.6129 => 17.3406, std. dev.: 0.0186) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.36% (0.2914 => 0.3041, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.35% (7.2180 => 7.5317, std. dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists1: 4.33% (0.3534 => 0.3687, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.24% (0.7506 => 0.7824, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.21% (1.1364 => 1.1842, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.21% (1.3813 => 1.4394, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.18% (0.4016 => 0.4184, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (13.2842 => 13.8342, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 4.13% (0.3293 => 0.3429, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.12% (0.4390 => 0.4571, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 4.12% (0.8310 => 0.8652, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.11% (1.3819 => 1.4387, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.01% (1.3245 => 1.3776, std. dev.: 0.0010) MultiSource/Applications/Burg/burg: 4.01% (1.1061 => 1.1504, std. dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.0594 => 1.1015, std. dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 3.96% (3.8646 => 4.0178, std. dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (0.7460 => 0.7748, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 3.81% (1.9270 => 2.0005, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 3.80% (0.3868 => 0.4015, std. dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.57% (3.6692 => 3.8003, std. dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.2945 => 0.3050, std. dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (4.4433 => 4.6012, std. dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (4.3801 => 4.5352, std. dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3220 => 0.3334, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 3.40% (1.2292 => 1.2710, std. dev.: 0.0008) MultiSource/Applications/siod/siod: 3.16% (2.1791 => 2.2480, std. dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.14% (1.1333 => 1.1689, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.03% (0.4791 => 0.4936, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.98% (0.3755 => 0.3867, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 2.89% (0.4113 => 0.4232, std. dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.77% (0.6135 => 0.6305, std. dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.68% (3.1889 => 3.2745, std. dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.60% (4.9865 => 5.1163, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.60% (8.4961 => 8.7172, std. dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.54% (0.8698 => 0.8919, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.53% (0.6283 => 0.6442, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.49% (3.2742 => 3.3556, std. dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (2.1007 => 2.1514, std. dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 2.40% (16.2614 => 16.6515, std. dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: 2.37% (6.5754 => 6.7311, std. dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.8535 => 15.2033, std. dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 2.29% (14.5298 => 14.8629, std. dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (1.5188 => 1.5485, std. dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.94% (4.6629 => 4.7535, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.38% (0.9108 => 0.9234, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2655, std. dev.: 0.0508) SingleSource/Benchmarks/Misc/mandel-2: 7.99% (1.2998 => 1.4037, std. dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.45% (0.9996 => 1.0541, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 4.51% (7.4271 => 7.7622, std. dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 4.23% (11.2619 => 11.7387, std. dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9876, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 2.97% (1.9199 => 1.9770, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.50% (1.5089 => 1.5315, std. dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1954, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.15% (1.0310 => 1.0429, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.81% (22.5627 => 21.0263, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.17% (0.2670 => 0.2532, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.77% (1.2308 => 1.1105, std. dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.82% (20.3410 => 18.5478, std. dev.: 0.0148) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std. dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.53% (0.4867 => 0.4695, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.37% (1.9762 => 1.9097, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.54% (8.8259 => 8.6016, std. dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2252, std. dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5055, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2206, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std. dev.: 0.0104) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4932, std. dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2495, std. dev.: 0.0045) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2234, std. dev.: 0.0051) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/806a404c/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 22:26:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 22:26:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802032659.BBEB43524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2576?compare_to=2574&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2576, Order: 161152, Start Time: 2012-08-02 02:08:46, End Time: 2012-08-02 03:27:28 To: 2574, Order: 161145, Start Time: 2012-08-02 00:22:21, End Time: 2012-08-02 01:40:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (82 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 930 (756 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.18% (0.0850 => 0.0996, std. dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.63% (54.8936 => 56.3354, std. dev.: 0.1636) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.46% (79.0564 => 80.2125, std. dev.: 0.2491) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.16% (2.1259 => 2.1013, std. dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 32.99% (10.3673 => 13.7876, std. dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 12.53% (0.3473 => 0.3908, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.07% (1.1194 => 1.2545, std. dev.: 0.0062) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.62% (0.3828 => 0.4273, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std. dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.61% (2.2022 => 2.3917, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.18% (1.7609 => 1.9049, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std. dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 6.44% (10.4361 => 11.1080, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.70% (0.5925 => 0.6263, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.61% (0.6030 => 0.6368, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.30% (0.3282 => 0.3456, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 5.26% (0.7326 => 0.7711, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.18% (0.4615 => 0.4854, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (7.0540 => 7.4179, std. dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (9.4845 => 9.9200, std. dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.34% (4.9449 => 5.1594, std. dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 4.19% (0.2554 => 0.2661, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (5.0018 => 5.2106, std. dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.04% (0.8172 => 0.8502, std. dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 4.01% (0.7433 => 0.7731, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.89% (4.2646 => 4.4306, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.81% (0.3121 => 0.3240, std. dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 3.73% (0.3109 => 0.3225, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.2758 => 0.2859, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.60% (8.1363 => 8.4288, std. dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.52% (0.5860 => 0.6066, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3423 => 0.3539, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.36% (0.3180 => 0.3287, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.36% (1.1861 => 1.2260, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.32% (0.7835 => 0.8095, std. dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.3050 => 1.3461, std. dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 3.12% (0.4299 => 0.4433, std. dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.06% (14.3668 => 14.8064, std. dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 2.99% (5.7591 => 5.9312, std. dev.: 0.0167) MultiSource/Benchmarks/sim/sim: 2.98% (0.3387 => 0.3488, std. dev.: 0.0002) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4275, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.75% (1.1642 => 1.1962, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.8067 => 0.8278, std. dev.: 0.0014) MultiSource/Applications/treecc/treecc: 2.61% (2.0273 => 2.0802, std. dev.: 0.0005) MultiSource/Applications/hbd/hbd: 2.60% (1.5603 => 1.6009, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (1.5415 => 1.5811, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.55% (0.4636 => 0.4754, std. dev.: 0.0011) MultiSource/Applications/lua/lua: 2.47% (3.8723 => 3.9679, std. dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.47% (0.5105 => 0.5231, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9765 => 0.9987, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.24% (1.5859 => 1.6214, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (0.6675 => 0.6820, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.17% (0.6450 => 0.6590, std. dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 2.06% (17.1811 => 17.5350, std. dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2471, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.02% (0.5981 => 0.6102, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4469, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8921 => 0.9095, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 1.78% (0.6456 => 0.6571, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.68% (2.0665 => 2.1013, std. dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.50% (1.1840 => 1.2018, std. dev.: 0.0062) MultiSource/Applications/minisat/minisat: 1.42% (0.7115 => 0.7216, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.31% (1.2842 => 1.3010, std. dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.02% (1.0722 => 1.0831, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.13% (4.2280 => 4.4028, std. dev.: 0.0079) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (3.6395 => 3.7468, std. dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.1578 => 3.2149, std. dev.: 0.0004) MultiSource/Applications/aha/aha: 1.42% (3.1595 => 3.2045, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2221, std. dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.06% (5.2763 => 3.1625, std. dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7169, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7142, std. dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.94% (54.1659 => 46.0761, std. dev.: 0.0958) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -12.82% (2.9384 => 2.5617, std. dev.: 0.0196) MultiSource/Applications/ClamAV/clamscan: -12.02% (22.1758 => 19.5106, std. dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std. dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -10.45% (1.2373 => 1.1080, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -7.95% (1.5373 => 1.4151, std. dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.83% (19.9488 => 18.5853, std. dev.: 0.0686) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -4.72% (1.9577 => 1.8652, std. dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5956, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.20% (8.1563 => 7.8955, std. dev.: 0.0089) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4882, std. dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (8.6802 => 8.4222, std. dev.: 0.0093) SingleSource/Benchmarks/Misc/salsa20: -2.74% (10.2830 => 10.0012, std. dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2014, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3177, std. dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4176, std. dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8088, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.12% (1.7254 => 1.7060, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/c1da0807/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 23:35:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 23:35:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802043525.50F033524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2577?compare_to=2575&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2577, Order: 161154, Start Time: 2012-08-02 03:22:01, End Time: 2012-08-02 04:35:54 To: 2575, Order: 161152, Start Time: 2012-08-02 01:40:11, End Time: 2012-08-02 02:53:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (137 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (724 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.66% (2.0176 => 2.3134, std. dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.5818 => 0.6313, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.50% (0.3578 => 0.3882, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5748 => 0.6228, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.31% (0.3646 => 0.3949, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.28% (0.3601 => 0.3899, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7061 => 0.7639, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.15% (0.3914 => 0.4233, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1986 => 0.2140, std. dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.78% (1.3693 => 1.4621, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.64% (3.9660 => 4.2293, std. dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.53% (0.5265 => 0.5609, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2721 => 0.2897, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.42% (0.7710 => 0.8205, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4328 => 0.4604, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.26% (0.2781 => 0.2955, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.20% (0.4062 => 0.4314, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.18% (0.2782 => 0.2954, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.08% (0.7038 => 0.7466, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.99% (0.2690 => 0.2851, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2655 => 0.2812, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.72% (0.2607 => 0.2756, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.52% (0.6959 => 0.7343, std. dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (0.4379 => 0.4620, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.48% (0.2937 => 0.3098, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.43% (0.3022 => 0.3186, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.41% (1.2193 => 1.2853, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.40% (0.2761 => 0.2910, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.36% (0.3899 => 0.4108, std. dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3485 => 0.3671, std. dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/except: 5.33% (0.2760 => 0.2907, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.25% (1.9828 => 2.0868, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.3107 => 0.3268, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.14% (0.3149 => 0.3311, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.13% (0.5577 => 0.5863, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.10% (0.3489 => 0.3667, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.9199 => 0.9664, std. dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 5.03% (13.8202 => 14.5152, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.2988 => 0.3136, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 4.92% (0.3192 => 0.3349, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.78% (0.3453 => 0.3618, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.2914 => 0.3051, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 4.65% (16.6129 => 17.3860, std. dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/lists: 4.65% (0.3293 => 0.3446, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 4.64% (0.3534 => 0.3698, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.4390 => 0.4591, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.56% (0.4016 => 0.4199, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.55% (7.2180 => 7.5467, std. dev.: 0.0079) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.42% (0.5637 => 0.5886, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.39% (1.4563 => 1.5202, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8656, std. dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 4.32% (0.8310 => 0.8669, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.30% (0.7506 => 0.7829, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.24% (1.1364 => 1.1846, std. dev.: 0.0005) MultiSource/Applications/Burg/burg: 4.20% (1.1061 => 1.1526, std. dev.: 0.0115) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.19% (1.3813 => 1.4392, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.18% (1.0594 => 1.1037, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 4.14% (0.2945 => 0.3067, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.09% (1.3819 => 1.4384, std. dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (1.3245 => 1.3786, std. dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 4.04% (3.8646 => 4.0206, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.01% (0.7460 => 0.7759, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.00% (1.9270 => 2.0040, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.91% (0.2995 => 0.3112, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.79% (3.6692 => 3.8082, std. dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 3.77% (1.2292 => 1.2755, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (4.4433 => 4.6082, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.3801 => 4.5368, std. dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.36% (0.4791 => 0.4952, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.36% (0.3755 => 0.3881, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.28% (2.1791 => 2.2506, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.25% (1.1333 => 1.1701, std. dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.00% (4.9865 => 5.1361, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.98% (0.6283 => 0.6470, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.87% (0.6135 => 0.6311, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8698 => 0.8944, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.75% (8.4961 => 8.7300, std. dev.: 0.0041) MultiSource/Applications/d/make_dparser: 2.74% (3.1889 => 3.2763, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (6.5754 => 6.7440, std. dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: 2.46% (14.8535 => 15.2193, std. dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (2.1007 => 2.1523, std. dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 2.44% (16.2614 => 16.6586, std. dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.36% (3.2742 => 3.3514, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.35% (14.5298 => 14.8713, std. dev.: 0.0194) MultiSource/Applications/oggenc/oggenc: 2.10% (4.6629 => 4.7610, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.05% (1.5188 => 1.5499, std. dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.61% (0.9108 => 0.9255, std. dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.08% (1.0313 => 1.0424, std. dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.39% (5.7573 => 7.5070, std. dev.: 0.0089) SingleSource/Benchmarks/Misc/fbench: 24.66% (1.8175 => 2.2657, std. dev.: 0.0335) SingleSource/Benchmarks/Misc/mandel-2: 8.18% (1.2998 => 1.4061, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6751, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.07% (0.9996 => 1.0503, std. dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: 4.54% (7.4271 => 7.7640, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.23% (11.2619 => 11.7388, std. dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.84% (1.9144 => 1.9880, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.81% (1.9199 => 1.9738, std. dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.67% (1.7688 => 1.8161, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (0.9692 => 0.9912, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.78% (0.8273 => 0.8420, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.66% (1.5089 => 1.5339, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5948, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5099, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.19% (1.0310 => 1.0433, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.53% (22.5627 => 21.0892, std. dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.81% (1.2308 => 1.1101, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.91% (20.3410 => 18.5290, std. dev.: 0.0399) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.04% (1.3780 => 1.3223, std. dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.45% (0.4867 => 0.4699, std. dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.30% (1.9762 => 1.9110, std. dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.80% (8.8259 => 8.5792, std. dev.: 0.0029) MultiSource/Applications/spiff/spiff: -2.57% (3.0263 => 2.9485, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.28% (0.6589 => 0.6439, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.6320 => 6.5050, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2382, std. dev.: 0.0175) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0049, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std. dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3305 => 7.2243, std. dev.: 0.0202) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2217, std. dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std. dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/076bfdee/attachment-0001.html From llvm-testresults at cs.uiuc.edu Wed Aug 1 23:47:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 1 Aug 2012 23:47:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802044727.ED0D33524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2578?compare_to=2573&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2578, Order: 161152, Start Time: 2012-08-02 02:04:35, End Time: 2012-08-02 04:47:57 To: 2573, Order: 161135, Start Time: 2012-08-01 22:52:44, End Time: 2012-08-02 01:36:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (68 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (815 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.03% (0.3446 => 0.3895, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.99% (0.3465 => 0.3915, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.99% (0.3496 => 0.3950, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.89% (0.3460 => 0.3906, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3488 => 0.3936, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3442 => 0.3884, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.83% (0.3469 => 0.3914, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.46% (0.3643 => 0.4097, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.33% (0.3650 => 0.4100, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.03% (0.3724 => 0.4172, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std. dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 6.44% (0.5826 => 0.6201, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 6.33% (0.5889 => 0.6262, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.52% (3.5627 => 3.7595, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.46% (1.6211 => 1.7096, std. dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 5.44% (1.5932 => 1.6798, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.88% (0.4361 => 0.4574, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.86% (1.3152 => 1.3791, std. dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 4.84% (0.7171 => 0.7518, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.81% (0.4994 => 0.5234, std. dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.78% (0.5900 => 0.6182, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.76% (0.5026 => 0.5265, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.66% (0.5000 => 0.5233, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.53% (0.3930 => 0.4108, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.47% (0.4029 => 0.4209, std. dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 4.22% (4.2109 => 4.3888, std. dev.: 0.0115) MultiSource/Applications/d/make_dparser: 4.22% (1.0781 => 1.1236, std. dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.01% (0.2866 => 0.2981, std. dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (2.7292 => 2.8386, std. dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.76% (0.2736 => 0.2839, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (1.9694 => 2.0391, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (1.9966 => 2.0662, std. dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (0.3890 => 0.4020, std. dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (2.1013 => 2.1703, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.13% (5.5417 => 5.7149, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (4.4195 => 4.5574, std. dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 3.02% (2.1653 => 2.2307, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.00% (0.3903 => 0.4020, std. dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.99% (4.6177 => 4.7558, std. dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 2.95% (0.9909 => 1.0201, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.85% (0.4139 => 0.4257, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.75% (2.0673 => 2.1241, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 2.56% (1.8794 => 1.9275, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 2.53% (0.4146 => 0.4251, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.48% (0.7875 => 0.8070, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.43% (23.5202 => 24.0906, std. dev.: 0.0061) MultiSource/Applications/lua/lua: 2.37% (1.4269 => 1.4607, std. dev.: 0.0013) MultiSource/Applications/hbd/hbd: 2.25% (0.9697 => 0.9915, std. dev.: 0.0004) MultiSource/Applications/Burg/burg: 2.18% (0.5546 => 0.5667, std. dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9637, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.16% (0.2122 => 0.2274, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6674, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8919, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6723, std. dev.: 0.0461) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1943, std. dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4911, std. dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5906, std. dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2269, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std. dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.78% (11.9555 => 11.7425, std. dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.07% (25.4195 => 16.5046, std. dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/ary2: -9.70% (0.2402 => 0.2169, std. dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -8.51% (17.2379 => 15.7716, std. dev.: 0.1047) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8004, std. dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/moments: -3.97% (0.4438 => 0.4262, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7929, std. dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -3.52% (14.0481 => 13.5536, std. dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std. dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120801/dfbd1c16/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 00:13:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 00:13:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802051331.2B3B03524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2579?compare_to=2576&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2579, Order: 161154, Start Time: 2012-08-02 03:55:41, End Time: 2012-08-02 05:14:01 To: 2576, Order: 161152, Start Time: 2012-08-02 02:08:46, End Time: 2012-08-02 03:27:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (83 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (755 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.84% (13.7876 => 13.5339, std. dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.54% (10.3673 => 13.5339, std. dev.: 0.0078) SingleSource/UnitTests/ObjC/trivial-interface: 12.76% (0.3473 => 0.3916, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.50% (0.3497 => 0.3934, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.39% (0.3543 => 0.3982, std. dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2530, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std. dev.: 0.0055) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.22% (1.7609 => 1.9056, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (2.2022 => 2.3734, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.75% (0.3817 => 0.4113, std. dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: 7.05% (0.1432 => 0.1533, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.19% (0.5925 => 0.6292, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 6.15% (0.6030 => 0.6401, std. dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.72% (0.7326 => 0.7745, std. dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (10.4361 => 11.0047, std. dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.96% (0.4615 => 0.4844, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.88% (0.4879 => 0.5117, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3828, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 4.48% (0.3282 => 0.3429, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.25% (0.8172 => 0.8519, std. dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (9.4845 => 9.8786, std. dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.01% (4.9449 => 5.1430, std. dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 3.94% (0.7433 => 0.7726, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.86% (5.0018 => 5.1950, std. dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5569 => 0.5782, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (4.2646 => 4.4139, std. dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3121 => 0.3229, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.45% (0.5860 => 0.6062, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 3.44% (0.3109 => 0.3216, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4084, std. dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3423 => 0.3535, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.27% (0.7835 => 0.8091, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.14% (1.1642 => 1.2007, std. dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.11% (0.4636 => 0.4780, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.10% (1.1861 => 1.2229, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.05% (0.4103 => 0.4228, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.02% (5.7591 => 5.9333, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.3050 => 1.3424, std. dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 2.86% (0.4299 => 0.4422, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7602, std. dev.: 0.0133) MultiSource/Applications/d/make_dparser: 2.51% (3.3354 => 3.4190, std. dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash: 2.45% (0.4289 => 0.4394, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.42% (2.0273 => 2.0764, std. dev.: 0.0103) MultiSource/Applications/hbd/hbd: 2.40% (1.5603 => 1.5978, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.40% (1.5415 => 1.5785, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.35% (2.0665 => 2.1150, std. dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.5105 => 0.5222, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9609, std. dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.27% (0.9765 => 0.9987, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.20% (0.6456 => 0.6598, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.19% (0.8067 => 0.8244, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (1.5859 => 1.6174, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.96% (0.6675 => 0.6806, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6450 => 0.6573, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.90% (2.2024 => 2.2443, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.84% (1.2842 => 1.3078, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.4186 => 1.4433, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8921 => 0.9073, std. dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.63% (17.1811 => 17.4604, std. dev.: 0.0189) MultiSource/Benchmarks/nbench/nbench: 1.25% (1.1840 => 1.1988, std. dev.: 0.0006) MultiSource/Applications/siod/siod: 1.20% (2.2969 => 2.3245, std. dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9738, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.21% (4.2280 => 4.4061, std. dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.27% (3.6395 => 3.7586, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 1.72% (3.1578 => 3.2122, std. dev.: 0.0011) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.24% (9.1159 => 9.2290, std. dev.: 0.0191) SingleSource/Benchmarks/Misc/fbench: 1.13% (2.2771 => 2.3029, std. dev.: 0.0054) MultiSource/Applications/lua/lua: 1.10% (26.0924 => 26.3797, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1266, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.15% (5.2763 => 3.1581, std. dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7017, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7005, std. dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.99% (54.1659 => 46.0448, std. dev.: 0.0299) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.40% (2.9384 => 2.5446, std. dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -12.26% (22.1758 => 19.4581, std. dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std. dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2373 => 1.1072, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -7.84% (1.5373 => 1.4168, std. dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.06% (19.9488 => 18.5395, std. dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5033, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.91% (1.9577 => 1.8616, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4887, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9086, std. dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.84% (8.6802 => 8.4333, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0026, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2012, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -1.69% (12.5348 => 12.3227, std. dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4173, std. dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.26% (1.8329 => 1.8098, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/46f0ba3b/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 03:02:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 03:02:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802080254.6099B3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2580?compare_to=2578&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2580, Order: 161154, Start Time: 2012-08-02 05:16:05, End Time: 2012-08-02 08:03:24 To: 2578, Order: 161152, Start Time: 2012-08-02 02:04:35, End Time: 2012-08-02 04:47:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (10 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (813 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.60% (0.3460 => 0.3896, std. dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 12.42% (0.3446 => 0.3874, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-4: 12.38% (0.3465 => 0.3894, std. dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0047) SingleSource/UnitTests/ObjC/synchronized: 12.28% (0.3469 => 0.3895, std. dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: 12.27% (0.3496 => 0.3925, std. dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.18% (0.3488 => 0.3913, std. dev.: 0.0082) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3643 => 0.4078, std. dev.: 0.0070) SingleSource/UnitTests/ObjC/property: 11.84% (0.3650 => 0.4082, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/parameter-passing: 11.63% (0.3724 => 0.4157, std. dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.1620 => 0.1733, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.20% (0.5826 => 0.6187, std. dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 6.09% (1.5932 => 1.6903, std. dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 5.93% (0.5889 => 0.6238, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.55% (3.5627 => 3.7603, std. dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.45% (1.6211 => 1.7095, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.37% (0.4994 => 0.5262, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.33% (0.5026 => 0.5294, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.32% (0.4361 => 0.4593, std. dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.29% (0.5900 => 0.6212, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.12% (0.5000 => 0.5256, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.07% (1.3152 => 1.3819, std. dev.: 0.0024) MultiSource/Applications/spiff/spiff: 4.79% (0.4029 => 0.4222, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.68% (0.3930 => 0.4114, std. dev.: 0.0030) MultiSource/Applications/d/make_dparser: 4.38% (1.0781 => 1.1253, std. dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.36% (2.7292 => 2.8481, std. dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 4.22% (4.2109 => 4.3885, std. dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.2736 => 0.2848, std. dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.62% (5.5417 => 5.7423, std. dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.61% (1.9966 => 2.0686, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.54% (1.9694 => 2.0392, std. dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 3.38% (2.1653 => 2.2384, std. dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.35% (0.9909 => 1.0241, std. dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.34% (0.3890 => 0.4020, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (0.4658 => 0.4811, std. dev.: 0.0009) MultiSource/Applications/siod/siod: 3.26% (0.6634 => 0.6850, std. dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 3.12% (4.6177 => 4.7616, std. dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.4139 => 0.4266, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.06% (0.3362 => 0.3465, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (2.0673 => 2.1305, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.02% (0.3903 => 0.4021, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (4.4195 => 4.5511, std. dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (1.8794 => 1.9344, std. dev.: 0.0008) MultiSource/Applications/lua/lua: 2.55% (1.4269 => 1.4633, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4146 => 0.4250, std. dev.: 0.0027) MultiSource/Applications/treecc/treecc: 2.49% (0.7875 => 0.8071, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4251 => 0.4354, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.18% (0.5546 => 0.5667, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.11% (0.9697 => 0.9902, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.5012 => 0.5112, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.6435 => 0.6549, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.06% (2.0346 => 2.0562, std. dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.12% (0.0734 => 0.0845, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9640, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.27% (12.0509 => 12.6854, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2122 => 0.2231, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8935, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1643, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.16% (105.3826 => 107.6570, std. dev.: 0.0296) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2139, std. dev.: 0.0507) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4951, std. dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2281, std. dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5908, std. dev.: 0.0339) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.46% (11.9555 => 11.7810, std. dev.: 0.0590) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.14% (25.4195 => 16.4876, std. dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary2: -9.58% (0.2402 => 0.2172, std. dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7949, std. dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/fldry: -6.93% (17.2379 => 16.0433, std. dev.: 0.2805) SingleSource/Benchmarks/Shootout-C++/moments: -4.06% (0.4438 => 0.4258, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -3.46% (14.0481 => 13.5626, std. dev.: 0.1461) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std. dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/5923f808/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 03:26:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 03:26:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802082609.4A9F23524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2581?compare_to=2577&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2581, Order: 161155, Start Time: 2012-08-02 07:12:45, End Time: 2012-08-02 08:26:38 To: 2577, Order: 161154, Start Time: 2012-08-02 03:22:01, End Time: 2012-08-02 04:35:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (141 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (720 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.76% (54.8722 => 56.3879, std. dev.: 0.1244) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.72% (2.0176 => 2.3145, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 8.47% (0.3578 => 0.3881, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.5818 => 0.6308, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.37% (0.3646 => 0.3951, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 8.33% (0.3601 => 0.3901, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.23% (0.5748 => 0.6221, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.14% (0.3623 => 0.3918, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.11% (0.3663 => 0.3960, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.80% (0.3130 => 0.3374, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.74% (0.3940 => 0.4245, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.53% (0.7061 => 0.7593, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.7710 => 0.8233, std. dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.67% (1.3693 => 1.4607, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (3.9660 => 4.2260, std. dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.2721 => 0.2899, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5265 => 0.5607, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (0.4328 => 0.4609, std. dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.47% (0.2596 => 0.2764, std. dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 6.18% (0.7038 => 0.7473, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.01% (0.2781 => 0.2948, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: 5.90% (0.2628 => 0.2783, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.71% (0.4062 => 0.4294, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 5.69% (0.2690 => 0.2843, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.55% (0.2937 => 0.3100, std. dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.55% (0.4379 => 0.4622, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.2140 => 0.2258, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.43% (0.2760 => 0.2910, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.42% (0.2765 => 0.2915, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.2966 => 0.3126, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.39% (0.6959 => 0.7334, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.36% (0.2761 => 0.2909, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 5.34% (0.3107 => 0.3273, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.31% (0.3899 => 0.4106, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.31% (0.3485 => 0.3670, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.30% (1.2193 => 1.2839, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.27% (0.2696 => 0.2838, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.25% (0.2726 => 0.2869, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.22% (1.9828 => 2.0864, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.20% (0.3580 => 0.3766, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.16% (0.3489 => 0.3669, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.11% (0.3149 => 0.3310, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.06% (0.5577 => 0.5859, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.03% (0.9199 => 0.9662, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.03% (13.8202 => 14.5147, std. dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.89% (0.3192 => 0.3348, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.89% (0.2988 => 0.3134, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 4.70% (0.3534 => 0.3700, std. dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.64% (16.6129 => 17.3830, std. dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.61% (7.2180 => 7.5508, std. dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.2914 => 0.3046, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.3293 => 0.3442, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.51% (0.4390 => 0.4588, std. dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.3756 => 0.3923, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.36% (0.5637 => 0.5883, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.36% (13.2842 => 13.8634, std. dev.: 0.0147) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.35% (1.4563 => 1.5197, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 4.34% (0.3868 => 0.4036, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.29% (1.1364 => 1.1851, std. dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.26% (0.7506 => 0.7826, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.26% (1.1061 => 1.1532, std. dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 4.25% (0.8310 => 0.8663, std. dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.24% (1.3813 => 1.4398, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.19% (0.3246 => 0.3382, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.04% (1.3819 => 1.4377, std. dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.03% (1.0594 => 1.1021, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.02% (1.3245 => 1.3778, std. dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.01% (1.9270 => 2.0043, std. dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 4.01% (0.2945 => 0.3063, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 3.97% (3.8646 => 4.0181, std. dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.86% (0.7460 => 0.7748, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.81% (3.6692 => 3.8090, std. dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.80% (1.2292 => 1.2759, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 3.76% (0.3220 => 0.3341, std. dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.55% (4.4433 => 4.6010, std. dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (4.3801 => 4.5303, std. dev.: 0.0029) MultiSource/Applications/siod/siod: 3.37% (2.1791 => 2.2525, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.33% (0.3755 => 0.3880, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.24% (0.4791 => 0.4946, std. dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1333 => 1.1695, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.96% (4.9865 => 5.1343, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.88% (0.6283 => 0.6464, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8698 => 0.8944, std. dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 2.80% (0.4113 => 0.4228, std. dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.74% (8.4961 => 8.7285, std. dev.: 0.0115) MultiSource/Applications/d/make_dparser: 2.72% (3.1889 => 3.2756, std. dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.66% (0.6135 => 0.6298, std. dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.5754 => 6.7495, std. dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6545, std. dev.: 0.0201) MultiSource/Applications/JM/lencod/lencod: 2.41% (14.8535 => 15.2111, std. dev.: 0.0236) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.5298 => 14.8735, std. dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.36% (3.2742 => 3.3515, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.31% (2.1007 => 2.1493, std. dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.15% (4.6629 => 4.7632, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.03% (1.5188 => 1.5496, std. dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.9108 => 0.9252, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.07% (1.0313 => 1.0423, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.36% (5.7573 => 7.5053, std. dev.: 0.0085) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: 7.70% (1.2998 => 1.3999, std. dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-4: 6.52% (1.0640 => 1.1334, std. dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6755, std. dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.18% (0.9996 => 1.0514, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 4.32% (7.4271 => 7.7479, std. dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 4.26% (11.2619 => 11.7415, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9878, std. dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.54% (1.7688 => 1.8138, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.26% (0.9692 => 0.9911, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.60% (1.5089 => 1.5330, std. dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 1.49% (1.9290 => 1.9578, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5097, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.33% (9.0760 => 9.1964, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std. dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (1.9433 => 1.9659, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.15% (1.0310 => 1.0429, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std. dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.5627 => 21.0713, std. dev.: 0.0233) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.28% (1.2308 => 1.1043, std. dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.18% (20.3410 => 18.4735, std. dev.: 0.0262) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.24% (0.3139 => 0.2943, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std. dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3141, std. dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.62% (0.4867 => 0.4691, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -3.43% (1.9762 => 1.9085, std. dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (8.8259 => 8.5806, std. dev.: 0.0218) MultiSource/Applications/spiff/spiff: -2.58% (3.0263 => 2.9483, std. dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2249, std. dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5092, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0053, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3305 => 7.2229, std. dev.: 0.0079) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2545, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.11% (3.8887 => 3.8455, std. dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/37f19af7/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 03:31:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 03:31:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802083100.2A09F3524039@llvm.org> http://llvm.org/perf/db_default/v4/nts/2582?compare_to=2579&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2582, Order: 161155, Start Time: 2012-08-02 07:12:42, End Time: 2012-08-02 08:31:30 To: 2579, Order: 161154, Start Time: 2012-08-02 03:55:41, End Time: 2012-08-02 05:14:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (80 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.86% (3.7533 => 3.8981, std. dev.: 0.0146) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.10% (1.3168 => 1.3313, std. dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.51% (10.3673 => 13.5308, std. dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.32% (0.3497 => 0.3928, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.28% (0.3543 => 0.3978, std. dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.24% (0.3561 => 0.3997, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.15% (0.3694 => 0.4143, std. dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.11% (0.0834 => 0.0935, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.92% (1.1194 => 1.2528, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.27% (1.7609 => 1.9066, std. dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.76% (2.2022 => 2.3732, std. dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 7.12% (0.1432 => 0.1534, std. dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.59% (0.2065 => 0.2201, std. dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.55% (0.1892 => 0.2016, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.31% (0.5925 => 0.6299, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.19% (0.6030 => 0.6403, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 5.43% (10.4361 => 11.0031, std. dev.: 0.0190) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3121 => 0.3280, std. dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.94% (0.4879 => 0.5120, std. dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.90% (0.4615 => 0.4841, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.88% (7.0540 => 7.3985, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/oourafft: 4.45% (0.3282 => 0.3428, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.42% (0.2554 => 0.2667, std. dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (9.4845 => 9.8800, std. dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.7433 => 0.7735, std. dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.8172 => 0.8499, std. dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.98% (5.0018 => 5.2007, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.9449 => 5.1383, std. dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5569 => 0.5780, std. dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.77% (0.5860 => 0.6081, std. dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 3.57% (0.3109 => 0.3220, std. dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (4.2646 => 4.4137, std. dev.: 0.0093) MultiSource/Applications/spiff/spiff: 3.29% (0.7835 => 0.8093, std. dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.28% (8.1363 => 8.4029, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 3.09% (5.7591 => 5.9370, std. dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2227, std. dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 2.93% (0.4299 => 0.4425, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.87% (1.3050 => 1.3425, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.80% (0.4103 => 0.4218, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.75% (0.4289 => 0.4407, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.74% (0.3865 => 0.3971, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1950, std. dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (14.3668 => 14.7383, std. dev.: 0.0035) MultiSource/Applications/treecc/treecc: 2.50% (2.0273 => 2.0779, std. dev.: 0.0032) MultiSource/Applications/d/make_dparser: 2.48% (3.3354 => 3.4182, std. dev.: 0.0179) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.5415 => 1.5788, std. dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.38% (2.0665 => 2.1156, std. dev.: 0.0004) MultiSource/Applications/hbd/hbd: 2.37% (1.5603 => 1.5973, std. dev.: 0.0105) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9609, std. dev.: 0.0214) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.26% (0.4636 => 0.4741, std. dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (0.5105 => 0.5219, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.12% (0.9765 => 0.9972, std. dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6187, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (2.2024 => 2.2478, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6675 => 0.6802, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.6450 => 0.6570, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.4186 => 1.4432, std. dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 1.72% (0.8921 => 0.9074, std. dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.53% (17.1811 => 17.4443, std. dev.: 0.0170) MultiSource/Benchmarks/nbench/nbench: 1.31% (1.1840 => 1.1995, std. dev.: 0.0060) MultiSource/Applications/siod/siod: 1.10% (2.2969 => 2.3222, std. dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.04% (2.6778 => 2.9735, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.83% (4.2280 => 4.3900, std. dev.: 0.0117) MultiSource/Benchmarks/llubenchmark/llu: 3.18% (3.7781 => 3.8981, std. dev.: 0.0146) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.01% (3.6395 => 3.7492, std. dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2145, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.79% (1.5086 => 1.5356, std. dev.: 0.0015) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2039, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2377, std. dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3374, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.03% (2.8904 => 2.9201, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.08% (5.2763 => 3.1616, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7042, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.87% (5.3526 => 3.7005, std. dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -14.93% (54.1659 => 46.0790, std. dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.37% (2.9384 => 2.5454, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -12.11% (22.1758 => 19.4901, std. dev.: 0.0331) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std. dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2373 => 1.1154, std. dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -7.61% (1.5373 => 1.4203, std. dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.21% (19.9488 => 18.5107, std. dev.: 0.0625) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.92% (1.9577 => 1.8614, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (8.1563 => 7.8972, std. dev.: 0.0123) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4814, std. dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.09% (8.6802 => 8.4119, std. dev.: 0.0204) SingleSource/Benchmarks/Misc/salsa20: -2.70% (10.2830 => 10.0050, std. dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.66% (1.3677 => 1.3313, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std. dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2013, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -1.72% (12.5348 => 12.3189, std. dev.: 0.0040) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4189, std. dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.24% (1.8329 => 1.8101, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/845c3d88/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 05:08:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 05:08:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802100831.0652F3524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2583?compare_to=2581&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2583, Order: 161159, Start Time: 2012-08-02 08:54:54, End Time: 2012-08-02 10:08:59 To: 2581, Order: 161155, Start Time: 2012-08-02 07:12:45, End Time: 2012-08-02 08:26:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (139 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (722 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.36% (0.7593 => 0.7696, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.90% (3.8274 => 3.7548, std. dev.: 0.0181) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.26% (2.0176 => 2.3054, std. dev.: 0.0159) SingleSource/UnitTests/ObjC++/property-reference-object: 9.16% (0.5818 => 0.6351, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5748 => 0.6268, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.99% (0.7061 => 0.7696, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.66% (0.1986 => 0.2158, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.41% (0.3578 => 0.3879, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.28% (0.3646 => 0.3948, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 8.28% (0.3601 => 0.3899, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.19% (0.3650 => 0.3949, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3663 => 0.3963, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.86% (0.3130 => 0.3376, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std. dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.03% (0.7710 => 0.8252, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.01% (0.5265 => 0.5634, std. dev.: 0.0016) MultiSource/Applications/hbd/hbd: 6.89% (1.3693 => 1.4637, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.62% (3.9660 => 4.2286, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4328 => 0.4596, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.15% (0.2782 => 0.2953, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.11% (0.7038 => 0.7468, std. dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 5.97% (0.2781 => 0.2947, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.89% (0.6959 => 0.7369, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4062 => 0.4296, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.51% (0.3899 => 0.4114, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.46% (0.2966 => 0.3128, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 5.45% (0.2607 => 0.2749, std. dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.41% (1.2193 => 1.2853, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.39% (0.3022 => 0.3185, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2690 => 0.2833, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.25% (0.2628 => 0.2766, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3580 => 0.3767, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.2937 => 0.3090, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 5.21% (0.2726 => 0.2868, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.21% (0.2765 => 0.2909, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.19% (0.3485 => 0.3666, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.18% (0.2760 => 0.2903, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2761 => 0.2902, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.08% (1.9828 => 2.0836, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.04% (0.5577 => 0.5858, std. dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 5.01% (13.8202 => 14.5131, std. dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2696 => 0.2831, std. dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 4.99% (0.3107 => 0.3262, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.3149 => 0.3305, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.87% (0.3489 => 0.3659, std. dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 4.75% (16.6129 => 17.4025, std. dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/matrix: 4.75% (0.2988 => 0.3130, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.73% (0.3192 => 0.3343, std. dev.: 0.0005) MultiSource/Applications/spiff/spiff: 4.70% (0.7506 => 0.7859, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.69% (1.4563 => 1.5246, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 4.63% (0.3453 => 0.3613, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 4.58% (0.3534 => 0.3696, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.2914 => 0.3047, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 4.55% (0.2243 => 0.2345, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.3756 => 0.3925, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.50% (7.2180 => 7.5425, std. dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 4.48% (0.2925 => 0.3056, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.46% (0.4016 => 0.4195, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.5637 => 0.5888, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.43% (1.3819 => 1.4431, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8310 => 0.8678, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.42% (0.4390 => 0.4584, std. dev.: 0.0022) MultiSource/Applications/Burg/burg: 4.40% (1.1061 => 1.1548, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.35% (13.2842 => 13.8614, std. dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.33% (1.1364 => 1.1856, std. dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.7460 => 0.7781, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.26% (3.8646 => 4.0293, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.22% (0.3246 => 0.3383, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.3245 => 1.3802, std. dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 4.11% (1.0594 => 1.1029, std. dev.: 0.0020) MultiSource/Applications/treecc/treecc: 4.05% (1.9270 => 2.0051, std. dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 3.81% (0.2995 => 0.3109, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.80% (3.6692 => 3.8088, std. dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.2945 => 0.3057, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3220 => 0.3340, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.71% (4.4433 => 4.6080, std. dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: 3.63% (1.2292 => 1.2738, std. dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (4.3801 => 4.5367, std. dev.: 0.0076) MultiSource/Applications/siod/siod: 3.43% (2.1791 => 2.2539, std. dev.: 0.0202) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.34% (1.1333 => 1.1712, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.28% (0.4791 => 0.4948, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.21% (0.6135 => 0.6332, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.17% (0.3755 => 0.3874, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (4.9865 => 5.1354, std. dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.94% (0.4113 => 0.4234, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.90% (0.6283 => 0.6465, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.84% (3.1889 => 3.2795, std. dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8698 => 0.8943, std. dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (8.4961 => 8.7259, std. dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 2.54% (16.2614 => 16.6751, std. dev.: 0.0166) MultiSource/Applications/JM/ldecod/ldecod: 2.53% (6.5754 => 6.7415, std. dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (2.1007 => 2.1509, std. dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.39% (3.2742 => 3.3523, std. dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 2.38% (14.8535 => 15.2063, std. dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: 2.37% (14.5298 => 14.8736, std. dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 2.12% (4.6629 => 4.7619, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.98% (1.5188 => 1.5489, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.46% (0.9108 => 0.9241, std. dev.: 0.0038) MultiSource/Applications/lua/lua: 1.22% (3.7467 => 3.7923, std. dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.12% (1.0313 => 1.0428, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.79% (1.8175 => 2.2681, std. dev.: 0.0187) SingleSource/Benchmarks/Misc/mandel-2: 8.72% (1.2998 => 1.4131, std. dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.85% (1.5824 => 1.6749, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.14% (0.9996 => 1.0510, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 4.45% (7.4271 => 7.7574, std. dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7392, std. dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 3.81% (1.9144 => 1.9873, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9765, std. dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.59% (1.7688 => 1.8147, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5336, std. dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (1.9290 => 1.9583, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.21% (1.0310 => 1.0435, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std. dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.1560 => 1.1681, std. dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.43% (22.5627 => 21.1111, std. dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.79% (1.2308 => 1.1103, std. dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.11% (20.3410 => 18.4887, std. dev.: 0.1009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.28% (0.3139 => 0.2942, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.63% (1.3780 => 1.3142, std. dev.: 0.0193) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.64% (0.4867 => 0.4690, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -3.23% (1.9762 => 1.9123, std. dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.85% (8.8259 => 8.5743, std. dev.: 0.0167) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9469, std. dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.98% (6.3560 => 6.2304, std. dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.85% (6.6320 => 6.5091, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3305 => 7.2123, std. dev.: 0.0078) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0051, std. dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2481, std. dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4934, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2185, std. dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std. dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/b66e1b40/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 05:17:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 05:17:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802101758.605F83524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2584?compare_to=2582&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2584, Order: 161161, Start Time: 2012-08-02 08:59:47, End Time: 2012-08-02 10:18:27 To: 2582, Order: 161155, Start Time: 2012-08-02 07:12:42, End Time: 2012-08-02 08:31:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (87 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (751 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.58% (55.0489 => 56.4709, std. dev.: 0.0925) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.15% (10.3673 => 13.4927, std. dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.08% (1.1194 => 1.2546, std. dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3497 => 0.3908, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.91% (1.7609 => 1.9178, std. dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.44% (2.2022 => 2.3880, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std. dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.24% (0.5925 => 0.6295, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 6.10% (0.6030 => 0.6398, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.57% (0.4879 => 0.5151, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 5.24% (0.3282 => 0.3454, std. dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.23% (10.4361 => 10.9817, std. dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.22% (0.4615 => 0.4856, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.12% (7.0540 => 7.4150, std. dev.: 0.0109) SingleSource/UnitTests/ObjC++/property-reference: 5.06% (0.7326 => 0.7697, std. dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 4.72% (9.4845 => 9.9321, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.34% (4.9449 => 5.1595, std. dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.34% (5.0018 => 5.2188, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.2554 => 0.2664, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.17% (0.7433 => 0.7743, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.86% (0.5569 => 0.5784, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.86% (0.3109 => 0.3229, std. dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.8172 => 0.8482, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.70% (0.2700 => 0.2800, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.2758 => 0.2860, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.69% (4.2646 => 4.4220, std. dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.60% (0.5860 => 0.6071, std. dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.49% (8.1363 => 8.4203, std. dev.: 0.0086) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3423 => 0.3541, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.37% (0.4299 => 0.4444, std. dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 3.34% (5.7591 => 5.9513, std. dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.1861 => 1.2254, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 3.24% (0.3180 => 0.3283, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.3050 => 1.3471, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 3.17% (0.7835 => 0.8083, std. dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.11% (0.4636 => 0.4780, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.95% (1.1642 => 1.1986, std. dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.91% (14.3668 => 14.7846, std. dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.82% (1.5415 => 1.5849, std. dev.: 0.0045) MultiSource/Applications/d/make_dparser: 2.80% (3.3354 => 3.4289, std. dev.: 0.0120) MultiSource/Applications/hbd/hbd: 2.69% (1.5603 => 1.6023, std. dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.66% (0.5105 => 0.5241, std. dev.: 0.0003) MultiSource/Applications/treecc/treecc: 2.64% (2.0273 => 2.0809, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.4289 => 0.4401, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.61% (0.4103 => 0.4210, std. dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.57% (0.3935 => 0.4036, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.45% (0.8067 => 0.8265, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 2.43% (3.8723 => 3.9665, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5859 => 1.6225, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.31% (0.6675 => 0.6829, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (2.0665 => 2.1124, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.20% (0.9765 => 0.9980, std. dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 2.19% (0.8921 => 0.9116, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.16% (0.6450 => 0.6589, std. dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.2024 => 2.2470, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.95% (1.4186 => 1.4463, std. dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.77% (17.1811 => 17.4847, std. dev.: 0.0242) MultiSource/Applications/hexxagon/hexxagon: 1.68% (1.2842 => 1.3058, std. dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.1840 => 1.2029, std. dev.: 0.0041) MultiSource/Applications/minisat/minisat: 1.56% (0.7115 => 0.7226, std. dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.56% (1.0722 => 1.0889, std. dev.: 0.0045) MultiSource/Applications/siod/siod: 1.32% (2.2969 => 2.3272, std. dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std. dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.39% (4.2280 => 4.4137, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (3.6395 => 3.7509, std. dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.5086 => 1.5348, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 1.66% (3.1578 => 3.2101, std. dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2561, std. dev.: 0.0034) MultiSource/Applications/aha/aha: 1.43% (3.1595 => 3.2047, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.0313 => 1.0448, std. dev.: 0.0002) MultiSource/Applications/lua/lua: 1.13% (26.0924 => 26.3873, std. dev.: 0.0339) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.01% (2.8904 => 2.9195, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1290, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.81% (5.2763 => 3.1758, std. dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.10% (5.3855 => 3.7108, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7093, std. dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0644, std. dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.33% (2.9384 => 2.5468, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -12.02% (22.1758 => 19.5108, std. dev.: 0.0223) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std. dev.: 0.0042) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2373 => 1.1060, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -7.59% (1.5373 => 1.4206, std. dev.: 0.0161) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.58% (19.9488 => 18.6363, std. dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5543, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.84% (1.9577 => 1.8629, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.55% (4.8142 => 4.5953, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.50% (1.5835 => 1.5123, std. dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4789, std. dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.08% (8.6802 => 8.4128, std. dev.: 0.0185) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (8.1563 => 7.9077, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0036, std. dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2013, std. dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.67% (12.5348 => 12.3251, std. dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std. dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4186, std. dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8088, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.08% (1.7254 => 1.7067, std. dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/3c9bd9d5/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 06:15:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 06:15:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802111503.174463524038@llvm.org> http://llvm.org/perf/db_default/v4/nts/2585?compare_to=2580&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2585, Order: 161156, Start Time: 2012-08-02 08:31:54, End Time: 2012-08-02 11:15:34 To: 2580, Order: 161154, Start Time: 2012-08-02 05:16:05, End Time: 2012-08-02 08:03:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (71 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (811 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 12.46% (0.3442 => 0.3871, std. dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.32% (0.3465 => 0.3892, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.31% (0.3460 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.25% (0.3469 => 0.3894, std. dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3496 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3488 => 0.3912, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.75% (0.3650 => 0.4079, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.57% (0.3724 => 0.4155, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.04% (0.1620 => 0.1734, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.16% (1.5932 => 1.6914, std. dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5826 => 0.6182, std. dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference-object: 5.77% (0.5889 => 0.6229, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.67% (0.4994 => 0.5277, std. dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.61% (1.6211 => 1.7120, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.51% (3.5627 => 3.7589, std. dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.43% (0.5026 => 0.5299, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.19% (1.3152 => 1.3834, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.02% (0.4361 => 0.4580, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.2866 => 0.3000, std. dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (0.5000 => 0.5232, std. dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.63% (0.3930 => 0.4112, std. dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.56% (0.5900 => 0.6169, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.54% (1.0781 => 1.1270, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 4.49% (0.4029 => 0.4210, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 4.46% (0.7171 => 0.7491, std. dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.43% (2.7292 => 2.8502, std. dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 3.97% (4.2109 => 4.3782, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.68% (2.1013 => 2.1787, std. dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 3.68% (5.5417 => 5.7457, std. dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.59% (1.9694 => 2.0401, std. dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.47% (23.5202 => 24.3367, std. dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.42% (0.3890 => 0.4023, std. dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.41% (0.4139 => 0.4280, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.37% (1.9966 => 2.0638, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.19% (0.3195 => 0.3297, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.16% (0.9909 => 1.0222, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.06% (4.6177 => 4.7591, std. dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (2.0673 => 2.1306, std. dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 3.06% (2.1653 => 2.2315, std. dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 2.93% (1.8794 => 1.9344, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0018) MultiSource/Applications/treecc/treecc: 2.86% (0.7875 => 0.8100, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.83% (4.4195 => 4.5444, std. dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 2.75% (0.3678 => 0.3779, std. dev.: 0.0003) MultiSource/Applications/siod/siod: 2.65% (0.6634 => 0.6810, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.35% (1.4269 => 1.4605, std. dev.: 0.0018) MultiSource/Applications/hbd/hbd: 2.14% (0.9697 => 0.9905, std. dev.: 0.0029) MultiSource/Applications/Burg/burg: 2.13% (0.5546 => 0.5664, std. dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.6435 => 0.6550, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.02% (2.0346 => 2.0553, std. dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 15.02% (2.5769 => 2.9639, std. dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.10% (0.5917 => 0.6692, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6704, std. dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8950, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1666, std. dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6753, std. dev.: 0.0510) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2050, std. dev.: 0.0439) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4955, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5921, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std. dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std. dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.61% (11.9555 => 11.7626, std. dev.: 0.0144) SingleSource/UnitTests/Vector/constpool: -1.49% (2.4764 => 2.4394, std. dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.16% (25.4195 => 16.4819, std. dev.: 0.0235) SingleSource/Benchmarks/Dhrystone/fldry: -8.97% (17.2379 => 15.6908, std. dev.: 0.2732) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7882, std. dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary2: -7.04% (0.2402 => 0.2233, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: -4.03% (0.4438 => 0.4259, std. dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7949, std. dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -3.44% (14.0481 => 13.5648, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5800, std. dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/24fc147d/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 06:50:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 06:50:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802115049.5DD2C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2586?compare_to=2583&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2586, Order: 161165, Start Time: 2012-08-02 10:37:11, End Time: 2012-08-02 11:51:18 To: 2583, Order: 161159, Start Time: 2012-08-02 08:54:54, End Time: 2012-08-02 10:08:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (147 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 952 (714 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.4327 => 56.4331, std. dev.: 0.1340) MultiSource/Benchmarks/llubenchmark/llu: 1.60% (3.7548 => 3.8150, std. dev.: 0.0188) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.63% (2.0176 => 2.3128, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.75% (0.5818 => 0.6327, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.67% (0.7061 => 0.7673, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5748 => 0.6239, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 8.46% (0.3663 => 0.3973, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.44% (0.3601 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.06% (0.1986 => 0.2146, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.73% (0.7710 => 0.8306, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4652, std. dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 6.83% (0.7038 => 0.7519, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.82% (0.2596 => 0.2773, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.82% (3.9660 => 4.2363, std. dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4328 => 0.4614, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.5265 => 0.5612, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4062 => 0.4313, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.6959 => 0.7361, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.75% (0.4379 => 0.4631, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2765 => 0.2923, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.69% (0.2655 => 0.2806, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.67% (0.3899 => 0.4120, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.65% (0.3485 => 0.3682, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.64% (1.2193 => 1.2881, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.58% (0.2760 => 0.2914, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.54% (0.2690 => 0.2839, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.49% (0.3022 => 0.3188, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.3489 => 0.3679, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.2937 => 0.3096, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.38% (0.9199 => 0.9694, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.33% (1.9828 => 2.0884, std. dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2761 => 0.2908, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.31% (0.3580 => 0.3770, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 5.28% (0.2726 => 0.2870, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.24% (0.2023 => 0.2129, std. dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 5.21% (13.8202 => 14.5407, std. dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.15% (0.2988 => 0.3142, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.08% (1.4563 => 1.5303, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 5.01% (0.3453 => 0.3626, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.98% (0.3192 => 0.3351, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.97% (0.4390 => 0.4608, std. dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 4.95% (0.2243 => 0.2354, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.93% (16.6129 => 17.4320, std. dev.: 0.0141) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.2914 => 0.3057, std. dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.89% (0.2925 => 0.3068, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.84% (0.3534 => 0.3705, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.75% (7.2180 => 7.5605, std. dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.4016 => 0.4205, std. dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.65% (0.7506 => 0.7855, std. dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.3813 => 1.4450, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.54% (1.3819 => 1.4447, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.52% (0.5637 => 0.5892, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.47% (0.3756 => 0.3924, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.45% (1.1061 => 1.1553, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (13.2842 => 13.8748, std. dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8310 => 0.8676, std. dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.32% (1.9270 => 2.0103, std. dev.: 0.0099) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0594 => 1.1049, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.28% (1.3245 => 1.3812, std. dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (3.8646 => 4.0280, std. dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.7460 => 0.7772, std. dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.12% (1.2292 => 1.2798, std. dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (4.4433 => 4.6243, std. dev.: 0.0079) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8165, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 3.98% (0.3220 => 0.3348, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.91% (4.3801 => 4.5512, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.60% (2.1791 => 2.2575, std. dev.: 0.0146) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (4.9865 => 5.1581, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.1333 => 1.1721, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.27% (0.8698 => 0.8982, std. dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 3.21% (0.4113 => 0.4245, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.6283 => 0.6484, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 2.95% (8.4961 => 8.7467, std. dev.: 0.0055) MultiSource/Applications/d/make_dparser: 2.95% (3.1889 => 3.2829, std. dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 2.76% (16.2614 => 16.7097, std. dev.: 0.0090) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.5754 => 6.7560, std. dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 2.73% (14.8535 => 15.2584, std. dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.61% (3.2742 => 3.3597, std. dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.60% (14.5298 => 14.9075, std. dev.: 0.0232) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1007 => 2.1550, std. dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.39% (4.6629 => 4.7742, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5188 => 1.5526, std. dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.9108 => 0.9262, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.66% (0.6744 => 0.6856, std. dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 1.65% (0.6250 => 0.6353, std. dev.: 0.0013) MultiSource/Applications/lemon/lemon: 1.27% (1.0313 => 1.0444, std. dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.22% (33.2944 => 33.7003, std. dev.: 0.0083) MultiSource/Applications/lua/lua: 1.13% (3.7467 => 3.7889, std. dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (6.2785 => 6.3454, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 25.56% (1.8175 => 2.2820, std. dev.: 0.0474) SingleSource/Benchmarks/Misc/mandel-2: 8.50% (1.2998 => 1.4103, std. dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.86% (1.5824 => 1.6752, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.20% (0.9996 => 1.0516, std. dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 4.43% (7.4271 => 7.7558, std. dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7390, std. dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.88% (1.9144 => 1.9886, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9660, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9760, std. dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.65% (1.7688 => 1.8157, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.33% (0.9692 => 0.9918, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.87% (1.4298 => 1.4566, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.76% (1.5089 => 1.5354, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.48% (5.5130 => 5.5946, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.30% (9.0760 => 9.1944, std. dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 1.29% (1.9290 => 1.9539, std. dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std. dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.14% (1.0310 => 1.0428, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1400, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6469 => 3.6851, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 1.03% (1.1560 => 1.1679, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.24% (22.5627 => 21.1539, std. dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.0460 => 0.8627, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.46% (1.2308 => 1.1021, std. dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.53% (20.3410 => 18.6053, std. dev.: 0.0199) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std. dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std. dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3141, std. dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.68% (0.4867 => 0.4688, std. dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -3.33% (1.9762 => 1.9104, std. dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.69% (8.8259 => 8.5884, std. dev.: 0.0123) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9468, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.26% (6.3560 => 6.2123, std. dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.82% (6.6320 => 6.5115, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8601, std. dev.: 0.0180) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3305 => 7.2247, std. dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2474, std. dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4931, std. dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2256, std. dev.: 0.0092) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/fef5c593/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 07:04:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 07:04:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802120436.8614C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2587?compare_to=2584&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2587, Order: 161165, Start Time: 2012-08-02 10:46:37, End Time: 2012-08-02 12:05:08 To: 2584, Order: 161161, Start Time: 2012-08-02 08:59:47, End Time: 2012-08-02 10:18:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (80 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 933 (759 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.12% (13.4927 => 13.2073, std. dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.39% (10.3673 => 13.2073, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 12.50% (0.3473 => 0.3907, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 12.30% (0.3497 => 0.3927, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.01% (1.1194 => 1.2538, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.67% (0.2065 => 0.2244, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (1.7609 => 1.9101, std. dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.03% (2.2022 => 2.3791, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 7.33% (0.1432 => 0.1537, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 5.96% (0.5925 => 0.6278, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.6030 => 0.6382, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.27% (0.4615 => 0.4858, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.25% (0.4879 => 0.5135, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.91% (0.7326 => 0.7686, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.90% (7.0540 => 7.3998, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.72% (10.4361 => 10.9283, std. dev.: 0.0149) MultiSource/Benchmarks/mafft/pairlocalalign: 4.41% (9.4845 => 9.9030, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.22% (4.9449 => 5.1534, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.17% (5.0018 => 5.2103, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.11% (0.8172 => 0.8508, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 4.05% (0.7433 => 0.7734, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.62% (0.5860 => 0.6072, std. dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (4.2646 => 4.4102, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4079, std. dev.: 0.0108) MultiSource/Benchmarks/McCat/18-imp/imp: 3.21% (0.3423 => 0.3533, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.18% (0.7835 => 0.8084, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2227, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.3050 => 1.3439, std. dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4636 => 0.4772, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 2.93% (0.4299 => 0.4425, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (14.3668 => 14.7812, std. dev.: 0.0158) MultiSource/Applications/oggenc/oggenc: 2.86% (5.7591 => 5.9237, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.69% (2.0665 => 2.1220, std. dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (1.5415 => 1.5826, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.66% (0.4103 => 0.4212, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.52% (2.0273 => 2.0784, std. dev.: 0.0037) MultiSource/Applications/d/make_dparser: 2.50% (3.3354 => 3.4187, std. dev.: 0.0110) MultiSource/Applications/hbd/hbd: 2.48% (1.5603 => 1.5990, std. dev.: 0.0024) MultiSource/Applications/Burg/burg: 2.47% (1.1642 => 1.1930, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.45% (0.5105 => 0.5230, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 2.35% (0.4289 => 0.4390, std. dev.: 0.0013) MultiSource/Applications/lua/lua: 2.29% (3.8723 => 3.9609, std. dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6456 => 0.6601, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.8067 => 0.8240, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.99% (0.9765 => 0.9959, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 1.97% (0.8921 => 0.9097, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.2024 => 2.2451, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.90% (0.6675 => 0.6802, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.89% (1.5859 => 1.6159, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.86% (0.5981 => 0.6092, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.4186 => 1.4437, std. dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.77% (1.2842 => 1.3069, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.71% (0.6450 => 0.6560, std. dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.66% (17.1811 => 17.4664, std. dev.: 0.0136) MultiSource/Benchmarks/nbench/nbench: 1.33% (1.1840 => 1.1997, std. dev.: 0.0023) MultiSource/Applications/siod/siod: 1.09% (2.2969 => 2.3220, std. dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.09% (4.2280 => 4.4009, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.28% (3.6395 => 3.7588, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.1578 => 3.2142, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.68% (1.5086 => 1.5339, std. dev.: 0.0021) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.28% (9.1159 => 9.2325, std. dev.: 0.0353) MultiSource/Applications/lua/lua: 1.04% (26.0924 => 26.3646, std. dev.: 0.0211) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.3135 => 2.3373, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9199, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.92% (5.2763 => 3.1702, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7044, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7035, std. dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -15.01% (54.1659 => 46.0352, std. dev.: 0.0411) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.31% (2.9384 => 2.5472, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -12.20% (22.1758 => 19.4700, std. dev.: 0.0464) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.21% (1.6925 => 1.4181, std. dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -10.49% (1.2373 => 1.1075, std. dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -7.04% (1.5373 => 1.4290, std. dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.64% (19.9488 => 18.6234, std. dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -4.89% (1.9577 => 1.8620, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.19% (8.1563 => 7.8965, std. dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.16% (32.5116 => 31.4851, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (8.6802 => 8.4152, std. dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: -2.73% (10.2830 => 10.0023, std. dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std. dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2012, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3150, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std. dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4168, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.31% (1.8329 => 1.8089, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.11% (1.7254 => 1.7062, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/50315bc8/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 09:02:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 09:02:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802140218.E5F4A2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2588?compare_to=2586&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2588, Order: 161172, Start Time: 2012-08-02 12:48:42, End Time: 2012-08-02 14:02:46 To: 2586, Order: 161165, Start Time: 2012-08-02 10:37:11, End Time: 2012-08-02 11:51:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (142 on baseline) Performance Improvements: 1 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.10% (3.7316 => 3.6906, std. dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.62% (2.0176 => 2.3126, std. dev.: 0.0064) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.70% (0.5818 => 0.6324, std. dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7061 => 0.7675, std. dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5748 => 0.6246, std. dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.45% (0.3646 => 0.3954, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.38% (0.3650 => 0.3956, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.33% (0.3663 => 0.3968, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 8.23% (0.3623 => 0.3921, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std. dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.00% (0.7710 => 0.8250, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.98% (3.9660 => 4.2429, std. dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 6.82% (1.3693 => 1.4627, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.2721 => 0.2901, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.55% (0.5265 => 0.5610, std. dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 6.54% (0.7038 => 0.7498, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.49% (0.4328 => 0.4609, std. dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.22% (0.2781 => 0.2954, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.04% (0.2782 => 0.2950, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4062 => 0.4307, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2607 => 0.2754, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.61% (1.2193 => 1.2877, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.59% (0.5577 => 0.5889, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.58% (0.2690 => 0.2840, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2760 => 0.2913, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.50% (0.6959 => 0.7342, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.48% (0.2628 => 0.2772, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.47% (0.4390 => 0.4630, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.46% (0.2655 => 0.2800, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.46% (0.2765 => 0.2916, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.42% (0.3485 => 0.3674, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.36% (0.3580 => 0.3772, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.36% (1.9828 => 2.0891, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 5.32% (0.2726 => 0.2871, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.29% (0.3022 => 0.3182, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.29% (0.2761 => 0.2907, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.28% (1.4563 => 1.5332, std. dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.3489 => 0.3672, std. dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.19% (0.2696 => 0.2836, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3149 => 0.3312, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.17% (0.9199 => 0.9675, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 5.09% (13.8202 => 14.5242, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 5.05% (0.2988 => 0.3139, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.01% (0.3192 => 0.3352, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 4.95% (0.3453 => 0.3624, std. dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 4.88% (16.6129 => 17.4236, std. dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/lists1: 4.81% (0.3534 => 0.3704, std. dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.77% (0.2243 => 0.2350, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.77% (0.2914 => 0.3053, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.69% (0.3756 => 0.3932, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.68% (0.4016 => 0.4204, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.62% (0.7506 => 0.7853, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (7.2180 => 7.5516, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 4.62% (0.3293 => 0.3445, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.59% (0.5637 => 0.5896, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.55% (1.3819 => 1.4448, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.49% (1.1364 => 1.1874, std. dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.3813 => 1.4432, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8310 => 0.8678, std. dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.42% (1.0594 => 1.1062, std. dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8666, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 4.37% (0.3868 => 0.4037, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 4.28% (1.9270 => 2.0095, std. dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.7460 => 0.7778, std. dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 4.25% (3.8646 => 4.0287, std. dev.: 0.0036) MultiSource/Applications/Burg/burg: 4.21% (1.1061 => 1.1527, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.20% (1.3245 => 1.3801, std. dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.3801 => 4.5607, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (3.6692 => 3.8200, std. dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/objinst: 4.04% (0.2945 => 0.3064, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2995 => 0.3114, std. dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.83% (4.4433 => 4.6135, std. dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.82% (1.2292 => 1.2761, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.67% (0.4791 => 0.4967, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 3.57% (2.1791 => 2.2568, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.49% (1.1333 => 1.1729, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.33% (0.6283 => 0.6492, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.9865 => 5.1523, std. dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.30% (0.3755 => 0.3879, std. dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.18% (0.8698 => 0.8975, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4113 => 0.4243, std. dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.02% (0.6135 => 0.6320, std. dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 2.93% (8.4961 => 8.7448, std. dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2798, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.70% (3.2742 => 3.3625, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 2.66% (6.5754 => 6.7502, std. dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 2.65% (16.2614 => 16.6928, std. dev.: 0.0122) MultiSource/Applications/ClamAV/clamscan: 2.63% (14.5298 => 14.9123, std. dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.1007 => 2.1557, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 2.56% (14.8535 => 15.2341, std. dev.: 0.0156) MultiSource/Applications/oggenc/oggenc: 2.34% (4.6629 => 4.7720, std. dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.31% (1.5188 => 1.5539, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.74% (0.6250 => 0.6359, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.65% (0.9108 => 0.9258, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.27% (1.0313 => 1.0444, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.18% (33.2944 => 33.6878, std. dev.: 0.0102) MultiSource/Applications/lua/lua: 1.11% (3.7467 => 3.7884, std. dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (6.2785 => 6.3434, std. dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std. dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5135, std. dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2559, std. dev.: 0.0161) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.49% (1.2998 => 1.3842, std. dev.: 0.0132) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.23% (0.9996 => 1.0519, std. dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.4271 => 7.7515, std. dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 4.25% (11.2619 => 11.7401, std. dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9871, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.88% (1.9199 => 1.9752, std. dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.64% (1.7688 => 1.8155, std. dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.29% (0.9692 => 0.9914, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (1.5089 => 1.5320, std. dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.47% (5.5130 => 5.5940, std. dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1950, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0410, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 1.28% (1.9290 => 1.9536, std. dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 1.22% (3.7731 => 3.8193, std. dev.: 0.0166) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9664, std. dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1406, std. dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.28% (0.2670 => 0.2529, std. dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8630, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.2308 => 1.1109, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.71% (20.3410 => 18.5696, std. dev.: 0.0573) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std. dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std. dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9826, std. dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.70% (0.4867 => 0.4687, std. dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -3.28% (1.9762 => 1.9114, std. dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.62% (3.0263 => 2.9470, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6080, std. dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2248, std. dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.6320 => 6.5065, std. dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (7.1097 => 7.0048, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3305 => 7.2237, std. dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: -1.37% (5.3167 => 5.2437, std. dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std. dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std. dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2230, std. dev.: 0.0155) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 3.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/9f1f8d09/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 09:06:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 09:06:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802140639.66B262A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2589?compare_to=2587&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2589, Order: 161172, Start Time: 2012-08-02 12:48:38, End Time: 2012-08-02 14:07:09 To: 2587, Order: 161165, Start Time: 2012-08-02 10:46:37, End Time: 2012-08-02 12:05:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (80 on baseline) Performance Improvements: 1 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (758 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.66% (79.4075 => 80.7291, std. dev.: 0.1485) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/huffbench: -1.08% (18.6234 => 18.4226, std. dev.: 0.0709) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 27.32% (10.3673 => 13.1998, std. dev.: 0.0134) SingleSource/UnitTests/ObjC/trivial-interface: 12.58% (0.3473 => 0.3910, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.32% (0.3497 => 0.3928, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.25% (0.3543 => 0.3977, std. dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3516 => 0.3946, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.13% (0.3561 => 0.3993, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.11% (1.1194 => 1.2550, std. dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.27% (0.3886 => 0.4324, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.38% (1.7609 => 1.9084, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.04% (2.2022 => 2.3792, std. dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.96% (0.3817 => 0.4121, std. dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5925 => 0.6279, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 5.84% (0.6030 => 0.6382, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.23% (0.4879 => 0.5134, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.07% (0.4615 => 0.4849, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 4.91% (0.7326 => 0.7686, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 4.75% (0.3282 => 0.3438, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (10.4361 => 10.9299, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.66% (7.0540 => 7.3830, std. dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.31% (9.4845 => 9.8933, std. dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: 4.12% (0.7433 => 0.7739, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.07% (5.0018 => 5.2055, std. dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.02% (4.9449 => 5.1439, std. dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.89% (0.8172 => 0.8490, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.84% (0.5860 => 0.6085, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.63% (0.5569 => 0.5771, std. dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3121 => 0.3231, std. dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.51% (0.3109 => 0.3218, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.41% (4.2646 => 4.4102, std. dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.34% (8.1363 => 8.4082, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.17% (0.7835 => 0.8083, std. dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 3.13% (0.3423 => 0.3530, std. dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1861 => 1.2228, std. dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 3.00% (0.4299 => 0.4428, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.3050 => 1.3434, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4636 => 0.4772, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (14.3668 => 14.7881, std. dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 2.83% (5.7591 => 5.9220, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.61% (0.4103 => 0.4210, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.59% (3.3354 => 3.4218, std. dev.: 0.0082) MultiSource/Applications/treecc/treecc: 2.56% (2.0273 => 2.0792, std. dev.: 0.0007) MultiSource/Applications/Burg/burg: 2.52% (1.1642 => 1.1935, std. dev.: 0.0020) MultiSource/Applications/hbd/hbd: 2.47% (1.5603 => 1.5988, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.43% (0.5105 => 0.5229, std. dev.: 0.0004) MultiSource/Applications/lua/lua: 2.34% (3.8723 => 3.9628, std. dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.32% (1.5415 => 1.5773, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.8067 => 0.8252, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.28% (2.0665 => 2.1136, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.07% (1.5859 => 1.6187, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.00% (0.9765 => 0.9960, std. dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.93% (0.6675 => 0.6804, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.89% (2.2024 => 2.2441, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.76% (0.5981 => 0.6086, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 1.74% (0.8921 => 0.9076, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.4186 => 1.4428, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.69% (0.6450 => 0.6559, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.68% (1.2842 => 1.3058, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.54% (17.1811 => 17.4451, std. dev.: 0.0283) MultiSource/Benchmarks/nbench/nbench: 1.32% (1.1840 => 1.1996, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 1.25% (2.2969 => 2.3255, std. dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9737, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.16% (4.2280 => 4.4040, std. dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (3.6395 => 3.7541, std. dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 1.80% (3.1578 => 3.2147, std. dev.: 0.0008) MultiSource/Applications/aha/aha: 1.39% (3.1595 => 3.2035, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.32% (1.0313 => 1.0449, std. dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2187, std. dev.: 0.0056) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3752, std. dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1268, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.95% (5.2763 => 3.1686, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7007, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6999, std. dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -15.03% (54.1659 => 46.0244, std. dev.: 0.0199) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.9384 => 2.5464, std. dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -12.24% (22.1758 => 19.4621, std. dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std. dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1165, std. dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -8.66% (1.5373 => 1.4041, std. dev.: 0.0243) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.65% (19.9488 => 18.4226, std. dev.: 0.0709) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5542, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.85% (1.9577 => 1.8627, std. dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4807, std. dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (8.1563 => 7.9066, std. dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.01% (8.6802 => 8.4193, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: -2.76% (10.2830 => 9.9996, std. dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std. dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2009, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std. dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std. dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4185, std. dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.38% (1.8329 => 1.8076, std. dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (1.7254 => 1.7069, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/fc91e398/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 09:27:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 09:27:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802142725.F24E02A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2590?compare_to=2585&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2590, Order: 161165, Start Time: 2012-08-02 11:44:01, End Time: 2012-08-02 14:27:56 To: 2585, Order: 161156, Start Time: 2012-08-02 08:31:54, End Time: 2012-08-02 11:15:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (78 on baseline) Performance Improvements: 0 (12 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 953 (804 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.12% (126.6495 => 130.6035, std. dev.: 0.2497) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3488 => 0.3920, std. dev.: 0.0066) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.34% (0.3460 => 0.3887, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.29% (0.3465 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3469 => 0.3891, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.13% (0.3496 => 0.3920, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.89% (0.3650 => 0.4084, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 11.49% (0.3724 => 0.4152, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.94% (0.3792 => 0.4169, std. dev.: 0.0139) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.69% (0.1063 => 0.1166, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.1620 => 0.1740, std. dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.58% (1.5932 => 1.6980, std. dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 6.18% (0.1619 => 0.1719, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.08% (0.5826 => 0.6180, std. dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.90% (3.5627 => 3.7730, std. dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference-object: 5.81% (0.5889 => 0.6231, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.56% (1.6211 => 1.7112, std. dev.: 0.0023) MultiSource/Applications/spiff/spiff: 5.46% (0.4029 => 0.4249, std. dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.41% (1.3152 => 1.3863, std. dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.39% (0.4994 => 0.5263, std. dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (0.5026 => 0.5284, std. dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.11% (0.4361 => 0.4584, std. dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.2014 => 0.2116, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.99% (0.3930 => 0.4126, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.98% (0.5000 => 0.5249, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.97% (0.5900 => 0.6193, std. dev.: 0.0023) MultiSource/Applications/d/make_dparser: 4.85% (1.0781 => 1.1304, std. dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 4.59% (4.2109 => 4.4042, std. dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (2.7292 => 2.8534, std. dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference: 4.25% (0.7171 => 0.7476, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.12% (0.2866 => 0.2984, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.06% (0.2736 => 0.2847, std. dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 4.05% (2.1013 => 2.1864, std. dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.00% (1.9694 => 2.0481, std. dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 3.85% (5.5417 => 5.7552, std. dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.80% (0.3890 => 0.4038, std. dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.66% (1.9966 => 2.0697, std. dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.65% (0.4658 => 0.4828, std. dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 3.53% (0.3004 => 0.3110, std. dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 3.48% (2.1653 => 2.2407, std. dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (4.4195 => 4.5671, std. dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.4139 => 0.4277, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.29% (0.3195 => 0.3300, std. dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.28% (4.6177 => 4.7690, std. dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 3.26% (0.9909 => 1.0232, std. dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 3.21% (23.5202 => 24.2760, std. dev.: 0.0149) MultiSource/Applications/treecc/treecc: 3.20% (0.7875 => 0.8127, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.10% (0.3903 => 0.4024, std. dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.00% (2.0673 => 2.1294, std. dev.: 0.0123) MultiSource/Applications/siod/siod: 2.88% (0.6634 => 0.6825, std. dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (1.8794 => 1.9334, std. dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.73% (0.3845 => 0.3950, std. dev.: 0.0001) MultiSource/Applications/lua/lua: 2.68% (1.4269 => 1.4651, std. dev.: 0.0039) MultiSource/Applications/Burg/burg: 2.49% (0.5546 => 0.5684, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 2.38% (0.4251 => 0.4352, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.22% (0.9697 => 0.9912, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.72% (0.6435 => 0.6546, std. dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.38% (2.0346 => 2.0627, std. dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std. dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6679, std. dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8962, std. dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1642, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.15% (105.3826 => 107.6456, std. dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1938, std. dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.86% (46.6247 => 47.4936, std. dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5911, std. dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2204, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std. dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std. dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.55% (11.9555 => 11.7702, std. dev.: 0.0159) SingleSource/UnitTests/Vector/constpool: -1.26% (2.4764 => 2.4453, std. dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.08% (25.4195 => 16.5017, std. dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/fldry: -9.38% (17.2379 => 15.6206, std. dev.: 0.2109) SingleSource/Benchmarks/Shootout-C++/ary2: -8.03% (0.2402 => 0.2209, std. dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7862, std. dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/moments: -3.99% (0.4438 => 0.4261, std. dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7991, std. dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -3.59% (14.0481 => 13.5441, std. dev.: 0.0123) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5795, std. dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/427c3273/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 10:44:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 10:44:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802154412.84FED2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2591?compare_to=2588&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2591, Order: 161175, Start Time: 2012-08-02 14:30:53, End Time: 2012-08-02 15:44:43 To: 2588, Order: 161172, Start Time: 2012-08-02 12:48:42, End Time: 2012-08-02 14:02:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (143 on baseline) Performance Improvements: 0 (30 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (717 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.04% (2.0176 => 2.3211, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5818 => 0.6346, std. dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5748 => 0.6263, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7061 => 0.7681, std. dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 8.61% (0.3578 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.33% (0.3650 => 0.3954, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 8.31% (0.3623 => 0.3924, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3663 => 0.3966, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.18% (0.3914 => 0.4234, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.99% (0.4003 => 0.4323, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.96% (0.3130 => 0.3379, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 6.84% (1.3693 => 1.4630, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.83% (3.9660 => 4.2369, std. dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.70% (0.2596 => 0.2770, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4328 => 0.4617, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.56% (0.7710 => 0.8216, std. dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 6.51% (0.7038 => 0.7496, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5265 => 0.5607, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.43% (0.2721 => 0.2896, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2782 => 0.2958, std. dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.18% (0.2781 => 0.2953, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 5.93% (0.4062 => 0.4303, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.76% (0.2690 => 0.2845, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2607 => 0.2757, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.73% (0.4379 => 0.4630, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.69% (0.3899 => 0.4121, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.62% (0.3485 => 0.3681, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.58% (0.2937 => 0.3101, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.57% (0.2655 => 0.2803, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (0.2628 => 0.2774, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.54% (1.2193 => 1.2868, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.50% (0.6959 => 0.7342, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.50% (0.2966 => 0.3129, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.47% (0.2761 => 0.2912, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.45% (0.3580 => 0.3775, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 5.43% (0.2726 => 0.2874, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (1.9828 => 2.0903, std. dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.34% (0.2696 => 0.2840, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3149 => 0.3315, std. dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 5.25% (0.3107 => 0.3270, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.9199 => 0.9680, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.2988 => 0.3143, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.15% (0.3453 => 0.3631, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.10% (13.8202 => 14.5244, std. dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.09% (0.5577 => 0.5861, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.04% (0.3192 => 0.3353, std. dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.03% (0.4390 => 0.4611, std. dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.96% (16.6129 => 17.4368, std. dev.: 0.0094) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 4.78% (0.3534 => 0.3703, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.76% (0.4016 => 0.4207, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.71% (0.3293 => 0.3448, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.66% (1.4563 => 1.5242, std. dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.59% (1.1364 => 1.1886, std. dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 4.58% (0.2925 => 0.3059, std. dev.: 0.0013) MultiSource/Applications/spiff/spiff: 4.54% (0.7506 => 0.7847, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.54% (7.2180 => 7.5457, std. dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.53% (0.3756 => 0.3926, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.3246 => 0.3392, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.47% (0.3868 => 0.4041, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.47% (0.5637 => 0.5889, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.46% (3.8646 => 4.0371, std. dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 4.44% (0.8310 => 0.8679, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.42% (13.2842 => 13.8717, std. dev.: 0.0128) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (1.3819 => 1.4420, std. dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 4.30% (1.0594 => 1.1050, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.29% (1.1061 => 1.1535, std. dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.3813 => 1.4400, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.24% (1.3245 => 1.3807, std. dev.: 0.0011) MultiSource/Applications/treecc/treecc: 4.15% (1.9270 => 2.0069, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.11% (0.2945 => 0.3066, std. dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.09% (0.7460 => 0.7765, std. dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2995 => 0.3117, std. dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2292 => 1.2779, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.91% (3.6692 => 3.8128, std. dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 3.91% (0.3220 => 0.3346, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.82% (4.4433 => 4.6132, std. dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.3801 => 4.5461, std. dev.: 0.0024) MultiSource/Applications/siod/siod: 3.60% (2.1791 => 2.2575, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.41% (0.3755 => 0.3883, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.1333 => 1.1719, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.26% (0.6283 => 0.6488, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.23% (0.4113 => 0.4246, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.21% (4.9865 => 5.1466, std. dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (0.8698 => 0.8976, std. dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 3.03% (8.4961 => 8.7539, std. dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.88% (3.1889 => 3.2807, std. dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.2742 => 3.3659, std. dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.68% (2.1007 => 2.1571, std. dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (6.5754 => 6.7491, std. dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.63% (16.2614 => 16.6893, std. dev.: 0.0220) MultiSource/Applications/JM/lencod/lencod: 2.58% (14.8535 => 15.2360, std. dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 2.54% (14.5298 => 14.8986, std. dev.: 0.0204) MultiSource/Applications/oggenc/oggenc: 2.49% (4.6629 => 4.7789, std. dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.38% (1.5188 => 1.5549, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.84% (0.6250 => 0.6365, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.9108 => 0.9265, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.39% (1.0313 => 1.0456, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.09% (3.7467 => 3.7874, std. dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 1.01% (33.2944 => 33.6301, std. dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5115, std. dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std. dev.: 0.0516) SingleSource/Benchmarks/Misc/mandel-2: 7.14% (1.2998 => 1.3926, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.17% (0.9996 => 1.0513, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 4.36% (7.4271 => 7.7512, std. dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 4.23% (11.2619 => 11.7385, std. dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7743, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 3.86% (1.9144 => 1.9883, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9663, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 2.86% (1.9199 => 1.9748, std. dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8159, std. dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.31% (0.9692 => 0.9916, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (1.5089 => 1.5341, std. dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5953, std. dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5087, std. dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1947, std. dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.23% (1.0310 => 1.0437, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (3.1071 => 3.1391, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.5627 => 21.1410, std. dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.24% (0.2670 => 0.2530, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2308 => 1.1099, std. dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.05% (20.3410 => 18.5004, std. dev.: 0.0796) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.21% (0.3139 => 0.2944, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.19% (1.3780 => 1.3065, std. dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std. dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9827, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std. dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -3.32% (1.9762 => 1.9106, std. dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9476, std. dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.8259 => 8.6075, std. dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (0.8342 => 0.8149, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.31% (6.3560 => 6.2092, std. dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std. dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.80% (6.6320 => 6.5125, std. dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3305 => 7.2266, std. dev.: 0.0142) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.28% (2.5254 => 2.4930, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std. dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2552, std. dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2318, std. dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.06% (3.8887 => 3.8476, std. dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/01d48d10/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 10:53:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 10:53:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802155326.D41D62A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2592?compare_to=2589&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2592, Order: 161175, Start Time: 2012-08-02 14:35:16, End Time: 2012-08-02 15:53:56 To: 2589, Order: 161172, Start Time: 2012-08-02 12:48:38, End Time: 2012-08-02 14:07:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (85 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 931 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.20% (13.1998 => 13.4903, std. dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 2.56% (1.4041 => 1.4401, std. dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.09% (55.0514 => 56.2006, std. dev.: 0.2029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 30.12% (10.3673 => 13.4903, std. dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.93% (1.1194 => 1.2529, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3561 => 0.3982, std. dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std. dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std. dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (2.2022 => 2.3906, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.53% (1.7609 => 1.9111, std. dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.17% (0.3817 => 0.4129, std. dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: 7.40% (0.1432 => 0.1538, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.11% (0.5925 => 0.6287, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 6.05% (0.6030 => 0.6395, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 5.68% (0.7326 => 0.7742, std. dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.48% (0.4615 => 0.4868, std. dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.41% (0.4879 => 0.5143, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 5.30% (0.3282 => 0.3456, std. dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.01% (10.4361 => 10.9594, std. dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.89% (7.0540 => 7.3989, std. dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 4.45% (9.4845 => 9.9065, std. dev.: 0.0107) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.7433 => 0.7756, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.24% (4.9449 => 5.1548, std. dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.21% (5.0018 => 5.2124, std. dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 4.12% (0.3109 => 0.3237, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 4.11% (0.2554 => 0.2659, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.07% (0.8172 => 0.8505, std. dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.94% (0.3121 => 0.3244, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.78% (0.2700 => 0.2802, std. dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.75% (0.5569 => 0.5778, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.68% (4.2646 => 4.4214, std. dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5860 => 0.6073, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 3.46% (0.3180 => 0.3290, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.45% (0.7835 => 0.8105, std. dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (8.1363 => 8.4139, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.36% (1.3050 => 1.3489, std. dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.30% (1.1861 => 1.2252, std. dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4636 => 0.4787, std. dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4299 => 0.4439, std. dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.25% (5.7591 => 5.9462, std. dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7900, std. dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.92% (0.4103 => 0.4223, std. dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (0.5105 => 0.5248, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 2.78% (1.5603 => 1.6037, std. dev.: 0.0064) MultiSource/Applications/d/make_dparser: 2.72% (3.3354 => 3.4262, std. dev.: 0.0006) MultiSource/Applications/Burg/burg: 2.71% (1.1642 => 1.1957, std. dev.: 0.0017) MultiSource/Applications/treecc/treecc: 2.65% (2.0273 => 2.0811, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.54% (0.8067 => 0.8272, std. dev.: 0.0018) MultiSource/Applications/lua/lua: 2.53% (3.8723 => 3.9704, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.52% (1.5415 => 1.5804, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9765 => 0.9997, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.35% (0.6456 => 0.6608, std. dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.34% (0.6675 => 0.6831, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.26% (2.0665 => 2.1131, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.24% (1.5859 => 1.6215, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5981 => 0.6109, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.14% (2.2024 => 2.2495, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 2.08% (0.8921 => 0.9107, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.4186 => 1.4477, std. dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.88% (17.1811 => 17.5035, std. dev.: 0.0177) MultiSource/Applications/hexxagon/hexxagon: 1.82% (1.2842 => 1.3076, std. dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.60% (0.7115 => 0.7229, std. dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1840 => 1.2024, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.39% (2.2969 => 2.3288, std. dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.16% (1.0722 => 1.0846, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.06% (2.6778 => 2.9739, std. dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.99% (4.2280 => 4.3965, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (3.6395 => 3.7460, std. dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 1.73% (3.1578 => 3.2123, std. dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.65% (1.5086 => 1.5335, std. dev.: 0.0015) MultiSource/Applications/aha/aha: 1.40% (3.1595 => 3.2037, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.24% (1.0313 => 1.0441, std. dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2237, std. dev.: 0.0073) MultiSource/Applications/lua/lua: 1.06% (26.0924 => 26.3695, std. dev.: 0.0361) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3375, std. dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9198, std. dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.11% (6.6874 => 0.1267, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1629, std. dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.10% (5.3855 => 3.7108, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.70% (5.3526 => 3.7094, std. dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -14.95% (54.1659 => 46.0664, std. dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.19% (2.9384 => 2.5509, std. dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -12.05% (22.1758 => 19.5029, std. dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.50% (0.0400 => 0.0202, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std. dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.2373 => 1.1138, std. dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.84% (19.9488 => 18.5844, std. dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -6.32% (1.5373 => 1.4401, std. dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5038, std. dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.93% (1.5660 => 1.4888, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -4.66% (1.9577 => 1.8664, std. dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.17% (32.5116 => 31.4794, std. dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (8.1563 => 7.9037, std. dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.94% (8.6802 => 8.4253, std. dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0030, std. dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3315, std. dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -2.18% (12.4730 => 12.2006, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.74% (12.5348 => 12.3166, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std. dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std. dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std. dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.8329 => 1.8080, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7064, std. dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std. dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/053c5d80/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 12:26:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 12:26:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802172632.CD2132A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2593?compare_to=2591&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2593, Order: 161180, Start Time: 2012-08-02 16:12:44, End Time: 2012-08-02 17:27:03 To: 2591, Order: 161175, Start Time: 2012-08-02 14:30:53, End Time: 2012-08-02 15:44:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (142 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 954 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.90% (2.0176 => 2.3182, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.5818 => 0.6375, std. dev.: 0.0084) SingleSource/UnitTests/ObjC++/Hello: 9.45% (0.5748 => 0.6291, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.22% (0.3578 => 0.3908, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.05% (0.3646 => 0.3976, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std. dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.99% (0.7061 => 0.7696, std. dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3663 => 0.3989, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.89% (0.3789 => 0.4126, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 8.86% (0.3623 => 0.3944, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.85% (0.3650 => 0.3973, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.69% (0.3914 => 0.4254, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.48% (0.3940 => 0.4274, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.44% (0.4003 => 0.4341, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3130 => 0.3382, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1986 => 0.2139, std. dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std. dev.: 0.0009) MultiSource/Applications/hbd/hbd: 7.04% (1.3693 => 1.4657, std. dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.88% (3.9660 => 4.2388, std. dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (0.4328 => 0.4618, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.59% (0.7038 => 0.7502, std. dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.2721 => 0.2900, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.55% (0.2596 => 0.2766, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.51% (0.2782 => 0.2963, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.47% (0.7710 => 0.8209, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.44% (0.5265 => 0.5604, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2781 => 0.2960, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.10% (0.2607 => 0.2766, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4062 => 0.4306, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2655 => 0.2810, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2765 => 0.2926, std. dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 5.82% (0.2628 => 0.2781, std. dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.80% (0.4379 => 0.4633, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.80% (0.2760 => 0.2920, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.80% (0.3485 => 0.3687, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.75% (0.2937 => 0.3106, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.74% (1.2193 => 1.2893, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.72% (0.3899 => 0.4122, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2726 => 0.2881, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3580 => 0.3783, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.63% (0.3022 => 0.3192, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.60% (0.2966 => 0.3132, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.58% (1.9828 => 2.0934, std. dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.56% (0.3489 => 0.3683, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.52% (0.6959 => 0.7343, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.50% (0.3107 => 0.3278, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.46% (0.3149 => 0.3321, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.39% (0.3453 => 0.3639, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.30% (0.9199 => 0.9687, std. dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.2988 => 0.3146, std. dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 5.26% (13.8202 => 14.5472, std. dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.25% (0.5577 => 0.5870, std. dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.09% (16.6129 => 17.4578, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.08% (0.4016 => 0.4220, std. dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.97% (0.4390 => 0.4608, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 4.92% (0.3534 => 0.3708, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 4.89% (0.3293 => 0.3454, std. dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.85% (1.4563 => 1.5269, std. dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.80% (0.2914 => 0.3054, std. dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.80% (0.2127 => 0.2229, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.71% (0.3868 => 0.4050, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.68% (0.2243 => 0.2348, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 4.65% (0.2925 => 0.3061, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (7.2180 => 7.5519, std. dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.59% (0.5637 => 0.5896, std. dev.: 0.0018) MultiSource/Applications/spiff/spiff: 4.48% (0.7506 => 0.7842, std. dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (13.2842 => 13.8778, std. dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.44% (0.3246 => 0.3390, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 4.43% (0.8310 => 0.8678, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.40% (1.1364 => 1.1864, std. dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.40% (1.0594 => 1.1060, std. dev.: 0.0001) MultiSource/Applications/Burg/burg: 4.35% (1.1061 => 1.1542, std. dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.27% (1.3245 => 1.3811, std. dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 4.24% (0.2995 => 0.3122, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.3819 => 1.4399, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.18% (0.7460 => 0.7772, std. dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.15% (3.8646 => 4.0251, std. dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.3813 => 1.4385, std. dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.14% (1.9270 => 2.0067, std. dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.07% (1.2292 => 1.2792, std. dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.03% (3.6692 => 3.8169, std. dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.94% (4.4433 => 4.6183, std. dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.82% (4.3801 => 4.5476, std. dev.: 0.0082) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3220 => 0.3342, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3755 => 0.3890, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4791 => 0.4963, std. dev.: 0.0007) MultiSource/Applications/siod/siod: 3.55% (2.1791 => 2.2564, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.55% (1.1333 => 1.1735, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.43% (0.4113 => 0.4254, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.38% (4.9865 => 5.1551, std. dev.: 0.0114) MultiSource/Benchmarks/sim/sim: 3.29% (0.3131 => 0.3234, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.23% (0.6283 => 0.6486, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.16% (0.8698 => 0.8973, std. dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (8.4961 => 8.7644, std. dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.00% (0.6135 => 0.6319, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.00% (3.1889 => 3.2845, std. dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.91% (3.2742 => 3.3696, std. dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.87% (2.1007 => 2.1609, std. dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7081, std. dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (6.5754 => 6.7530, std. dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.67% (14.8535 => 15.2498, std. dev.: 0.0171) MultiSource/Applications/ClamAV/clamscan: 2.54% (14.5298 => 14.8982, std. dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.5188 => 1.5565, std. dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.37% (4.6629 => 4.7735, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.80% (0.9108 => 0.9272, std. dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.74% (0.6250 => 0.6359, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.46% (1.0313 => 1.0464, std. dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.2785 => 6.3481, std. dev.: 0.0125) MultiSource/Benchmarks/Bullet/bullet: 1.00% (33.2944 => 33.6283, std. dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std. dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2594, std. dev.: 0.0139) SingleSource/Benchmarks/Misc/mandel-2: 7.47% (1.2998 => 1.3969, std. dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.83% (1.5824 => 1.6746, std. dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.16% (0.9996 => 1.0512, std. dev.: 0.0050) SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.4271 => 7.7550, std. dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7397, std. dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.82% (1.9144 => 1.9875, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (2.8606 => 2.9659, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 2.91% (1.9199 => 1.9758, std. dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.32% (0.9692 => 0.9917, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std. dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (1.9290 => 1.9603, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5088, std. dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1959, std. dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.21% (1.0310 => 1.0435, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1395, std. dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.5627 => 21.1368, std. dev.: 0.0191) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.62% (0.2670 => 0.2520, std. dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -9.41% (1.2308 => 1.1150, std. dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.83% (20.3410 => 18.5447, std. dev.: 0.0175) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3074, std. dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std. dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.65% (0.4366 => 0.4163, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -3.36% (1.9762 => 1.9098, std. dev.: 0.0099) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.33% (0.4867 => 0.4705, std. dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9468, std. dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.57% (8.8259 => 8.5988, std. dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (0.8342 => 0.8150, std. dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -2.23% (6.3560 => 6.2144, std. dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std. dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.99% (6.6320 => 6.5003, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3305 => 7.2262, std. dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.30% (2.5254 => 2.4926, std. dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2546, std. dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8720, std. dev.: 0.0037) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2288, std. dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/50421725/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 12:39:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 12:39:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802173920.67F332A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2594?compare_to=2590&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2594, Order: 161175, Start Time: 2012-08-02 14:56:12, End Time: 2012-08-02 17:39:51 To: 2590, Order: 161165, Start Time: 2012-08-02 11:44:01, End Time: 2012-08-02 14:27:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 954 (780 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.48% (0.3446 => 0.3876, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.44% (0.3465 => 0.3896, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3488 => 0.3919, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.34% (0.3469 => 0.3897, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.31% (0.3460 => 0.3886, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.30% (0.3496 => 0.3926, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3643 => 0.4078, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.49% (0.3724 => 0.4152, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 6.56% (0.5826 => 0.6208, std. dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.48% (1.5932 => 1.6965, std. dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 6.32% (0.5889 => 0.6261, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.71% (0.4994 => 0.5279, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.62% (3.5627 => 3.7631, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (1.6211 => 1.7103, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.18% (0.4361 => 0.4587, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.18% (1.3152 => 1.3833, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.10% (0.5000 => 0.5255, std. dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 4.94% (0.7171 => 0.7525, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.82% (0.2866 => 0.3004, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.74% (0.5026 => 0.5264, std. dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.73% (0.5900 => 0.6179, std. dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.71% (0.3930 => 0.4115, std. dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.62% (1.0781 => 1.1279, std. dev.: 0.0035) MultiSource/Applications/spiff/spiff: 4.49% (0.4029 => 0.4210, std. dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.36% (4.2109 => 4.3946, std. dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.35% (0.3195 => 0.3334, std. dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.33% (2.7292 => 2.8475, std. dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sumcol: 4.17% (0.2875 => 0.2995, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 4.09% (0.3004 => 0.3127, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.02% (0.2738 => 0.2848, std. dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.02% (0.9909 => 1.0307, std. dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.95% (0.2736 => 0.2844, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 3.89% (0.2725 => 0.2831, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 3.87% (0.2792 => 0.2900, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 3.83% (0.2714 => 0.2818, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 3.78% (0.2750 => 0.2854, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.78% (0.3124 => 0.3242, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 3.78% (0.2780 => 0.2885, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.76% (2.0673 => 2.1450, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.74% (0.2811 => 0.2916, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 3.70% (0.2729 => 0.2830, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.68% (1.9694 => 2.0418, std. dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 3.67% (0.3267 => 0.3387, std. dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.64% (5.5417 => 5.7432, std. dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (2.1013 => 2.1776, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 3.62% (0.3096 => 0.3208, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.2823 => 0.2925, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 3.59% (0.2813 => 0.2914, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.59% (0.3317 => 0.3436, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.57% (0.2911 => 0.3015, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.56% (0.3258 => 0.3374, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.53% (1.9966 => 2.0671, std. dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (0.4658 => 0.4821, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.46% (0.3060 => 0.3166, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.44% (0.3890 => 0.4024, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.41% (0.3282 => 0.3394, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 3.40% (0.3678 => 0.3803, std. dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 3.39% (23.5202 => 24.3187, std. dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3362 => 0.3475, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3726 => 0.3850, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.4146 => 0.4280, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 3.23% (0.3348 => 0.3456, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.16% (2.1653 => 2.2338, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.3271 => 0.3374, std. dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3625 => 0.3738, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 3.11% (0.3477 => 0.3585, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (4.4195 => 4.5560, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.3903 => 0.4023, std. dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.06% (1.8794 => 1.9370, std. dev.: 0.0002) MultiSource/Applications/hbd/hbd: 3.06% (0.9697 => 0.9994, std. dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 3.04% (4.6177 => 4.7580, std. dev.: 0.0066) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.4139 => 0.4262, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.87% (0.4251 => 0.4373, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.81% (0.3981 => 0.4093, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.79% (0.3690 => 0.3793, std. dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.78% (0.3845 => 0.3952, std. dev.: 0.0002) MultiSource/Applications/treecc/treecc: 2.59% (0.7875 => 0.8079, std. dev.: 0.0019) MultiSource/Applications/lua/lua: 2.56% (1.4269 => 1.4634, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.38% (0.5546 => 0.5678, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.5012 => 0.5131, std. dev.: 0.0005) MultiSource/Applications/siod/siod: 2.32% (0.6634 => 0.6788, std. dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.6435 => 0.6575, std. dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.18% (2.0346 => 2.0586, std. dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std. dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 14.99% (2.5769 => 2.9632, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.08% (0.5917 => 0.6691, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6681, std. dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1655, std. dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (105.3826 => 107.6795, std. dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1979, std. dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4585, std. dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4960, std. dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.73% (49.7329 => 50.5916, std. dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2214, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std. dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std. dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.27% (11.9555 => 11.8033, std. dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5329, std. dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -8.35% (17.2379 => 15.7992, std. dev.: 0.1101) SingleSource/Benchmarks/Shootout-C++/ary2: -8.16% (0.2402 => 0.2206, std. dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7939, std. dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/moments: -3.90% (0.4438 => 0.4265, std. dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7993, std. dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -3.51% (14.0481 => 13.5544, std. dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std. dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/c97aa90e/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 12:39:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 12:39:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802173954.05EC72A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/2595?compare_to=2592&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2595, Order: 161180, Start Time: 2012-08-02 16:21:59, End Time: 2012-08-02 17:40:25 To: 2592, Order: 161175, Start Time: 2012-08-02 14:35:16, End Time: 2012-08-02 15:53:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (82 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 932 (757 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.57% (13.4903 => 13.8370, std. dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.22% (7.9570 => 8.0540, std. dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.47% (10.3673 => 13.8370, std. dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3473 => 0.3900, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.95% (0.3516 => 0.3936, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.94% (0.3543 => 0.3966, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3561 => 0.3984, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.74% (1.1194 => 1.2508, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3694 => 0.4125, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3927 => 0.4355, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.83% (1.7609 => 1.9163, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 8.78% (0.3817 => 0.4152, std. dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.55% (2.2022 => 2.3905, std. dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 7.82% (0.1432 => 0.1544, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1892 => 0.2014, std. dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 6.40% (0.5925 => 0.6304, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.39% (0.2065 => 0.2197, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.37% (0.6030 => 0.6414, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.39% (0.3282 => 0.3459, std. dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.39% (0.4879 => 0.5142, std. dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 5.23% (0.7326 => 0.7709, std. dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.16% (7.0540 => 7.4181, std. dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4615 => 0.4852, std. dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (10.4361 => 10.9296, std. dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 4.61% (9.4845 => 9.9221, std. dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.7433 => 0.7760, std. dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.09% (4.9449 => 5.1472, std. dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.06% (5.0018 => 5.2050, std. dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8172 => 0.8488, std. dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.86% (0.3109 => 0.3229, std. dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.79% (4.2646 => 4.4263, std. dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.75% (0.5569 => 0.5778, std. dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.75% (0.3121 => 0.3238, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.63% (0.5860 => 0.6073, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.44% (8.1363 => 8.4165, std. dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 3.39% (5.7591 => 5.9541, std. dev.: 0.0125) MultiSource/Applications/spiff/spiff: 3.34% (0.7835 => 0.8097, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.24% (1.3050 => 1.3473, std. dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.1861 => 1.2243, std. dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.13% (0.4636 => 0.4781, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.07% (0.4299 => 0.4431, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.00% (0.5105 => 0.5258, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (14.3668 => 14.7910, std. dev.: 0.0046) MultiSource/Applications/hbd/hbd: 2.85% (1.5603 => 1.6048, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.84% (1.1642 => 1.1973, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.72% (1.5415 => 1.5835, std. dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.63% (3.3354 => 3.4232, std. dev.: 0.0009) MultiSource/Applications/treecc/treecc: 2.57% (2.0273 => 2.0795, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.56% (0.4103 => 0.4208, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.8067 => 0.8270, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.49% (3.8723 => 3.9686, std. dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.49% (0.6675 => 0.6841, std. dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.46% (2.2024 => 2.2565, std. dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.45% (1.5859 => 1.6248, std. dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.44% (0.9765 => 1.0003, std. dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.40% (0.6456 => 0.6611, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.4289 => 0.4389, std. dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (2.0665 => 2.1123, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.07% (0.5981 => 0.6105, std. dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.05% (0.6450 => 0.6582, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4186 => 1.4469, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 1.95% (0.8921 => 0.9095, std. dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.77% (1.1840 => 1.2049, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.71% (1.2842 => 1.3062, std. dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4723, std. dev.: 0.0055) MultiSource/Applications/minisat/minisat: 1.63% (0.7115 => 0.7231, std. dev.: 0.0004) MultiSource/Applications/siod/siod: 1.45% (2.2969 => 2.3301, std. dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.08% (1.0722 => 1.0838, std. dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.05% (2.6778 => 2.9736, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.42% (4.2280 => 4.4147, std. dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (3.6395 => 3.7511, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1578 => 3.2160, std. dev.: 0.0002) MultiSource/Applications/aha/aha: 1.41% (3.1595 => 3.2041, std. dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0313 => 1.0439, std. dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3708, std. dev.: 0.0343) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.02% (2.8904 => 2.9200, std. dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1271, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.05% (5.2763 => 3.1630, std. dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7172, std. dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7141, std. dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.96% (54.1659 => 46.0638, std. dev.: 0.0581) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.52% (2.9384 => 2.5411, std. dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: -11.99% (22.1758 => 19.5178, std. dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std. dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -9.82% (1.2373 => 1.1158, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -7.04% (1.5373 => 1.4291, std. dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.95% (19.9488 => 18.5623, std. dev.: 0.0407) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.42% (2.7294 => 2.5541, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.92% (1.5660 => 1.4889, std. dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -4.71% (1.9577 => 1.8654, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std. dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5955, std. dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4711, std. dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (8.1563 => 7.9095, std. dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.87% (8.6802 => 8.4311, std. dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.73% (1.3677 => 1.3303, std. dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0030, std. dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2004, std. dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.73% (12.5348 => 12.3179, std. dev.: 0.0044) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4173, std. dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.27% (1.8329 => 1.8097, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std. dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/4d02bf45/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 14:11:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 14:11:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802191153.A3EEC2A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2596?compare_to=2593&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2596, Order: 161183, Start Time: 2012-08-02 17:55:04, End Time: 2012-08-02 19:08:54 To: 2593, Order: 161180, Start Time: 2012-08-02 16:12:44, End Time: 2012-08-02 17:27:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (28 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (716 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.33% (54.7787 => 56.6011, std. dev.: 0.0116) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 14.42% (2.0176 => 2.3086, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7061 => 0.7687, std. dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.65% (0.5818 => 0.6321, std. dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5748 => 0.6238, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.33% (0.3578 => 0.3876, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.16% (0.3601 => 0.3895, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.09% (0.3646 => 0.3941, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.05% (0.3663 => 0.3958, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3623 => 0.3911, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.92% (0.3650 => 0.3939, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.89% (0.3130 => 0.3377, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.66% (0.3940 => 0.4242, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1986 => 0.2138, std. dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std. dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std. dev.: 0.0010) MultiSource/Applications/hbd/hbd: 7.00% (1.3693 => 1.4651, std. dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.95% (0.2721 => 0.2910, std. dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.89% (0.7710 => 0.8241, std. dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.85% (3.9660 => 4.2378, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.66% (0.2596 => 0.2769, std. dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.58% (0.2782 => 0.2965, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.53% (0.5265 => 0.5609, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4062 => 0.4327, std. dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.7038 => 0.7491, std. dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2781 => 0.2957, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.95% (0.2607 => 0.2762, std. dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.91% (0.4379 => 0.4638, std. dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 5.87% (0.2690 => 0.2848, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.86% (0.2937 => 0.3109, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.82% (0.3485 => 0.3688, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.80% (0.2655 => 0.2809, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.80% (0.3899 => 0.4125, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.79% (0.2765 => 0.2925, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.78% (0.2628 => 0.2780, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.74% (1.2193 => 1.2893, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.6959 => 0.7353, std. dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.63% (0.4390 => 0.4637, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 5.62% (0.2760 => 0.2915, std. dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 5.58% (0.2761 => 0.2915, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.56% (0.3580 => 0.3779, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.53% (0.2966 => 0.3130, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.53% (0.2696 => 0.2845, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.53% (0.3022 => 0.3189, std. dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.50% (0.3489 => 0.3681, std. dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.49% (1.9828 => 2.0917, std. dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 5.47% (0.2726 => 0.2875, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.36% (0.5577 => 0.5876, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.3192 => 0.3363, std. dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.32% (0.9199 => 0.9688, std. dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 5.31% (0.3107 => 0.3272, std. dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3149 => 0.3314, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.21% (0.3453 => 0.3633, std. dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 5.18% (13.8202 => 14.5365, std. dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 4.97% (16.6129 => 17.4392, std. dev.: 0.0171) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.94% (0.2127 => 0.2232, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 4.87% (0.3534 => 0.3706, std. dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 4.83% (0.3293 => 0.3452, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.79% (1.4563 => 1.5261, std. dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.75% (0.2925 => 0.3064, std. dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.2243 => 0.2347, std. dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.62% (7.2180 => 7.5518, std. dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.61% (0.3756 => 0.3929, std. dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 4.60% (0.3868 => 0.4046, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 4.58% (0.8310 => 0.8691, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.58% (0.5637 => 0.5895, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (13.2842 => 13.8921, std. dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.56% (0.3246 => 0.3394, std. dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.54% (1.0594 => 1.1075, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.50% (1.1364 => 1.1875, std. dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.46% (1.3819 => 1.4435, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.45% (1.3245 => 1.3834, std. dev.: 0.0003) MultiSource/Applications/spiff/spiff: 4.44% (0.7506 => 0.7839, std. dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 4.37% (0.2995 => 0.3126, std. dev.: 0.0008) MultiSource/Applications/Burg/burg: 4.35% (1.1061 => 1.1542, std. dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.29% (1.3813 => 1.4405, std. dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.2945 => 0.3071, std. dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 4.22% (3.8646 => 4.0276, std. dev.: 0.0157) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.21% (0.7460 => 0.7774, std. dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.20% (1.9270 => 2.0080, std. dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.01% (3.6692 => 3.8162, std. dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 3.90% (1.2292 => 1.2772, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.87% (4.4433 => 4.6151, std. dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.85% (4.3801 => 4.5488, std. dev.: 0.0090) MultiSource/Benchmarks/McCat/18-imp/imp: 3.85% (0.3220 => 0.3344, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.80% (0.4791 => 0.4973, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.65% (4.9865 => 5.1684, std. dev.: 0.0026) MultiSource/Applications/siod/siod: 3.63% (2.1791 => 2.2583, std. dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.62% (0.3755 => 0.3891, std. dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.53% (0.6283 => 0.6505, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 3.53% (0.4113 => 0.4258, std. dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (1.1333 => 1.1723, std. dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 3.35% (0.3131 => 0.3236, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.33% (0.8698 => 0.8988, std. dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.4961 => 8.7789, std. dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.19% (0.6135 => 0.6331, std. dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.01% (3.2742 => 3.3727, std. dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.93% (2.1007 => 2.1622, std. dev.: 0.0146) MultiSource/Applications/d/make_dparser: 2.85% (3.1889 => 3.2799, std. dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.5754 => 6.7616, std. dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: 2.70% (14.8535 => 15.2539, std. dev.: 0.0120) MultiSource/Applications/oggenc/oggenc: 2.63% (4.6629 => 4.7855, std. dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.62% (16.2614 => 16.6881, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.62% (1.5188 => 1.5586, std. dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8962, std. dev.: 0.0156) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.11% (0.9108 => 0.9300, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6250 => 0.6371, std. dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.53% (1.0313 => 1.0471, std. dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.09% (33.2944 => 33.6584, std. dev.: 0.0169) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.07% (6.2785 => 6.3457, std. dev.: 0.0048) MultiSource/Applications/lua/lua: 1.05% (3.7467 => 3.7862, std. dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.25% (5.7573 => 7.4989, std. dev.: 0.0119) SingleSource/Benchmarks/Misc/fbench: 24.54% (1.8175 => 2.2636, std. dev.: 0.0363) SingleSource/Benchmarks/Misc/mandel-2: 7.49% (1.2998 => 1.3972, std. dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.87% (1.5824 => 1.6753, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.10% (0.9996 => 1.0506, std. dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 4.49% (7.4271 => 7.7605, std. dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7390, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 3.80% (1.9144 => 1.9872, std. dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.70% (2.8606 => 2.9664, std. dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: 2.95% (1.9199 => 1.9766, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.61% (1.7688 => 1.8150, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.28% (0.9692 => 0.9913, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std. dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 1.73% (0.8273 => 0.8416, std. dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.64% (1.5089 => 1.5337, std. dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5949, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std. dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5086, std. dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: 1.32% (9.0760 => 9.1960, std. dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.28% (2.0152 => 2.0409, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.22% (1.0310 => 1.0436, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std. dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/fldry: 1.16% (1.9290 => 1.9514, std. dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6856, std. dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.1560 => 1.1680, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.5627 => 21.1526, std. dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.39% (0.2670 => 0.2526, std. dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.50% (1.0460 => 0.8630, std. dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.66% (1.2308 => 1.0996, std. dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (20.3410 => 18.6143, std. dev.: 0.0499) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.31% (0.3139 => 0.2941, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std. dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std. dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.94% (1.3780 => 1.3099, std. dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.67% (0.4366 => 0.4162, std. dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.27% (6.2497 => 5.9828, std. dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std. dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -3.36% (1.9762 => 1.9098, std. dev.: 0.0040) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9453, std. dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.59% (8.8259 => 8.5972, std. dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (0.8342 => 0.8151, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -2.16% (6.3560 => 6.2190, std. dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.93% (6.6320 => 6.5039, std. dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std. dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3305 => 7.2153, std. dev.: 0.0276) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0050, std. dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2484, std. dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std. dev.: 0.0088) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/Vector/constpool Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/e1f84e80/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 14:29:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 14:29:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20120802192951.4C4BF2A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2597?compare_to=2595&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 2597, Order: 161183, Start Time: 2012-08-02 18:08:30, End Time: 2012-08-02 19:27:00 To: 2595, Order: 161180, Start Time: 2012-08-02 16:21:59, End Time: 2012-08-02 17:40:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (87 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (60 on baseline) Existing Failures: 20 (18 on baseline) Unchanged Tests: 934 (753 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 33.47% (10.3673 => 13.8371, std. dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3473 => 0.3904, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.12% (0.3497 => 0.3921, std. dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.08% (0.3543 => 0.3971, std. dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-3: 12.06% (0.3516 => 0.3940, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.05% (0.3543 => 0.3970, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std. dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.62% (1.1194 => 1.2495, std. dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std. dev.: 0.0028) SingleSource/UnitTests/ObjC/block-byref-aggr: 9.90% (0.3817 => 0.4195, std. dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.16% (1.7609 => 1.9222, std. dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.71% (2.2022 => 2.3941, std. dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 7.75% (0.1432 => 0.1543, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std. dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std. dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.02% (0.6030 => 0.6393, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 5.97% (0.5925 => 0.6279, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.55% (0.4879 => 0.5150, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.51% (0.3282 => 0.3463, std. dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 5.27% (0.7326 => 0.7712, std. dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.24% (0.4615 => 0.4857, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.11% (7.0540 => 7.4142, std. dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.09% (10.4361 => 10.9673, std. dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 4.55% (9.4845 => 9.9159, std. dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 4.24% (0.7433 => 0.7748, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.07% (4.9449 => 5.1464, std. dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.03% (0.2554 => 0.2657, std. dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (5.0018 => 5.2034, std. dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.00% (0.5569 => 0.5792, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.79% (0.8172 => 0.8482, std. dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 3.76% (0.3109 => 0.3226, std. dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.70% (4.2646 => 4.4222, std. dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3121 => 0.3233, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.53% (0.5860 => 0.6067, std. dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.34% (5.7591 => 5.9517, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.32% (8.1363 => 8.4061, std. dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3180 => 0.3285, std. dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 3.30% (0.3423 => 0.3536, std. dev.: 0.0007) MultiSource/Applications/spiff/spiff: 3.24% (0.7835 => 0.8089, std. dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.24% (1.1861 => 1.2245, std. dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.13% (1.3050 => 1.3458, std. dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 3.12% (0.4299 => 0.4433, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8017, std. dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.02% (0.4636 => 0.4776, std. dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.5105 => 0.5247, std. dev.: 0.0001) MultiSource/Applications/d/make_dparser: 2.76% (3.3354 => 3.4275, std. dev.: 0.0101) MultiSource/Applications/hbd/hbd: 2.67% (1.5603 => 1.6019, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.66% (2.0273 => 2.0812, std. dev.: 0.0018) MultiSource/Applications/Burg/burg: 2.65% (1.1642 => 1.1951, std. dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.56% (1.5415 => 1.5810, std. dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.50% (0.6675 => 0.6842, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.47% (0.4289 => 0.4395, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.46% (0.4103 => 0.4204, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.43% (0.8067 => 0.8263, std. dev.: 0.0007) MultiSource/Applications/lua/lua: 2.41% (3.8723 => 3.9658, std. dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (1.5859 => 1.6240, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.25% (2.0665 => 2.1130, std. dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (2.2024 => 2.2514, std. dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 2.20% (0.6456 => 0.6598, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.16% (0.9765 => 0.9976, std. dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.14% (0.6450 => 0.6588, std. dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 2.03% (0.8921 => 0.9102, std. dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.02% (1.4186 => 1.4473, std. dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.87% (0.5981 => 0.6093, std. dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 1.78% (1.1840 => 1.2051, std. dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.2842 => 1.3060, std. dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4716, std. dev.: 0.0136) MultiSource/Applications/minisat/minisat: 1.52% (0.7115 => 0.7223, std. dev.: 0.0002) MultiSource/Applications/siod/siod: 1.41% (2.2969 => 2.3293, std. dev.: 0.0022) MultiSource/Applications/lemon/lemon: 1.14% (1.0722 => 1.0844, std. dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std. dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.07% (2.6778 => 2.9741, std. dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.27% (4.2280 => 4.4085, std. dev.: 0.0083) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (3.6395 => 3.7499, std. dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.1578 => 3.2119, std. dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.62% (1.5086 => 1.5331, std. dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 1.54% (2.2771 => 2.3122, std. dev.: 0.0122) MultiSource/Applications/aha/aha: 1.45% (3.1595 => 3.2052, std. dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.33% (1.0313 => 1.0450, std. dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2244, std. dev.: 0.0173) MultiSource/Applications/lua/lua: 1.09% (26.0924 => 26.3766, std. dev.: 0.0468) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.04% (2.3135 => 2.3376, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.03% (2.8904 => 2.9201, std. dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1270, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.91% (5.2763 => 3.1705, std. dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.02% (5.3855 => 3.7151, std. dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7123, std. dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -15.06% (54.1659 => 46.0091, std. dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.45% (2.9384 => 2.5431, std. dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -12.09% (22.1758 => 19.4950, std. dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std. dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -9.76% (1.2373 => 1.1165, std. dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -9.00% (1.5373 => 1.3989, std. dev.: 0.0239) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.96% (19.9488 => 18.5601, std. dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.43% (2.7294 => 2.5540, std. dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.94% (1.8525 => 1.7610, std. dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.94% (1.5660 => 1.4887, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std. dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -4.70% (1.9577 => 1.8657, std. dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.54% (4.8142 => 4.5954, std. dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4716, std. dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.13% (8.6802 => 8.4082, std. dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (8.1563 => 7.9081, std. dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: -2.72% (10.2830 => 10.0028, std. dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std. dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.19% (12.4730 => 12.2004, std. dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6782, std. dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: -1.75% (12.5348 => 12.3160, std. dev.: 0.0062) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std. dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4178, std. dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.8329 => 1.8093, std. dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.10% (1.7254 => 1.7065, std. dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/e9f877f5/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 15:51:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 15:51:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20120802205132.100792A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2598?compare_to=2594&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 2598, Order: 161183, Start Time: 2012-08-02 18:08:05, End Time: 2012-08-02 20:52:01 To: 2594, Order: 161175, Start Time: 2012-08-02 14:56:12, End Time: 2012-08-02 17:39:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (80 on baseline) Performance Improvements: 0 (11 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 952 (803 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.66% (124.0453 => 129.8223, std. dev.: 0.7911) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (2.0692 => 2.0921, std. dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: 12.29% (0.3792 => 0.4258, std. dev.: 0.0112) SingleSource/UnitTests/ObjC/exceptions-2: 12.28% (0.3446 => 0.3869, std. dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 12.21% (0.3465 => 0.3888, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3460 => 0.3882, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.16% (0.3496 => 0.3921, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3488 => 0.3912, std. dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3442 => 0.3859, std. dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.11% (0.3469 => 0.3889, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.69% (0.3643 => 0.4069, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.62% (0.3650 => 0.4074, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std. dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std. dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 6.40% (1.5932 => 1.6951, std. dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 6.28% (0.5826 => 0.6192, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 5.98% (0.5889 => 0.6241, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.41% (3.5627 => 3.7556, std. dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.25% (1.6211 => 1.7062, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.89% (0.4994 => 0.5238, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.72% (0.4361 => 0.4567, std. dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.72% (0.5000 => 0.5236, std. dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.68% (1.3152 => 1.3767, std. dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.59% (0.5900 => 0.6171, std. dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 4.57% (0.7171 => 0.7499, std. dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.48% (0.3930 => 0.4106, std. dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.41% (1.0781 => 1.1256, std. dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.39% (0.4029 => 0.4206, std. dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (0.5026 => 0.5240, std. dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 4.21% (4.2109 => 4.3883, std. dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.97% (2.7292 => 2.8376, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.80% (0.2866 => 0.2975, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.80% (0.2736 => 0.2840, std. dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.75% (1.9694 => 2.0433, std. dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.60% (0.3195 => 0.3310, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.57% (0.3890 => 0.4029, std. dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.57% (5.5417 => 5.7397, std. dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 3.55% (0.2875 => 0.2977, std. dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 3.43% (0.3004 => 0.3107, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.39% (1.9966 => 2.0642, std. dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 3.36% (0.9909 => 1.0242, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.32% (2.1013 => 2.1710, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.19% (2.0673 => 2.1333, std. dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.18% (0.4658 => 0.4806, std. dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 3.15% (0.3267 => 0.3370, std. dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 3.10% (23.5202 => 24.2489, std. dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary: 3.07% (0.3258 => 0.3358, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.3271 => 0.3371, std. dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (2.1653 => 2.2300, std. dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.3903 => 0.4016, std. dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 2.88% (1.8794 => 1.9335, std. dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (4.4195 => 4.5435, std. dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.80% (0.4139 => 0.4255, std. dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 2.77% (4.6177 => 4.7457, std. dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: 2.75% (0.3678 => 0.3779, std. dev.: 0.0004) MultiSource/Applications/treecc/treecc: 2.74% (0.7875 => 0.8091, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 2.68% (0.3726 => 0.3826, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 2.57% (1.4269 => 1.4635, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.51% (0.4146 => 0.4250, std. dev.: 0.0011) MultiSource/Applications/siod/siod: 2.50% (0.6634 => 0.6800, std. dev.: 0.0019) MultiSource/Applications/hbd/hbd: 2.38% (0.9697 => 0.9928, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (0.4251 => 0.4351, std. dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.25% (0.5546 => 0.5671, std. dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.5012 => 0.5115, std. dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.6435 => 0.6553, std. dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std. dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 15.01% (2.5769 => 2.9636, std. dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.99% (0.0734 => 0.0844, std. dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.06% (0.5917 => 0.6690, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6753, std. dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std. dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1634, std. dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.17% (105.3826 => 107.6734, std. dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2131, std. dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std. dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5031, std. dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (49.7329 => 50.5903, std. dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std. dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std. dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std. dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.39% (11.9555 => 11.7898, std. dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5225, std. dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std. dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -7.67% (17.2379 => 15.9157, std. dev.: 0.1068) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8063, std. dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: -6.95% (0.2402 => 0.2235, std. dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -4.03% (0.4438 => 0.4259, std. dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.66% (14.0481 => 13.5342, std. dev.: 0.0132) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std. dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std. dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5755, std. dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.cs.uiuc.edu/pipermail/llvm-testresults/attachments/20120802/ea1caee6/attachment-0001.html From llvm-testresults at cs.uiuc.edu Thu Aug 2 15:57:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 2 Aug 2012 15:57:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20120802205725.A4E3C2A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/2599?compare_to=2596&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 2599, Order: 161198, Start Time: 2012-08-02 19:40:29, End Time: 2012-08-02 20:54:21 To: 2596, Order: 161183, Start Time: 2012-08-02 17:55:04, End Time: 2012-08-02 19:08:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (142 on baseline) Performance Improvements: 0 (29 on baseline) Added Tests: 0 (64 on baseline) Unchanged Tests: 953 (719 on baseline) Total Tests: 954 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.79% (79.3113 => 80.7339, std. dev.: 0.4286) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 15.19% (2.0176 => 2.3241, std. dev.: 0.0182) SingleSource/UnitTests/ObjC++/property-reference: 8.58% (0.7061 => 0.7667, std. dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.5818 => 0.6309, std. dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5748 => 0.6232, std. dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3130 => 0.3392, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.99% (0.3578 => 0.3864, std. dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.94% (0.3663 => 0.3954, std. dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.93% (0.3646 => 0.3935, std. dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std. dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 7.78% (0.3623 => 0.3905, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.75% (0.3650 => 0.3933, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3914 => 0.4217, std. dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.4003 => 0.4307, std. dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.50% (0.1986 => 0.2135, std. dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std. dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.30% (1.3693 => 1.4692, std. dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.29% (0.1413 => 0.1516, std. dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std. dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.96% (3.9660 => 4.2422, std. dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.2721 => 0.2905, std. dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5265 => 0.5619, std. dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 6.71% (0.7038 => 0.7510, std. dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4328 => 0.4615, std. dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.63% (0.2596 => 0.2768, std. dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2781 => 0.2962, std. dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (0.7710 => 0.8201, std. dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.25% (0.2782 => 0.2956, std. dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.00% (0.3899 => 0.4133, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.91% (0.4062 => 0.4302, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.87% (0.2607 => 0.2760, std. dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.78% (0.4379 => 0.4632, std. dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.73% (0.6959 => 0.7358, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.73% (1.2193 => 1.2892, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2655 => 0.2807, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.72% (0.2690 => 0.2844, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.70% (0.3580 => 0.3784, std. dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.70% (0.2966 => 0.3135, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.69% (0.2760 => 0.2917, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.69% (0.2937 => 0.3104, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.66% (0.3022 => 0.3193, std. dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2765 => 0.2921, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.63% (0.2628 => 0.2776, std. dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.59% (0.3489 => 0.3684, std. dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.57% (1.9828 => 2.0932, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.51% (0.2761 => 0.2913, std. dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.49% (0.3149 => 0.3322, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.48% (0.3485 => 0.3676, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.44% (0.3107 => 0.3276, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.42% (0.2696 => 0.2842, std. dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.40% (0.9199 => 0.9696, std. dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.38% (0.5577 => 0.5877, std. dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.32% (0.2988 => 0.3147, std. dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 5.27% (13.8202 => 14.5484, std. dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary2: 5.23% (0.3192 => 0.3359, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.18% (0.3453 => 0.3632, std. dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.09% (0.3534 => 0.3714, std. dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 5.05% (16.6129 => 17.4516, std. dev.: 0.0146) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.84% (0.2127 => 0.2230, std. dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.84% (0.2914 => 0.3055, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.81% (0.4016 => 0.4209, std. dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.80% (0.3293 => 0.3451, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (1.4563 => 1.5259, std. dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 4.78% (0.8310 => 0.8707, std. dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.77% (1.0594 => 1.1099, std. dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.70% (1.1364 => 1.1898, std. dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 4.68% (0.3868 => 0.4049, std. dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.66% (0.3756 => 0.3931, std. dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5637 => 0.5899, std. dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 4.59% (0.2243 => 0.2346, std. dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3246 => 0.3395, std. dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.56% (1.3245 => 1.3849, std. dev.: 0.0063) MultiSource/Benchmarks/McCat/09-vor/vor: 4.55% (0.2925 => 0.3058, std. dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.54% (7.2180 => 7.5458, std. dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.53% (13.2842 => 13.8861, std. dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 4.52% (3.8646 => 4.0391, std. dev.: 0.0038) MultiSource/Applications/treecc/treecc: 4.51% (1.9270 => 2.0139, std. dev.: 0.0008) MultiSource/Applications/spiff/spiff: 4.50% (0.7506 => 0.7844, std. dev.: 0.0065) MultiSource/Applications/Burg/burg: 4.35% (1.1061 => 1.1542, std. dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 4.34% (0.2995 => 0.3125, std. dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.28% (0.7460 => 0.7779, std. dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.24% (1.3819 => 1.4405, std. dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.21% (0.2945 => 0.3069, std. dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.18% (1.3813 => 1.4390, std. dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.16% (3.6692 => 3.8217, std. dev.: 0.0138) MultiSource/Applications/hexxagon/hexxagon: 4.06% (1.2292 => 1.2791, std. dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.03% (0.4791 => 0.4984, std. dev.: 0.0001) MultiSource/Applications/siod/siod: 3.96% (2.1791 => 2.2653, std. dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.90% (4.3801 => 4.5508, std. dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 3.88% (0.3220 => 0.3345, std. dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.88% (4.4433 => 4.6156, std. dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.66% (4.9865 => 5.1692, std. dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.57% (0.3755 => 0.3889, std. dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.49% (0.6283 => 0.6502, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.47% (0.8698 => 0.9000, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.46% (1.1333 => 1.1725, std. dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.45% (0.3131 => 0.3239, std. dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 3.43% (0.4113 => 0.4254, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.29% (0.6135 => 0.6337, std. dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (8.4961 => 8.7737, std. dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.19% (3.2742 => 3.3786, std. dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.18% (2.1007 => 2.1675, std. dev.: 0.0005) MultiSource/Applications/d/make_dparser: 3.03% (3.1889 => 3.2854, std. dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 2.94% (16.2614 => 16.7390, std. dev.: 0.0174) MultiSource/Applications/JM/lencod/lencod: 2.90% (14.8535 => 15.2849, std. dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.5754 => 6.7622, std. dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 2.83% (4.6629 => 4.7948, std. dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 2.74% (14.5298 => 14.9279, std. dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.69% (1.5188 => 1.5596, std. dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.12% (0.9108 => 0.9301, std. dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.6250 => 0.6366, std. dev.: 0.0006) MultiSource/Applications/lemon/lemon: 1.64% (1.0313 => 1.0482, std. dev.: 0.0005) MultiSource/Applications/lua/lua: 1.15% (3.7467 => 3.7898, std. dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.01% (6.2785 => 6.3418, std. dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std. dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5192, std. dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2720, std. dev.: 0.0133) SingleSource/Benchmarks/Misc/mandel-2: 8.04% (1.2998 => 1.4043, std. dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std. dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.88% (1.5824 => 1.6754, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.22% (0.9996 => 1.0518, std. dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 4.47% (7.4271 => 7.7589, std. dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 4.24% (11.2619 => 11.7390, std. dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std. dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-5: 3.83% (1.9144 => 1.9877, std. dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.69% (2.8606 => 2.9661, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 2.92% (1.9199 => 1.9759, std. dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.66% (1.7688 => 1.8158, std. dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.34% (0.9692 => 0.9919, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std. dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std. dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.49% (5.5130 => 5.5950, std. dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.44% (2.0200 => 2.0491, std. dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5095, std. dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.31% (9.0760 => 9.1953, std. dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 1.29% (2.0152 => 2.0411, std. dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.20% (1.0310 => 1.0434, std. dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std. dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.06% (3.6469 => 3.6857, std. dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (3.1071 => 3.1401, std. dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 1.01% (1.1560 => 1.1677, std. dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.5627 => 21.1690, std. dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.36% (0.2670 => 0.2527, std. dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std. dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.51% (1.0460 => 0.8628, std. dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -9.85% (1.2308 => 1.1096, std. dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.63% (20.3410 => 18.5862, std. dev.: 0.0772) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.34% (0.3139 => 0.2940, std. dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std. dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std. dev.: 0.0058) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std. dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/dro