From lattner at cs.uiuc.edu Mon May 22 20:15:05 2006 From: lattner at cs.uiuc.edu (Chris Lattner) Date: Mon, 22 May 2006 20:15:05 -0500 Subject: [llvm-commits] CVS: llvm-test/TEST.libcalls.report TEST.libcalls.Makefile Message-ID: <200605230115.UAA19344@zion.cs.uiuc.edu> Changes in directory llvm-test: TEST.libcalls.report added (r1.1) TEST.libcalls.Makefile updated: 1.2 -> 1.3 --- Log message: Add a report for the libcalls test and make it work like normal tests. It is now a useful example for an LLVM optimizer pass. --- Diffs of the changes: (+32 -2) TEST.libcalls.Makefile | 11 +++++++++-- TEST.libcalls.report | 23 +++++++++++++++++++++++ 2 files changed, 32 insertions(+), 2 deletions(-) Index: llvm-test/TEST.libcalls.report diff -c /dev/null llvm-test/TEST.libcalls.report:1.1 *** /dev/null Mon May 22 20:15:01 2006 --- llvm-test/TEST.libcalls.report Mon May 22 20:14:51 2006 *************** *** 0 **** --- 1,23 ---- + ##=== TEST.libcalls.report - Report desc for libcalls tests ----*- perl -*-===## + # + # This file defines a report to be generated for the libcalls test. + # + ##===----------------------------------------------------------------------===## + + # Sort by name + $SortCol = 1; + $TrimRepeatedPrefix = 1; + + # These are the columns for the report. The first entry is the header for the + # column, the second is the regex to use to match the value. Empty list create + # seperators, and closures may be put in for custom processing. + ( + # Name + ["Name" , '\'([^\']+)\' Program'], + [], + ["total", '([0-9]+).*Number of library calls simplified'], + [], + # Specifics + ["#exit", '([0-9]+).*Number of .exit. calls simplified'], + [] + ); Index: llvm-test/TEST.libcalls.Makefile diff -u llvm-test/TEST.libcalls.Makefile:1.2 llvm-test/TEST.libcalls.Makefile:1.3 --- llvm-test/TEST.libcalls.Makefile:1.2 Sat May 14 13:46:10 2005 +++ llvm-test/TEST.libcalls.Makefile Mon May 22 20:14:51 2006 @@ -7,13 +7,20 @@ # Usage: # make TEST=libcalls summary (short summary) # make TEST=libcalls (detailed list with time passes, etc.) +# make TEST=libcalls report +# make TEST=libcalls report.html # ##===----------------------------------------------------------------------===## -TDIR:=$(patsubst $(PROJ_OBJ_ROOT)/%,%,$(shell pwd)) +CURDIR := $(shell cd .; pwd) +PROGDIR := $(PROJ_SRC_ROOT) +RELDIR := $(subst $(PROGDIR),,$(CURDIR)) + $(PROGRAMS_TO_TEST:%=test.$(TEST).%): \ test.$(TEST).%: Output/%.$(TEST).report.txt - @echo "======= $(TDIR)/$*' Program" + @echo "---------------------------------------------------------------" + @echo ">>> ========= '$(RELDIR)/$*' Program" + @echo "---------------------------------------------------------------" @cat $< $(PROGRAMS_TO_TEST:%=Output/%.$(TEST).report.txt): \ From lattner at cs.uiuc.edu Mon May 22 20:25:23 2006 From: lattner at cs.uiuc.edu (Chris Lattner) Date: Mon, 22 May 2006 20:25:23 -0500 Subject: [llvm-commits] CVS: llvm/docs/TestingGuide.html Message-ID: <200605230125.UAA19405@zion.cs.uiuc.edu> Changes in directory llvm/docs: TestingGuide.html updated: 1.35 -> 1.36 --- Log message: Wrap long lines fix typo --- Diffs of the changes: (+20 -13) TestingGuide.html | 33 ++++++++++++++++++++------------- 1 files changed, 20 insertions(+), 13 deletions(-) Index: llvm/docs/TestingGuide.html diff -u llvm/docs/TestingGuide.html:1.35 llvm/docs/TestingGuide.html:1.36 --- llvm/docs/TestingGuide.html:1.35 Wed Apr 19 23:47:55 2006 +++ llvm/docs/TestingGuide.html Mon May 22 20:25:11 2006 @@ -108,9 +108,10 @@ programs in C and C++ is in the llvm-test module. This module should be checked out to the llvm/projects directory. When you configure the llvm module, the llvm-test module -will be automatically configured. Alternatively, you can configure the llvm-test module manually.
-To run all of the simple tests in LLVM using DejaGNU, use the master Makefile in the -llvm/test directory:
+will be automatically configured. Alternatively, you can configure the + llvm-test module manually. +To run all of the simple tests in LLVM using DejaGNU, use the master Makefile + in the llvm/test directory:
% gmake -C llvm/test@@ -323,11 +324,13 @@ that you might find useful when writing RUN lines.
Lastly, you can easily mark a test that is expected to fail on a -specific platform or with a specific version of llvmgcc by using the XFAIL keyword. Xfail lines are +specific platform or with a specific version of llvmgcc by using the + XFAIL keyword. Xfail lines are specified in the comments of the test program using XFAIL, followed by a colon, and one or more regular expressions (separated by a comma) that will match against the target triplet or llvmgcc version for the -machine. You can use * to match all targets. You can specify the major or full version (i.e. 3.4) for llvmgcc. Here is an example of an +machine. You can use * to match all targets. You can specify the major or full + version (i.e. 3.4) for llvmgcc. Here is an example of an XFAIL line:
; XFAIL: darwin,sun,llvmgcc4 @@ -402,8 +405,8 @@ are not executed inside of the LLVM source tree. This is because the test suite creates temporary files during execution. -The master Makefile in llvm/test is capable of running only the DejaGNU driven -tests. By default, it will run all of these tests.
+The master Makefile in llvm/test is capable of running only the DejaGNU +driven tests. By default, it will run all of these tests.
To run only the DejaGNU driven tests, run gmake at the command line in llvm/test. To run a specific directory of tests, use @@ -432,7 +435,8 @@ properly configured.
If you'd like to set up an instance of the nightly tester to run on your machine, take a look at the comments at the top of the utils/NightlyTester.pl file. We usually run it from a crontab entry -that looks ilke this:
+that looks like this:-5 3 * * * $HOME/llvm/utils/NightlyTest.pl -parallel $CVSROOT $HOME/buildtest-X86 $HOME/cvs/testresults-X86 +5 3 * * * $HOME/llvm/utils/NightlyTest.pl -parallel $CVSROOT \ + $HOME/buildtest $HOME/cvs/testresults