[LLVMdev] Testing documentation and terminology
tonic at nondot.org
Fri May 23 22:52:39 CDT 2008
>> Currently, the first is called the "LLVM test suite" (which is the
>> subject of
>> the testing documentation). The second is called the DejaGNU tests,
>> fragment tests or llvm/test. The last one is the most confusing,
>> it's called
>> the whole program tests, test-suite (named after the svn directory
>> it is in,
>> easily confused with the entire test suite), llvm-test (named after
>> directory in which you should place it, easily confused with llvm/
> llvm-test was the name of the CVS module. When we moved to SVN, it
> got renamed to test-suite, which I consider to be very confusing. We
> should probably recommend that people check it out into test-suite,
> and refer to it as that. Alternatively, change the svn module name to
> something more useful.
I think at one time we did try to allow people to check it out as
test-suite, but there is something in the Makefiles that require it
to be llvm-test (I don't know exactly what though). So this is
something that needs to be fixed. It would be great to get it fixed.
>> Furthermore, I would no longer refer to all of llvm's testing stuff
>> as the
>> "LLVM test suite", but use the term "LLVM test architecture" or
>> "framework" or
>> something similar (suggestions?).
> LLVM testing infrastructure?
>> Since the testing stuff is composed of two
>> distinct parts, I'm not sure the term "suite" is appropriate here.
>> If people
>> think that "test suite" is still very much appropriate here, I think
>> renaming the "test-suite" svn module would be in order.
> Right. It is somewhat complicated by the fact that "llvm-test" is
> really just a collection of programs with some makefile drivers. How
> about calling it "program-tests" or "llvm-program-tests" or something
> like that?
>> Lastly, I would refer to the "whole program tests" as the "Test
>> suite", since
>> it is a suite of testing programs that can be run as a whole. This
>> will also
>> make sure that the name properly matches the svn module that the
>> program tests" are housing in.
> Yeah, we definitely need a better name :)
>> After these changes, I think the testing framework should be a lot
>> easier to
>> describe and document and more accessible to new users.
> Sounds great to me,
> LLVM Developers mailing list
> LLVMdev at cs.uiuc.edu http://llvm.cs.uiuc.edu
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the LLVMdev