Zach Mullen
c32088cfee
Local test timeouts will now always take precedence over the global --timeout option.
2009-12-08 10:26:43 -05:00
Zach Mullen
b30f627190
CMake global timeout (--timeout option) should prevail over individual test timeouts if it is lower than the individual timeout.
2009-12-07 13:25:54 -05:00
Bill Hoffman
22c37b2b19
Hanle the case where a test can not be run because it is a bad executable.
2009-12-02 16:37:43 -05:00
Zach Mullen
a52c0118d4
Added the --timeout option to ctest command line. This sets a global timeout on all tests if no more specific timeout is set on them.
2009-11-30 16:08:11 -05:00
Zach Mullen
c9c0ee4056
Change logic of ctest subdirs command to allow for absolute paths. Also added test coverage for passing absolute paths to subdirs.
2009-11-10 10:40:24 -05:00
Zach Mullen
17afd5257b
Bug 9090: CTest does not handle absolute paths in CTestTestfile SUBDIR( ) entries.
...
The ctest subdirs command now checks the relative path first, and if that does not exist, also checks if the given path was absolute. Thanks vodall for the patch.
2009-11-09 14:07:36 -05:00
Zach Mullen
8612aa10b6
Hook for scheduling tests in a random order
...
This may help statistically detect implicit dependencies among unit
tests while running in parallel.
2009-10-29 15:30:12 -04:00
Zach Mullen
7fd3d7cf80
BUG: #0009648 Change "The following tests FAILED" message to print on stdout rather than stderr
2009-10-05 12:47:09 -04:00
David Cole
ccb0cf1306
Fix warnings in CMake source code.
2009-10-02 15:30:01 -04:00
Brad King
96afb12087
Convert CMake to OSI-approved BSD License
...
This converts the CMake license to a pure 3-clause OSI-approved BSD
License. We drop the previous license clause requiring modified
versions to be plainly marked. We also update the CMake copyright to
cover the full development time range.
2009-09-28 11:43:28 -04:00
Bill Hoffman
8a690289c2
Add label summary times to ctest default output. Also, remove parallel time output. Add flag to disable label summary.
2009-09-11 13:34:35 -04:00
Zach Mullen
4b4e801eba
BUG: Fixed segfault and bad reporting if a ctest executable could not be found. Also added some batch testing code that is not yet complete.
2009-09-10 11:16:08 -04:00
Zach Mullen
a516040579
ENH: ctest now writes time cost data to a file after a test set is run, and uses these time costs to schedule the processes the next time ctest is run in that build tree.
2009-09-08 17:10:35 -04:00
Zach Mullen
39e5f9d963
ENH: Replaced the EXPENSIVE test property with a COST test property taking a floating point value. Tests are now started in descending order of their cost, which defaults to 0 if none is specified.
2009-09-08 13:39:13 -04:00
Zach Mullen
5fb958fde9
ENH: Added ctest test options PROCESSORS and RUN_SERIAL. These allow specification of resource allocation for given tests running with the ctest -j N option. RUN_SERIAL ensures that a given test does not run in parallel with any other test. Also forced appending of "..." to the longest test name in ctest.
2009-09-07 10:26:17 -04:00
Zach Mullen
c6e5dd21fd
Added the test property EXPENSIVE, which denotes that the given test(s) should be started prior to tests that are not marked as such. Also fixed test dependencies, and a few uninitialized variables in cmProcess.
2009-09-04 10:16:06 -04:00
Zach Mullen
20713ab89d
Fixed warnings
2009-09-03 11:14:13 -04:00
Zach Mullen
659171d1f7
ENH: Added PARALLEL_LEVEL option for ctest_memcheck(). Added PROCESSORS option to set_tests_properties (implementation to come).
2009-09-03 10:47:14 -04:00
Zach Mullen
7e20db0224
ENH: Added PARALLEL_LEVEL option to ctest_test() command.
2009-09-02 12:35:42 -04:00
Zach Mullen
59b34a6a1a
Fixed Dart time recording for ctest
2009-08-31 10:28:39 -04:00
Zach Mullen
5a5cc52230
Fixed conversion warning on 64 bit machines
2009-08-31 09:50:35 -04:00
Zach Mullen
b0b5ffcf5c
MemCheck should now work again in ctest
2009-08-28 15:08:03 -04:00
Zach Mullen
b427d1985e
Added ctest -N test. Fixed ctest working directory bug. MemCheck fix coming soon...
2009-08-28 11:08:39 -04:00
Zach Mullen
177edc5ed1
Fixed ctest -N segfault issue. Further refactored ctest. Enabled failover for ctest
2009-08-27 10:37:30 -04:00
Zach Mullen
8ffd8d0a03
ENH: refactored ctest. All testing is now parallel. If no -j option is specified, defaults to a MP level of 1 (non parallel)
2009-08-26 12:09:06 -04:00
Zach Mullen
a2ef34d344
Fixed overwriting of a previous change set
2009-08-19 09:24:55 -04:00
Zach Mullen
b9daa192af
ENH: Refactored CTest test execution code into an object
2009-08-19 08:58:36 -04:00
Bill Hoffman
c02c8c287c
Add test times to log file as well as the stdout.
2009-08-18 14:03:50 -04:00
Bill Hoffman
3c34d0440c
If labels are found on the tests, then print a time summary for all the tests run with each label.
2009-08-18 13:34:05 -04:00
Bill Hoffman
a696fe8183
Output total time when using -j N
2009-08-11 22:02:49 -04:00
Brad King
e9d7ebb3ec
BUG: Do not double-initialize local generators
...
All global generator CreateLocalGenerator methods automatically
initialize the local generator instances with SetGlobalGenerator. In
several places we were calling SetGlobalGenerator again after receiving
the return value from CreateLocalGenerator. The double-initializations
leaked the resources allocated by the first call to SetGlobalGenerator.
This fix removes the unnecessary calls.
2009-07-28 10:47:02 -04:00
Bill Hoffman
40850e7f1f
ENH: add test times and a total time to the output of command line ctest
2009-07-27 14:17:38 -04:00
Bill Hoffman
a5b06dcbb6
ENH: fix warning
2009-07-19 13:40:38 -04:00
Bill Hoffman
eb5d0a7f61
ENH: fix warning
2009-07-17 16:15:11 -04:00
Bill Hoffman
3250cb3d3b
ENH: compute the max test name width based on the length of the tests
2009-07-17 10:06:38 -04:00
Brad King
5b51ad580b
ENH: Reports "Passed" for WILL_FAIL tests
...
Previously tests marked with WILL_FAIL have been reported by CTest as
...............***Failed - supposed to fail
when they correctly failed. Now we just report ".....Passed" because
there is no reason to draw attention to something that works as
expected.
2009-07-02 16:13:55 -04:00
Bill Hoffman
3043ddf144
BUG: #8611 add pass fail reasons into log file
2009-02-27 16:28:07 -05:00
Bill Hoffman
3b73cdc89f
ENH: add a CDash measured value showing the reason for passed and failed tests based on regular expressions
2009-02-24 17:23:51 -05:00
Bill Hoffman
4e710a9ebe
ENH: add the ability to run tests by labels
2009-02-10 14:24:24 -05:00
Brad King
dc13914cd6
ENH: Create cmXMLSafe to help escapes in XML
...
This class provides easy syntax to efficiently insert blocks of data
into XML documents with proper escapes. It replaces the old
cmCTest::MakeXMLSafe and cmSystemTools::MakeXMLSafe methods which
allocated extra memory instead of directly streaming the data.
2009-02-05 16:31:37 -05:00
Brad King
cc2092d5bb
ENH: Put test labels in MemCheck results
...
This refactors generation of <Test> element headers and footers in
cmCTestTestHandler and re-uses it in cmCTestMemCheckHandler. The change
removes duplicate code and enables the new <Labels> element for MemCheck
results.
2009-02-02 13:24:26 -05:00
David Cole
0a23c0ee40
BUG: Fix issue #8363 . Wrap output with MakeXMLSafe calls so that the generated XML files are valid, parse-able XML.
2009-01-22 07:16:05 -05:00
Bill Hoffman
be52e3b6fc
BUG: fix for bug #8174
2009-01-15 10:32:56 -05:00
Brad King
447f5b303e
ENH: Divide CTest file submission list by part
...
This splits the list of files for CTest to submit into those belonging
to each part. The set is recombined just before submission. Later this
will allow piecewise submissions.
2009-01-12 10:37:55 -05:00
Brad King
cccac773ce
ENH: Teach ctest_* to create appending XML files
...
This adds an APPEND option to the ctest_* commands which tells them to
put the Append="true" attribute in the Site element of their XML file.
2009-01-12 09:11:29 -05:00
Brad King
377bebb910
ENH: Teach CTest to submit test property LABELS
...
This teaches CTest to send the test property "LABELS" in Test.xml
dashboard submissions as Label elements inside a Labels element.
2009-01-07 10:41:37 -05:00
Bill Hoffman
690f83b81b
STYLE: fix shadow warning
2008-12-19 10:19:37 -05:00
Bill Hoffman
f5ee5cc04f
BUG: partial fix for #8056
2008-12-18 21:59:25 -05:00
David Cole
ceaef94ccc
ENH: Implement feature request from issue 7885. Allow setting environment variables on a per-test basis for ctest using set_test_properties ENVIRONMENT.
2008-11-26 14:38:43 -05:00
Bill Hoffman
ecf312ccc8
STYLE: fix line length stuff for KWStyle
2008-10-01 09:04:27 -04:00
Bill Hoffman
43fe0d3978
ENH: add max width option to ctest ouptut
2008-09-22 14:04:13 -04:00
Bill Hoffman
64fc597de2
ENH: add initial support for HAIKU OS from bug# 7425
2008-09-15 17:53:28 -04:00
Bill Hoffman
bc58fe6485
COMP: fix warning
2008-07-06 22:06:08 -04:00
Bill Hoffman
cb4eaeabe5
COMP: fix a few more warnings
2008-07-06 19:58:38 -04:00
Bill Hoffman
5292b3edef
COMP: try to fix sgi compiler problem with set and also shorten symbol lengths for set class
2008-07-04 10:28:22 -04:00
Bill Hoffman
112d377fbb
COMP: fix more warnings
2008-07-04 10:10:30 -04:00
Bill Hoffman
fba54c56f2
COMP: fix warning
2008-07-04 09:55:26 -04:00
Bill Hoffman
7098b666fa
COMP: fix some warnings
2008-07-04 09:50:32 -04:00
Bill Hoffman
bb7b27e417
ENH: add initial ctest -j feature
2008-07-03 09:31:33 -04:00
Bill Hoffman
aa53857f59
BUG: fix for bug 7136
2008-06-17 14:03:49 -04:00
Ken Martin
5020a1f4a0
ENH: make tes test finding logic also try full paths as relative paths because some folks have been doing that and 2.4 handled it
2008-05-30 09:14:25 -04:00
Bill Hoffman
1427aa8391
BUG: fix for bug 7077 handle DartMeasurement tags with tyep text/html
2008-05-23 11:28:46 -04:00
Ken Martin
70e9412dc7
BUG: minor fix for ctest
2008-01-31 16:33:07 -05:00
Ken Martin
21852384e0
ENH: read in old file formats Dart as well
2008-01-31 11:43:44 -05:00
Bill Hoffman
21e6791789
ENH: remove warnings
2008-01-30 11:54:55 -05:00
Bill Hoffman
c4093afc52
ENH: enhancements for cdash, include system information and better time entries
2008-01-30 11:17:36 -05:00
Ken Martin
0e69d38004
ENH: add return and break support to cmake, also change basic command invocation signature to be able to return extra informaiton via the cmExecutionStatus class
2008-01-23 10:28:26 -05:00
Ken Martin
c3ab83150c
ENH: improve backwards compatibility
2008-01-19 15:09:36 -05:00
Ken Martin
7c473d4828
BUG: fix bugs 5539 (progress going beyond 100% when new files are added) and 5889 (tests are not found in some cases when using add_subdirectory to .. etc)
2008-01-18 10:25:25 -05:00
Ken Martin
456631225b
ENH: use CTestTestfile.txt
2008-01-17 12:44:59 -05:00
Bill Hoffman
43c8923f14
BUG: try to fix crash
2007-11-08 13:03:37 -05:00
Bill Hoffman
5059adb5ff
ENH: fix line length issues
2007-09-24 11:10:55 -04:00
Bill Hoffman
797db515a0
ENH: fix failing test when valgrind is on
2007-09-19 11:16:57 -04:00
Bill Hoffman
267fd538d8
ENH: fix build issue with config type not being specified by ctest
2007-09-17 10:40:57 -04:00
Bill Hoffman
f262298bb0
ENH: fix 2 ctest issues, do not use the build type of ctest to look for config types, do not inherit pipes in child procs for ctest so it can kill them
2007-09-11 11:21:36 -04:00
Bill Hoffman
ca31d33151
ENH: fix bug with valgrind output being truncated
2007-07-25 16:37:50 -04:00
Alexander Neundorf
61d3444f93
ENH: merge CMake-CrossCompileBasic to HEAD
...
-add a RESULT_VARIABLE to INCLUDE()
-add CMAKE_TOOLCHAIN_FILE for specifiying your (potentially crosscompiling) toolchain
-have TRY_RUN() complain if you try to use it in crosscompiling mode (which were compiled but cannot run on this system)
-use CMAKE_EXECUTABLE_SUFFIX in TRY_RUN(), probably TRY_RUN won't be able to
run the executables if they have a different suffix because they are
probably crosscompiled, but nevertheless it should be able to find them
-make several cmake variables presettable by the user: CMAKE_C/CXX_COMPILER, CMAKE_C/CXX_OUTPUT_EXTENSION, CMAKE_SYSTEM_NAME, CMAKE_SYSTEM_INFO_FILE
-support prefix for GNU toolchains (arm-elf-gcc, arm-elf-ar, arm-elf-strip etc.)
-move ranlib on OSX from the file command to a command in executed in cmake_install.cmake
-add support for stripping during install in cmake_install.cmake
-split out cl.cmake from Windows-cl.cmake, first (very incomplete) step to support MS crosscompiling tools
-remove stdio.h from the simple C program which checks if the compiler works, since this may not exist for some embedded platforms
-create a new CMakeFindBinUtils.cmake which collects the search fro ar, ranlib, strip, ld, link, install_name_tool and other tools like these
-add support for CMAKE_FIND_ROOT_PATH for all FIND_XXX commands, which is a
list of directories which will be prepended to all search directories, right
now as a cmake variable, turning it into a global cmake property may need
some more work
-remove cmTestTestHandler::TryExecutable(), it's unused
-split cmFileCommand::HandleInstall() into slightly smaller functions
Alex
2007-05-17 13:20:44 -04:00
Ken Martin
3abf39eda0
ENH: support for --build-config-sample feature #1022
2007-03-19 13:04:10 -04:00
Ken Martin
15d338e26f
COMP: fix warning
2007-01-26 09:31:44 -05:00
Ken Martin
2f84bd1758
ENH: added per test timeout support
2007-01-25 11:16:16 -05:00
Ken Martin
f7a5289e31
ENH: added total time limit for a CTest run bug 1207
2006-10-19 10:45:19 -04:00
Andy Cedilnik
2f713072c7
ENH: Report command line as a measurement and allow user to add custom measurements
2006-10-13 09:30:33 -04:00
Bill Hoffman
027b9cbe87
BUG: fix bug where converage was required to get valgrind output because of bad current directory
2006-10-05 17:53:09 -04:00
Andy Cedilnik
a9c0929d39
COMP: Handle both ansi and non-ansi C
2006-07-26 11:46:22 -04:00
Andy Cedilnik
d2710d5142
STYLE: Fix kwstyle
2006-07-13 09:13:29 -04:00
Andy Cedilnik
6101b67610
ENH: Remove debug
2006-07-12 16:30:14 -04:00
Andy Cedilnik
6bdff06594
STYLE: Remove debug
2006-07-12 09:21:43 -04:00
Andy Cedilnik
12cc89a8e5
BUG: Try to fix the problem of bad test names
2006-07-11 15:58:07 -04:00
Ken Martin
aae0bcdacf
STYLE: fix line length
2006-05-10 13:50:44 -04:00
Andy Cedilnik
386900bfdd
ENH: Several cleanups and make sure things get propagated where they should. Also, allow to load CTest custom files to the actual ctest -S script
2006-03-29 12:01:24 -05:00
Andy Cedilnik
867e41d23b
BUG: Couple of memcheck bugs: Log files should really be different for test and memcheck. Also make sure to not trunkate the output of the test until the valgrind or any other checking is pefrormed.
2006-03-16 11:29:12 -05:00
Ken Martin
3d96e52261
STYLE: some m_ to this-> cleanup
2006-03-15 11:02:08 -05:00
Andy Cedilnik
862f5df25c
STYLE: Fix some style issues
2006-03-10 15:03:09 -05:00
Andy Cedilnik
6503a0eecc
STYLE: Fix some style issues
2006-03-09 11:17:10 -05:00
Ken Martin
3480c252a3
ENH: change the pass regexp so that it overrides the return value
2005-11-10 10:55:04 -05:00
Andy Cedilnik
4e9d832525
ENH: Change flag to PASS_REGULAR_EXPRESSION and FAIL_REGULAR_EXPRESSION and add help in cmSetTestsPropertiesCommand
2005-11-09 11:07:36 -05:00
Andy Cedilnik
34e7834451
ENH: Add support for output reguilar expression
2005-11-08 17:59:20 -05:00
Andy Cedilnik
baa7b749e4
BUG: Initialize to something resonable
2005-10-19 11:00:06 -04:00
Andy Cedilnik
33ac18891f
BUG: If test passes but it should fail, report an error
2005-10-17 09:09:51 -04:00
Andy Cedilnik
0d824e1d1a
ENH: Properly report failed tests
2005-09-20 15:08:41 -04:00
Andy Cedilnik
51a19d99ba
ENH: Modify output based on wether it is tested or memory checked
2005-09-19 15:11:54 -04:00
Andy Cedilnik
fcce3ac0a1
ENH: Add a way for test to intentionally fail
2005-09-06 23:31:41 -04:00
Bill Hoffman
62ae06081e
ENH: use native Deployment and Development directories
2005-08-30 13:58:46 -04:00
Andy Cedilnik
a274a8fb77
ENH: Improve log file strategy
2005-08-18 13:50:16 -04:00
Ken Martin
7df63f38c5
BUG: do not search the user's path for text executables when a full path is provided to the test
2005-08-09 13:12:03 -04:00
Andy Cedilnik
0e76ab6eb6
BUG: Go back to the original directory after examining the current directory
2005-07-12 12:31:42 -04:00
Andy Cedilnik
c9a7f056fd
BUG: Make sure it always starts in the current directory when searching for tests
2005-07-12 12:30:15 -04:00
Andy Cedilnik
e712c7c05e
ENH: Improve performance of testing and do not complain if DartTestfile.txt is not found or if directory does not exist
2005-07-02 22:30:37 -04:00
Andy Cedilnik
1b578d3180
ENH: Several improvements with the way things are handled. Also, support multiple submited files
2005-06-23 13:04:18 -04:00
Andy Cedilnik
1823e78d5c
BUG: Fix displaying of percentage
2005-06-22 10:54:19 -04:00
Ken Martin
68cb67c3b1
COMP: see about fixing warning
2005-06-20 08:59:33 -04:00
Andy Cedilnik
6ab962b348
ENH: Pass configuration type to subprocesses
2005-06-17 15:43:35 -04:00
Andy Cedilnik
d9dc9b54a6
ENH: Add superclass for all commands and handlers. Improve handlers to have initialization code, and start initializing ctest when start is invoked
2005-06-17 13:04:56 -04:00
Andy Cedilnik
7758abb2e6
BUG: Remove debugging code
2005-06-07 10:55:44 -04:00
Andy Cedilnik
33f9780ade
ENH: Use CMake for parsing DartTestfile.txt
2005-06-07 09:06:38 -04:00
Andy Cedilnik
7f7cf5ee6b
COMP: Remove ERROR reserved word or something and replace with ERROR_MESSAGE
2005-05-31 18:40:43 -04:00
Andy Cedilnik
f6e5a878fc
ENH: Add support for writing output file. While doing that, redesign the way ctest does output. There may still be problems with commands failing, but that should be fixed by applying the similar concept to whole CMake
2005-05-31 17:32:40 -04:00
Andy Cedilnik
7acfc4dc3c
ENH: Start adding support for CTest testfiles
2005-04-01 14:57:55 -05:00
Andy Cedilnik
28f2dfb752
BUG: Detect when TestsToRunInformation is not set
2005-02-17 16:59:22 -05:00
Andy Cedilnik
d5aafe1b93
ENH: Some more generalization
2005-02-17 16:11:10 -05:00
Andy Cedilnik
c22cc421e0
ENH: Several cleanups and improvements
2005-01-27 15:54:47 -05:00
Andy Cedilnik
dc0ce24cc6
ENH: Add a superclass to all handlers
2005-01-27 11:43:22 -05:00
Andy Cedilnik
62b310bc52
ENH: Add compression support to XML files
2005-01-27 10:15:01 -05:00
Andy Cedilnik
f6cd83d6f3
ENH: Add support for shrinking the output of the test
2005-01-26 11:13:12 -05:00
Ken Martin
5a0366c6e0
ENH: added -U option to take union of -R and -I
2004-11-13 09:55:31 -05:00
Andy Cedilnik
0cbf55745a
BUG: Fix reporting of path and full command when test program was not found
2004-10-21 16:07:33 -04:00
Andy Cedilnik
b40cd9fc3b
ENH: Cleanups and unify output
2004-10-17 22:47:15 -04:00
Andy Cedilnik
64a6ad4975
BUG: Remove maximum size of test output
2004-09-29 14:14:17 -04:00
Ken Martin
be7722b368
missing include
2004-09-09 10:52:51 -04:00
Ken Martin
43d8918f40
more cleanup of ctest
2004-09-09 08:41:05 -04:00