Commit Graph

230 Commits

Author SHA1 Message Date
Zach Mullen c32088cfee Local test timeouts will now always take precedence over the global --timeout option. 2009-12-08 10:26:43 -05:00
Zach Mullen b30f627190 CMake global timeout (--timeout option) should prevail over individual test timeouts if it is lower than the individual timeout. 2009-12-07 13:25:54 -05:00
Bill Hoffman 22c37b2b19 Hanle the case where a test can not be run because it is a bad executable. 2009-12-02 16:37:43 -05:00
Zach Mullen a52c0118d4 Added the --timeout option to ctest command line. This sets a global timeout on all tests if no more specific timeout is set on them. 2009-11-30 16:08:11 -05:00
Zach Mullen c9c0ee4056 Change logic of ctest subdirs command to allow for absolute paths. Also added test coverage for passing absolute paths to subdirs. 2009-11-10 10:40:24 -05:00
Zach Mullen 17afd5257b Bug 9090: CTest does not handle absolute paths in CTestTestfile SUBDIR( ) entries.
The ctest subdirs command now checks the relative path first, and if that does not exist, also checks if the given path was absolute.  Thanks vodall for the patch.
2009-11-09 14:07:36 -05:00
Zach Mullen 8612aa10b6 Hook for scheduling tests in a random order
This may help statistically detect implicit dependencies among unit
tests while running in parallel.
2009-10-29 15:30:12 -04:00
Zach Mullen 7fd3d7cf80 BUG: #0009648 Change "The following tests FAILED" message to print on stdout rather than stderr 2009-10-05 12:47:09 -04:00
David Cole ccb0cf1306 Fix warnings in CMake source code. 2009-10-02 15:30:01 -04:00
Brad King 96afb12087 Convert CMake to OSI-approved BSD License
This converts the CMake license to a pure 3-clause OSI-approved BSD
License.  We drop the previous license clause requiring modified
versions to be plainly marked.  We also update the CMake copyright to
cover the full development time range.
2009-09-28 11:43:28 -04:00
Bill Hoffman 8a690289c2 Add label summary times to ctest default output. Also, remove parallel time output. Add flag to disable label summary. 2009-09-11 13:34:35 -04:00
Zach Mullen 4b4e801eba BUG: Fixed segfault and bad reporting if a ctest executable could not be found. Also added some batch testing code that is not yet complete. 2009-09-10 11:16:08 -04:00
Zach Mullen a516040579 ENH: ctest now writes time cost data to a file after a test set is run, and uses these time costs to schedule the processes the next time ctest is run in that build tree. 2009-09-08 17:10:35 -04:00
Zach Mullen 39e5f9d963 ENH: Replaced the EXPENSIVE test property with a COST test property taking a floating point value. Tests are now started in descending order of their cost, which defaults to 0 if none is specified. 2009-09-08 13:39:13 -04:00
Zach Mullen 5fb958fde9 ENH: Added ctest test options PROCESSORS and RUN_SERIAL. These allow specification of resource allocation for given tests running with the ctest -j N option. RUN_SERIAL ensures that a given test does not run in parallel with any other test. Also forced appending of "..." to the longest test name in ctest. 2009-09-07 10:26:17 -04:00
Zach Mullen c6e5dd21fd Added the test property EXPENSIVE, which denotes that the given test(s) should be started prior to tests that are not marked as such. Also fixed test dependencies, and a few uninitialized variables in cmProcess. 2009-09-04 10:16:06 -04:00
Zach Mullen 20713ab89d Fixed warnings 2009-09-03 11:14:13 -04:00
Zach Mullen 659171d1f7 ENH: Added PARALLEL_LEVEL option for ctest_memcheck(). Added PROCESSORS option to set_tests_properties (implementation to come). 2009-09-03 10:47:14 -04:00
Zach Mullen 7e20db0224 ENH: Added PARALLEL_LEVEL option to ctest_test() command. 2009-09-02 12:35:42 -04:00
Zach Mullen 59b34a6a1a Fixed Dart time recording for ctest 2009-08-31 10:28:39 -04:00
Zach Mullen 5a5cc52230 Fixed conversion warning on 64 bit machines 2009-08-31 09:50:35 -04:00
Zach Mullen b0b5ffcf5c MemCheck should now work again in ctest 2009-08-28 15:08:03 -04:00
Zach Mullen b427d1985e Added ctest -N test. Fixed ctest working directory bug. MemCheck fix coming soon... 2009-08-28 11:08:39 -04:00
Zach Mullen 177edc5ed1 Fixed ctest -N segfault issue. Further refactored ctest. Enabled failover for ctest 2009-08-27 10:37:30 -04:00
Zach Mullen 8ffd8d0a03 ENH: refactored ctest. All testing is now parallel. If no -j option is specified, defaults to a MP level of 1 (non parallel) 2009-08-26 12:09:06 -04:00
Zach Mullen a2ef34d344 Fixed overwriting of a previous change set 2009-08-19 09:24:55 -04:00
Zach Mullen b9daa192af ENH: Refactored CTest test execution code into an object 2009-08-19 08:58:36 -04:00
Bill Hoffman c02c8c287c Add test times to log file as well as the stdout. 2009-08-18 14:03:50 -04:00
Bill Hoffman 3c34d0440c If labels are found on the tests, then print a time summary for all the tests run with each label. 2009-08-18 13:34:05 -04:00
Bill Hoffman a696fe8183 Output total time when using -j N 2009-08-11 22:02:49 -04:00
Brad King e9d7ebb3ec BUG: Do not double-initialize local generators
All global generator CreateLocalGenerator methods automatically
initialize the local generator instances with SetGlobalGenerator.  In
several places we were calling SetGlobalGenerator again after receiving
the return value from CreateLocalGenerator.  The double-initializations
leaked the resources allocated by the first call to SetGlobalGenerator.
This fix removes the unnecessary calls.
2009-07-28 10:47:02 -04:00
Bill Hoffman 40850e7f1f ENH: add test times and a total time to the output of command line ctest 2009-07-27 14:17:38 -04:00
Bill Hoffman a5b06dcbb6 ENH: fix warning 2009-07-19 13:40:38 -04:00
Bill Hoffman eb5d0a7f61 ENH: fix warning 2009-07-17 16:15:11 -04:00
Bill Hoffman 3250cb3d3b ENH: compute the max test name width based on the length of the tests 2009-07-17 10:06:38 -04:00
Brad King 5b51ad580b ENH: Reports "Passed" for WILL_FAIL tests
Previously tests marked with WILL_FAIL have been reported by CTest as

  ...............***Failed  - supposed to fail

when they correctly failed.  Now we just report ".....Passed" because
there is no reason to draw attention to something that works as
expected.
2009-07-02 16:13:55 -04:00
Bill Hoffman 3043ddf144 BUG: #8611 add pass fail reasons into log file 2009-02-27 16:28:07 -05:00
Bill Hoffman 3b73cdc89f ENH: add a CDash measured value showing the reason for passed and failed tests based on regular expressions 2009-02-24 17:23:51 -05:00
Bill Hoffman 4e710a9ebe ENH: add the ability to run tests by labels 2009-02-10 14:24:24 -05:00
Brad King dc13914cd6 ENH: Create cmXMLSafe to help escapes in XML
This class provides easy syntax to efficiently insert blocks of data
into XML documents with proper escapes.  It replaces the old
cmCTest::MakeXMLSafe and cmSystemTools::MakeXMLSafe methods which
allocated extra memory instead of directly streaming the data.
2009-02-05 16:31:37 -05:00
Brad King cc2092d5bb ENH: Put test labels in MemCheck results
This refactors generation of <Test> element headers and footers in
cmCTestTestHandler and re-uses it in cmCTestMemCheckHandler.  The change
removes duplicate code and enables the new <Labels> element for MemCheck
results.
2009-02-02 13:24:26 -05:00
David Cole 0a23c0ee40 BUG: Fix issue #8363. Wrap output with MakeXMLSafe calls so that the generated XML files are valid, parse-able XML. 2009-01-22 07:16:05 -05:00
Bill Hoffman be52e3b6fc BUG: fix for bug #8174 2009-01-15 10:32:56 -05:00
Brad King 447f5b303e ENH: Divide CTest file submission list by part
This splits the list of files for CTest to submit into those belonging
to each part.  The set is recombined just before submission.  Later this
will allow piecewise submissions.
2009-01-12 10:37:55 -05:00
Brad King cccac773ce ENH: Teach ctest_* to create appending XML files
This adds an APPEND option to the ctest_* commands which tells them to
put the Append="true" attribute in the Site element of their XML file.
2009-01-12 09:11:29 -05:00
Brad King 377bebb910 ENH: Teach CTest to submit test property LABELS
This teaches CTest to send the test property "LABELS" in Test.xml
dashboard submissions as Label elements inside a Labels element.
2009-01-07 10:41:37 -05:00
Bill Hoffman 690f83b81b STYLE: fix shadow warning 2008-12-19 10:19:37 -05:00
Bill Hoffman f5ee5cc04f BUG: partial fix for #8056 2008-12-18 21:59:25 -05:00
David Cole ceaef94ccc ENH: Implement feature request from issue 7885. Allow setting environment variables on a per-test basis for ctest using set_test_properties ENVIRONMENT. 2008-11-26 14:38:43 -05:00
Bill Hoffman ecf312ccc8 STYLE: fix line length stuff for KWStyle 2008-10-01 09:04:27 -04:00
Bill Hoffman 43fe0d3978 ENH: add max width option to ctest ouptut 2008-09-22 14:04:13 -04:00
Bill Hoffman 64fc597de2 ENH: add initial support for HAIKU OS from bug# 7425 2008-09-15 17:53:28 -04:00
Bill Hoffman bc58fe6485 COMP: fix warning 2008-07-06 22:06:08 -04:00
Bill Hoffman cb4eaeabe5 COMP: fix a few more warnings 2008-07-06 19:58:38 -04:00
Bill Hoffman 5292b3edef COMP: try to fix sgi compiler problem with set and also shorten symbol lengths for set class 2008-07-04 10:28:22 -04:00
Bill Hoffman 112d377fbb COMP: fix more warnings 2008-07-04 10:10:30 -04:00
Bill Hoffman fba54c56f2 COMP: fix warning 2008-07-04 09:55:26 -04:00
Bill Hoffman 7098b666fa COMP: fix some warnings 2008-07-04 09:50:32 -04:00
Bill Hoffman bb7b27e417 ENH: add initial ctest -j feature 2008-07-03 09:31:33 -04:00
Bill Hoffman aa53857f59 BUG: fix for bug 7136 2008-06-17 14:03:49 -04:00
Ken Martin 5020a1f4a0 ENH: make tes test finding logic also try full paths as relative paths because some folks have been doing that and 2.4 handled it 2008-05-30 09:14:25 -04:00
Bill Hoffman 1427aa8391 BUG: fix for bug 7077 handle DartMeasurement tags with tyep text/html 2008-05-23 11:28:46 -04:00
Ken Martin 70e9412dc7 BUG: minor fix for ctest 2008-01-31 16:33:07 -05:00
Ken Martin 21852384e0 ENH: read in old file formats Dart as well 2008-01-31 11:43:44 -05:00
Bill Hoffman 21e6791789 ENH: remove warnings 2008-01-30 11:54:55 -05:00
Bill Hoffman c4093afc52 ENH: enhancements for cdash, include system information and better time entries 2008-01-30 11:17:36 -05:00
Ken Martin 0e69d38004 ENH: add return and break support to cmake, also change basic command invocation signature to be able to return extra informaiton via the cmExecutionStatus class 2008-01-23 10:28:26 -05:00
Ken Martin c3ab83150c ENH: improve backwards compatibility 2008-01-19 15:09:36 -05:00
Ken Martin 7c473d4828 BUG: fix bugs 5539 (progress going beyond 100% when new files are added) and 5889 (tests are not found in some cases when using add_subdirectory to .. etc) 2008-01-18 10:25:25 -05:00
Ken Martin 456631225b ENH: use CTestTestfile.txt 2008-01-17 12:44:59 -05:00
Bill Hoffman 43c8923f14 BUG: try to fix crash 2007-11-08 13:03:37 -05:00
Bill Hoffman 5059adb5ff ENH: fix line length issues 2007-09-24 11:10:55 -04:00
Bill Hoffman 797db515a0 ENH: fix failing test when valgrind is on 2007-09-19 11:16:57 -04:00
Bill Hoffman 267fd538d8 ENH: fix build issue with config type not being specified by ctest 2007-09-17 10:40:57 -04:00
Bill Hoffman f262298bb0 ENH: fix 2 ctest issues, do not use the build type of ctest to look for config types, do not inherit pipes in child procs for ctest so it can kill them 2007-09-11 11:21:36 -04:00
Bill Hoffman ca31d33151 ENH: fix bug with valgrind output being truncated 2007-07-25 16:37:50 -04:00
Alexander Neundorf 61d3444f93 ENH: merge CMake-CrossCompileBasic to HEAD
-add a RESULT_VARIABLE to INCLUDE()
-add CMAKE_TOOLCHAIN_FILE for specifiying your (potentially crosscompiling) toolchain
-have TRY_RUN() complain if you try to use it in crosscompiling mode (which were compiled but cannot run on this system)
-use CMAKE_EXECUTABLE_SUFFIX in TRY_RUN(), probably TRY_RUN won't be able to
run the executables if they have a different suffix because they are
probably crosscompiled, but nevertheless it should be able to find them
-make several cmake variables presettable by the user: CMAKE_C/CXX_COMPILER, CMAKE_C/CXX_OUTPUT_EXTENSION, CMAKE_SYSTEM_NAME, CMAKE_SYSTEM_INFO_FILE
-support prefix for GNU toolchains (arm-elf-gcc, arm-elf-ar, arm-elf-strip etc.)
-move ranlib on OSX from the file command to a command in executed in cmake_install.cmake
-add support for stripping during install in cmake_install.cmake
-split out cl.cmake from Windows-cl.cmake, first (very incomplete) step to support MS crosscompiling tools
-remove stdio.h from the simple C program which checks if the compiler works, since this may not exist for some embedded platforms
-create a new CMakeFindBinUtils.cmake which collects the search fro ar, ranlib, strip, ld, link, install_name_tool and other tools like these
-add support for CMAKE_FIND_ROOT_PATH for all FIND_XXX commands, which is a
list of directories which will be prepended to all search directories, right
now as a cmake variable, turning it into a global cmake property may need
some more work
-remove cmTestTestHandler::TryExecutable(), it's unused
-split cmFileCommand::HandleInstall() into slightly smaller functions

Alex
2007-05-17 13:20:44 -04:00
Ken Martin 3abf39eda0 ENH: support for --build-config-sample feature #1022 2007-03-19 13:04:10 -04:00
Ken Martin 15d338e26f COMP: fix warning 2007-01-26 09:31:44 -05:00
Ken Martin 2f84bd1758 ENH: added per test timeout support 2007-01-25 11:16:16 -05:00
Ken Martin f7a5289e31 ENH: added total time limit for a CTest run bug 1207 2006-10-19 10:45:19 -04:00
Andy Cedilnik 2f713072c7 ENH: Report command line as a measurement and allow user to add custom measurements 2006-10-13 09:30:33 -04:00
Bill Hoffman 027b9cbe87 BUG: fix bug where converage was required to get valgrind output because of bad current directory 2006-10-05 17:53:09 -04:00
Andy Cedilnik a9c0929d39 COMP: Handle both ansi and non-ansi C 2006-07-26 11:46:22 -04:00
Andy Cedilnik d2710d5142 STYLE: Fix kwstyle 2006-07-13 09:13:29 -04:00
Andy Cedilnik 6101b67610 ENH: Remove debug 2006-07-12 16:30:14 -04:00
Andy Cedilnik 6bdff06594 STYLE: Remove debug 2006-07-12 09:21:43 -04:00
Andy Cedilnik 12cc89a8e5 BUG: Try to fix the problem of bad test names 2006-07-11 15:58:07 -04:00
Ken Martin aae0bcdacf STYLE: fix line length 2006-05-10 13:50:44 -04:00
Andy Cedilnik 386900bfdd ENH: Several cleanups and make sure things get propagated where they should. Also, allow to load CTest custom files to the actual ctest -S script 2006-03-29 12:01:24 -05:00
Andy Cedilnik 867e41d23b BUG: Couple of memcheck bugs: Log files should really be different for test and memcheck. Also make sure to not trunkate the output of the test until the valgrind or any other checking is pefrormed. 2006-03-16 11:29:12 -05:00
Ken Martin 3d96e52261 STYLE: some m_ to this-> cleanup 2006-03-15 11:02:08 -05:00
Andy Cedilnik 862f5df25c STYLE: Fix some style issues 2006-03-10 15:03:09 -05:00
Andy Cedilnik 6503a0eecc STYLE: Fix some style issues 2006-03-09 11:17:10 -05:00
Ken Martin 3480c252a3 ENH: change the pass regexp so that it overrides the return value 2005-11-10 10:55:04 -05:00
Andy Cedilnik 4e9d832525 ENH: Change flag to PASS_REGULAR_EXPRESSION and FAIL_REGULAR_EXPRESSION and add help in cmSetTestsPropertiesCommand 2005-11-09 11:07:36 -05:00
Andy Cedilnik 34e7834451 ENH: Add support for output reguilar expression 2005-11-08 17:59:20 -05:00
Andy Cedilnik baa7b749e4 BUG: Initialize to something resonable 2005-10-19 11:00:06 -04:00
Andy Cedilnik 33ac18891f BUG: If test passes but it should fail, report an error 2005-10-17 09:09:51 -04:00
Andy Cedilnik 0d824e1d1a ENH: Properly report failed tests 2005-09-20 15:08:41 -04:00
Andy Cedilnik 51a19d99ba ENH: Modify output based on wether it is tested or memory checked 2005-09-19 15:11:54 -04:00
Andy Cedilnik fcce3ac0a1 ENH: Add a way for test to intentionally fail 2005-09-06 23:31:41 -04:00
Bill Hoffman 62ae06081e ENH: use native Deployment and Development directories 2005-08-30 13:58:46 -04:00
Andy Cedilnik a274a8fb77 ENH: Improve log file strategy 2005-08-18 13:50:16 -04:00
Ken Martin 7df63f38c5 BUG: do not search the user's path for text executables when a full path is provided to the test 2005-08-09 13:12:03 -04:00
Andy Cedilnik 0e76ab6eb6 BUG: Go back to the original directory after examining the current directory 2005-07-12 12:31:42 -04:00
Andy Cedilnik c9a7f056fd BUG: Make sure it always starts in the current directory when searching for tests 2005-07-12 12:30:15 -04:00
Andy Cedilnik e712c7c05e ENH: Improve performance of testing and do not complain if DartTestfile.txt is not found or if directory does not exist 2005-07-02 22:30:37 -04:00
Andy Cedilnik 1b578d3180 ENH: Several improvements with the way things are handled. Also, support multiple submited files 2005-06-23 13:04:18 -04:00
Andy Cedilnik 1823e78d5c BUG: Fix displaying of percentage 2005-06-22 10:54:19 -04:00
Ken Martin 68cb67c3b1 COMP: see about fixing warning 2005-06-20 08:59:33 -04:00
Andy Cedilnik 6ab962b348 ENH: Pass configuration type to subprocesses 2005-06-17 15:43:35 -04:00
Andy Cedilnik d9dc9b54a6 ENH: Add superclass for all commands and handlers. Improve handlers to have initialization code, and start initializing ctest when start is invoked 2005-06-17 13:04:56 -04:00
Andy Cedilnik 7758abb2e6 BUG: Remove debugging code 2005-06-07 10:55:44 -04:00
Andy Cedilnik 33f9780ade ENH: Use CMake for parsing DartTestfile.txt 2005-06-07 09:06:38 -04:00
Andy Cedilnik 7f7cf5ee6b COMP: Remove ERROR reserved word or something and replace with ERROR_MESSAGE 2005-05-31 18:40:43 -04:00
Andy Cedilnik f6e5a878fc ENH: Add support for writing output file. While doing that, redesign the way ctest does output. There may still be problems with commands failing, but that should be fixed by applying the similar concept to whole CMake 2005-05-31 17:32:40 -04:00
Andy Cedilnik 7acfc4dc3c ENH: Start adding support for CTest testfiles 2005-04-01 14:57:55 -05:00
Andy Cedilnik 28f2dfb752 BUG: Detect when TestsToRunInformation is not set 2005-02-17 16:59:22 -05:00
Andy Cedilnik d5aafe1b93 ENH: Some more generalization 2005-02-17 16:11:10 -05:00
Andy Cedilnik c22cc421e0 ENH: Several cleanups and improvements 2005-01-27 15:54:47 -05:00
Andy Cedilnik dc0ce24cc6 ENH: Add a superclass to all handlers 2005-01-27 11:43:22 -05:00
Andy Cedilnik 62b310bc52 ENH: Add compression support to XML files 2005-01-27 10:15:01 -05:00
Andy Cedilnik f6cd83d6f3 ENH: Add support for shrinking the output of the test 2005-01-26 11:13:12 -05:00
Ken Martin 5a0366c6e0 ENH: added -U option to take union of -R and -I 2004-11-13 09:55:31 -05:00
Andy Cedilnik 0cbf55745a BUG: Fix reporting of path and full command when test program was not found 2004-10-21 16:07:33 -04:00
Andy Cedilnik b40cd9fc3b ENH: Cleanups and unify output 2004-10-17 22:47:15 -04:00
Andy Cedilnik 64a6ad4975 BUG: Remove maximum size of test output 2004-09-29 14:14:17 -04:00
Ken Martin be7722b368 missing include 2004-09-09 10:52:51 -04:00
Ken Martin 43d8918f40 more cleanup of ctest 2004-09-09 08:41:05 -04:00