Zach Mullen
5bfe1a1962
Changed XML formatting of files attached to test so that each file is archived and marked up individually, in order to make things easier on the CDash side. Also switched to using the NamedMeasurement tag instead of a new tag.
2009-12-15 14:24:24 -05:00
Zach Mullen
dc66139f7c
CTest-side changes to allow users to attach arbitrary files to test results that will be submitted to cdash using the ATTACHED_FILES test property.
2009-12-15 12:07:15 -05:00
Zach Mullen
b2e7da885d
Added a "-http1.0" option to ctest to make it submit using curl's http 1.0 option. Also added parsing of html reponse output to determine whether errors or warnings were sent in response from the server. If errors or warnings occurred, the response is output to stdout, and the "submission successful" message has been changed to accurately reflect whether or not warnings or errors were returned with the response.
2009-12-11 14:10:37 -05:00
Zach Mullen
5e427677c3
Restore the "***Not Run" message to ctest command line output for tests which did not start due to missing/bad executables or missing required files.
2009-12-10 15:51:56 -05:00
Zach Mullen
4de7cc3621
Unfortunately, I noticed the comment on bug 8668 too late. This changes my last implementation of the exe wrapper to something which makes much more sense: a REQUIRED_FILES property on tests.
2009-12-10 15:37:04 -05:00
Zach Mullen
48b6133928
[0008668: CTest Dev: Missing executables shown as failed tests when using MPI.] Added a wrapping option to add_test so that exes built by the project can be safely wrapped in other exes and be listed as "not run" rather than "failed" if they are not built.
2009-12-10 14:38:32 -05:00
Zach Mullen
08ac33fe6a
Fix memory leak that occurred when a test executable could not be started. (See BadExe test)
2009-12-10 09:39:19 -05:00
Zach Mullen
c32088cfee
Local test timeouts will now always take precedence over the global --timeout option.
2009-12-08 10:26:43 -05:00
Zach Mullen
b30f627190
CMake global timeout (--timeout option) should prevail over individual test timeouts if it is lower than the individual timeout.
2009-12-07 13:25:54 -05:00
David Cole
0b38bb4c53
Fix issue #2336 - honor the -C arg to ctest. Honor it for all stages of running -D dashboards from the command line and running ctest_configure, ctest_build and ctest_test commands in -S scripts. Also, allow a script to change it by setting the CTEST_CONFIGURATION_TYPE variable: allows for multiple configuration build/test cycles within one script. Add a new signature for the cmake command build_command that accepts CONFIGURATION as one argument. The original build_command signature is still there, but now marked as deprecated in the documentation. Of course... also add CTestConfig tests to verify that -C is honored for -D dashboards and -S scripts.
2009-12-04 12:09:01 -05:00
Bill Hoffman
22c37b2b19
Hanle the case where a test can not be run because it is a bad executable.
2009-12-02 16:37:43 -05:00
Zach Mullen
c17ce46c73
Align test output for timeout condition.
2009-11-30 16:09:00 -05:00
Zach Mullen
a52c0118d4
Added the --timeout option to ctest command line. This sets a global timeout on all tests if no more specific timeout is set on them.
2009-11-30 16:08:11 -05:00
Brad King
e1548142fb
CTest: Move initial checkout to ctest_start()
...
In CTest command-driven script mode we support starting without a source
tree. Previously the ctest_start() command would do some initialization
but could not do anything that required CTestConfig.cmake from the input
source tree. Later, ctest_update() would run CTEST_CHECKOUT_COMMAND to
create the source tree, and then re-initialize everything. This
delayed-initialization approach led to many complicated cases of which
only some worked. For example, the second initialization only worked
correctly in Nightly mode and simply failed for Experimental and
Continuous builds.
A simpler solution is to run CTEST_CHECKOUT_COMMAND during ctest_start()
and then have a single initialization path. In principle this change in
behavior could break scripts that set the checkout command after
ctest_start() but before ctest_update(). However, the convention we've
always followed has been to set all variables before ctest_start().
See issue #9450 .
2009-11-24 08:58:59 -05:00
Zach Mullen
2921fa96ed
Handle multiple carriage return issue on windows VS9. Also make sure that running ctest in showonly mode does not kill our cost store, since many ctest tests do this and corrupt our cost data.
2009-11-16 10:58:43 -05:00
Bill Hoffman
1b48d361d8
fix number of callers to work with newer versions of valgrind
2009-11-11 08:43:15 -05:00
Zach Mullen
c9c0ee4056
Change logic of ctest subdirs command to allow for absolute paths. Also added test coverage for passing absolute paths to subdirs.
2009-11-10 10:40:24 -05:00
Zach Mullen
f7899c7445
Fixed a bug where it was possible for a test to be started twice if a lower-indexed test depended on it.
2009-11-09 16:07:47 -05:00
Zach Mullen
17afd5257b
Bug 9090: CTest does not handle absolute paths in CTestTestfile SUBDIR( ) entries.
...
The ctest subdirs command now checks the relative path first, and if that does not exist, also checks if the given path was absolute. Thanks vodall for the patch.
2009-11-09 14:07:36 -05:00
Zach Mullen
9f105a3f6d
Fix style warning in cmsystemtools, cosmetic change to ctest code
2009-11-05 11:37:47 -05:00
Zach Mullen
9aa4e134b5
Fixed infinite loop condition when a test's dependent test executable could not be found.
2009-11-05 11:03:07 -05:00
Zach Mullen
85912a3777
Added TARGET, CONFIGURATION, PROJECT_NAME, and FLAGS arguments to ctest_build command
2009-11-03 16:46:30 -05:00
Zach Mullen
d47ada823a
Added logic to check for cycles in the test dependency graph before any tests are run. Previously a cycle resulted in a segfault from stack overflow.
2009-11-02 12:52:50 -05:00
Zach Mullen
8612aa10b6
Hook for scheduling tests in a random order
...
This may help statistically detect implicit dependencies among unit
tests while running in parallel.
2009-10-29 15:30:12 -04:00
Bill Hoffman
d7a3277fb3
Fix bug#9767 catch missing leak.
2009-10-29 08:38:04 -04:00
Zach Mullen
e2b63e473d
Fix working dir issue for ctest show only mode (-N)
2009-10-27 10:16:01 -04:00
Zach Mullen
99697308f3
Add a ctest test to cover cmCTestBatchTestHandler. Since its behavior isn't fully defined yet, we just run it as is and don't care much about the result.
2009-10-26 09:44:08 -04:00
Zach Mullen
f2010871ba
Ctest was broken for subdirs. Restored working directory state for tests so that their executables could be found.
2009-10-20 10:54:02 -04:00
Zach Mullen
727fa7bcb6
Fix ctest output alignment for cases where total tests run is not the same width as max test index.
2009-10-15 12:02:22 -04:00
David Cole
85feea2d0d
Fix floating point comparison warnings. Thanks to Alex Neundorf for the patch.
2009-10-13 16:39:48 -04:00
David Cole
4439f17b20
Fix issue #5668 - use CollapseFullPath when determining if covered file is within source or binary tree. Allows gcc/gcov coverage analysis using MinGW on Windows.
2009-10-12 14:51:54 -04:00
Zach Mullen
7fd3d7cf80
BUG: #0009648 Change "The following tests FAILED" message to print on stdout rather than stderr
2009-10-05 12:47:09 -04:00
Zach Mullen
b304186bc5
Match width of ctest "Start xx: " line to line up with the end test line
2009-10-05 10:20:52 -04:00
Alexander Neundorf
b3040beb41
fix two more warnings from icpc
...
asfGlob and abfGlob were there since rev 1.3 of this file (Oct 17th 2004) and unused since
then, so remove them
Alex
2009-10-04 11:40:02 -04:00
David Cole
ccb0cf1306
Fix warnings in CMake source code.
2009-10-02 15:30:01 -04:00
David Cole
44bcba7461
Fix warnings in CMake source code. Suppress rampant warnings emanating from Qt files.
2009-10-01 16:47:08 -04:00
Zach Mullen
a5be445ca9
BUG: CTest should honor test timeouts.
2009-09-29 14:31:58 -04:00
Zach Mullen
202bb45695
BUG: 0009612: --output-on-failure option doesn't work with the new parallel CTest handler
2009-09-29 09:45:43 -04:00
Brad King
96afb12087
Convert CMake to OSI-approved BSD License
...
This converts the CMake license to a pure 3-clause OSI-approved BSD
License. We drop the previous license clause requiring modified
versions to be plainly marked. We also update the CMake copyright to
cover the full development time range.
2009-09-28 11:43:28 -04:00
Zach Mullen
5e06f0a557
Fixed uninitialized memory issue in ctest show-only mode
2009-09-25 11:45:19 -04:00
Zach Mullen
5a2f24856e
Output a message in ctest when each test is started
2009-09-24 13:49:20 -04:00
Zach Mullen
65c418e56f
Reformat ctest -N output. Removed the "Start processing tests" message as well.
2009-09-24 09:49:46 -04:00
Zach Mullen
84f3f6cad6
Tests which are not run should be added to the failed test list.
2009-09-23 15:37:50 -04:00
Zach Mullen
4342e37d63
More SLURM experimentation (ctest batch mode)
2009-09-21 15:29:34 -04:00
Zach Mullen
a4c6f178fe
Fixed a slurm batch argument identifier.
2009-09-21 14:58:30 -04:00
Zach Mullen
87b4c66ca8
Need to quote args when generating batch scripts from ctest
2009-09-21 14:21:41 -04:00
Zach Mullen
e4293b4b38
Re-enabled failing tests; fixed ctest_build output to be consistent in the error condition across different make programs so that these tests would pass.
2009-09-21 13:40:40 -04:00
Bill Hoffman
932dac93b7
Fix uninitialized errors.
2009-09-16 11:49:09 -04:00
Zach Mullen
243bbae954
Removed fork-and-continue option from ctest generated batch script entries
2009-09-14 11:23:20 -04:00
Brad King
bcbb4626a3
Avoid shadowing std::vector member
...
The cmProcess::Buffer class derives from std::vector. We were using
local variable 'data' in the GetLine method but this name shadowed a
member of vector with GNU. This renames it to 'text'.
2009-09-12 10:20:00 -04:00