aad15c3abf
Fix issue #10060 - add APPEND arg to ctest_start command.
...
If APPEND is given to ctest_start, it will read the tag from the current existing Testing/TAG file rather than creating a new one based on the current time stamp. This allows a developer to run several dashboard scripts in a row, all of which will share the same tag/stamp/buildid when they finally get submitted to CDash. Now you can split the running of build phases and test phases for the same dashboard row into multiple scripts.
2009-12-29 14:38:31 -05:00
4d3a387ac6
Preserve environment variables across calls to cmCTestScriptHandler::RunConfigurationScript. This will help prevent problems like we are currently experiencing (regarding CMake continuous dashboards only running once each day because the HOME environment variable is modified indirectly by a command in a called script, but affects the environment in the calling script).
2009-12-23 14:34:46 -05:00
cb27cfb1cc
Use human-readable Git commit times in Update.xml
...
Previously we produced commit times formatted like
1261403774 -0500
which is what the Git plumbing prints. Now we use a human-readable
format like
2009-12-21 15:28:06 -0500
which is still easy to machine-parse.
2009-12-21 10:29:00 -05:00
3312e3d710
Fix size type conversion warning in RunTest.
2009-12-21 09:52:56 -05:00
66f44f64d5
Fix segfault on Borland compiler resulting from divide by 0.
2009-12-18 11:42:58 -05:00
a4cdd73636
Use literal quotes in Update.xml UpdateCommand
...
Previously we escaped quotes in <UpdateCommand>...</UpdateCommand>
values using '"'. This is not necessary because the value is in
xml CDATA and not an xml attribute.
2009-12-18 10:54:24 -05:00
3e724b2725
Submit Subversion directory path in Update.xml
...
A Subversion revision is unique across the entire repository, but work
trees typically correspond only to a subdirectory below the root path.
In order to specify the version of the source code that was tested,
CTest now submits a <SVNPath> element in Update.xml that specifies the
directory of the repository that corresponds to the work tree. In
combination with the revision number this uniquely specifies the tested
source. See issue #7541 .
2009-12-18 08:19:41 -05:00
a73833d037
Submit global tree revision in Update.xml
...
We teach CTest to report in a <Revision> element the revision of the
source tree that was tested. This makes sense for all modern VCS tools
because they version the whole tree. We simply omit this element for
CVS because it only versions files. See issue #7541 .
2009-12-18 08:13:51 -05:00
1842d2eae0
Fix output compression error message
2009-12-17 11:17:57 -05:00
ff916b48bd
CTest output submitted to the dashboard is now compressed by default.
2009-12-17 11:14:49 -05:00
9add940eb6
Added an option to conditionally attach files to a test submission only if the test does not pass. Also some preliminary changes for test output compression.
2009-12-16 14:50:16 -05:00
5bfe1a1962
Changed XML formatting of files attached to test so that each file is archived and marked up individually, in order to make things easier on the CDash side. Also switched to using the NamedMeasurement tag instead of a new tag.
2009-12-15 14:24:24 -05:00
dc66139f7c
CTest-side changes to allow users to attach arbitrary files to test results that will be submitted to cdash using the ATTACHED_FILES test property.
2009-12-15 12:07:15 -05:00
b2e7da885d
Added a "-http1.0" option to ctest to make it submit using curl's http 1.0 option. Also added parsing of html reponse output to determine whether errors or warnings were sent in response from the server. If errors or warnings occurred, the response is output to stdout, and the "submission successful" message has been changed to accurately reflect whether or not warnings or errors were returned with the response.
2009-12-11 14:10:37 -05:00
5e427677c3
Restore the "***Not Run" message to ctest command line output for tests which did not start due to missing/bad executables or missing required files.
2009-12-10 15:51:56 -05:00
4de7cc3621
Unfortunately, I noticed the comment on bug 8668 too late. This changes my last implementation of the exe wrapper to something which makes much more sense: a REQUIRED_FILES property on tests.
2009-12-10 15:37:04 -05:00
48b6133928
[0008668: CTest Dev: Missing executables shown as failed tests when using MPI.] Added a wrapping option to add_test so that exes built by the project can be safely wrapped in other exes and be listed as "not run" rather than "failed" if they are not built.
2009-12-10 14:38:32 -05:00
08ac33fe6a
Fix memory leak that occurred when a test executable could not be started. (See BadExe test)
2009-12-10 09:39:19 -05:00
c32088cfee
Local test timeouts will now always take precedence over the global --timeout option.
2009-12-08 10:26:43 -05:00
b30f627190
CMake global timeout (--timeout option) should prevail over individual test timeouts if it is lower than the individual timeout.
2009-12-07 13:25:54 -05:00
0b38bb4c53
Fix issue #2336 - honor the -C arg to ctest. Honor it for all stages of running -D dashboards from the command line and running ctest_configure, ctest_build and ctest_test commands in -S scripts. Also, allow a script to change it by setting the CTEST_CONFIGURATION_TYPE variable: allows for multiple configuration build/test cycles within one script. Add a new signature for the cmake command build_command that accepts CONFIGURATION as one argument. The original build_command signature is still there, but now marked as deprecated in the documentation. Of course... also add CTestConfig tests to verify that -C is honored for -D dashboards and -S scripts.
2009-12-04 12:09:01 -05:00
22c37b2b19
Hanle the case where a test can not be run because it is a bad executable.
2009-12-02 16:37:43 -05:00
c17ce46c73
Align test output for timeout condition.
2009-11-30 16:09:00 -05:00
a52c0118d4
Added the --timeout option to ctest command line. This sets a global timeout on all tests if no more specific timeout is set on them.
2009-11-30 16:08:11 -05:00
e1548142fb
CTest: Move initial checkout to ctest_start()
...
In CTest command-driven script mode we support starting without a source
tree. Previously the ctest_start() command would do some initialization
but could not do anything that required CTestConfig.cmake from the input
source tree. Later, ctest_update() would run CTEST_CHECKOUT_COMMAND to
create the source tree, and then re-initialize everything. This
delayed-initialization approach led to many complicated cases of which
only some worked. For example, the second initialization only worked
correctly in Nightly mode and simply failed for Experimental and
Continuous builds.
A simpler solution is to run CTEST_CHECKOUT_COMMAND during ctest_start()
and then have a single initialization path. In principle this change in
behavior could break scripts that set the checkout command after
ctest_start() but before ctest_update(). However, the convention we've
always followed has been to set all variables before ctest_start().
See issue #9450 .
2009-11-24 08:58:59 -05:00
2921fa96ed
Handle multiple carriage return issue on windows VS9. Also make sure that running ctest in showonly mode does not kill our cost store, since many ctest tests do this and corrupt our cost data.
2009-11-16 10:58:43 -05:00
1b48d361d8
fix number of callers to work with newer versions of valgrind
2009-11-11 08:43:15 -05:00
c9c0ee4056
Change logic of ctest subdirs command to allow for absolute paths. Also added test coverage for passing absolute paths to subdirs.
2009-11-10 10:40:24 -05:00
f7899c7445
Fixed a bug where it was possible for a test to be started twice if a lower-indexed test depended on it.
2009-11-09 16:07:47 -05:00
17afd5257b
Bug 9090: CTest does not handle absolute paths in CTestTestfile SUBDIR( ) entries.
...
The ctest subdirs command now checks the relative path first, and if that does not exist, also checks if the given path was absolute. Thanks vodall for the patch.
2009-11-09 14:07:36 -05:00
9f105a3f6d
Fix style warning in cmsystemtools, cosmetic change to ctest code
2009-11-05 11:37:47 -05:00
9aa4e134b5
Fixed infinite loop condition when a test's dependent test executable could not be found.
2009-11-05 11:03:07 -05:00
85912a3777
Added TARGET, CONFIGURATION, PROJECT_NAME, and FLAGS arguments to ctest_build command
2009-11-03 16:46:30 -05:00
d47ada823a
Added logic to check for cycles in the test dependency graph before any tests are run. Previously a cycle resulted in a segfault from stack overflow.
2009-11-02 12:52:50 -05:00
8612aa10b6
Hook for scheduling tests in a random order
...
This may help statistically detect implicit dependencies among unit
tests while running in parallel.
2009-10-29 15:30:12 -04:00
d7a3277fb3
Fix bug#9767 catch missing leak.
2009-10-29 08:38:04 -04:00
e2b63e473d
Fix working dir issue for ctest show only mode (-N)
2009-10-27 10:16:01 -04:00
99697308f3
Add a ctest test to cover cmCTestBatchTestHandler. Since its behavior isn't fully defined yet, we just run it as is and don't care much about the result.
2009-10-26 09:44:08 -04:00
f2010871ba
Ctest was broken for subdirs. Restored working directory state for tests so that their executables could be found.
2009-10-20 10:54:02 -04:00
727fa7bcb6
Fix ctest output alignment for cases where total tests run is not the same width as max test index.
2009-10-15 12:02:22 -04:00
85feea2d0d
Fix floating point comparison warnings. Thanks to Alex Neundorf for the patch.
2009-10-13 16:39:48 -04:00
4439f17b20
Fix issue #5668 - use CollapseFullPath when determining if covered file is within source or binary tree. Allows gcc/gcov coverage analysis using MinGW on Windows.
2009-10-12 14:51:54 -04:00
7fd3d7cf80
BUG: #0009648 Change "The following tests FAILED" message to print on stdout rather than stderr
2009-10-05 12:47:09 -04:00
b304186bc5
Match width of ctest "Start xx: " line to line up with the end test line
2009-10-05 10:20:52 -04:00
b3040beb41
fix two more warnings from icpc
...
asfGlob and abfGlob were there since rev 1.3 of this file (Oct 17th 2004) and unused since
then, so remove them
Alex
2009-10-04 11:40:02 -04:00
ccb0cf1306
Fix warnings in CMake source code.
2009-10-02 15:30:01 -04:00
44bcba7461
Fix warnings in CMake source code. Suppress rampant warnings emanating from Qt files.
2009-10-01 16:47:08 -04:00
a5be445ca9
BUG: CTest should honor test timeouts.
2009-09-29 14:31:58 -04:00
202bb45695
BUG: 0009612: --output-on-failure option doesn't work with the new parallel CTest handler
2009-09-29 09:45:43 -04:00
96afb12087
Convert CMake to OSI-approved BSD License
...
This converts the CMake license to a pure 3-clause OSI-approved BSD
License. We drop the previous license clause requiring modified
versions to be plainly marked. We also update the CMake copyright to
cover the full development time range.
2009-09-28 11:43:28 -04:00
5e06f0a557
Fixed uninitialized memory issue in ctest show-only mode
2009-09-25 11:45:19 -04:00
5a2f24856e
Output a message in ctest when each test is started
2009-09-24 13:49:20 -04:00
65c418e56f
Reformat ctest -N output. Removed the "Start processing tests" message as well.
2009-09-24 09:49:46 -04:00
84f3f6cad6
Tests which are not run should be added to the failed test list.
2009-09-23 15:37:50 -04:00
4342e37d63
More SLURM experimentation (ctest batch mode)
2009-09-21 15:29:34 -04:00
a4c6f178fe
Fixed a slurm batch argument identifier.
2009-09-21 14:58:30 -04:00
87b4c66ca8
Need to quote args when generating batch scripts from ctest
2009-09-21 14:21:41 -04:00
e4293b4b38
Re-enabled failing tests; fixed ctest_build output to be consistent in the error condition across different make programs so that these tests would pass.
2009-09-21 13:40:40 -04:00
932dac93b7
Fix uninitialized errors.
2009-09-16 11:49:09 -04:00
243bbae954
Removed fork-and-continue option from ctest generated batch script entries
2009-09-14 11:23:20 -04:00
bcbb4626a3
Avoid shadowing std::vector member
...
The cmProcess::Buffer class derives from std::vector. We were using
local variable 'data' in the GetLine method but this name shadowed a
member of vector with GNU. This renames it to 'text'.
2009-09-12 10:20:00 -04:00
63a7d85249
Fix for bug#9442, ctest crash if CTEST_SOURCE_DIRECTORY was not set.
2009-09-11 17:15:02 -04:00
8c24c1dcc3
Fix new CTest output handling for no newline
...
When we clear the buffer for an output pipe after returning the last
partial line (without a newline) we need to set the partial line range
to empty. Otherwise the buffer object is left in an inconsistent state.
2009-09-11 16:20:24 -04:00
8a690289c2
Add label summary times to ctest default output. Also, remove parallel time output. Add flag to disable label summary.
2009-09-11 13:34:35 -04:00
6a7eae7184
Rewrite CTest child output handling
...
This commit fixes cmCTestRunTest and cmProcess to more efficiently
handle child output. We now use the buffer for each child output pipe
to hold at most a partial line plus one new block of data at a time.
All complete lines are scanned in-place, and then only the partial line
at the end of the buffer is moved back to the beginning before appending
new data.
We also simplify the cmProcess interface by making GetNextOutputLine the
only method that needs to be called while the process is running. This
simplifies cmCTestRunTest so that CheckOutput can be called until it
returns false when the process is done.
2009-09-11 12:26:41 -04:00
b6c26cded2
Initialize cmCTestRunTest instances robustly
...
All instances of this class need a cmCTestTestHandler, so we now require
one to construct it. The instance also provides the cmCTest instance
too.
2009-09-11 10:09:48 -04:00
b41a548d86
Add parentheses around '&&' between '||' for gcc
...
The GNU compiler warns about possible operator precedence mistakes and
asks for explicit parentheses (-Wparentheses). We add the parentheses
to silence the warning. This also fixes one real logic error in the
find_package() implementation by correcting expression evaluation order.
2009-09-11 08:18:15 -04:00
c57fb18920
Added some ctest batch capabilities
2009-09-10 11:18:05 -04:00
4b4e801eba
BUG: Fixed segfault and bad reporting if a ctest executable could not be found. Also added some batch testing code that is not yet complete.
2009-09-10 11:16:08 -04:00
a516040579
ENH: ctest now writes time cost data to a file after a test set is run, and uses these time costs to schedule the processes the next time ctest is run in that build tree.
2009-09-08 17:10:35 -04:00
6727834a8c
BUG: Fixed extraneous newlines from ctest process output
2009-09-08 14:48:23 -04:00
39e5f9d963
ENH: Replaced the EXPENSIVE test property with a COST test property taking a floating point value. Tests are now started in descending order of their cost, which defaults to 0 if none is specified.
2009-09-08 13:39:13 -04:00
a02ef56401
BUG: Fixed issue where ctest would hang if a process terminated with output in its buffers but no newline
2009-09-08 10:16:16 -04:00
384f4d1f3f
Fixed warning
2009-09-08 09:12:44 -04:00
5fb958fde9
ENH: Added ctest test options PROCESSORS and RUN_SERIAL. These allow specification of resource allocation for given tests running with the ctest -j N option. RUN_SERIAL ensures that a given test does not run in parallel with any other test. Also forced appending of "..." to the longest test name in ctest.
2009-09-07 10:26:17 -04:00
cdb966532b
Fix memory and process leak in ctest_run_script.
2009-09-04 17:01:47 -04:00
68b8332088
Increase curl submit timeout. A submit will timeout if there are 120 seconds of very little activity. 30 seconds was too short.
2009-09-04 14:00:26 -04:00
5517e17bf9
Fixed ctest output processing. Should now display output as it occurs, as well as be able to consume multiple lines if they exist within the timeout.
2009-09-04 13:50:06 -04:00
7d190a65ca
Change run_ctest_script in ctest to not stop processing when there is an error in the script being run. Also, add a RETURN_VALUE option so that you can find out if the script failed
2009-09-04 13:24:25 -04:00
7f9a0f508f
Fixed output as-it-happens issue. Now displays output as it receives each newline.
2009-09-04 11:23:38 -04:00
c6e5dd21fd
Added the test property EXPENSIVE, which denotes that the given test(s) should be started prior to tests that are not marked as such. Also fixed test dependencies, and a few uninitialized variables in cmProcess.
2009-09-04 10:16:06 -04:00
7f6ff73396
Fixed 2 unused variable warnings
2009-09-03 15:50:47 -04:00
d4adde13d7
Allowed tests to pull more than one line of output in their quantum. Fixed uninitialized variables in the case that the test process could not start.
2009-09-03 15:33:44 -04:00
20713ab89d
Fixed warnings
2009-09-03 11:14:13 -04:00
659171d1f7
ENH: Added PARALLEL_LEVEL option for ctest_memcheck(). Added PROCESSORS option to set_tests_properties (implementation to come).
2009-09-03 10:47:14 -04:00
c5cf9b0e5f
STYLE: line length
2009-09-02 16:32:43 -04:00
7e20db0224
ENH: Added PARALLEL_LEVEL option to ctest_test() command.
2009-09-02 12:35:42 -04:00
69fd641adb
Fixed ctest output where max test index is not the same width as the total number of tests. Also some preliminary changes for batching ctest jobs
2009-09-02 10:08:40 -04:00
d741a6a57f
Add curl timeout options to the SubmitUsingHTTP method. They were only in the SubmitUsingFTP method.
2009-09-01 17:23:50 -04:00
90cc5c5e04
ENH: Improved test reporting output
2009-09-01 11:58:04 -04:00
6d0b6f2b9e
Fixed ctest_memcheck docs ( http://www.cmake.org/Bug/view.php?id=9242 )
2009-08-31 11:32:39 -04:00
59b34a6a1a
Fixed Dart time recording for ctest
2009-08-31 10:28:39 -04:00
5a5cc52230
Fixed conversion warning on 64 bit machines
2009-08-31 09:50:35 -04:00
387ba0c646
Fixed line length issue
2009-08-30 10:57:30 -04:00
b0b5ffcf5c
MemCheck should now work again in ctest
2009-08-28 15:08:03 -04:00
996bb51a1d
Replaced std::stringstream with cmOStringStream
2009-08-28 11:40:34 -04:00
b427d1985e
Added ctest -N test. Fixed ctest working directory bug. MemCheck fix coming soon...
2009-08-28 11:08:39 -04:00
177edc5ed1
Fixed ctest -N segfault issue. Further refactored ctest. Enabled failover for ctest
2009-08-27 10:37:30 -04:00
8ffd8d0a03
ENH: refactored ctest. All testing is now parallel. If no -j option is specified, defaults to a MP level of 1 (non parallel)
2009-08-26 12:09:06 -04:00
8c6aa445a2
Fixed line length over 80
2009-08-20 09:46:43 -04:00
David Cole
Brad King
Zach Mullen
Bill Hoffman
Alexander Neundorf