I've put a page about Suite Tester with some demos, so if you have a spare half-hour over the weekend, I'd appreciate it if you'd give it a go and let me know what you think
Thanks,
Nathaniel
Moderator: General Moderators
I didn't quite follow the introduction at first. Am I right in saying it tests the entire suite at the start, and then updates individual tests as you direct? That by itself is a time saver...Conveniently test an entire application or a single unit in one place!
Maugrim_The_Reaper wrote:You bought me with the first line on the web page...
Yup. Of course, if you want to reload every test, just hit F5. A "Reload All" button is planned for the next version.I didn't quite follow the introduction at first. Am I right in saying it tests the entire suite at the start, and then updates individual tests as you direct?
If you add Group folding (let me hide those I already know are passing) it would make navigation easier. I have test suites with a lot more than 7 test cases. Scrolling down to click a test case, and then back up to see the results will get tiresome eventually.
Also it would be nice for an entire Group to be capable of a rerun.
Optional display of a test's detailed output by running it in a popup/floating-div (a separate optional link alongside the current test title links maybe). Not as important as the main summary view but it's output I often go looking for.
Is $_GET['test'] sanitised before hitting the include() statement? The statement also has the @ error suppressor for some reason.
May need to adapt to super-long test names without breaking the page width.
I'd like to see more obvious highlighting of failing test cases - like the red bar effect instead of just the red text. I know you have a CSS file in the package so it's probably just a minor point.
Thanks, and thanks for the feedbackNice going! It looks like a really cool tool.
Currently we have to reload. A "Refresh All" button is in the feature queue, however.Ambush Commander wrote:Question: is there an AJAX way to refresh the entire test suite, or do I have to reload?
Also, is there a way to continually refresh a test result every, say, two seconds?
Do you mean when you f5 the page, or when you click an individual test case to be rerun?The flickering that happens when you load reload a test is slightly annoying, but not major.
That sounds good, although, you probably want to give the user more control over which tests to refresh.What about "on window focus, refresh the last test run"? Firebug shows the test cases taking about 60ms to load, so lag time would be negligent.
When individual test-cases get rerun. The associated messages get erased, which often moves the menu widget around: the menu of test cases should stay in the same position.Do you mean when you f5 the page, or when you click an individual test case to be rerun?
Code: Select all
error_reporting(E_ALL);
ini_set('display_errors', '1');I'm running php 5.1Myclimbing Test Case failed. Response Text:
Fatal error: Cannot redeclare class fieldexpectation in /Applications/MAMP/htdocs/tests/simpletest/web_tester.php on line 23
3/3 test cases complete: 2 passes, 0 fails, and 1 exceptions.
Code: Select all
require(SIMPLETEST_DIR . 'unit_tester.php');
require(SIMPLETEST_DIR . 'web_tester.php');
require(SIMPLETEST_DIR . 'reporter.php');
require(SIMPLETEST_DIR . 'mock_objects.php');Option 2:Example Test Case failed. Response Text:
Fatal error: Class 'TestSuite' not found in /Applications/MAMP/htdocs/suite-tester/library/test-runner.class.php on line 8
Myclimbing Test Case failed. Response Text:
Fatal error: Class 'TestSuite' not found in /Applications/MAMP/htdocs/suite-tester/library/test-runner.class.php on line 8
A Test Inside a Group failed. Response Text:
Fatal error: Class 'TestSuite' not found in /Applications/MAMP/htdocs/suite-tester/library/test-runner.class.php on line 8
3/3 test cases complete: 0 passes, 0 fails, and 3 exceptions
Maybe we could solve this if you'd tell me how the setup should look like. As my simpletest is setup now:Myclimbing Test Case failed. Response Text:
Warning: TestSuite::include(web_test.php) [function.TestSuite-include]: failed to open stream: No such file or directory in /Applications/MAMP/htdocs/tests/simpletest/test_case.php on line 461
Warning: TestSuite::include() [function.include]: Failed opening 'web_test.php' for inclusion (include_path='.:/Applications/MAMP/bin/php5/lib/php') in /Applications/MAMP/htdocs/tests/simpletest/test_case.php on line 461
All tests
Fail: web_test.php -> Bad TestSuite [web_test.php] with error [Failed opening 'web_test.php' for inclusion (include_path='.:/Applications/MAMP/bin/php5/lib/php')]
0/0 test cases complete: 0 passes, 1 fails and 0 exceptions.
Warning: Cannot modify header information - headers already sent by (output started at /Applications/MAMP/htdocs/tests/simpletest/test_case.php:461) in /Applications/MAMP/htdocs/suite-tester/library/json-reporter.php on line 40
{ "messages" : [ { "type" : "exception", "msg" : "../../tests/all_tests.php -> Bad TestSuite: ../../tests/all_tests.php has no runnable test cases." } ], "passes" : "0" }
3/3 test cases complete: 2 passes, 0 fails, and 1 exceptions.