simipletest: anyone passing unit test cases of simpletest?

Discussion of testing theory and practice, including methodologies (such as TDD, BDD, DDD, Agile, XP) and software - anything to do with testing goes here. (Formerly "The Testing Side of Development")

Moderator: General Moderators

Post Reply
jmut
Forum Regular
Posts: 945
Joined: Tue Jul 05, 2005 3:54 am
Location: Sofia, Bulgaria
Contact:

simipletest: anyone passing unit test cases of simpletest?

Post by jmut »

I downloaded latest version of simpletest
https://sourceforge.net/project/showfil ... _id=153280

and there is test directory with test cases...
The thing is it stalls :(. I tried removing the tests with mocking objects and interfaces but no luck.

Anyone with same result?
Are you using simpletest for production environment tests.

Code: Select all

prompt$ php all_tests.php
All tests for SimpleTest 1.0.1alpha3
E_USER_NOTICE: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 60
E_USER_NOTICE: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 81
E_USER_NOTICE: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 87
E_USER_WARNING: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 93
E_USER_ERROR: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 99
E_USER_ERROR: Cannot set maximum call count as no aMissingMethod() in class MockDummyWithInjectedTestCase in /storage/www/3dPartyLib/simpletest/mock_objects.php on line 505
E_USER_ERROR: Cannot set expected arguments as $args parameter is not an array in /storage/www/3dPartyLib/simpletest/mock_objects.php on line 490
E_USER_NOTICE: Method [aMissingMethod] is not mocked in /storage/www/3dPartyLib/simpletest/mock_objects.php(1057) : eval()'d code on line 75
E_WARNING: Missing argument 1 for MockDummyInterface::anotherMethod(), called in /storage/www/3dPartyLib/simpletest/test/interfaces_test.php on line 29 and defined in /storage/www/3dPartyLib/simpletest/mock_objects.php(1036) : eval()'d code on line 10

//........never finishes.....freezes here

Edit: Forgot to mention

Slackware 10.2.0
2.6.16.24


PHP 5.1.2 (cli) (built: May 12 2006 15:42:32)
Copyright (c) 1997-2006 The PHP Group
Zend Engine v2.1.0, Copyright (c) 1998-2006 Zend Technologies
with DBG v2.13.1, (C) 2000,2006, by Dmitri Dmitrienko
User avatar
Chris Corbyn
Breakbeat Nuttzer
Posts: 13098
Joined: Wed Mar 24, 2004 7:57 am
Location: Melbourne, Australia

Post by Chris Corbyn »

Marcus seems to be a bit busy and doesn't keep parts of the package up to date (apart from the core stuff). The tests used to work on PHP4 but not 5... I haven't tried the tests in alpha 3.

EDIT | Comment about other place to read docs removed. Apparently docs in the latest tarball are up-to-date.
lastcraft
Forum Commoner
Posts: 80
Joined: Sat Jul 12, 2003 10:31 pm
Location: London

Re: simipletest: anyone passing unit test cases of simpletes

Post by lastcraft »

Hi...
jmut wrote:...and there is test directory with test cases...
The thing is it stalls :(. I tried removing the tests with mocking objects and interfaces but no luck.
This is a serious problem, as I have working tests for every setup I can manage. Do you have the rror reporting turned on? It's possibe that it ran out of memeory during the test run and this wasn't reported by PHP. Timing out is another probem, as it does live web page fetching from the LastCraft site.

Which version are you using?

Can you run just the unit tests on their own (not all_tests.php)?

yours, Marcus
jmut
Forum Regular
Posts: 945
Joined: Tue Jul 05, 2005 3:54 am
Location: Sofia, Bulgaria
Contact:

Post by jmut »

Ok I guess there were some timeouts but I thought it stall.
So I waited this time longer and got results for all tests.

2.6.16.24
Slackware 10.2.0

Code: Select all

My config:

PHP Version: 5.1.2
PHP OS: Linux
Error Reporting: 2047 (E_ALL)
Register Globals: Off
Short Tags: On
Display Errors: On
Magic Quotes GPC: Off
Magic Quotes Runtime: Off
Magic Quotes Sybase: Off
Loaded Extensions:
   xmlwriter    libxml       xmlrpc       dom       
   xmlreader    xml          wddx         tokenizer 
   sysvshm      sysvsem      standard     SimpleXML 
   SPL          session      sockets      PDO       
   shmop        SQLite       Reflection   posix     
   pdo_sqlite   pdo_mysql    mhash        iconv     
   hash         gmp          gd           ftp       
   exif         dbase        dba          date      
   ctype        calendar     bz2          bcmath    
   zlib         pcre         openssl      apache    
   mysql        mysqli       dbg          gettext

Code: Select all

$ php all_tests.php
All tests for SimpleTest 1.0.1alpha3
E_USER_NOTICE: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 60
E_USER_NOTICE: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 81
E_USER_NOTICE: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 87
E_USER_WARNING: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 93
E_USER_ERROR: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 99
E_USER_ERROR: Cannot set maximum call count as no aMissingMethod() in class MockDummyWithInjectedTestCase in /storage/www/3dPartyLib/simpletest/mock_objects.php on line 505
E_USER_ERROR: Cannot set expected arguments as $args parameter is not an array in /storage/www/3dPartyLib/simpletest/mock_objects.php on line 490
E_USER_NOTICE: Method [aMissingMethod] is not mocked in /storage/www/3dPartyLib/simpletest/mock_objects.php(1057) : eval()'d code on line 75
E_WARNING: Missing argument 1 for MockDummyInterface::anotherMethod(), called in /storage/www/3dPartyLib/simpletest/test/interfaces_test.php on line 29 and defined in /storage/www/3dPartyLib/simpletest/mock_objects.php(1036) : eval()'d code on line 10


1) Nothing fetched
        in testButtonSubmissionByLabel
        in TestOfLiveForms
        in /storage/www/3dPartyLib/simpletest/test/acceptance_test.php
2) True assertion got False at [/storage/www/3dPartyLib/simpletest/test/acceptance_test.php line 692]
        in testButtonSubmissionByLabel
        in TestOfLiveForms
        in /storage/www/3dPartyLib/simpletest/test/acceptance_test.php
3) Pattern [/go=\[ButtonGo\]/s] not detected in [Boolean: false] at [/storage/www/3dPartyLib/simpletest/test/acceptance_test.php line 693]
        in testButtonSubmissionByLabel
        in TestOfLiveForms
        in /storage/www/3dPartyLib/simpletest/test/acceptance_test.php
4) Nothing fetched
        in testSavantStyleHiddenFieldDefaults
        in TestOfLiveMultiValueWidgets
        in /storage/www/3dPartyLib/simpletest/test/acceptance_test.php
5) True assertion got False at [/storage/www/3dPartyLib/simpletest/test/acceptance_test.php line 942]
        in testSavantStyleHiddenFieldDefaults
        in TestOfLiveMultiValueWidgets
        in /storage/www/3dPartyLib/simpletest/test/acceptance_test.php
6) Text [a=[a0]] not detected in [String: ] at [/storage/www/3dPartyLib/simpletest/test/acceptance_test.php line 943]
        in testSavantStyleHiddenFieldDefaults
        in TestOfLiveMultiValueWidgets
        in /storage/www/3dPartyLib/simpletest/test/acceptance_test.php
7) Text [b=[b0]] not detected in [String: ] at [/storage/www/3dPartyLib/simpletest/test/acceptance_test.php line 944]
        in testSavantStyleHiddenFieldDefaults
        in TestOfLiveMultiValueWidgets
        in /storage/www/3dPartyLib/simpletest/test/acceptance_test.php
FAILURES!!!
Test cases run: 118/118, Passes: 2463, Failures: 7, Exceptions: 0
lastcraft
Forum Commoner
Posts: 80
Joined: Sat Jul 12, 2003 10:31 pm
Location: London

Post by lastcraft »

Hi...
jmut wrote:FAILURES!!!
Test cases run: 118/118, Passes: 2463, Failures: 7, Exceptions: 0
Could you run it again and see if you get the same failures. I reckon only the arguments notice will stay the same, although at this stage I'm guessing. The php.ini file on my machine recognises command line arguments, so I hadn't thought what would hapen if this was turned off. I need to supress this spurious warning.

The rest I think are networking issues, probably because my site sometimes runs rather slowly. Won't know for sure until we have another go.

yours, Marcus
jmut
Forum Regular
Posts: 945
Joined: Tue Jul 05, 2005 3:54 am
Location: Sofia, Bulgaria
Contact:

Post by jmut »

lastcraft wrote:Hi...
jmut wrote:FAILURES!!!
Test cases run: 118/118, Passes: 2463, Failures: 7, Exceptions: 0
Could you run it again and see if you get the same failures. I reckon only the arguments notice will stay the same, although at this stage I'm guessing. The php.ini file on my machine recognises command line arguments, so I hadn't thought what would hapen if this was turned off. I need to supress this spurious warning.

The rest I think are networking issues, probably because my site sometimes runs rather slowly. Won't know for sure until we have another go.

yours, Marcus
Ok, you want me to run same simpletest package..or is there another version somewhere I can download? I don't see any svn or anything to use.
jmut
Forum Regular
Posts: 945
Joined: Tue Jul 05, 2005 3:54 am
Location: Sofia, Bulgaria
Contact:

Post by jmut »

Anyhow I ran the same tests again...same package.
I guess it is getting better :)

Code: Select all

All tests for SimpleTest 1.0.1alpha3
E_USER_NOTICE: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 60
E_USER_NOTICE: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 81
E_USER_NOTICE: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 87
E_USER_WARNING: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 93
E_USER_ERROR: Ouch! in /storage/www/3dPartyLib/simpletest/test/errors_test.php on line 99
E_USER_ERROR: Cannot set maximum call count as no aMissingMethod() in class MockDummyWithInjectedTestCase in /storage/www/3dPartyLib/simpletest/mock_objects.php on line 505
E_USER_ERROR: Cannot set expected arguments as $args parameter is not an array in /storage/www/3dPartyLib/simpletest/mock_objects.php on line 490
E_USER_NOTICE: Method [aMissingMethod] is not mocked in /storage/www/3dPartyLib/simpletest/mock_objects.php(1057) : eval()'d code on line 75
E_WARNING: Missing argument 1 for MockDummyInterface::anotherMethod(), called in /storage/www/3dPartyLib/simpletest/test/interfaces_test.php on line 29 and defined in /storage/www/3dPartyLib/simpletest/mock_objects.php(1036) : eval()'d code on line 10
OK
Test cases run: 118/118, Passes: 2468, Failures: 0, Exceptions: 0
Post Reply