master/phpng has many Windows specific regressions (PHPT and Joomla)

Hi Matt,

Can you provide instruction how to install and run Joomla and Symfony unit
tests.

Thanks. Dmitry.

On Thu, Aug 21, 2014 at 10:27 PM, Matt Ficken themattficken@gmail.com
wrote:

Master (with PHPNG) builds on Windows (our snapshot build servers were
never interrupted BTW), though extensions including PDO, mysql and soap
are disabled.

Master on Windows now has 201 test failures(all sapi scenarios) while Linux
(for me at least) only has about 20 failures, see:

http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PHPT_CMP_PHP_5_6-5.6.0RC3-TS-X86-VC11_Local-FileSystem_MySQL-5.6_CLI_v_PHP_Master-r0ac3d8d-TS-X86-VC.html
Master is now all RED on qa.php.net, see: http://qa.php.net/pftt.php

Additionally, for the CLI sapi scenario, there are many regressions of
Joomla's PhpUnit test suites: typically I get a ~72% pass rate but now only
get ~60% pass rate.
See:

http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PhpUnit_CMP_Joomla-Platform-12.3_PHP_Master-r0ac3d8d-TS-X86-VC11_Local-FileSyste.html
Looks like Joomla regressions are mostly because of the deprecation of
iconv.internal_encoding and missing the PDO extension.

Pass rate for Symfony remains unchanged (~93%), see:

http://qa.php.net/reports/db/PHP_MASTER/r0ac3d8d/PhpUnit_CMP_Symfony-Standard-2.1.8_PHP_Master-r0ac3d8d-TS-X86-VC11_Local-FileSys.html

See list below for PHPT failures and analysis. Apparently I can't attach
the run-test.php output or Joomla output.

Some tests fail because expected output has changed (sapi and file
failures) which I don't believe are actual functionality problems. Unless
anyone disagrees that those tests are not actually ok, I'm going to file
bug reports and update them (creating -win32 fork if needed).
Some tests (array, reflection, session) could be a major regression.

;
; expected output didn't include the character encoding, which is now
included by builtin web server
Sapi\cli\tests\006.phpt
Sapi\cli\tests\bug43177.phpt
Sapi\cli\tests\bug61977.phpt
Sapi\cli\tests\bug65066_100.phpt
Sapi\cli\tests\bug65066_422.phpt
Sapi\cli\tests\bug65066_511.phpt
Sapi\cli\tests\bug65633.phpt
Sapi\cli\tests\bug66830.phpt
Sapi\cli\tests\bug67429.phpt
Sapi\cli\tests\php_cli_server_004.phpt
Sapi\cli\tests\php_cli_server_005.phpt
Sapi\cli\tests\php_cli_server_006.phpt
Sapi\cli\tests\php_cli_server_007.phpt
Sapi\cli\tests\php_cli_server_008.phpt
Sapi\cli\tests\php_cli_server_009.phpt
Sapi\cli\tests\php_cli_server_010.phpt
Sapi\cli\tests\php_cli_server_012.phpt
Sapi\cli\tests\php_cli_server_015.phpt
Sapi\cli\tests\php_cli_server_017.phpt
Sapi\cli\tests\php_cli_server_018.phpt
Sapi\cli\tests\php_cli_server_019.phpt
;
; expected reference count has changed
Zend\tests\001.phpt
Zend\tests\002.phpt
Zend\tests\003.phpt
Zend\tests\bug24773.phpt
Zend\tests\bug35393.phpt
Zend\tests\bug38047.phpt
Zend\tests\bug40815.phpt
Zend\tests\bug52361.phpt
Zend\tests\bug54013.phpt
Zend\tests\bug60825.phpt
Zend\tests\bug63635.phpt
Zend\tests\bug64515.phpt
Zend\tests\bug67436\bug67436_nohandler.phpt
Zend\tests\call_user_func_004.phpt
Zend\tests\call_user_func_005.phpt
Zend\tests\closure_018.phpt
Zend\tests\closure_019.phpt
Zend\tests\closure_026.phpt
Zend\tests\dereference_002.phpt
Zend\tests\fr47160.phpt
Zend\tests\gc_014.phpt
Zend\tests\gc_029_zts.phpt
Zend\tests\gc_030.phpt
Zend\tests\gc_032.phpt
Zend\tests\generators\errors\non_ref_generator_iterated_by_ref_error.phpt
Zend\tests\generators\generator_rewind.phpt
Zend\tests\objects_027.phpt
; returning false
ext\date\tests\009_win32.phpt
ext\date\tests\DateTimeZone_verify.phpt
ext\date\tests\DateTime_verify.phpt
ext\date\tests\bug41523.phpt
ext\date\tests\bug51866.phpt
ext\date\tests\bug65184.phpt
ext\date\tests\gmstrftime_basic.phpt
ext\date\tests\gmstrftime_variation1.phpt
ext\date\tests\gmstrftime_variation2.phpt
ext\date\tests\gmstrftime_variation21
ext\date\tests\gmstrftime_variation3.phpt
ext\date\tests\gmstrftime_variation4.phpt
ext\date\tests\gmstrftime_variation5.phpt
ext\date\tests\gmstrftime_variation6.phpt
ext\date\tests\gmstrftime_variation7.phpt
ext\date\tests\gmstrftime_variation8.phpt
ext\date\tests\strftime_basic.phpt
ext\date\tests\strftime_variation1.phpt
ext\date\tests\strftime_variation2.phpt
ext\date\tests\strftime_variation21.phpt
ext\date\tests\strftime_variation23.phpt
ext\date\tests\strftime_variation3.phpt
ext\date\tests\strftime_variation4.phpt
ext\date\tests\strftime_variation5.phpt
ext\date\tests\strftime_variation6.phpt
ext\date\tests\strftime_variation7.phpt
ext\date\tests\strftime_variation8.phpt
ext\hash\tests\hash_algos.phpt
ext\hash\tests\hash_copy_001.phpt
ext\iconv\tests\iconv_encoding_basic.phpt
ext\iconv\tests\iconv_get_encoding_basic.phpt
ext\iconv\tests\iconv_set_encoding_variation.phpt
ext\iconv\tests\iconv_strpos_basic.phpt
ext\iconv\tests\iconv_strpos_variation5.phpt
ext\iconv\tests\iconv_strrpos_basic.phpt
ext\pcre\tests\006.phpt
ext\pcre\tests\recursion_limit.phpt
ext\phar\tests\create_path_error.phpt
; ?
ext\reflection\tests\009.phpt
ext\reflection\tests\025.phpt
ext\reflection\tests\ReflectionClass_getInterfaces_003.phpt
ext\reflection\tests\ReflectionClass_getMethods_001.phpt
ext\reflection\tests\ReflectionClass_getMethods_003.phpt
ext\reflection\tests\ReflectionClass_getProperties_001.phpt
ext\reflection\tests\ReflectionClass_getProperties_003.phpt
ext\reflection\tests\ReflectionExtension_getClasses_basic.phpt
ext\reflection\tests\ReflectionParameter_canBePassedByValue.phpt
ext\reflection\tests\ReflectionProperty_setAccessible.phpt
ext\reflection\tests\bug40431.phpt
ext\reflection\tests\bug46064_2.phpt
ext\reflection\tests\traits004.phpt
ext\session\tests\016.phpt
ext\session\tests\bug60634_error_1.phpt
ext\session\tests\session_module_name_variation3.phpt
ext\session\tests\session_save_path_variation2.phpt
ext\session\tests\session_set_save_handler_basic.phpt
ext\session\tests\session_set_save_handler_class_002.phpt
ext\session\tests\session_set_save_handler_class_003.phpt
ext\session\tests\session_set_save_handler_class_005.phpt
ext\session\tests\session_set_save_handler_class_007.phpt
ext\session\tests\session_set_save_handler_class_012.phpt
ext\session\tests\session_set_save_handler_class_016.phpt
ext\session\tests\session_set_save_handler_closures.phpt
ext\session\tests\session_set_save_handler_error3.phpt
ext\session\tests\session_set_save_handler_error4.phpt
ext\session\tests\session_set_save_handler_iface_001.phpt
ext\session\tests\session_set_save_handler_variation4.phpt
ext\simplexml\tests\SimpleXMLElement_xpath.phpt
ext\spl\tests\ArrayObject_unserialize_empty_string.phpt
ext\spl\tests\SplObjectStorage_unserialize_invalid_parameter3.phpt
ext\spl\tests\bug51532.phpt
ext\spl\tests\bug60201.phpt
ext\spl\tests\bug64782.phpt
ext\spl\tests\iterator_042.phpt
;
; not clear why array functions fail
ext\standard\tests\array\array_fill.phpt
ext\standard\tests\array\array_fill_error.phpt
ext\standard\tests\array\array_fill_variation2.phpt
ext\standard\tests\array\array_filter_error.phpt
ext\standard\tests\array\array_intersect_uassoc_variation10.phpt
ext\standard\tests\array\array_intersect_ukey_variation9.phpt
ext\standard\tests\array\bug24766.phpt
ext\standard\tests\array\bug25708.phpt
ext\standard\tests\array\bug26458.phpt
ext\standard\tests\array\bug67693.phpt
ext\standard\tests\array\extract_variation1.phpt
ext\standard\tests\dir\closedir_variation2.phpt
ext\standard\tests\dir\dir_basic.phpt
ext\standard\tests\dir\rewinddir_variation2.phpt
;
; many tests fail because error messages changed slightly
ext\standard\tests\file\007_basic.phpt
ext\standard\tests\file\007_error.phpt
ext\standard\tests\file\bug27508.phpt
ext\standard\tests\file\bug41655_1.phpt
ext\standard\tests\file\fclose_variation1.phpt
ext\standard\tests\file\feof_basic.phpt
ext\standard\tests\file\fgetc_variation2.phpt
ext\standard\tests\file\fgets_error.phpt
ext\standard\tests\file\fgets_variation2.phpt
ext\standard\tests\file\fgetss.phpt
ext\standard\tests\file\fgetss_error.phpt
ext\standard\tests\file\flock.phpt
ext\standard\tests\file\flock_error.phpt
ext\standard\tests\file\fread_error.phpt
ext\standard\tests\file\fscanf_error.phpt
ext\standard\tests\file\fseek_ftell_rewind_error1.phpt
ext\standard\tests\file\fseek_ftell_rewind_error2.phpt
ext\standard\tests\file\fseek_ftell_rewind_error3.phpt
ext\standard\tests\file\fstat.phpt
ext\standard\tests\file\ftruncate_error.phpt
ext\standard\tests\file\fwrite_error.phpt
ext\standard\tests\file\glob_variation3.phpt
ext\standard\tests\file\pathinfo_basic1-win32.phpt
ext\standard\tests\file\pathinfo_basic2-win32.phpt
ext\standard\tests\file\userwrapper.phpt
ext\standard\tests\general_functions\bug29038.phpt
ext\standard\tests\general_functions\bug44487.phpt
ext\standard\tests\general_functions\call_user_func_return.phpt
ext\standard\tests\general_functions\call_user_method.phpt
ext\standard\tests\general_functions\call_user_method_002.phpt
ext\standard\tests\general_functions\debug_zval_dump_b.phpt
ext\standard\tests\general_functions\debug_zval_dump_v.phpt
ext\standard\tests\general_functions\ini_get_all.phpt
ext\standard\tests\math\pow_variation1.phpt
ext\standard\tests\math\pow_variation2.phpt
ext\standard\tests\network\setcookie.phpt
ext\standard\tests\serialize\005.phpt
ext\standard\tests\serialize\bug64146.phpt
ext\standard\tests\serialize\bug67072_2.phpt
ext\standard\tests\serialize\serialization_arrays_005.phpt
ext\standard\tests\streams\bug40459.phpt
ext\standard\tests\streams\bug54623.phpt
ext\standard\tests\streams\stream_get_meta_data_file_error.phpt
ext\standard\tests\streams\stream_set_timeout_error.phpt
ext\standard\tests\strings\bug55871.phpt
ext\standard\tests\strings\crypt.phpt
ext\standard\tests\strings\str_pad_variation5.phpt
ext\standard\tests\strings\strncasecmp_variation10.phpt
ext\standard\tests\strings\strncasecmp_variation11.phpt
ext\standard\tests\strings\strncasecmp_variation4.phpt
ext\standard\tests\strings\strncmp_variation4.phpt
ext\tokenizer\tests\bug60097.phpt
ext\wddx\tests\bug48562.phpt
ext\zlib\tests\bug67724.phpt
ext\zlib\tests\gzclose_basic.phpt
ext\zlib\tests\gzeof_variation1.phpt
;
; might expect phpng to break these
tests\basic\024.phpt
tests\basic\026.phpt
tests\classes\inheritance_007.
phpt
tests\func\005a.phpt
tests\lang\foreachLoop.013.phpt
tests\lang\foreachLoop.014.phpt
tests\lang\foreachLoop.015.phpt
tests\lang\func_get_arg.001.phpt
tests\lang\func_get_args.004.phpt