Newsgroups: php.internals Path: news.php.net Xref: news.php.net php.internals:47198 Return-Path: Mailing-List: contact internals-help@lists.php.net; run by ezmlm Delivered-To: mailing list internals@lists.php.net Received: (qmail 99914 invoked from network); 12 Mar 2010 23:06:47 -0000 Received: from unknown (HELO lists.php.net) (127.0.0.1) by localhost with SMTP; 12 Mar 2010 23:06:47 -0000 Authentication-Results: pb1.pair.com header.from=stas@zend.com; sender-id=pass Authentication-Results: pb1.pair.com smtp.mail=stas@zend.com; spf=pass; sender-id=pass Received-SPF: pass (pb1.pair.com: domain zend.com designates 63.205.162.117 as permitted sender) X-PHP-List-Original-Sender: stas@zend.com X-Host-Fingerprint: 63.205.162.117 us-mr1.zend.com Received: from [63.205.162.117] ([63.205.162.117:46246] helo=us-mr1.zend.com) by pb1.pair.com (ecelerity 2.1.1.9-wez r(12769M)) with ESMTP id 45/B8-13686-409CA9B4 for ; Fri, 12 Mar 2010 18:06:47 -0500 Received: from us-gw1.zend.com (us-ex1.zend.net [192.168.16.5]) by us-mr1.zend.com (Postfix) with ESMTP id F0BA543F81 for ; Fri, 12 Mar 2010 15:08:06 -0800 (PST) Received: from [192.168.16.93] ([192.168.16.93]) by us-gw1.zend.com with Microsoft SMTPSVC(6.0.3790.3959); Fri, 12 Mar 2010 15:06:38 -0800 Message-ID: <4B9AC8FD.7050406@zend.com> Date: Fri, 12 Mar 2010 15:06:37 -0800 Organization: Zend Technologies User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.8) Gecko/20100227 Thunderbird/3.0.3 MIME-Version: 1.0 To: internals@lists.php.net References: <4B9926E8.4080202@lerdorf.com> <4B997381.1050300@oracle.com> <4B9A14FF.6000703@iki.fi> <4B9A833A.8040402@zend.com> <4B9A848C.3080701@iki.fi> <4B9A93EE.7080403@zend.com> <1418253B-84A3-4CA6-965B-A2501A5D432F@gmail.com> <4B9AB840.1010209@zend.com> <4B9ABDCE.2070904@zend.com> <4B9AC13B.401@sci.fi> In-Reply-To: <4B9AC13B.401@sci.fi> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-OriginalArrivalTime: 12 Mar 2010 23:06:38.0972 (UTC) FILETIME=[ABCC23C0:01CAC238] Subject: Re: [PHP-DEV] Tests repository From: stas@zend.com (Stanislav Malyshev) Hi! > What tests are you really talking about here? I thought we have > regression tests in there which test that stuff does not change between Yes, we have those. But we also have other tests, which are different between versions. > should not be any need for any updates given the tests aren't for some > reason different between branches in which case they aren't really the > same test anymore. I'm not into paying semantic games about the meaning of the word "is". Define them as "different tests" if you want - how that solves the problem, if you have different tests in the next version? You still have two of them, not one. > Short version: if test works in 5.2 it also has to (!) work in 5.3. > Otherwise the test is pointless. It's not what happens with real .phpt tests, and they are not pointless. We can spend weeks discussing how the fine theory it should be, but in practice if 5.2 outputs one thing and 5.3 another then the tests differ. Just take Zend engine tests directory - out of 511 tests 62 are different in 5.3 - more than 10%. Most of them are messages, but not only. What you're going to do with them? -- Stanislav Malyshev, Zend Software Architect stas@zend.com http://www.zend.com/ (408)253-8829 MSN: stas@zend.com