Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:54741
Mailing-List: contact internals-help@lists.php.net; run by ezmlm
Received-SPF: pass (pb1.pair.com: domain gmail.com designates 209.85.161.170 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <4E4EFB43.1050201@sugarcrm.com>
References: <4E4EEED3.4070001@sugarcrm.com>
	<4E4EF9AE.6090102@lerdorf.com>
	<4E4EFB43.1050201@sugarcrm.com>
Date: Sat, 20 Aug 2011 10:25:42 +0200
Message-ID: <CAEZPtU5pr7Q8_vyEgN5mAvw+yMiqu4nqPqHAYDOaA6umFzRVjQ@mail.gmail.com>
To: Stas Malyshev <smalyshev@sugarcrm.com>
Cc: Rasmus Lerdorf <rasmus@lerdorf.com>, PHP Internals <internals@lists.php.net>
Content-Type: text/plain; charset=ISO-8859-1
Subject: Re: [PHP-DEV] Test failures (was: 5.3.7pl1)
From: pierre.php@gmail.com (Pierre Joye)

hi,

Right, I sadly did not run them as I use to between the last RC and
final but only the apps tests (wp&co), which do not use crypt's md5. I
also agree about the amount of failing tests and warnings, for the
same reasons. However checking the delta between two releases should
help too (that's what I use to stop a release).

btw, can we go with 5.3.8 instead? I really don't like the pl thing :)

Cheers,

On Sat, Aug 20, 2011 at 2:09 AM, Stas Malyshev <smalyshev@sugarcrm.com> wrote:
> Hi!
>
> On 8/19/11 5:02 PM, Rasmus Lerdorf wrote:
>>
>> The secondary problem is that we are not doing a good job running our
>> tests prior to releases. I think this is mostly because we have way too
>> many tests that fail and one more or less failing test gets lost in the
>> noise.
>
> Yes, this is a problem: here
> http://gcov.php.net/viewer.php?version=PHP_5_4&func=tests we have 218
> failing tests. Unit test system with this amount of failures is next to
> useless. So if we have some component that is buggy (like DateTime) or not
> updated - we need to figure out a way to separate tests that we know would
> fail (XFAIL?) from tests that should not fail and not release a version
> until the second number is 0. Otherwise we get broken releases.
> --
> Stanislav Malyshev, Software Architect
> SugarCRM: http://www.sugarcrm.com/
> (408)454-6900 ext. 227
>
> --
> PHP Internals - PHP Runtime Development Mailing List
> To unsubscribe, visit: http://www.php.net/unsub.php
>
>



-- 
Pierre

@pierrejoye | http://blog.thepimp.net | http://www.libgd.org