Newsgroups: php.internals Path: news.php.net Xref: news.php.net php.internals:54739 Return-Path: Mailing-List: contact internals-help@lists.php.net; run by ezmlm Delivered-To: mailing list internals@lists.php.net Received: (qmail 42539 invoked from network); 20 Aug 2011 00:09:45 -0000 Received: from unknown (HELO lists.php.net) (127.0.0.1) by localhost with SMTP; 20 Aug 2011 00:09:45 -0000 Authentication-Results: pb1.pair.com smtp.mail=smalyshev@sugarcrm.com; spf=pass; sender-id=pass Authentication-Results: pb1.pair.com header.from=smalyshev@sugarcrm.com; sender-id=pass Received-SPF: pass (pb1.pair.com: domain sugarcrm.com designates 207.97.245.183 as permitted sender) X-PHP-List-Original-Sender: smalyshev@sugarcrm.com X-Host-Fingerprint: 207.97.245.183 smtp183.iad.emailsrvr.com Linux 2.6 Received: from [207.97.245.183] ([207.97.245.183:57719] helo=smtp183.iad.emailsrvr.com) by pb1.pair.com (ecelerity 2.1.1.9-wez r(12769M)) with ESMTP id 97/A0-37318-74BFE4E4 for ; Fri, 19 Aug 2011 20:09:44 -0400 Received: from localhost (localhost.localdomain [127.0.0.1]) by smtp28.relay.iad1a.emailsrvr.com (SMTP Server) with ESMTP id 219A3E0688; Fri, 19 Aug 2011 20:09:41 -0400 (EDT) X-Virus-Scanned: OK Received: by smtp28.relay.iad1a.emailsrvr.com (Authenticated sender: smalyshev-AT-sugarcrm.com) with ESMTPSA id A1F4FE05B0; Fri, 19 Aug 2011 20:09:40 -0400 (EDT) Message-ID: <4E4EFB43.1050201@sugarcrm.com> Date: Fri, 19 Aug 2011 17:09:39 -0700 Organization: SugarCRM User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0) Gecko/20110624 Thunderbird/5.0 MIME-Version: 1.0 To: Rasmus Lerdorf CC: PHP Internals References: <4E4EEED3.4070001@sugarcrm.com> <4E4EF9AE.6090102@lerdorf.com> In-Reply-To: <4E4EF9AE.6090102@lerdorf.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [PHP-DEV] Test failures (was: 5.3.7pl1) From: smalyshev@sugarcrm.com (Stas Malyshev) Hi! On 8/19/11 5:02 PM, Rasmus Lerdorf wrote: > The secondary problem is that we are not doing a good job running our > tests prior to releases. I think this is mostly because we have way too > many tests that fail and one more or less failing test gets lost in the > noise. Yes, this is a problem: here http://gcov.php.net/viewer.php?version=PHP_5_4&func=tests we have 218 failing tests. Unit test system with this amount of failures is next to useless. So if we have some component that is buggy (like DateTime) or not updated - we need to figure out a way to separate tests that we know would fail (XFAIL?) from tests that should not fail and not release a version until the second number is 0. Otherwise we get broken releases. -- Stanislav Malyshev, Software Architect SugarCRM: http://www.sugarcrm.com/ (408)454-6900 ext. 227