Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:54858
Mailing-List: contact internals-help@lists.php.net; run by ezmlm
Received-SPF: error (pb1.pair.com: domain schlueters.de from 217.114.211.66 cause and error)
To: Ferenc Kovacs <tyra3l@gmail.com>
Cc: Pierre Joye <pierre.php@gmail.com>, Derick Rethans <derick@php.net>, 
 alan@akbkhome.com, internals@lists.php.net
In-Reply-To: <CAH-PCH5hG4i76ox03YvFVrt+FCoUR=SxouCzQW4nTpafbZ8h2w@mail.gmail.com>
References: <1314115682.2635.98.camel@guybrush>
	 <4E545A6C.60704@akbkhome.com>
	 <CAH-PCH5jyEQZvwgqxkUpqN7a-VUc+nYt=_ixFQ1si64xxMBw4A@mail.gmail.com>
	 <alpine.DEB.2.02.1108241035240.3964@whisky>
	 <CAEZPtU6OdCv2woSq1p9-D6oJf3nNWbocd48C059RTnXa-bqtsQ@mail.gmail.com>
	 <CAH-PCH5hG4i76ox03YvFVrt+FCoUR=SxouCzQW4nTpafbZ8h2w@mail.gmail.com>
Content-Type: text/plain; charset="UTF-8"
Date: Wed, 24 Aug 2011 12:42:04 +0200
Message-ID: <1314182524.2261.12.camel@guybrush>
Mime-Version: 1.0
Content-Transfer-Encoding: 7bit
Subject: Re: [PHP-DEV] PHP 5.3.8 Released!
From: johannes@schlueters.de (Johannes =?ISO-8859-1?Q?Schl=FCter?=)

On Wed, 2011-08-24 at 12:24 +0200, Ferenc Kovacs wrote:
> we could have spotted this via two ways:
> - those who participated in fixing
> https://bugs.php.net/bug.php?id=53727 could have spotted this
> - our tests should have start failing after the change

Third option:
- RC testers might have spotted and reported it.

I have the impression that very few people actually test these. When
creating an RC we inform the "primary testers" as well as qa and
internals list members. From there I get one or two responses in
general. 

When I approach PHP users I often get answers like installing PHP
without breaking their setup would be complicated (which is not the case
but maybe needs education?) and they won't have time. I try to use a
hypothetical case, like we have here in reality, to explain them why it
is beneficial for their business if it is detected early as then we can
fix it, fixing something after a release is hard. We also can try to
improve our tests but we will never be able to test each and every way
PHP is being used out there in the wild.


So how can we motivate people to test new versions during RC not the day
after it is being released?


We don't push them out as news on the php.net frontpage and we don't
send it out to the announce list for reasons like not confusing users.
Should we change that? Other ideas?

johannes