Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:74725
Mailing-List: contact internals-help@lists.php.net; run by ezmlm
Received-SPF: pass (pb1.pair.com: domain gmail.com designates 209.85.220.181 as permitted sender)
MIME-Version: 1.0
Sender: julienpauli@gmail.com
In-Reply-To: <CADyq6sLRqHPNn2TJZeoY4QsPd4Jdowod6E42FzBdr+5dk3xZtA@mail.gmail.com>
References: <53886F73.70402@php.net> <CAEPJdunEaCHaBvzQ+AJiO5tLGW2NhW53fot1hztNXkV+sUDNSQ@mail.gmail.com>
 <1401810913.2282.81.camel@guybrush> <CADyq6sKfUU_v+vSaCTFijxcu3PW4HGD7sU5SQS+fdaERhtn3rA@mail.gmail.com>
 <1401811624.2282.86.camel@guybrush> <CADyq6sLRqHPNn2TJZeoY4QsPd4Jdowod6E42FzBdr+5dk3xZtA@mail.gmail.com>
Date: Tue, 3 Jun 2014 18:26:49 +0200
Message-ID: <CAMUwpuRUsXp_Cj-hxpyiWhynGhXYw7ZHfHQr4EerLgicx6pi2Q@mail.gmail.com>
To: Marco Pivetta <ocramius@gmail.com>
Cc: =?UTF-8?Q?Johannes_Schl=C3=BCter?= <johannes@schlueters.de>, 
	Benjamin Eberlei <kontakt@beberlei.de>, Remi Collet <remi@php.net>, PHP <internals@lists.php.net>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Subject: Re: [PHP-DEV] BC break in 5.4.29 and 5.5.13
From: jpauli@php.net (Julien Pauli)

On Tue, Jun 3, 2014 at 6:17 PM, Marco Pivetta <ocramius@gmail.com> wrote:
> On 3 June 2014 18:07, Johannes Schl=C3=BCter <johannes@schlueters.de> wro=
te:
>>
>> Nightly testing (or push testing) I see on our side. The issue with
>> testing applications is that we need the time from the individual
>> project maintainers. Not knowing the application it often is quite hard
>> to dig down what in the underlying systems broke. Project maintainers
>> typically an pinpoint this faster.
>
>
> Pushing a "nightly" package to Travis would solve this issue almost
> entirely.
>
>>
>> Speaking about resources: The core PHP team is very small, way to small
>> to keep up with a relevant amount of projects all moving.
>
>
> There's an already working test suite by the HHVM folks at
> https://github.com/facebook/hhvm/blob/1ecb4443d95c2e2659028f148083dd5c85f=
2099b/hphp/test/frameworks/frameworks.yaml
>
> In the eventuality in which PHP-SRC retains control over the CI environme=
nt
> that runs the framework tests, this suite could be reused. The problem is
> that it actually takes days to run all those tests, and I don't know if t=
he
> hardware is available.

I agree we should run our tests against well known tested projects,
such as PHPUnit , Doctrine or other.

That's in a perfect world though.

Julien.P