Newsgroups: php.internals,php.qa
Path: news.php.net
Xref: news.php.net php.internals:55061 php.qa:65916
Return-Path: <hannes.magnusson@gmail.com>
Mailing-List: contact internals-help@lists.php.net; run by ezmlm
Delivered-To: mailing list internals@lists.php.net
Received: (qmail 65805 invoked from network); 1 Sep 2011 14:17:18 -0000
Received: from unknown (HELO lists.php.net) (127.0.0.1)
  by localhost with SMTP; 1 Sep 2011 14:17:18 -0000
Authentication-Results: pb1.pair.com header.from=hannes.magnusson@gmail.com; sender-id=pass
Authentication-Results: pb1.pair.com smtp.mail=hannes.magnusson@gmail.com; spf=pass; sender-id=pass
Received-SPF: pass (pb1.pair.com: domain gmail.com designates 209.85.220.170 as permitted sender)
X-PHP-List-Original-Sender: hannes.magnusson@gmail.com
X-Host-Fingerprint: 209.85.220.170 mail-vx0-f170.google.com  
Received: from [209.85.220.170] ([209.85.220.170:65266] helo=mail-vx0-f170.google.com)
	by pb1.pair.com (ecelerity 2.1.1.9-wez r(12769M)) with ESMTP
	id D4/DB-03466-DE39F5E4 for <internals@lists.php.net>; Thu, 01 Sep 2011 10:17:17 -0400
Received: by vxh24 with SMTP id 24so1403794vxh.29
        for <multiple recipients>; Thu, 01 Sep 2011 07:17:14 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:cc:content-type
         :content-transfer-encoding;
        bh=8GTv+2Cg2IgltZL2tVW6jwZnlSTiWG/VXkg41aeKdec=;
        b=QvhoYxp9t+AHaLs5Zo3HYJRARnZyfIlXkwqeeEczW15AkhVO76mDlqWLpiQeoTRYEC
         t4xbKSVG9L3iX/WlmBG0w0EdVUhcuyzKKCnRIIYUU+aDBRrl/LnmVxfSF3mv1aqmwTwx
         0Elu9flie5qOqsx6g7PMUXsHx2c4ufjK4jcxk=
MIME-Version: 1.0
Received: by 10.52.70.100 with SMTP id l4mr136292vdu.23.1314886634422; Thu, 01
 Sep 2011 07:17:14 -0700 (PDT)
Sender: hannes.magnusson@gmail.com
Received: by 10.52.159.34 with HTTP; Thu, 1 Sep 2011 07:17:14 -0700 (PDT)
In-Reply-To: <1314886182.1211.5.camel@guybrush>
References: <CADNQb0WmZg_6kwUjh58-WhzzrzWR62fy3aOBdox6dQ+DD2bhbg@mail.gmail.com>
	<CAH-PCH5_y4KZnDimaT+mFML8DMy0wYVLn57mHrADT+U=chfdJQ@mail.gmail.com>
	<CAAAa2siM=z6o42S6jDXsatQxDwUBoDWN8rWT_3HTTQwKaZewfw@mail.gmail.com>
	<1314886182.1211.5.camel@guybrush>
Date: Thu, 1 Sep 2011 16:17:14 +0200
X-Google-Sender-Auth: FzUq2llPoQ-09hvnOLJdOyOAQWI
Message-ID: <CADNQb0U7bDF5_T19XrmouneQ6EGd0_TYothpgjzpubOd9+a58g@mail.gmail.com>
To: =?UTF-8?Q?Johannes_Schl=C3=BCter?= <johannes@schlueters.de>
Cc: Alexey Shein <confik@gmail.com>, Ferenc Kovacs <tyra3l@gmail.com>, 
	PHP Development <internals@lists.php.net>, PHP QA <php-qa@lists.php.net>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Subject: Re: [PHP-DEV] New run-tests.php feature
From: bjori@php.net (Hannes Magnusson)

2011/9/1 Johannes Schl=C3=BCter <johannes@schlueters.de>:
> On Thu, 2011-09-01 at 17:53 +0400, Alexey Shein wrote:
>> Great addition.
>> While you're at it, could you also add an option to print a list of
>> skipped tests (maybe above XFAIL section), that's also currently can't
>> be done with other options in run-tests.php.
>> It could also be useful because some skipped tests maybe skipped for
>> the wrong reason and be actually failed. It's also a great spot to
>> notice obsolete tests that need to be removed from the suite and make
>> running all process faster.
>
> Let's open a can of worms: When designing this I'd like to keep in mind
> a feature I had on the list for the rewrite of run-tests by Zoe (anybody
> knows the status of that?) which is skipping entire directories with a
> single skipif.
> Benefit there is that for instance we don't have to create two PHP
> process for each and every test and don't have to try connecting to
> databases two times for each test (during skipif and the actual test).

Create a magical "run-me-first" file which run-tests will execute
first, and if it fails it will skip all the tests in that directory..
should be relatively easy to implement.

Being able to run the tests for two directories in parallel however..
that would be awesome.

-Hannes