Newsgroups: php.internals,php.qa
Path: news.php.net
Xref: news.php.net php.internals:55059 php.qa:65914
Return-Path: <hannes.magnusson@gmail.com>
Mailing-List: contact internals-help@lists.php.net; run by ezmlm
Delivered-To: mailing list internals@lists.php.net
Received: (qmail 62011 invoked from network); 1 Sep 2011 14:08:07 -0000
Received: from unknown (HELO lists.php.net) (127.0.0.1)
  by localhost with SMTP; 1 Sep 2011 14:08:07 -0000
Authentication-Results: pb1.pair.com smtp.mail=hannes.magnusson@gmail.com; spf=pass; sender-id=pass
Authentication-Results: pb1.pair.com header.from=hannes.magnusson@gmail.com; sender-id=pass
Received-SPF: pass (pb1.pair.com: domain gmail.com designates 209.85.212.42 as permitted sender)
X-PHP-List-Original-Sender: hannes.magnusson@gmail.com
X-Host-Fingerprint: 209.85.212.42 mail-vw0-f42.google.com  
Received: from [209.85.212.42] ([209.85.212.42:59130] helo=mail-vw0-f42.google.com)
	by pb1.pair.com (ecelerity 2.1.1.9-wez r(12769M)) with ESMTP
	id 9B/1B-03466-6C19F5E4 for <internals@lists.php.net>; Thu, 01 Sep 2011 10:08:06 -0400
Received: by vwl1 with SMTP id 1so1517000vwl.29
        for <multiple recipients>; Thu, 01 Sep 2011 07:08:03 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:cc:content-type;
        bh=IGuA7RVZHDjS9WXiiRhb+9S78LFfQ3n8Tgecg0jrqLk=;
        b=hrw6MZiw29S+oeJ+K2WlVh1ISRS4yBxU+lsvDGwJNE8PZnenRi4MG+ubvULGR1Q+rJ
         R5yrUPxBQx478ZrR5makGvONSDevUm4hsCjJVYrYiz53nUz4W77VPrGkYQtoj4ONR6wd
         8muVnsQduNVwPmhTbPZsqkQxTaMZgpWPJs7VY=
MIME-Version: 1.0
Received: by 10.52.174.193 with SMTP id bu1mr263906vdc.291.1314886083205; Thu,
 01 Sep 2011 07:08:03 -0700 (PDT)
Sender: hannes.magnusson@gmail.com
Received: by 10.52.159.34 with HTTP; Thu, 1 Sep 2011 07:08:03 -0700 (PDT)
In-Reply-To: <CAAAa2siM=z6o42S6jDXsatQxDwUBoDWN8rWT_3HTTQwKaZewfw@mail.gmail.com>
References: <CADNQb0WmZg_6kwUjh58-WhzzrzWR62fy3aOBdox6dQ+DD2bhbg@mail.gmail.com>
	<CAH-PCH5_y4KZnDimaT+mFML8DMy0wYVLn57mHrADT+U=chfdJQ@mail.gmail.com>
	<CAAAa2siM=z6o42S6jDXsatQxDwUBoDWN8rWT_3HTTQwKaZewfw@mail.gmail.com>
Date: Thu, 1 Sep 2011 16:08:03 +0200
X-Google-Sender-Auth: HZ2B8oSOvIGksxBNWw5vVAE70MQ
Message-ID: <CADNQb0UavHwp2-mFKkos7PHiA7OkfopWnRJx=zrWSEDYep-JYA@mail.gmail.com>
To: Alexey Shein <confik@gmail.com>
Cc: Ferenc Kovacs <tyra3l@gmail.com>, PHP Development <internals@lists.php.net>, 
	PHP QA <php-qa@lists.php.net>
Content-Type: text/plain; charset=UTF-8
Subject: Re: [PHP-DEV] New run-tests.php feature
From: bjori@php.net (Hannes Magnusson)

On Thu, Sep 1, 2011 at 15:53, Alexey Shein <confik@gmail.com> wrote:
> 2011/9/1 Ferenc Kovacs <tyra3l@gmail.com>:
>> On Thu, Sep 1, 2011 at 1:35 PM, Hannes Magnusson <bjori@php.net> wrote:
>>> Throw qa and internals@ into the loop to.
>>>
>>> I'd also like to move the XFAIL section (printed out in the end) above
>>> the FAIL section.
>>> We have bucketloads of xfailed tests, I actually have to scroll up to
>>> see the failed tests which is really annoying and silly.
>>>
>>> Anyone have strong opinion on the printout order?
>>
>> yeah, strongly agree
>
> Great addition.
> While you're at it, could you also add an option to print a list of
> skipped tests (maybe above XFAIL section), that's also currently can't
> be done with other options in run-tests.php.
> It could also be useful because some skipped tests maybe skipped for
> the wrong reason and be actually failed. It's also a great spot to
> notice obsolete tests that need to be removed from the suite and make
> running all process faster.


Depending on how you run the test suite, you could get buuuuuuuunch of
skipped tests..
Unsure if its that good idea to include them in the report.

To see the skipped tests while running the test suite, and nothing
else, you can use the new switch/environment variable as mentioned
earlier in this thread..

-Hannes