Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:74756
Mailing-List: contact internals-help@lists.php.net; run by ezmlm
Received-SPF: pass (pb1.pair.com: domain gmail.com designates 209.85.192.53 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <8C.E0.17294.AD860935@pb1.pair.com>
References: <CAOg_pRRAwHq5ho7vWJ_taug8a5W+g07ezRAj2jouue+ApDr1aQ@mail.gmail.com>
	<CAH-PCH7_D74PZNY5U7KKds-3bj7JxLxmJsu0u7uy+-7yHRm5Pw@mail.gmail.com>
	<8C.E0.17294.AD860935@pb1.pair.com>
Date: Thu, 5 Jun 2014 15:32:19 +0200
Message-ID: <CAH-PCH5GniAFqqYfKCQwegQ5MLTZ5vZRN67gDSoaC=z69E7XVg@mail.gmail.com>
To: Maciej Sobaczewski <sobak@php.net>
Cc: PHP Internals <internals@lists.php.net>
Content-Type: multipart/alternative; boundary=001a11c11d12296a7504fb16c6c3
Subject: Re: [PHP-DEV] tests code coverage for php 5.5
From: tyra3l@gmail.com (Ferenc Kovacs)

--001a11c11d12296a7504fb16c6c3
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

On Thu, Jun 5, 2014 at 2:55 PM, Maciej Sobaczewski <sobak@php.net> wrote:

> On Wed, Jun 4, 2014 at 10:06 PM, Nicolai Scheer <nicolai.scheer@gmail.com=
>
>> wrote:
>>
>>  Hi,
>>>
>>> looking for tasks to invest a little spare time in the weeks to come I
>>> had
>>> a look at
>>>
>>> http://gcov.php.net/viewer.php?version=3DPHP_5_5
>>>
>>> The test coverage is suspiciously low...
>>>
>>> Test coverage of 5.4 is quite high, so is coverage for 5.3.
>>>
>>> I would have guessed, that for a new major php version all tests from t=
he
>>> previous version are reused, and fixed if needed.
>>>
>>> Looking at the 5.5 source tree all the phpt files seem in place... Aren=
't
>>> the tests just currently not executed on gcov.php.net?
>>>
>>> Thanks for any insight!
>>>
>>> Greetings
>>>
>>> Nico
>>>
>>>
>> Yeah, something is definitely wrong:
>> http://gcov.php.net/PHP_5_4/lcov_html/
>> vs
>> http://gcov.php.net/PHP_5_5/lcov_html/
>>
>> and it we dates are correct, the last gcov build for 5.6 was more than a
>> week ago:
>> http://gcov.php.net/
>> http://gcov.php.net/PHP_5_6/lcov_html/
>>
>> ps: I've cc'ed Nuno as he is the man who knows our gcov setup.
>>
>>
> I will ask by the way. Aren't any parts duplicate of what we've got with
> travis/QA reports now? I mean statistics about passed/failed tests etc. I=
t
> is probably good to have all such data in one place, but not when tools a=
re
> not working properly. It also means two systems to maintain and in my
> opinion leads to confusion as the results are not equal.
>
> Regards,
> Maciej.
>
> --
> PHP Internals - PHP Runtime Development Mailing List
> To unsubscribe, visit: http://www.php.net/unsub.php
>
>
my idea with jenkins was to have everything in one place, so build and test
php-src on multiple platforms(including windows) and also test userland
projects with the resulting binaries and also have coverity reports (not
for every commit, but periodically) but that was low prio, as gcov was
already there:
http://grokbase.com/p/php/php-internals/11btzq29x8/php-dev-ci-for-5-4
but stuff happen, and I never managed to finish what I was planning.
having travis is a bit redundant, as it does less than what jenkins does
(or can), and only supports linux with one distribution and only 64bit, but
it doesn't really require any maintenance from our part and "just works"
and also supports testing pull requests, which would require a bit more
work on our part if we want to do that on our jenkins environment (not the
PR building, but doing that in an isolated and secure way).

btw, I'm currently working on two pull request for our travis setup: one is
for changing our current travis project from php to C, which saves some
build time, as the travis box won't need to build php 5.4 which we doesn't
use at all, and it will also mean that we will install our dependencies for
ourselves explicitly instead of using those installed by default for the
travis php 5.4.
the other pull request is to do cross-compile 32bit builds on travis
through ia32-libs.
that would help us at least cover one platform/distro.

--=20
Ferenc Kov=C3=A1cs
@Tyr43l - http://tyrael.hu

--001a11c11d12296a7504fb16c6c3--