Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:128423
Precedence: list
MIME-Version: 1.0
Date: Thu, 07 Aug 2025 16:03:14 +0000
To: carlosv775@gmail.com
Cc: PHP internals <internals@lists.php.net>
Subject: Re: [PHP-DEV] Test coverage
In-Reply-To: <CAPyj-LCT6xiZ1a1VbVEN=7mq6VGJsR8Ytu3i0tW0qV0BAVd=hg@mail.gmail.com>
References: <CAEwRQKZBZxV6D6qcpEduY5Er_+du+mWyrK-c+SQCwkNCQwKwHQ@mail.gmail.com>
 <CAPyj-LCT6xiZ1a1VbVEN=7mq6VGJsR8Ytu3i0tW0qV0BAVd=hg@mail.gmail.com>
Message-ID: <1f5225ac83c660b6f333981b75f00669@posteo.de>
Content-Type: text/plain; charset=UTF-8;
 format=flowed
Content-Transfer-Encoding: quoted-printable
From: thomas.pakkanen@posteo.de (=?UTF-8?Q?Thomas_Kr=C3=BCger?=)

Hi Vinicius,

as Ilija mentioned you can see here an overall view on the current 55%=20
line coverage in PHP. I guess its "line coverage" (a less strong code=20
coverage type in comparison to types like "branch coverage", "MC/DC" or=20
wonderful "path coverage"):
https://app.codecov.io/github/php/php-src?search=3D&trend=3Dall%20time

More important than high line coverage would be to collect the=20
requirements of features in a project, which should be tested plus=20
negative variants of the reuirements. So, high code coverage is fine,=20
but high test coverage would be more helpful. :)

Here some sloppy explanations:

Code coverage:
Percentage of how many lines of code are covered by automated tests.

Test coverage:
Percentage of how many defined test cases covered real requirements.

Requirement coverage:
Percentage of how many reuirements are well defined and how many are=20
missing.

Be ware of:
100% line coverage does not mean anything other that 100% of the lines=20
of a project a "covered" by "any" automated tests, Your project still=20
includes bugs, missing features, security problems and crashes. So=20
additional coverage types like input value coverage, path coverage,=20
MC/DC and other helps to have more confidents in the correctness of the=20
project. :)

Best regards,
Thomas

Am 07.08.2025 17:44 schrieb Ilija Tovilo:
> Hi Vinicius
>=20
> On Thu, Aug 7, 2025 at 5:20=E2=80=AFPM Vinicius Dias <carlosv775@gmail.co=
m>=20
> wrote:
>>=20
>> I would like to know how or where I can find the code coverage for
>> php-src to see if there is any uncovered code I might be able to
>> contribute with new tests.
>=20
> It lives here:
>=20
> https://app.codecov.io/github/php/php-src
>=20
> However, it seems it's currently borked. The nightly job succeeded, so
> I'm not immediately sure what's wrong. I'll put it on my list, unless
> somebody beats me to it.
>=20
> Ilija