Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:89222
Mailing-List: contact internals-help@lists.php.net; run by ezmlm
Received-SPF: pass (pb1.pair.com: domain intel.com designates 192.55.52.88 as permitted sender)
To: 'Matt Wilmas' <php_lists@realplain.com>, "internals@lists.php.net"
	<internals@lists.php.net>, Andrea Faulds <ajf@ajf.me>
Thread-Topic: [PHP-DEV] Re: Benchmark Results for PHP Master 2015-11-12
Thread-Index: AQHRHWqlRYAl+1HonkCmWuNoN3+BXZ6Z01AAgAAEtW+ABHhB4A==
Date: Mon, 16 Nov 2015 08:19:10 +0000
Message-ID: <0ABC26E371A76440A370CFC5EB1056CC40EAC013@IRSMSX106.ger.corp.intel.com>
References: <01e9a162-732d-460c-b47c-e570b1e2e2b6@irsmsx151.ger.corp.intel.com>
 <52.12.37356.97AC5465@pb1.pair.com> <E2C8827BEAF24C61AB710977F3E76969@pc1>
In-Reply-To: <E2C8827BEAF24C61AB710977F3E76969@pc1>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Subject: RE: [PHP-DEV] Re: Benchmark Results for PHP Master 2015-11-12
From: bogdan.andone@intel.com ("Andone, Bogdan")



> -----Original Message-----
> From: Matt Wilmas [mailto:php_lists@realplain.com]
> Sent: Friday, November 13, 2015 1:49 PM
> To: internals@lists.php.net; Andrea Faulds
> Subject: Re: [PHP-DEV] Re: Benchmark Results for PHP Master 2015-11-12
>=20
> Hi,
>=20
> ----- Original Message -----
> From: "Andrea Faulds"
> Sent: Friday, November 13, 2015
>=20
> > Hi,
> >
> > lp_benchmark_robot@intel.com wrote:
> >>
> >> ---------------------------------------------------------------------
> ----------------------
> >>                          benchmark   relative   change since   change
> >> since  current rev run
> >>                                      std_dev*       last run
> >> baseline         with PGO
> >> ---------------------------------------------------------------------
> ----------------------
> >> :-(   Wordpress 4.2.2 cgi -T10000
> >> 9%         -3.67%         -1.28%            6.51%
> >> :-(       Drupal 7.36 cgi -T10000
> >> 8%         -2.03%         -0.67%            2.63%
> >> :-(   MediaWiki 1.23.9 cgi -T5000
> >> 1%         -3.19%         -0.97%            3.84%
> >> :-(             bench.php cgi -T1
> >> 08%        -16.51%        -12.70%            9.68%
> >> :-(       micro_bench.php cgi -T1      0.03%         -1.50%
> >> 0.10%            5.41%
> >> :-(        mandelbrot.php cgi -T1
> >> 31%        -25.68%        -18.78%           -0.74%
> >> ---------------------------------------------------------------------
> ----------------------
> >
> >
> > Huh? Sad faces across the board, as bad as -25% for one test?
> >
> > Did we have to change something and it inadvertently affected
> performance?
> > This looks pretty bad.
>=20
> Yup, I noticed right away yesterday and wondered the same, but decided
> to
> hold off on commenting until the next report(s) come(s). :-)
>=20
> I figured it might have happened "between some changes that weren't
> optimal," but after the commits were finalized, etc. it would be sorted
> out
> again.  But this does seem pretty extreme, and I don't recall seeing
> radical
> changes since the last one... *shrug*
Indeed, it seemed that the sources "sampling" occurred on an unstable commi=
t. We didn't escalate explicitly the issue as we saw it solved during the n=
ext day with the performance back on track.
Not sure if this was the cause, but having a short look at the commits appl=
ied just before and after the performance drop we observed several iteratio=
ns and reverts on #70895 and #70898.

>=20
>=20
> - Matt
>=20
>=20
> --
> PHP Internals - PHP Runtime Development Mailing List
> To unsubscribe, visit: http://www.php.net/unsub.php

Kind Regards,
Bogdan