# Benchmark Results for PHP Master 2015-11-12 - Thread: https://externals.io/message/89199 - Original archive: https://news-web.php.net/php.internals/89199 - Started by lp_benchmark_robot@intel.com on 2015-11-12T16:53:25+00:00 - Messages: 4 - Reply by email to internals@lists.php.net - More for agents: search with https://externals.io/search.md?q={query} · JSON API at https://externals.io/api · documentation at https://externals.io/llms.txt --- ## #89199 — lp_benchmark_robot@intel.com — 2015-11-12T16:53:25+00:00 URL: https://externals.io/message/89199#89199 Results for project PHP master, build date 2015-11-12 05:26:37+02:00 commit: a4e16cd8238e5b09b6afe7a84a62c0bfa58cccd0 revision date: 2015-11-12 01:43:38+01:00 environment: Haswell-EP cpu: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz 2x18 cores, stepping 2, LLC 45 MB mem: 128 GB os: CentOS 7.1 kernel: Linux 3.10.0-229.4.2.el7.x86_64 Baseline results were generated using release php-7.0.0beta3, with hash 1674bd9b151ff389fb8c9fc223bc6aafdd49ff2c from 2015-08-05 04:56:40+00:00 ------------------------------------------------------------------------------------------- benchmark relative change since change since current rev run std_dev* last run baseline with PGO ------------------------------------------------------------------------------------------- :-( Wordpress 4.2.2 cgi -T10000 0.29% -3.67% -1.28% 6.51% :-( Drupal 7.36 cgi -T10000 0.38% -2.03% -0.67% 2.63% :-( MediaWiki 1.23.9 cgi -T5000 0.51% -3.19% -0.97% 3.84% :-( bench.php cgi -T1 0.08% -16.51% -12.70% 9.68% :-( micro_bench.php cgi -T1 0.03% -1.50% 0.10% 5.41% :-( mandelbrot.php cgi -T1 0.31% -25.68% -18.78% -0.74% ------------------------------------------------------------------------------------------- Note: Benchmark results for Wordpress, Drupal, MediaWiki are measured in fetches/second while all others are measured in seconds. More details on measurements methodology at: https://01.org/lp/documentation/php-environment-setup. * Relative Standard Deviation (Standard Deviation/Average) Our lab does a nightly source pull and build of the PHP project and measures performance changes against the previous stable version and the previous nightly measurement. This is provided as a service to the community so that quality issues with current hardware can be identified quickly. Intel technologies' features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. --- ## #89203 — Andrea Faulds — 2015-11-13T11:33:10+00:00 URL: https://externals.io/message/89199#89203 · In reply to: #89199 Hi, lp_benchmark_robot@intel.com wrote: > > ------------------------------------------------------------------------------------------- > benchmark relative change since change since current rev run > std_dev* last run baseline with PGO > ------------------------------------------------------------------------------------------- > :-( Wordpress 4.2.2 cgi -T10000 0.29% -3.67% -1.28% 6.51% > :-( Drupal 7.36 cgi -T10000 0.38% -2.03% -0.67% 2.63% > :-( MediaWiki 1.23.9 cgi -T5000 0.51% -3.19% -0.97% 3.84% > :-( bench.php cgi -T1 0.08% -16.51% -12.70% 9.68% > :-( micro_bench.php cgi -T1 0.03% -1.50% 0.10% 5.41% > :-( mandelbrot.php cgi -T1 0.31% -25.68% -18.78% -0.74% > ------------------------------------------------------------------------------------------- Huh? Sad faces across the board, as bad as -25% for one test? Did we have to change something and it inadvertently affected performance? This looks pretty bad. Thanks. -- Andrea Faulds http://ajf.me/ --- ## #89204 — Matt Wilmas — 2015-11-13T11:48:40+00:00 URL: https://externals.io/message/89199#89204 · In reply to: #89203 Hi, ----- Original Message ----- From: "Andrea Faulds" Sent: Friday, November 13, 2015 > Hi, > > lp_benchmark_robot@intel.com wrote: > > […] > > > Huh? Sad faces across the board, as bad as -25% for one test? > > Did we have to change something and it inadvertently affected performance? > This looks pretty bad. Yup, I noticed right away yesterday and wondered the same, but decided to hold off on commenting until the next report(s) come(s). :-) I figured it might have happened "between some changes that weren't optimal," but after the commits were finalized, etc. it would be sorted out again. But this does seem pretty extreme, and I don't recall seeing radical changes since the last one... *shrug* - Matt --- ## #89222 — Andone — 2015-11-16T08:19:10+00:00 URL: https://externals.io/message/89199#89222 · In reply to: #89204 > -----Original Message----- > From: Matt Wilmas [mailto:php_lists@realplain.com] > Sent: Friday, November 13, 2015 1:49 PM > To: internals@lists.php.net; Andrea Faulds > Subject: Re: [PHP-DEV] Re: Benchmark Results for PHP Master 2015-11-12 > > Hi, > > ----- Original Message ----- > From: "Andrea Faulds" > Sent: Friday, November 13, 2015 > > > […] > ---------------------- > > […] > ---------------------- > > […] > ---------------------- > > […] > performance? > > […] > > Yup, I noticed right away yesterday and wondered the same, but decided > to > hold off on commenting until the next report(s) come(s). :-) > > I figured it might have happened "between some changes that weren't > optimal," but after the commits were finalized, etc. it would be sorted > out > again. But this does seem pretty extreme, and I don't recall seeing > radical > changes since the last one... *shrug* Indeed, it seemed that the sources "sampling" occurred on an unstable commit. We didn't escalate explicitly the issue as we saw it solved during the next day with the performance back on track. Not sure if this was the cause, but having a short look at the commits applied just before and after the performance drop we observed several iterations and reverts on #70895 and #70898. > > > - Matt > > > -- > > Kind Regards, Bogdan