Results for project PHP master, build date 2015-11-12 05:26:37+02:00
commit: a4e16cd8238e5b09b6afe7a84a62c0bfa58cccd0
revision date: 2015-11-12 01:43:38+01:00
environment: Haswell-EP
cpu: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz 2x18 cores, stepping 2, LLC 45 MB
mem: 128 GB
os: CentOS 7.1
kernel: Linux 3.10.0-229.4.2.el7.x86_64
Baseline results were generated using release php-7.0.0beta3, with hash
1674bd9b151ff389fb8c9fc223bc6aafdd49ff2c from 2015-08-05 04:56:40+00:00
benchmark relative change since change since current rev run
std_dev* last run baseline with PGO
:-( Wordpress 4.2.2 cgi -T10000 0.29% -3.67% -1.28% 6.51%
:-( Drupal 7.36 cgi -T10000 0.38% -2.03% -0.67% 2.63%
:-( MediaWiki 1.23.9 cgi -T5000 0.51% -3.19% -0.97% 3.84%
:-( bench.php cgi -T1 0.08% -16.51% -12.70% 9.68%
:-( micro_bench.php cgi -T1 0.03% -1.50% 0.10% 5.41%
:-( mandelbrot.php cgi -T1 0.31% -25.68% -18.78% -0.74%
Note: Benchmark results for Wordpress, Drupal, MediaWiki are measured in
fetches/second while all others are measured in seconds.
More details on measurements methodology at:
https://01.org/lp/documentation/php-environment-setup.
- Relative Standard Deviation (Standard Deviation/Average)
Our lab does a nightly source pull and build of the PHP project and measures
performance changes against the previous stable version and the previous nightly
measurement. This is provided as a service to the community so that quality
issues with current hardware can be identified quickly.
Intel technologies' features and benefits depend on system configuration and may
require enabled hardware, software or service activation. Performance varies
depending on system configuration.
Hi,
lp_benchmark_robot@intel.com wrote:
benchmark relative change since change since current rev run std_dev* last run baseline with PGO
:-( Wordpress 4.2.2 cgi -T10000 0.29% -3.67% -1.28% 6.51%
:-( Drupal 7.36 cgi -T10000 0.38% -2.03% -0.67% 2.63%
:-( MediaWiki 1.23.9 cgi -T5000 0.51% -3.19% -0.97% 3.84%
:-( bench.php cgi -T1 0.08% -16.51% -12.70% 9.68%
:-( micro_bench.php cgi -T1 0.03% -1.50% 0.10% 5.41%
:-( mandelbrot.php cgi -T1 0.31% -25.68% -18.78% -0.74%
Huh? Sad faces across the board, as bad as -25% for one test?
Did we have to change something and it inadvertently affected
performance? This looks pretty bad.
Thanks.
Andrea Faulds
http://ajf.me/
Hi,
----- Original Message -----
From: "Andrea Faulds"
Sent: Friday, November 13, 2015
Hi,
lp_benchmark_robot@intel.com wrote:
benchmark relative change since changesince current rev run
std_dev* last run
baseline with PGO:-( Wordpress 4.2.2 cgi -T10000
9% -3.67% -1.28% 6.51%
:-( Drupal 7.36 cgi -T10000
8% -2.03% -0.67% 2.63%
:-( MediaWiki 1.23.9 cgi -T5000
1% -3.19% -0.97% 3.84%
:-( bench.php cgi -T1
08% -16.51% -12.70% 9.68%
:-( micro_bench.php cgi -T1 0.03% -1.50%
0.10% 5.41%
:-( mandelbrot.php cgi -T1
31% -25.68% -18.78% -0.74%Huh? Sad faces across the board, as bad as -25% for one test?
Did we have to change something and it inadvertently affected performance?
This looks pretty bad.
Yup, I noticed right away yesterday and wondered the same, but decided to
hold off on commenting until the next report(s) come(s). :-)
I figured it might have happened "between some changes that weren't
optimal," but after the commits were finalized, etc. it would be sorted out
again. But this does seem pretty extreme, and I don't recall seeing radical
changes since the last one... shrug
- Matt
-----Original Message-----
From: Matt Wilmas [mailto:php_lists@realplain.com]
Sent: Friday, November 13, 2015 1:49 PM
To: internals@lists.php.net; Andrea Faulds
Subject: Re: [PHP-DEV] Re: Benchmark Results for PHP Master 2015-11-12Hi,
----- Original Message -----
From: "Andrea Faulds"
Sent: Friday, November 13, 2015Hi,
lp_benchmark_robot@intel.com wrote:
benchmark relative change since changesince current rev run
std_dev* last run
baseline with PGO
:-( Wordpress 4.2.2 cgi -T10000
9% -3.67% -1.28% 6.51%
:-( Drupal 7.36 cgi -T10000
8% -2.03% -0.67% 2.63%
:-( MediaWiki 1.23.9 cgi -T5000
1% -3.19% -0.97% 3.84%
:-( bench.php cgi -T1
08% -16.51% -12.70% 9.68%
:-( micro_bench.php cgi -T1 0.03% -1.50%
0.10% 5.41%
:-( mandelbrot.php cgi -T1
31% -25.68% -18.78% -0.74%
Huh? Sad faces across the board, as bad as -25% for one test?
Did we have to change something and it inadvertently affected
performance?
This looks pretty bad.Yup, I noticed right away yesterday and wondered the same, but decided
to
hold off on commenting until the next report(s) come(s). :-)I figured it might have happened "between some changes that weren't
optimal," but after the commits were finalized, etc. it would be sorted
out
again. But this does seem pretty extreme, and I don't recall seeing
radical
changes since the last one... shrug
Indeed, it seemed that the sources "sampling" occurred on an unstable commit. We didn't escalate explicitly the issue as we saw it solved during the next day with the performance back on track.
Not sure if this was the cause, but having a short look at the commits applied just before and after the performance drop we observed several iterations and reverts on #70895 and #70898.
- Matt
--
Kind Regards,
Bogdan