GOOD Benchmark Results for PHP Master 2016-03-18

8 years ago by lp_benchmark_robot@intel.com — view source

unread

Results for project PHP master, build date 2016-03-18 06:28:14+02:00
commit: 48e3459
previous commit: fc49f1c
revision date: 2016-03-17 22:44:23+03:00
environment: Haswell-EP
cpu: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz 2x18 cores, stepping 2, LLC 45 MB
mem: 128 GB
os: CentOS 7.1
kernel: Linux 3.10.0-229.4.2.el7.x86_64

Baseline results were generated using release php-7.0.0, with hash 60fffd2 from
2015-12-01 04:16:47+00:00

                    benchmark   relative   change since   change since  current rev run
                                std_dev*       last run       baseline         with PGO

:-| Wordpress 4.2.2 cgi -T10000 0.18% -0.19% 0.39% 7.67%
:-| Drupal 7.36 cgi -T10000 0.17% -0.32% -0.64% 5.21%
:-| MediaWiki 1.23.9 cgi -T5000 0.14% -0.44% 0.89% 4.04%
:-) bench.php cgi -T100 0.00% 17.92% 19.80% -0.67%
:-) micro_bench.php cgi -T10 0.01% 2.90% 5.37% 3.31%
:-) mandelbrot.php cgi -T100 0.03% 37.69% 28.50% 9.80%

Relative Standard Deviation (Standard Deviation/Average)

If this is not displayed properly please visit our results page here: http://languagesperformance.intel.com/good-benchmark-results-for-php-master-2016-03-18/

Note: Benchmark results for Wordpress, Drupal, MediaWiki are measured in
fetches/second while all others are measured in seconds.
More details on measurements methodology at:
https://01.org/lp/documentation/php-environment-setup.

Subject Label Legend:
Attributes are determined based on the performance evolution of the workloads
compared to the previous measurement iteration.
NEUTRAL: performance did not change by more than 1% for any workload
GOOD: performance improved by more than 1% for at least one workload and there
is no regression greater than 1%
BAD: performance dropped by more than 1% for at least one workload and there is
no improvement greater than 1%
UGLY: performance improved by more than 1% for at least one workload and also
dropped by more than 1% for at least one workload

Our lab does a nightly source pull and build of the PHP project and measures
performance changes against the previous stable version and the previous nightly
measurement. This is provided as a service to the community so that quality
issues with current hardware can be identified quickly.

Intel technologies' features and benefits depend on system configuration and may
require enabled hardware, software or service activation. Performance varies
depending on system configuration.

8 years ago by Yasuo Ohgaki — view source

unread

Hi all,

                    benchmark   relative   change since   change since  current rev run
                                std_dev*       last run       baseline         with PGO
:-| Wordpress 4.2.2 cgi -T10000 0.18% -0.19% 0.39% 7.67%
:-| Drupal 7.36 cgi -T10000 0.17% -0.32% -0.64% 5.21%
:-| MediaWiki 1.23.9 cgi -T5000 0.14% -0.44% 0.89% 4.04%
:-) bench.php cgi -T100 0.00% 17.92% 19.80% -0.67%
:-) micro_bench.php cgi -T10 0.01% 2.90% 5.37% 3.31%
:-) mandelbrot.php cgi -T100 0.03% 37.69% 28.50% 9.80%

I'm just curious. Is this due to huge page change?

Thanks.

--
Yasuo Ohgaki
yohgaki@ohgaki.net

8 years ago by Matt Wilmas — view source

unread

Hi Yasuo,

----- Original Message -----
From: "Yasuo Ohgaki"
Sent: Tuesday, March 22, 2016

Hi all,
                    benchmark   relative   change since   change 
since current rev run
std_dev* last run
baseline with PGO

:-| Wordpress 4.2.2 cgi -T10000 0.18% -0.19%
0.39% 7.67%
:-| Drupal 7.36 cgi -T10000
7% -0.32% -0.64% 5.21%
:-| MediaWiki 1.23.9 cgi -T5000 0.14% -0.44%
0.89% 4.04%
:-) bench.php cgi -T100 0.00% 17.92%
19.80% -0.67%
:-) micro_bench.php cgi -T10 0.01% 2.90%
5.37% 3.31%
:-) mandelbrot.php cgi -T100 0.03% 37.69%
28.50% 9.80%
I'm just curious. Is this due to huge page change?

No, it's from enabling "DFA pass by default" in the optimizer:
http://git.php.net/?p=php-src.git;a=commitdiff;h=681de725542cbd776a1b3579c6778780c727d2ad

I was going to make a comment when I saw these results also. It helped the
synthetic stuff a LOT, and more than corrected the mandelbrot regression
(since 7.0), but not "real apps." Still nice to see for comparing with
HHVM. :-) And of course it helps isolated areas of different apps, and more
optimizations will be added...

The "huge page" change you're referring to is Rasmus disabling them by
default now? If Intel doesn't enable them again, it should show reduced
performance on Wordpress, etc. (1% or more? Can't remember.)

Thanks.

--
Yasuo Ohgaki
yohgaki@ohgaki.net

Matt

GOOD Benchmark Results for PHP Master 2016-03-18

since current rev run std_dev* last run baseline with PGO

since current rev run
std_dev* last run
baseline with PGO