Benchmark Results for PHP Master 2015-07-30

9 years ago by lp_benchmark_robot — view source

unread

Results for project php-src-nightly, build date 2015-07-30 05:00:00+03:00

commit: ae1a4f47e6bd9f8d1d969e5080dae60136d7444b

revision_date: 2015-07-29 21:00:43+02:00

environment: Haswell-EP

  cpu:  Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz 2x18 cores, stepping 2, LLC 45 MB

  mem:  128 GB

  os:   CentOS 7.1

  kernel:     Linux 3.10.0-229.4.2.el7.x86_64

Note: Baseline results were generated using release php-7.0.0beta1, with hash

ad8a73dd55c087de465ad80e8715611693bb1460 from 2015-07-07 16:02:13+00:00

                 benchmark     executable unit   change since   change since

                                                    yesterday php-7.0.0beta1

Wordpress 4.2.2 cgi -T10000 php opc=on fps -1.36% -0.78%

   Drupal 7.36 cgi -T10000     php opc=on  fps         -0.08%          0.25%

MediaWiki 1.23.9 cgi -T5000 php opc=on fps -0.97% -1.16%

         bench.php cgi -T1     php opc=on  sec          0.65%         -3.81%

   micro_bench.php cgi -T1     php opc=on  sec          2.28%          2.94%

    mandelbrot.php cgi -T1     php opc=on  sec          0.06%         -1.76%

Our lab does a nightly source pull and build of the PHP project and measures performance changes against the previous stable version and the previous nightly measurement. This is provided as a service to the community so that quality issues with current hardware can be identified quickly.

Intel technologies' features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. No license (express or implied, by estoppel or otherwise) to any intellectual property rights is granted by this document.

Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade. This document may contain information on products, services and/or processes in development. Contact your Intel representative to obtain the latest forecast, schedule, specifications and roadmaps. The products and services described may contain defects or errors known as errata which may cause deviations from published specifications.

Current characterized errata are available on request.

9 years ago by Pierre Joye — view source

unread

Hi,

Does someone has a contact there?

It would be nicer to have these results combined with what we pushed on
qa.php.net as well.

Cheers,
Pierre
On Jul 30, 2015 3:29 PM, "lp_benchmark_robot" lp_benchmark_robot@intel.com
wrote:

Results for project php-src-nightly, build date 2015-07-30 05:00:00+03:00

commit: ae1a4f47e6bd9f8d1d969e5080dae60136d7444b

revision_date: 2015-07-29 21:00:43+02:00

environment: Haswell-EP
  cpu:  Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz 2x18 cores, stepping
2, LLC 45 MB
  mem:  128 GB

  os:   CentOS 7.1

  kernel:     Linux 3.10.0-229.4.2.el7.x86_64
Note: Baseline results were generated using release php-7.0.0beta1, with
hash

ad8a73dd55c087de465ad80e8715611693bb1460 from 2015-07-07 16:02:13+00:00
                 benchmark     executable unit   change since   change
since
                                                    yesterday
php-7.0.0beta1

Wordpress 4.2.2 cgi -T10000 php opc=on fps -1.36%
-0.78%
   Drupal 7.36 cgi -T10000     php opc=on  fps         -0.08%
0.25%

MediaWiki 1.23.9 cgi -T5000 php opc=on fps -0.97%
-1.16%
         bench.php cgi -T1     php opc=on  sec          0.65%
-3.81%
   micro_bench.php cgi -T1     php opc=on  sec          2.28%
2.94%
    mandelbrot.php cgi -T1     php opc=on  sec          0.06%
-1.76%

Our lab does a nightly source pull and build of the PHP project and
measures performance changes against the previous stable version and the
previous nightly measurement. This is provided as a service to the
community so that quality issues with current hardware can be identified
quickly.

Intel technologies' features and benefits depend on system configuration
and may require enabled hardware, software or service activation.
Performance varies depending on system configuration. No license (express
or implied, by estoppel or otherwise) to any intellectual property rights
is granted by this document.

Intel disclaims all express and implied warranties, including without
limitation, the implied warranties of merchantability, fitness for a
particular purpose, and non-infringement, as well as any warranty arising
from course of performance, course of dealing, or usage in trade. This
document may contain information on products, services and/or processes in
development. Contact your Intel representative to obtain the latest
forecast, schedule, specifications and roadmaps. The products and services
described may contain defects or errors known as errata which may cause
deviations from published specifications.

Current characterized errata are available on request.

(C) 2015 Intel Corporation.

9 years ago by Niklas Keller — view source

unread

2015-07-30 11:57 GMT+02:00 Pierre Joye pierre.php@gmail.com:

Hi,

Does someone has a contact there?

It would be nicer to have these results combined with what we pushed on
qa.php.net as well.

Cheers,
Pierre

Thought about that as well, results per mail aren't that useful, especially
as they're badly formatted for me in GMail (no fixed font).
A graph visualizing those numbers would be nice.

Regards, Niklas

9 years ago by Andone — view source

unread

-----Original Message-----
From: Niklas Keller [mailto:me@kelunik.com]
Sent: Thursday, July 30, 2015 1:47 PM
To: Pierre Joye
Cc: lp_benchmark_robot; PHP internals; lp@lists.01.org
Subject: Re: [PHP-DEV] Benchmark Results for PHP Master 2015-07-30

2015-07-30 11:57 GMT+02:00 Pierre Joye pierre.php@gmail.com:

Hi,

Does someone has a contact there?

It would be nicer to have these results combined with what we pushed
on qa.php.net as well.

Cheers,
Pierre

Thought about that as well, results per mail aren't that useful,
especially as they're badly formatted for me in GMail (no fixed font).
A graph visualizing those numbers would be nice.

Regards, Niklas

Hi Guys,

We are glad that our small ticking spam start to be observed :) !

We would like to offer valuable information to the community related to
performance trends of the PHP project on Intel platforms based on daily builds
and we are open for suggestions for making these results relevant.

We chose to share our numbers as plain text mails for easily seeing the summary
snapshots on discussion lists without the need of other clicks.
Everybody agrees that plain text is ugly and, yes, you need to have fixed font in
place for having the table formatted correctly. Let’s discuss a better way of doing;
integration with qa.php.net is possible if we find the right interface for sharing
data in an automated way.

Normally lp@lists.01.org should be the official entry for feedbacks and requests but,
unfortunately, it is not yet operational, so I will be your direct contact as I am part
of the team which deploys this project.

Kind regards,
Bogdan

9 years ago by Niklas Keller — view source

unread

2015-07-30 14:42 GMT+02:00 Andone, Bogdan bogdan.andone@intel.com:

-----Original Message-----
From: Niklas Keller [mailto:me@kelunik.com]
Sent: Thursday, July 30, 2015 1:47 PM
To: Pierre Joye
Cc: lp_benchmark_robot; PHP internals; lp@lists.01.org
Subject: Re: [PHP-DEV] Benchmark Results for PHP Master 2015-07-30

2015-07-30 11:57 GMT+02:00 Pierre Joye pierre.php@gmail.com:

Hi,

Does someone has a contact there?

It would be nicer to have these results combined with what we pushed
on qa.php.net as well.

Cheers,
Pierre

Thought about that as well, results per mail aren't that useful,
especially as they're badly formatted for me in GMail (no fixed font).
A graph visualizing those numbers would be nice.

Regards, Niklas

Hi Guys,

We are glad that our small ticking spam start to be observed :) !

We would like to offer valuable information to the community related to
performance trends of the PHP project on Intel platforms based on daily
builds
and we are open for suggestions for making these results relevant.

We chose to share our numbers as plain text mails for easily seeing the
summary
snapshots on discussion lists without the need of other clicks.
Everybody agrees that plain text is ugly and, yes, you need to have fixed
font in
place for having the table formatted correctly. Let’s discuss a better way
of doing;
integration with qa.php.net is possible if we find the right interface
for sharing
data in an automated way.

Normally lp@lists.01.org should be the official entry for feedbacks and
requests but,
unfortunately, it is not yet operational, so I will be your direct contact
as I am part
of the team which deploys this project.

Kind regards,
Bogdan

Hi Bogdan,

I think absolute numbers (instead of a %-change) would be better suited for
visualizing performance over time.

Regards, Niklas

9 years ago by Christopher Jones — view source

unread

2015-07-30 14:42 GMT+02:00 Andone, Bogdan bogdan.andone@intel.com:

-----Original Message-----
From: Niklas Keller [mailto:me@kelunik.com]
Sent: Thursday, July 30, 2015 1:47 PM
To: Pierre Joye
Cc: lp_benchmark_robot; PHP internals; lp@lists.01.org
Subject: Re: [PHP-DEV] Benchmark Results for PHP Master 2015-07-30

2015-07-30 11:57 GMT+02:00 Pierre Joye pierre.php@gmail.com:

Hi,

Does someone has a contact there?

It would be nicer to have these results combined with what we pushed
on qa.php.net as well.

Cheers,
Pierre

Thought about that as well, results per mail aren't that useful,
especially as they're badly formatted for me in GMail (no fixed font).
A graph visualizing those numbers would be nice.

Regards, Niklas

Hi Guys,

We are glad that our small ticking spam start to be observed :) !

We would like to offer valuable information to the community related to
performance trends of the PHP project on Intel platforms based on daily
builds
and we are open for suggestions for making these results relevant.

We chose to share our numbers as plain text mails for easily seeing the
summary
snapshots on discussion lists without the need of other clicks.
Everybody agrees that plain text is ugly and, yes, you need to have fixed
font in
place for having the table formatted correctly. Let’s discuss a better way
of doing;
integration with qa.php.net is possible if we find the right interface
for sharing
data in an automated way.

Normally lp@lists.01.org should be the official entry for feedbacks and
requests but,
unfortunately, it is not yet operational, so I will be your direct contact
as I am part
of the team which deploys this project.

Kind regards,
Bogdan

Hi Bogdan,

I think absolute numbers (instead of a %-change) would be better suited for
visualizing performance over time.

Regards, Niklas

I agree on using absolute numbers. With percentages it is not
immediately obvious whether the change was good or bad.

Including the build options would be good.

Chris

--
http://twitter.com/ghrd

9 years ago by Andone — view source

unread

-----Original Message-----
From: Christopher Jones [mailto:christopher.jones@oracle.com]
Sent: Friday, July 31, 2015 1:12 AM
To: internals@lists.php.net
Subject: Re: [PHP-DEV] Benchmark Results for PHP Master 2015-07-30

2015-07-30 14:42 GMT+02:00 Andone, Bogdan bogdan.andone@intel.com:

-----Original Message-----
From: Niklas Keller [mailto:me@kelunik.com]
Sent: Thursday, July 30, 2015 1:47 PM
To: Pierre Joye
Cc: lp_benchmark_robot; PHP internals; lp@lists.01.org
Subject: Re: [PHP-DEV] Benchmark Results for PHP Master 2015-07-30

2015-07-30 11:57 GMT+02:00 Pierre Joye pierre.php@gmail.com:

Hi,

Does someone has a contact there?

It would be nicer to have these results combined with what we
pushed
on qa.php.net as well.

Cheers,
Pierre

Thought about that as well, results per mail aren't that useful,
especially as they're badly formatted for me in GMail (no fixed
font).
A graph visualizing those numbers would be nice.

Regards, Niklas

Hi Guys,

We are glad that our small ticking spam start to be observed :) !

We would like to offer valuable information to the community related
to
performance trends of the PHP project on Intel platforms based on
daily
builds
and we are open for suggestions for making these results relevant.

We chose to share our numbers as plain text mails for easily seeing
the
summary
snapshots on discussion lists without the need of other clicks.
Everybody agrees that plain text is ugly and, yes, you need to have
fixed
font in
place for having the table formatted correctly. Let’s discuss a
better way
of doing;
integration with qa.php.net is possible if we find the right
interface
for sharing
data in an automated way.

Normally lp@lists.01.org should be the official entry for feedbacks
and
requests but,
unfortunately, it is not yet operational, so I will be your direct
contact
as I am part
of the team which deploys this project.

Kind regards,
Bogdan

Hi Bogdan,

I think absolute numbers (instead of a %-change) would be better
suited for
visualizing performance over time.

Regards, Niklas

I agree on using absolute numbers. With percentages it is not
immediately obvious whether the change was good or bad.

Including the build options would be good.

Chris

--
http://twitter.com/ghrd

--

We can work on build option documentation. Most probably we will offer a link on the 01.org containing details on the environment configuration.
Concerning absolute numbers I am afraid it will be difficult to publish them in this way. Our intention is to allow you to see progresses trend in the context of Zend PHP project only. We would like to avoid the temptation to use the absolute numbers for comparisons with other projects; they might be misleading and could drive to wrong conclusions if they are removed from the context.

If the PHP baseline is relevant, the fact you see absolute numbers or percents should not make a real difference. We chose php-7.0.0beta1 in a somehow subjective way as they are no official PHP7 releases yet but we can take a PHP5.x release baseline if it looks more relevant.

Kind Regards,
Bogdan

9 years ago by Pasindu De Silva — view source

unread

Hi Andone
Is there a way to better send the results maybe csv attachment or dump some
where.
I can build a small integration.

+1
Pasindu

On Fri, Jul 31, 2015 at 10:01 PM, Andone, Bogdan bogdan.andone@intel.com
wrote:

-----Original Message-----
From: Christopher Jones [mailto:christopher.jones@oracle.com]
Sent: Friday, July 31, 2015 1:12 AM
To: internals@lists.php.net
Subject: Re: [PHP-DEV] Benchmark Results for PHP Master 2015-07-30

2015-07-30 14:42 GMT+02:00 Andone, Bogdan bogdan.andone@intel.com:

-----Original Message-----
From: Niklas Keller [mailto:me@kelunik.com]
Sent: Thursday, July 30, 2015 1:47 PM
To: Pierre Joye
Cc: lp_benchmark_robot; PHP internals; lp@lists.01.org
Subject: Re: [PHP-DEV] Benchmark Results for PHP Master 2015-07-30

2015-07-30 11:57 GMT+02:00 Pierre Joye pierre.php@gmail.com:

Hi,

Does someone has a contact there?

It would be nicer to have these results combined with what we
pushed
on qa.php.net as well.

Cheers,
Pierre

Thought about that as well, results per mail aren't that useful,
especially as they're badly formatted for me in GMail (no fixed
font).
A graph visualizing those numbers would be nice.

Regards, Niklas

Hi Guys,

We are glad that our small ticking spam start to be observed :) !

We would like to offer valuable information to the community related
to
performance trends of the PHP project on Intel platforms based on
daily
builds
and we are open for suggestions for making these results relevant.

We chose to share our numbers as plain text mails for easily seeing
the
summary
snapshots on discussion lists without the need of other clicks.
Everybody agrees that plain text is ugly and, yes, you need to have
fixed
font in
place for having the table formatted correctly. Let’s discuss a
better way
of doing;
integration with qa.php.net is possible if we find the right
interface
for sharing
data in an automated way.

Normally lp@lists.01.org should be the official entry for feedbacks
and
requests but,
unfortunately, it is not yet operational, so I will be your direct
contact
as I am part
of the team which deploys this project.

Kind regards,
Bogdan

Hi Bogdan,

I think absolute numbers (instead of a %-change) would be better
suited for
visualizing performance over time.

Regards, Niklas

I agree on using absolute numbers. With percentages it is not
immediately obvious whether the change was good or bad.

Including the build options would be good.

Chris

--
http://twitter.com/ghrd

--

We can work on build option documentation. Most probably we will offer a
link on the 01.org containing details on the environment configuration.
Concerning absolute numbers I am afraid it will be difficult to publish
them in this way. Our intention is to allow you to see progresses trend in
the context of Zend PHP project only. We would like to avoid the temptation
to use the absolute numbers for comparisons with other projects; they might
be misleading and could drive to wrong conclusions if they are removed from
the context.

If the PHP baseline is relevant, the fact you see absolute numbers or
percents should not make a real difference. We chose php-7.0.0beta1 in a
somehow subjective way as they are no official PHP7 releases yet but we can
take a PHP5.x release baseline if it looks more relevant.

Kind Regards,
Bogdan

Pasindu De Silvappasindud@gmail.com ppasindud@gmail.com