Newsgroups: php.internals,php.qa Path: news.php.net Xref: news.php.net php.internals:63530 php.qa:66762 Return-Path: Mailing-List: contact internals-help@lists.php.net; run by ezmlm Delivered-To: mailing list internals@lists.php.net Received: (qmail 80091 invoked from network); 18 Oct 2012 12:28:14 -0000 Received: from unknown (HELO lists.php.net) (127.0.0.1) by localhost with SMTP; 18 Oct 2012 12:28:14 -0000 Authentication-Results: pb1.pair.com smtp.mail=pierre.php@gmail.com; spf=pass; sender-id=pass Authentication-Results: pb1.pair.com header.from=pierre.php@gmail.com; sender-id=pass Received-SPF: pass (pb1.pair.com: domain gmail.com designates 209.85.223.170 as permitted sender) X-PHP-List-Original-Sender: pierre.php@gmail.com X-Host-Fingerprint: 209.85.223.170 mail-ie0-f170.google.com Received: from [209.85.223.170] ([209.85.223.170:41784] helo=mail-ie0-f170.google.com) by pb1.pair.com (ecelerity 2.1.1.9-wez r(12769M)) with ESMTP id 77/1B-30095-DD5FF705 for ; Thu, 18 Oct 2012 08:28:13 -0400 Received: by mail-ie0-f170.google.com with SMTP id c12so15689411ieb.29 for ; Thu, 18 Oct 2012 05:28:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ytH93C+jAViT6dkL0pJUAYfIXeRnwa97ML+/vAth8/w=; b=xJfPrz+plrvZziVF4gNTGZKjTGuV/2+6u49WFkF1scF6Y9fWMFgVJUN5oRikRbrzvs IfSrr51dIaOconmyqYTpy9LYh07bapZBottQ/z+IV8VX500I6ashJnHr2v50HY8499MF tKVuMP2C4ceED/FtoXKWjqhZrn7jgg7sRZoucr0xQviUuFQPhxJAla8gNdHI/INf4KyZ lRRpYXSdPRZB/wEkKT3fdF5284sJ4AX82Yee0vvUbdP8XAUylBWA2+HLGmGkGMypEr3t bi5Jy6FSON1WSSXE4TejZotuUrAenLchtRee5esrlOYAGfAswNrSi+vqpIUdIEhMdkAF +e5Q== MIME-Version: 1.0 Received: by 10.50.33.138 with SMTP id r10mr4611800igi.6.1350563289832; Thu, 18 Oct 2012 05:28:09 -0700 (PDT) Received: by 10.64.33.143 with HTTP; Thu, 18 Oct 2012 05:28:09 -0700 (PDT) In-Reply-To: <507ED1BE.8040903@gmail.com> References: <4FB4E844.2070305@gmail.com> <9AF025709ED6452F9E5A91834F82F788@PC07655> <4FB9EE1E.3050701@gmail.com> <506E9442.6050501@gmail.com> <038CBF95DEC5479DA771E23528A33FB3@pc07654> <507C7DE0.5030508@gmail.com> <507ED1BE.8040903@gmail.com> Date: Thu, 18 Oct 2012 14:28:09 +0200 Message-ID: To: zoe slattery Cc: Nuno Lopes , internals@lists.php.net, PHP QA Content-Type: text/plain; charset=ISO-8859-1 Subject: Re: [PHP-QA] Re: [PHP-DEV] Re: [PHP-QA] Parallel run-tests From: pierre.php@gmail.com (Pierre Joye) hi! On Wed, Oct 17, 2012 at 5:41 PM, zoe slattery wrote: > Nuno - just a PS to the last note. It is (mainly) the task allocation across > processors which means that running tests in parallel on a 4-way machine is > not 4 times as fast as running them in sequence. > > Here are some results from a run on my 2-way Mac - > http://static.inky.ws/image/3257/image.jpg. The blocks of colour are just > representations of the time it takes a group to run - and Open office is > allocating the colors randomly so they don't have any significance. I've > annotated the chart to show which groups are taking a long time.... > > The net is that P0 runs its half of the tasks and then just hangs about > waiting for P1 to finish :-/. > > I have added a 'debug' flag to the code which will print information about > how tasks are allocated if anyone wants to try on a 4 or 8 way. Given that > there are not many groups that take a long time to run the simplest thing > seems to be to map these to specific processors - that's easy enough and > requires no difficult code. There are more elegant solutions of course. Have you considered doing it using a daemon and php as client (to launch tasks and the tests)? Gearman or even a webserver could do a better job without the hassle to deal with what you are experiencing now. We do that using webservers in our labs to test all phpt and various apps. That being said, to multiply cores never bring a linear speed increase, even less in this case. Cheers, -- Pierre @pierrejoye | http://blog.thepimp.net | http://www.libgd.org