Newsgroups: php.internals Path: news.php.net Xref: news.php.net php.internals:35917 Return-Path: Mailing-List: contact internals-help@lists.php.net; run by ezmlm Delivered-To: mailing list internals@lists.php.net Received: (qmail 82605 invoked from network); 3 Mar 2008 18:59:04 -0000 Received: from unknown (HELO lists.php.net) (127.0.0.1) by localhost with SMTP; 3 Mar 2008 18:59:04 -0000 Authentication-Results: pb1.pair.com header.from=stas@zend.com; sender-id=pass Authentication-Results: pb1.pair.com smtp.mail=stas@zend.com; spf=pass; sender-id=pass Received-SPF: pass (pb1.pair.com: domain zend.com designates 212.25.124.162 as permitted sender) X-PHP-List-Original-Sender: stas@zend.com X-Host-Fingerprint: 212.25.124.162 mail.zend.com Windows 2000 SP4, XP SP1 Received: from [212.25.124.162] ([212.25.124.162:45320] helo=mx1.zend.com) by pb1.pair.com (ecelerity 2.1.1.9-wez r(12769M)) with ESMTP id BD/1D-29055-57A4CC74 for ; Mon, 03 Mar 2008 13:59:03 -0500 Received: from us-ex1.zend.com ([192.168.16.5]) by mx1.zend.com with Microsoft SMTPSVC(6.0.3790.3959); Mon, 3 Mar 2008 20:59:13 +0200 Received: from [192.168.16.221] ([192.168.16.221]) by us-ex1.zend.com with Microsoft SMTPSVC(6.0.3790.3959); Mon, 3 Mar 2008 10:59:10 -0800 Message-ID: <47CC4A6F.3000507@zend.com> Date: Mon, 03 Mar 2008 10:58:55 -0800 Organization: Zend Technologies User-Agent: Thunderbird 2.0.0.12 (Windows/20080213) MIME-Version: 1.0 To: =?ISO-8859-1?Q?Johannes_Schl=FCter?= CC: Marcus Boerger , internals@lists.php.net References: <1706278209.20080302232134@marcus-boerger.de> <47CB2E9D.6010102@zend.com> <1204540861.3463.21.camel@goldfinger.johannes.nop> In-Reply-To: <1204540861.3463.21.camel@goldfinger.johannes.nop> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-OriginalArrivalTime: 03 Mar 2008 18:59:10.0484 (UTC) FILETIME=[AA236D40:01C87D60] Subject: Re: [PHP-DEV] [RFC] Replace the flex-based scanner with an re2c [1] based lexer From: stas@zend.com (Stanislav Malyshev) Hi! > Since there's no documentation about zend-multibyte stuff I spent some > time searching for other resources about it, but except bug reports I > found nothing whee it was required. I'm sure there are some but comments > like "TODO: support widechars" in the code give me the impression that > it doesn't really work... and I guess many people just enable it sinceit It does work and there are people using it, even though I imagine it can have some bugs. I guess it would be best to talk to mbstring maintainer on code details, etc. > If there are good use cases for that switch I won't like to replace some > small engine thingy with a huge external library like ICU. The use cases are scripts written in encodings like shift-JIS, etc. > And I doubt that more than just a few people know what it really does - > Marcus and I just found out while working on that stuff over the > weekend. So I guess documentation is important :) Let it be a lesson to us all. -- Stanislav Malyshev, Zend Software Architect stas@zend.com http://www.zend.com/ (408)253-8829 MSN: stas@zend.com