Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:63768
Mailing-List: contact internals-help@lists.php.net; run by ezmlm
Received-SPF: pass (pb1.pair.com: domain gmail.com designates 74.125.83.42 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <BE6472C8-8D25-42EF-B55C-D500F5F928EE@roshambo.org>
References: <5fce29a0cb5467c00eeb267dd38fd788@localhost> <5097E376.6040709@lerdorf.com>
 <f1ab16342a6d381b198a881d2fb18de7@localhost> <5097EF8A.1000809@lerdorf.com> <BE6472C8-8D25-42EF-B55C-D500F5F928EE@roshambo.org>
Date: Tue, 6 Nov 2012 19:46:10 -0200
Message-ID: <CA+5g0SLrwj3hKznd9xyeYaRws6r27hN=b8+6cOiBR2xp22+QOQ@mail.gmail.com>
To: Philip Olson <philip@roshambo.org>
Cc: Rasmus Lerdorf <rasmus@lerdorf.com>, =?UTF-8?Q?Jean=2DS=C3=A9bastien_Hedde?= <jeanseb@au-fil-du.net>, 
	internals <internals@lists.php.net>
Content-Type: multipart/alternative; boundary=047d7b343ce6ed29ef04cdda8878
Subject: Re: [PHP-DEV] Incomprehension with preg_match and utf8
From: felipensp@gmail.com (Felipe Pena)

--047d7b343ce6ed29ef04cdda8878
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi guys,

2012/11/6 Philip Olson <philip@roshambo.org>

>
> On Nov 5, 2012, at 8:55 AM, Rasmus Lerdorf wrote:
>
> > On 11/05/2012 08:41 AM, Jean-S=C3=A9bastien Hedde wrote:
> >> On Mon, 05 Nov 2012 08:04:06 -0800, Rasmus Lerdorf <rasmus@lerdorf.com=
>
> >> wrote:
> >>>
> >>> I think the documentation is wrong on that. In Unicode mode [[:alnum:=
]]
> >>> actually becomes \p{Xan} which should match Unicode chars as well, bu=
t
> >>> only if PCRE was compiled with Unicode support. So I suspect you don'=
t
> >>> actually have a Unicode-capable PCRE build in some cases there.
> >>>
> >>> -Rasmus
> >>
> >> I will report the bug to the package maintainers (remi, debian too...)=
.
> >>
> >> Is there anyway for us to avoid those "wrong" builds ?
> >
> > I don't see how.
>
>
> Hi geeks,
>
> Does anyone have a suggestion on how the documentation should be
> updated? The quote is from here:
>
>   http://php.net/manual/en/regexp.reference.character-classes.php
>
> With the quote being:
>
>   "In UTF-8 mode, characters with values greater than 128 do
>    not match any of the POSIX character classes."
>
> A few simple/related facts:
>
>   - PCRE_UCP exists as of PCRE 8.10
>   - Gustavo mentioned the related PHP change on Oct 3, 2010 (not sure
>     what PHP version, and googling for "87a237342" turns up empty,
>     and I miss SVN version numbers)
>
> Anyway, how should this be documented?
>
> Regards,
> Philip
>
>
I added PCRE_UCP on PHP 5.3.4 as a fix for bug #52971. [1]

For documentation just say something like:

"In unicode mode the unicode properties are used instead to classify
characters of some classes."

More information extracted from PCRE documentation [2]:

---------8<-------------------------------

 [:alnum:] becomes \p{Xan}
[:alpha:] becomes \p{L}
[:blank:] becomes \h
[:digit:] becomes \p{Nd}
[:lower:] becomes \p{Ll}
[:space:] becomes \p{Xps}
[:upper:] becomes \p{Lu}
[:word:] becomes \p{Xwd}

Negated versions, such as [:^alpha:] use \P instead of \p.
The other POSIX classes are unchanged, and match only
characters with code points less than 128.

---------------------------------------------


[1] - http://svn.php.net/viewvc/?view=3Drevision&amp;revision=3D303963
[2] - http://pcre.org/man.txt


--=20
Regards,
Felipe Pena

--047d7b343ce6ed29ef04cdda8878--