Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:72644
Mailing-List: contact internals-help@lists.php.net; run by ezmlm
Received-SPF: pass (pb1.pair.com: domain gmail.com designates 209.85.215.47 as permitted sender)
MIME-Version: 1.0
Sender: yohgaki@gmail.com
In-Reply-To: <53017E72.3050807@sugarcrm.com>
References: <50100EC8.3040102@ajf.me> <CAH-PCH5BNg6i2TcZbiWbi0bYKkSd9i8q5e3nfniS=aFL9V+fXA@mail.gmail.com>
 <52FDF7BC.8050408@lsces.co.uk> <52FE46D2.4060903@gmail.com>
 <52FE6FEA.5050204@lerdorf.com> <53017E72.3050807@sugarcrm.com>
Date: Mon, 17 Feb 2014 13:56:57 +0900
Message-ID: <CAGa2bXaNrrx3=mObXZBewW6HpbNUAfBeGD4-0f4mBLExewdw9A@mail.gmail.com>
To: Stas Malyshev <smalyshev@sugarcrm.com>
Cc: Rasmus Lerdorf <rasmus@lerdorf.com>, Rowan Collins <rowan.collins@gmail.com>, 
	"internals@lists.php.net" <internals@lists.php.net>
Content-Type: multipart/alternative; boundary=001a11c3ee8e98752a04f292feb2
Subject: Re: [PHP-DEV] PHP6 wiki page
From: yohgaki@ohgaki.net (Yasuo Ohgaki)

--001a11c3ee8e98752a04f292feb2
Content-Type: text/plain; charset=UTF-8

Hi Stas,

On Mon, Feb 17, 2014 at 12:13 PM, Stas Malyshev <smalyshev@sugarcrm.com>wrote:

> > operation. There are a ton of non-obvious things beyond simple string
> > manipulation. String collation alone is massively complicated, for
> example.
>
> Oh yes, and if somebody thinks case sensitivity is weird now, wait until
> Unicode gets into play. There for some chars when you change the case
> string length changes, and for some conversion is not roundtrip-safe.
> And you have various long form/short form combining issues which means
> you need to normalize everything on every corner. So letting Unicode
> into things like identifiers opens a huge container of worms.
> Also, if one wants to appreciate what other cans of worms are hiding
> there, I recommend this oldie but goodie:
> http://stackoverflow.com/a/6163129/214196
> It's about Perl, but we'd have many of the same issues.


Nice article. I mostly agree.

"Code that converts unknown characters to ? is broken, stupid, braindead,
and runs contrary to the standard recommendation, which says NOT TO DO
THAT! RTFM for why not."

While I agree this (It's BAD to accept broken text as valid input), there
are situations that programmer has to handle broken text. Ruby finally
admits scrab method is needed. It's available from Ruby 2.1.0.

Regards,

--
Yasuo Ohgaki
yohgaki@ohgaki.net

--001a11c3ee8e98752a04f292feb2--