Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:124886
Precedence: bulk
MIME-Version: 1.0
References: <8a60a5d76bf3bbdda821160c6141b45914a33b98.camel@ageofdream.com>
 <47D63911-3C48-4514-9296-F1CAAC9597B9@rwec.co.uk> <20240812095038.D97AC1A00BD@qa.php.net>
In-Reply-To: <20240812095038.D97AC1A00BD@qa.php.net>
Date: Mon, 12 Aug 2024 19:33:47 +0900
Message-ID: <CAEPPVa0BAtc4LOZYFwkhpXwYXQh5snGw2Jv7xaY09HEWAoMz1g@mail.gmail.com>
Subject: Re: [PHP-DEV][Discussion] Should All String Functions Become
 Multi-Byte Safe?
To: internals@lists.php.net
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
From: youkidearitai@gmail.com (youkidearitai)

2024=E5=B9=B48=E6=9C=8812=E6=97=A5(=E6=9C=88) 18:54 Daniel Haber <danielhab=
er@gmail.com>:
>
> On 8/12/2024 9:53 AM, Rowan Tommins [IMSoP] wrote:
> >
> >
> > On 11 August 2024 16:50:52 BST, Nick Lockheart <lists@ageofdream.com> w=
rote:
> >> It seems that if everything on the Internet is multi-byte encoded now,
> >> then all of the PHP string functions should be multi-byte safe.
> >
> > The phrase "multibyte safe" may have made sense about 30 years ago, whe=
n it was thought that a "universal character set" could just be a "wide ASC=
II", encoding a straightforward list of characters, just more of them.
> >
> > Modern Unicode is so much more than that, because the world's writing s=
ystems don't all work the same way. Should strlen() measure bytes, code poi=
nts, or graphemes? Should strtoupper() accept a locale, so it can handle ca=
ses like Turkish "dotless i" where "I" is not the uppercase of "i"? And so =
on, and so on.
> >
> > I've seen plenty of languages boast that they are "Unicode aware" but f=
ew actually engaging with the question of what that actually means. Often t=
hey equate "character" with "code point" and stop there, which leads to res=
ults that are just as useless to most of the world as if they'd equated it =
with "byte".
> >
> > Regards,
> > Rowan Tommins
> > [IMSoP]
>
> Feels appropriate to link to this:
> "The Absolute Minimum Every Software Developer Must Know About Unicode
> in 2023 (Still No Excuses!)"
> https://tonsky.me/blog/unicode/

Hi, there

> Feels appropriate to link to this:
> "The Absolute Minimum Every Software Developer Must Know About Unicode
> in 2023 (Still No Excuses!)"
> https://tonsky.me/blog/unicode/

I think it's the same as the quoted site.
However, In programming, there are times when you want to operate on
bytes, code points, or grapheme clusters.
UTF-8 can't solve everything, what to program is important for
programmers (byte programming, character programming etc).

Also, other character encodings are also important in mainly CJK.
Character set has a lot of consider of many things.

Regards
Yuya

--=20
---------------------------
Yuya Hamada (tekimen)
- https://tekitoh-memdhoi.info
- https://github.com/youkidearitai
-----------------------------