Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:113689
To: internals@lists.php.net
References: <f313c9c4-f8a2-0b39-7499-30620d80cecd@gmail.com>
 <CAESVnVoa2U1ZCsthWCt8Cu8Es-P8WWO=vky4TG5CmtaoumEmUA@mail.gmail.com>
 <e120bf6b-12cd-5b3e-b27c-b746d1a1661b@gmail.com>
 <CAESVnVqJh3oOM-5CkatiUctRupOdS7mce7QYzv3uxUb3QcpHWw@mail.gmail.com>
 <693767b5-a25b-b4d9-f535-6b985bf26d67@gmail.com>
 <29d5329c-bea2-7944-4820-515d4a10ae86@alec.pl>
 <16ecfc31-33aa-4223-fb67-b5a4b5895f05@gmail.com>
 <11e9a312-ed10-412e-506d-ccf9f24457f8@alec.pl>
Message-ID: <aca8b8f2-1495-df71-587e-dd23cdf02b01@gmail.com>
Date: Mon, 22 Mar 2021 17:22:15 +0000
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101
 Thunderbird/78.8.1
MIME-Version: 1.0
In-Reply-To: <11e9a312-ed10-412e-506d-ccf9f24457f8@alec.pl>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Content-Language: en-GB
Subject: Re: [PHP-DEV] What should we do with utf8_encode and utf8_decode?
From: rowan.collins@gmail.com (Rowan Tommins)

On 22/03/2021 16:52, Aleksander Machniak wrote:
> On 22.03.2021 16:41, Rowan Tommins wrote:
>> That code will never do anything useful.
> I already proved it is useful, regardless of it's name/intention.


You have proven no such thing. If that function is saving you from 
errors, it is completely by accident.

The same effect can be achieved using base64_encode() and 
base64_decode(), or bin2hex() and hex2bin(), or any other function that 
takes a series of bytes and applies an arbitrary encoding to it.

It could also be achieved by using a binary column type in the database, 
because the values you have stored are not useful as strings; they might 
as well be encrypted.

Given the sequence of bytes "\xE3\x82\zB0", which is a valid UTF-8 
string representing U+30B0 KATAKANA LETTER GU グ calling utf8_encode() 
will result in the sequence of bytes "\xC3\xA3\xC2\x82\xC2\xB0", which 
is the UTF-8 representation of the following Unicode code points:

- U+00E3 LATIN SMALL LETTER A WITH TILDE ã
- U+0082 CONTROL: BREAK PERMITTED HERE
- U+00B0 DEGREE SIGN °

This is clearly gibberish, and bears no relationship to the original 
string; it is what is generally referred to as "mojibake".

Regards,

-- 
Rowan Tommins
[IMSoP]