Newsgroups: php.internals
Path: news.php.net
Xref: news.php.net php.internals:113673
To: internals@lists.php.net
References: <f313c9c4-f8a2-0b39-7499-30620d80cecd@gmail.com>
 <CAESVnVoa2U1ZCsthWCt8Cu8Es-P8WWO=vky4TG5CmtaoumEmUA@mail.gmail.com>
 <e120bf6b-12cd-5b3e-b27c-b746d1a1661b@gmail.com>
 <CAESVnVqJh3oOM-5CkatiUctRupOdS7mce7QYzv3uxUb3QcpHWw@mail.gmail.com>
 <693767b5-a25b-b4d9-f535-6b985bf26d67@gmail.com>
Message-ID: <29d5329c-bea2-7944-4820-515d4a10ae86@alec.pl>
Date: Mon, 22 Mar 2021 16:04:35 +0100
MIME-Version: 1.0
In-Reply-To: <693767b5-a25b-b4d9-f535-6b985bf26d67@gmail.com>
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: 8bit
Subject: Re: [PHP-DEV] What should we do with utf8_encode and utf8_decode?
From: alec@alec.pl (Aleksander Machniak)

On 22.03.2021 15:30, Rowan Tommins wrote:
> - Make utf8_decode() throw errors for unrepresentable characters.

I'm not sure I understand this, but it sounds like it would be a BC
break for my case.

I'm using utf8_encode()/utf8_decode() to make input string safe to be
stored in DB, and back. In most cases the input is utf-8, but it
occasionally may contain "broken characters".

    $str = '';
    for ($x=0; $x<256; $x++) {
        $str .= chr($x);
    }

    $this->assertSame($str, utf8_decode(utf8_encode($str)));

    $str = "グーグル谷歌中信фδοκιμήóźdźрöß😁😃";

    $this->assertSame($str, utf8_decode(utf8_encode($str)));

Could anyone point to a sample input that will not work with my use-case?

-- 
Aleksander Machniak
Kolab Groupware Developer        [https://kolab.org]
Roundcube Webmail Developer  [https://roundcube.net]
----------------------------------------------------
PGP: 19359DC1 # Blog: https://kolabian.wordpress.com