Newsgroups: php.internals Path: news.php.net Xref: news.php.net php.internals:121202 Return-Path: Delivered-To: mailing list internals@lists.php.net Received: (qmail 49963 invoked from network); 1 Oct 2023 10:46:39 -0000 Received: from unknown (HELO php-smtp4.php.net) (45.112.84.5) by pb1.pair.com with SMTP; 1 Oct 2023 10:46:39 -0000 Received: from php-smtp4.php.net (localhost [127.0.0.1]) by php-smtp4.php.net (Postfix) with ESMTP id 414A618005C for ; Sun, 1 Oct 2023 03:46:38 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on php-smtp4.php.net X-Spam-Level: X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_ENVFROM_END_DIGIT, FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.2 X-Spam-ASN: AS15169 209.85.128.0/17 X-Spam-Virus: No X-Envelope-From: Received: from mail-oo1-f54.google.com (mail-oo1-f54.google.com [209.85.161.54]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by php-smtp4.php.net (Postfix) with ESMTPS for ; Sun, 1 Oct 2023 03:46:37 -0700 (PDT) Received: by mail-oo1-f54.google.com with SMTP id 006d021491bc7-57ba2cd3507so6722177eaf.2 for ; Sun, 01 Oct 2023 03:46:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1696157197; x=1696761997; darn=lists.php.net; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=AkLKGk+JjuIyQ4utJ+EAfB9jtp4f3Kn/U8rQL57OU2A=; b=Xi3IMmptkyxmq87ZmPcuHGcvDmYmUWwksDIgXSupxN732Nt1Neo70BoPFMZUlL4ggy DU+oQYeGXNjMNX4y5W6bmT6et/WMULXVj8k/6VllYpSM49BZ8KVe6LBX7Abnn3Mf3TzP JFyyV2qk1pEP3xdvQSowev54y5JM2SGjCjMAWCl7PaKvKfKOEhGfpVPV8Lfkg4u2lLv3 5QhwpXfTF2OamaScngqZbgP66+5ItK9TBrC76cyUysfL8s0COUFtwpO2IuI6d520kKSf i9R3utvRnPUgLBV5xhRSRe5j2G4lw7mlTv1c5JiJsy7cOi2oLcMoAet6ISlMeoFiSO0i okiA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1696157197; x=1696761997; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=AkLKGk+JjuIyQ4utJ+EAfB9jtp4f3Kn/U8rQL57OU2A=; b=ta9x5NTsaq1eb+KNgSDF66+nR40N57SanG0PvyumGayb6HBl/dHeO0YpwE0OCpjn5v 8m/B4G+/pZogLDMVwx+Pm9WaBV2F0/gslCHId7MgRxTC1Ll9UsFiwTEtJhEpIBUE9RSz K2mh8mHU6chkdnZRtOH4yQQqk0kGdpBRrbS47TmRHk9AJK3FazDYdBFnFI/EMGxFulaB RZ129+PZtVOWoCdBb7K9soIFm0U4sk8wWf1dlvkoptAae7/V/MeMFC15LWKvfzcP3goa bhExcPEm14bCQrYJ5lnjXjj35YUkv7PszYTA8ongLsag6fla79XaOgCa56NtAXRzw+ZZ IUzA== X-Gm-Message-State: AOJu0Yw/zwqg1S2T/11n4ZGoJA1yYIwIqYi2ZA8et2c646SAIqtwVww7 Hqa6UEe3V1ikBaYpmfbumTyqR2gPpiEVmn8Nqmo= X-Google-Smtp-Source: AGHT+IGhlaSR2Mr5E45OReLuvpH6wG1MAp9/2A4XkgkgKqnds40P6wPneJyLD6SIv+QePapv7NvHyA4L2GoOSkkS2aI= X-Received: by 2002:a4a:3c07:0:b0:57b:6f5c:c90a with SMTP id d7-20020a4a3c07000000b0057b6f5cc90amr8289132ooa.8.1696157196691; Sun, 01 Oct 2023 03:46:36 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: Date: Sun, 1 Oct 2023 12:46:00 +0200 Message-ID: To: youkidearitai Cc: Saki Takamachi , internals@lists.php.net Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [PHP-DEV] trim support for multibyte spaces From: divinity76@gmail.com (Hans Henrik Bergan) .. probably a bunch of stuff that *could* be optimized or done better, but one i saw just now is that instead of 2x nested loops and goto, the outer loop and labels could be removed and the `goto remove_from_start_continue_2;` could be replaced with `i=3D-1;` eg size_t local_strlen =3D *strlen; char *local_str =3D *str; for (size_t i =3D 0; i < trim_lengths_num; ++i) { if (local_strlen >=3D trim_lengths[i] && memcmp(local_str, trim_chars[i], trim_lengths[i]) =3D=3D 0) { local_strlen -=3D trim_lengths[i]; local_str +=3D trim_lengths[i]; i =3D -1; } } 2x nested loops reduced to 1 loop, and goto removed~ On Sun, 1 Oct 2023 at 10:43, Hans Henrik Bergan wrot= e: > > > If have any idea, feel free to comment to me. > > i think the C code would look something like > > > void mb_trim(size_t *strlen, char **str, const size_t > trim_lengths_num, const size_t *trim_lengths, const char **trim_chars) > { > size_t local_strlen =3D *strlen; > char *local_str =3D *str; > for (;;) > { > for (size_t i =3D 0; i < trim_lengths_num; ++i) > { > if (local_strlen >=3D trim_lengths[i] && memcmp(local_str, > trim_chars[i], trim_lengths[i]) =3D=3D 0) > { > local_strlen -=3D trim_lengths[i]; > local_str +=3D trim_lengths[i]; > goto remove_from_start_continue_2; > } > } > break; > remove_from_start_continue_2:; > } > for (;;) > { > for (size_t i =3D 0; i < trim_lengths_num; ++i) > { > if (local_strlen >=3D trim_lengths[i] && memcmp(((local_str > + local_strlen) - trim_lengths[i]), trim_chars[i], trim_lengths[i]) =3D= =3D > 0) > { > local_strlen -=3D trim_lengths[i]; > goto remove_from_end_continue_2; > } > } > break; > remove_from_end_continue_2:; > } > memmove(*str, local_str, local_strlen); > char *newstr =3D (char *)realloc(*str, local_strlen); > if (newstr !=3D nullptr) > { > *strlen =3D local_strlen; > *str =3D newstr; > } > else > { > // some error handling > } > } > > with my simple testcode looking like > > int main() > { > const char *trim_chars[] =3D { > " ", > "!", > // utf8 whitespace: > "\xE2\x80\x80", // EN QUAD > "\xE2\x80\x81", // EM QUAD > "\xE2\x80\x82", // EN SPACE > "\xE2\x80\x83", // EM SPACE > "\xE2\x80\x84", // THREE-PER-EM SPACE > "\xE2\x80\x85", // FOUR-PER-EM SPACE > "\xE2\x80\x86", // SIX-PER-EM SPACE > }; > size_t trim_lengths[] =3D { > strlen(trim_chars[0]), > strlen(trim_chars[1]), > strlen(trim_chars[2]), > strlen(trim_chars[3]), > strlen(trim_chars[4]), > strlen(trim_chars[5]), > strlen(trim_chars[6]), > strlen(trim_chars[7]), > strlen(trim_chars[8]), > }; > size_t trim_lengths_num =3D sizeof(trim_lengths) / sizeof(trim_length= s[0]); > char *teststr =3D strdup(" ! \xE2\x80\x80\xE2\x80\x81\xE2\x80\x82 > Hello World ! \xE2\x80\x83\xE2\x80\x84\xE2\x80\x85\xE2\x80\x86 ! > "); > // char *teststr =3D strdup(" ! Hello World ! ! "); > size_t teststrlen =3D strlen(teststr); > std::cout << teststrlen << ": \"" << std::string_view(teststr, > teststrlen) << "\"" << std::endl; > mb_trim(&teststrlen, &teststr, trim_lengths_num, trim_lengths, trim_c= hars); > std::cout << teststrlen << ": \"" << std::string_view(teststr, > teststrlen) << "\"" << std::endl; > return 0; > } > > > On Sat, 30 Sept 2023 at 13:16, youkidearitai wr= ote: > > > > 2023=E5=B9=B49=E6=9C=8830=E6=97=A5(=E5=9C=9F) 17:42 Saki Takamachi : > > > > > > > I also want to trim function of multibyte trim functions. > > > > > > > I think that in addition to mb_trim, > > > mb_ltrim and mb_rtrim are also necessary. > > > > > > Hi. > > > > > > Having a new option besides regex sounds like a good idea for me, as = a user of a language that benefits from `mb_trim()`. > > > > > > Perhaps users are more intuitive about the usefulness of those functi= ons who have spent more time cleaning "multibyte spaces". > > > > Hi > > > > Thanks for reply. > > I'm trying implements to trim for multibyte function. > > Please give me some time. > > > > If have any idea, feel free to comment to me. > > > > Regards > > Yuya > > > > -- > > --------------------------- > > Yuya Hamada (tekimen) > > - https://tekitoh-memdhoi.info > > - https://github.com/youkidearitai > > ----------------------------- > > > > -- > > PHP Internals - PHP Runtime Development Mailing List > > To unsubscribe, visit: https://www.php.net/unsub.php > >