Conversation

Notices

1. Embed this notice
   daniel:// stenberg:// (bagder@mastodon.social)'s status on Monday, 12-May-2025 19:39:49 JST daniel:// stenberg://

   We have a CI job to spot unwanted utf8 letters in #curl PRs as we have noticed that GitHub will gladly show the for example (identical) Cyrillic version of a letter next to the Latin version in a diff and it is yes, entirely impossible for a human to spot the diff. I mean the diff is shown, but the significance of it is not.

   Changing just a single letter like that in a URL hostname opens up for a world of grief.

   • kaia likes this.
   • Embed this notice
     Peter Krefting (nafmo@social.vivaldi.net)'s status on Monday, 12-May-2025 21:22:56 JST Peter Krefting

     in reply to

     • FOSS Unleashed

     @fossunleashed @bagder All the #Unicode metadata is available at http://unicode.org/Public/

     Have a look at https://unicode.org/Public/UNIDATA/Scripts.txt

   • Embed this notice
     FOSS Unleashed (fossunleashed@social.linux.pizza)'s status on Monday, 12-May-2025 21:22:57 JST FOSS Unleashed

     in reply to

     @bagder I feel like there needs to be tools that make safer handling of Unicode easier. Anyone know of the full list of Unicode ranges? I know there are some sites that give partial ones. But I'd like the information needed to detect "this sentence contains Unicode characters consistent with language X" vs "this sentence contains Unicode characters for 45 different languages"

   • Embed this notice
     Peter Krefting (nafmo@social.vivaldi.net)'s status on Monday, 12-May-2025 21:43:13 JST Peter Krefting

     in reply to

     • FOSS Unleashed

     @fossunleashed @bagder These documents are also relevant in this case:

     UTR#36: https://www.unicode.org/reports/tr36/
     UTR#39: https://www.unicode.org/reports/tr39/

   • Embed this notice
     vsz (vsz@mastodon.social)'s status on Tuesday, 13-May-2025 08:27:54 JST vsz

     in reply to

     @bagder forgejo / gitea showing it like this:

     feld likes this.