Conversation

Notices

Embed this notice
zunda (zundan@mastodon.zunda.ninja)'s status on Thursday, 21-Sep-2023 02:53:42 JST zunda
in reply to
- 斎藤ただし
- かき@GNUsocialJP
@tadd たぶん横から失礼なんですけど、UTF-8では１バイト目にその文字のバイト数もエンコードされてるので文字数を数えるには残りのバイトを読む必要はありません。かっこいい！
UTF-8 - Wikipedia https://en.wikipedia.org/wiki/UTF-8#Encoding
In conversation about a year ago from mastodon.zunda.ninja permalink
Attachments
1. Domain not in remote thumbnail source whitelist: upload.wikimedia.org
  
  UTF-8
  
  UTF-8 is a variable-length character encoding standard used for electronic communication. Defined by the Unicode Standard, the name is derived from Unicode (or Universal Coded Character Set) Transformation Format – 8-bit.UTF-8 is capable of encoding all 1,112,064 valid character code points in Unicode using one to four one-byte (8-bit) code units. Code points with lower numerical values, which tend to occur more frequently, are encoded using fewer bytes. It was designed for backward compatibility with ASCII: the first 128 characters of Unicode, which correspond one-to-one with ASCII, are encoded using a single byte with the same binary value as ASCII, so that valid ASCII text is valid UTF-8-encoded Unicode as well. UTF-8 was designed as a superior alternative to UTF-1, a proposed variable-length encoding with partial ASCII compatibility which lacked some features including self-synchronization and fully ASCII-compatible handling of characters such as slashes. Ken Thompson and Rob Pike produced the first implementation for the Plan 9 operating system in September 1992. This led to its adoption by X/Open as its specification for FSS-UTF...
- Embed this notice
  斎藤ただし (tadd@best-friends.chat)'s status on Thursday, 21-Sep-2023 02:53:43 JST 斎藤ただし
  
  そういえば思い出してしまったのですが、
  UTF-8のコードポイントの数を数えるだけ（妥当性チェックなし）の時、各一バイト目より後を見る必要ってあるんでしたっけ？
  社会人二年目くらいの昔のコードだと、実際、飛ばしてしまった気がしていて。
  
  In conversation about a year ago permalink

Public

Conversation

Notices

Feeds