emre şahin's digital garden 🍃 - UTF-8 https://emresahin.net/tags/utf-8/ Posts in the UTF-8 tag en contact@emresahin.net (Emre Şahin) Tue, 15 Sep 2026 19:46:32 +0000 TIL April 28 2020-04-28T21:40:02+00:00 2020-04-28T21:40:02+00:00 Emre Şahin Tue, 28 Apr 2020 21:40:02 +0000 https://emresahin.net/til-april-28--4248/ https://emresahin.net/til-april-28--4248/ In yesterday’s post , I presented a Python script to convert Pelican preamble files to YAML for Hugo. For some UTF-8 files, there is a BOM marker at the beginning of the file. The script (as a true quick and dirty solution) doesn’t check for the presence of such a marker and cannot detect the Tit... TIL Python BOM Encoding UTF-8 bvi Hex-editor In yesterday’s post, I presented a Python script to convert Pelican preamble files to YAML for Hugo.

For some UTF-8 files, there is a BOM marker at the beginning of the file. The script (as a true quick and dirty solution) doesn’t check for the presence of such a marker and cannot detect the Title element if it exists.

I added an fm = fm.strip('\ufeff') line to clear the BOM marker from a line if it exists.

There is an editor called bvi to edit binary files in Hex format, similar to the vi editor.

]]> A Need for Yet Another Transliteration Alphabet for Ottoman 2012-09-25T14:00:00+00:00 2012-09-25T14:00:00+00:00 Emre Şahin Tue, 25 Sep 2012 14:00:00 +0000 https://emresahin.net/12126-3-1424/ https://emresahin.net/12126-3-1424/ The Ottoman Text Archival Project has its own reversible transcription system. However, for word labels, this is an overkill and requires too much work from experts. I’m looking for a one-to-one mapping between the different visual elements of a word and its representation in UTF-8. The labels sh... Dervaze Linguistics Typography transliteration Ottoman visual encoding UTF-8 alphabet transcription The Ottoman Text Archival Project has its own reversible transcription system. However, for word labels, this is an overkill and requires too much work from experts.

I’m looking for a one-to-one mapping between the different visual elements of a word and its representation in UTF-8. The labels should be simple to remember, yet distinctive enough to represent visual variations of words.

I’m considering creating letter+digit codes. The letter part will reflect the most similar sound, and the digit will reflect the visual variation. In this case, I need a Latin letter for each letter in the Ottoman alphabet, but there are not enough letters in the standard Turkish alphabet to denote all the letters of Ottoman. So, how can I solve this?

]]>