Writing Domain Names Language VS. Scriptnic.sa/docs/lectures_and_presentations/... · – Letters that can be joined are always joined in both hand-written and printed Arabic

Writing Domain Names Language VS. Script What are the Issues?What are the Issues?

www.arabicwww.arabicwww.arabicwww.arabicwww.arabicwww.arabicwww.arabicwww.arabic--------domains.orgdomains.orgdomains.orgdomains.orgdomains.orgdomains.orgdomains.orgdomains.org

What are the Issues?What are the Issues?

APTLD Meeting, Kuala Lumpur May 18-24 2008

Dr. Abdulaziz H. Al-ZomanDirector of SaudiNIC - CITC

Chairman of Steering CommitteeArabic Domain Name Pilot Project

Raed I. Al-FayezSaudiNIC - CITC

Chairman of Technical CommitteeArabic Domain Name Pilot Project

AgendaAgendaAgendaAgendaAgendaAgendaAgendaAgendaAgendaAgendaAgendaAgendaAgendaAgendaAgendaAgenda

� Part I: Arabic language

� Part II: Arabic Script ISSUES

www.arabic-domains.org

� Part III: Arabic Script IDN Working Group

About usAbout usAbout usAbout usAbout usAbout usAbout usAbout usAbout usAbout usAbout usAbout usAbout usAbout usAbout usAbout us

� Arab Team for Arabic Domain Names– Formed under the auspices of Arab League, 2005

– Supervising “ADNPP: Arabic Domain Name Pilot Project”

� SaudiNIC– Administering the Saudi domain name space (.sa) since


– Administering the Saudi domain name space (.sa) since 1995.

– Operated by Communication and Information Technology Commission (CITC) … governmental org.

– Leading the local community effort towards supportingArabic language in DNS• Head of the ADNPP Steering Committee

• Head of the ADNPP Technical Committee

Part I:Part I:Part I:Part I:Part I:Part I:Part I:Part I:Arabic languageArabic languageArabic languageArabic languageArabic languageArabic languageArabic languageArabic language


Arabic languageArabic languageArabic languageArabic languageArabic languageArabic languageArabic languageArabic language

Arabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language CharacteristicsArabic Language Characteristics

1. Written from right to left in a cursive style

2. Most characters have different shapes

– depending on their position (beginning, middle, or end) within a word

– probably conjugated with preceding and succeeding characters.

جـ ـجـ ـج ج

بـ ـبـ ـب ب

ـا ا

نـ ـنـ ـن ن


succeeding characters.

– These different shapes for a single character do not count as different code points but they are handled using different fonts

– Letters that can be joined are always joined in both hand-written and printedArabic.

ج ب ا ن

نـ ـنـ ـن ن

جبان


3. Tashkeel (diacritic)– A small sing (not a letter) that is usually put on top

or under a character for the purpose of correct pronunciation

– It is not widely used except incase of the possibility of mispronouncing words that have the same letters but with different pronunciations, and hence having

ان ب ج


but with different pronunciations, and hence having different meanings.

4. ◌Abbreviations are not widely used– When an abbreviation is written (in domain name)

characters will be joined together … leads to a different word and pronunciation

5. Two sets of numerals are used:– Arabic : 0, 1, 2, 3, 4, 5, 6, 7, 8, 9

– Arabic-Indic : 0 ،1 ،2 ،3 ،4 ،5 ،6 ،7 ،8 ،9– Numerals are written from left to right

ان ب ج جبان


6. Words are separated by spaces– A space character is needed between words to get correct

shaping

– Connecting words without spaces

• not acceptable

• decrease readability


• decrease readability

• Confused with other words

مدارسخيف�خطأدبي�

مدارس خيف�خط أدبي�

space

space

Arabic Language Arabic Language Arabic Language Arabic Language Arabic Language Arabic Language Arabic Language Arabic Language Basic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesArabic Language Arabic Language Arabic Language Arabic Language Arabic Language Arabic Language Arabic Language Arabic Language Basic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic IssuesBasic Linguistic Issues

� Identified a number of linguistic issues with respect to domain names:

– Usage of Tashkeel (diacritics).

– Usage of Kashidah.

– Character folding.


– Character folding.

– Which numerical digits should be supported.

– Connecting multiple words.

– Mixing with other languages.

– Usage of special characters.

Arabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation SummaryArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesArabic Linguistic IssuesRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation SummaryRecommendation Summary

Tashkeel should not be allowed.

However, if there is a need to allowed users to entered it as part of a domain name then it should be stripped off by nameprep

Tashkeel (Diacritics)

Kasheeda should be disallowedKasheeda

Folding should not be allowed

Character folding:

Teh Marbuta + Heh

different forms of Hamzah


Alif Maqsura+YaNumbers

If it is technically possible, it is preferred to support both (Latin and Arabic) sets with folding to one set. Otherwise, Latin set is sufficient

Numbers (numerical digits)

It is recommended that multiple words are separated by the character "-".

Connecting Multiple Words

It is recommended that Arabic domain names be pure Arabic and they should not be mixed with other languages.

Mixing Latin and Arabic Characters

It is recommended that Arabic domain names should follow the standard with respect to the use of special characters.

Special Characters (e.g., @, #, $, %, ...)

Arabic LanguageArabic LanguageArabic LanguageArabic LanguageArabic LanguageArabic LanguageArabic LanguageArabic LanguageAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableArabic LanguageArabic LanguageArabic LanguageArabic LanguageArabic LanguageArabic LanguageArabic LanguageArabic LanguageAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set TableAccepted Character Set Table

� Development Principles– Study and discuss the linguistic issues

• extensively (more than 3 years) by a team who work under the umbrella of Arab League

– Adhere to LDH convention

– Follow the inclusion mode recommended by the new IDNA


Follow the inclusion mode recommended by the new IDNA standards

• Many characters are disallowed: symbols , punctuations, diacritics (tashkeel), Koranic annotation signs, honorifics, etc are not allowed.

– Arabic labels are not intended to write sentences or phrases

� The goal is to develop:– A simple character set table that includes ONLY needed letters and digits


� 0621 Arabic Letter HAMZA (ء)� 0622 (آ) Arabic Letter ALEF with MADDA above� 0623 Arabic Letter ALEF with HAMZA above (أ)� 0624 Arabic Letter WAW with HAMZA above (ؤ)� 0625 Arabic Letter ALEF with HAMZA below (إ)� 0626 (ئ) Arabic Letter YEH with HAMZA above� 0627 Arabic Letter ALEF (ا)� 0628 Arabic Letter BEH (ب)� 0629 (ة) Arabic Letter TEH MARBUTA

� 0638 Arabic Letter ZAH (ظ)� 0639 Arabic Letter AIN (ع)� 063A Arabic Letter GHAIN (غ)� 0641 Arabic Letter FEH (ف)� 0642 Arabic Letter QAF (ق)� 0643 Arabic Letter KAF (ك)� 0644 Arabic Letter LAM (ل)� 0645 Arabic Letter MEEM (م)� 0646 Arabic Letter NOON (ن)

� Characters from Unicode Arabic Table (0600–06FF)


� 0629 (ة) Arabic Letter TEH MARBUTA� 062A Arabic Letter TEH (ت)� 062B Arabic Letter THEH (ث)� 062C Arabic Letter JEEM (ج)� 062D Arabic Letter HAH (ح)� 062E Arabic Letter KHAH (خ)� 062F Arabic Letter DAL (د)� 0630 Arabic Letter THAL (ذ)� 0631 Arabic Letter REH (ر)� 0632 Arabic Letter ZAIN (ز)� 0633 Arabic Letter SEEN (س)� 0634 Arabic Letter SHEEN (ش)� 0635 (ص) Arabic Letter SAD� 0636 (ض) Arabic Letter DAD� 0637 Arabic Letter TAH (ط)

� 0646 Arabic Letter NOON (ن)� 0647 Arabic Letter HEH (ھـ)� 0648 Arabic Letter WAW (و)� 0649 Arabic Letter ALEF MAKSURA (ى)� 064A Arabic Letter YEH (ي)� 0660 (0) Arabic-Indic Digit Zero� 0661 (1) Arabic-Indic Digit One� 0662 (2) Arabic-Indic Digit Two� 0663 (3) Arabic-Indic Digit Three� 0664 (4) Arabic-Indic Digit Four� 0665 (5) Arabic-Indic Digit Five� 0666 (6) Arabic-Indic Digit Six� 0667 (7) Arabic-Indic Digit Seven� 0668 (8) Arabic-Indic Digit Eight� 0669 (9) Arabic-Indic Digit Nine


� 0030 (0) Digit Zero

� 0031 (1) Digit One

� 0032 (2) Digit Two

� 0033 (3) Digit Three

� 0034 (4) Digit Four

� 0035 (5) Digit Five

� 0036 (6) Digit Six

� Characters from Unicode Basic Latin Table (0000–007F):


� 0036 (6) Digit Six

� 0037 (7) Digit Seven

� 0038 (8) Digit Eight

� 0039 (9) Digit Nine

� 002D (-) Hyphen-Minus

� 002E (.) Full Stop (Dot)


Accepted characters for Arabic, Persian, Urdu, and Pashto


Part II:Part II:Part II:Part II:Part II:Part II:Part II:Part II:Let us expand and look Let us expand and look Let us expand and look Let us expand and look Let us expand and look Let us expand and look Let us expand and look Let us expand and look


Let us expand and look Let us expand and look Let us expand and look Let us expand and look Let us expand and look Let us expand and look Let us expand and look Let us expand and look at the whole script,at the whole script,at the whole script,at the whole script,at the whole script,at the whole script,at the whole script,at the whole script,what are the issues?what are the issues?what are the issues?what are the issues?what are the issues?what are the issues?what are the issues?what are the issues?

About Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic ScriptAbout Arabic Script

� The 2nd most widely used alphabetic writing system in the world

� Used by many languages such as:

– Persian, Urdu, Turkish, Kurdish, Pashto, Jawi, …

� It is widely used by more than 43 countries


� It is widely used by more than 43 countries

– more than one billion potential users could be concerned in using Arabic script domain names.

Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations 11111111. . . . . . . . Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations Issues Need Further Investigations 11111111. . . . . . . . Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints Valid Unicode Codepoints � 0600..0603 ; CONTEXTO # ARABIC NUMBER SIGN..ARABIC SIGN SAFHA� 0604..060A ; UNASSIGNED # <reserved>..<reserved>� 060B..060F ; DISALLOWED # AFGHANI SIGN..ARABIC SIGN MISRA� 0610..0615 ; PVALID # ARABIC SIGN SALLALLAHOU ALAYHE WASSALLAM..AR� 0616..061A ; UNASSIGNED # <reserved>..<reserved>� 061B ; DISALLOWED # ARABIC SEMICOLON� 061C..061D ; UNASSIGNED # <reserved>..<reserved>� 061E..061F ; DISALLOWED # ARABIC TRIPLE DOT PUNCTUATION MARK..ARABIC Q� 0620 ; UNASSIGNED # <reserved>� 0621..063A ; PVALID # ARABIC LETTER HAMZA..ARABIC LETTER GHAIN� 063B..063F ; UNASSIGNED # <reserved>..<reserved>� 0640..065E ; PVALID # ARABIC TATWEEL..ARABIC FATHA WITH TWO DOTS


� 0640..065E ; PVALID # ARABIC TATWEEL..ARABIC FATHA WITH TWO DOTS� 065F ; UNASSIGNED # <reserved>� 0660..0669 ; PVALID # ARABIC-INDIC DIGIT ZERO..ARABIC-INDIC DIGIT� 066A..066D ; DISALLOWED # ARABIC PERCENT SIGN..ARABIC FIVE POINTED STA� 066E..0674 ; PVALID # ARABIC LETTER DOTLESS BEH..ARABIC LETTER HIG� 0675..0678 ; DISALLOWED # ARABIC LETTER HIGH HAMZA ALEF..ARABIC LETTER� 0679..06D3 ; PVALID # ARABIC LETTER TTEH..ARABIC LETTER YEH BARREE� 06D4 ; DISALLOWED # ARABIC FULL STOP� 06D5..06DC; PVALID # ARABIC LETTER AE..ARABIC SMALL HIGH SEEN� 06DD ; CONTEXTO # ARABIC END OF AYAH� 06DE ; DISALLOWED # ARABIC START OF RUB EL HIZB� 06DF..06E8 ; PVALID # ARABIC SMALL HIGH ROUNDED ZERO..ARABIC SMALL� 06E9 ; DISALLOWED # ARABIC PLACE OF SAJDAH� 06EA..06FC ; PVALID # ARABIC EMPTY CENTRE LOW STOP..ARABIC LETTER� 06FD..06FE ; DISALLOWED # ARABIC SIGN SINDHI AMPERSAND..ARABIC SIGN SI� 06FF ; PVALID # ARABIC LETTER HEH WITH INVERTED V

Source: draft-faltstrom-idnbis-tables-05.txt

IDNX200X DISALLOWED / CONTEXTO


ASIWG Recommendations 0 DISALLOWED Characters


Issues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations22222222. . . . . . . . Combining MarksCombining MarksCombining MarksCombining MarksCombining MarksCombining MarksCombining MarksCombining MarksIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations22222222. . . . . . . . Combining MarksCombining MarksCombining MarksCombining MarksCombining MarksCombining MarksCombining MarksCombining Marks

� The use of combining marks with some base characters would confuse with other character.– Combining maddah and hamza 0653-0655

– Other combining marks 0656-065E

ا ◌ ا ا ا ا ا ا ا ا


≠

ځځځځis confusing with

ح ++++ ◌ ==== ح ح ح ح U+0681U+062d U+0654U+0654U+062d

ا ا ا ا is confusing with

ا ++++ ◌ ==== ا ا ا ا U+0623U+0627 U+0654U+0654U+0627

Issues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations33333333. . . . . . . . Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Issues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations33333333. . . . . . . . Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)Diacritics (Tashkeel)

� Tashkeel Points: about 9– 064B-0652, 0670

� From user point view, he/she does not know– Whether the label is with or without tashkeel

– Whether the label is totally (i.e., all characters) use tashkeel

جمعية�جمعية�جمعية�جمعية�جمعية�


tashkeel

– The correct pronunciations to put the correct taskeel

– There are many different pronunciations depending on the local dialogue

� There will be huge number of combinations when registering a single label– good playground for phishing

جمعيةجمعية�جمعية �جمعية �جمعية �جمعية�جمعية�

Issues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations44444444. . . . . . . . ZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations44444444. . . . . . . . ZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control CharactersZWNJ & ZWJ Control Characters

� The support of ZWJ and ZWNJ in domain names would result in some confusions

� Their use and concepts are not known to regular users



� ZWNJ: Visually noticed

ح بل حبل


ح بلinput[0] = U+062d

input[1] = U+200c

input[2] = U+0628

input[3] = U+0644

حبلinput[0] = U+062d input[1] = U+0628 input[2] = U+0644


� ZWNJ: Visually Unnoticed

ط بل طبل


ط بلinput[0] = U+0637

input[1] = U+200c

input[2] = U+0628

input[3] = U+0644

طبلinput[0] = U+0637 input[1] = U+0628 input[2] = U+0644

≠


الدولي- الرباط- مجمعinput[0] = U+0645 input[1] = U+062c input[2] = U+0645 input[3] = U+0639

input[4] = U+200d input[5] = U+002d input[6] = U+0627

الدولي-الرباط-مجمعinput[0] = U+0645 input[1] = U+062c input[2] = U+0645 input[3] = U+0639 input[4] = U+002d input[5] = U+0627

ZWJVisually noticed


input[6] = U+0627 input[7] = U+0644 input[8] = U+0631 input[9] = U+0628

input[10] = U+0627 input[11] = U+0637

input[12] = U+200d input[13] = U+002d input[14] = U+0627 input[15] = U+0644 input[16] = U+062f input[17] = U+0648 input[18] = U+0644 input[19] = U+064a

input[5] = U+0627 input[6] = U+0644 input[7] = U+0631 input[8] = U+0628 input[9] = U+0637 input[10] = U+002d input[11] = U+0627 input[12] = U+0644 input[13] = U+062f input[14] = U+0648 input[15] = U+0644 input[16] = U+064a

ZWJVisually Unnoticed

Issues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations55555555. . . . . . . . DigitsDigitsDigitsDigitsDigitsDigitsDigitsDigitsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations55555555. . . . . . . . DigitsDigitsDigitsDigitsDigitsDigitsDigitsDigits

� Arabic-Indic VS. Eastern Arabic-Indic digits

– 0 1 2 3 4 5 6 7 8 9

– ٩ ٨ ٧ ۶ ۵ ۴ ٣ ٢ ١ ٠

۱۲۳۷۸۹۰ ١٢٣٧٨٩٠


۱۲۳۷۸۹۰input[0] = U+06f1

input[1] = U+06f2

input[2] = U+06f3

input[3] = U+06f7

input[4] = U+06f8

input[5] = U+06f9

input[6] = U+06f0

١٢٣٧٨٩٠input[0] = U+0661

input[1] = U+0662

input[2] = U+0663

input[3] = U+0667

input[4] = U+0668

input[5] = U+0669

input[6] = U+0660

≠

Issues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations55555555. . . . . . . . DigitsDigitsDigitsDigitsDigitsDigitsDigitsDigitsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations55555555. . . . . . . . DigitsDigitsDigitsDigitsDigitsDigitsDigitsDigits� Arabic-Indic vs. European-Arabic digits

– 0 1 2 3 4 5 6 7 8 9– 0 1 2 3 4 5 6 7 8 9

� “Windows has supported number substitution by allowing the representation of different cultural shapes for the same digits while keeping the internal storage of these digits unified among different locales, for example numbers are stored in their well known hexadecimal values, 0x40, 0x41, but displayed according to the selected language.


hexadecimal values, 0x40, 0x41, but displayed according to the selected language.

Source: http://msdn2.microsoft.com/en-us/library/aa350685(VS.85).aspx?PHPSESSID=o1fb21liejulfgrptbmi9dec92

م12مinput[0] = U+0645

input[1] = U+0031

input[2] = U+0032

input[3] = U+0645

م١٢مinput[0] = U+0645

input[1] = U+0661

input[2] = U+0662

input[3] = U+0645

≠

Issues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations66666666. . . . . . . . Similar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations66666666. . . . . . . . Similar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape CharactersSimilar Shape Characters

� There are a number of groups of characters that have the same shapes,

– eg. Kaf, Heh, Yeh, Alef, … groups




ېلمنکلمنيکكلمني

input[0] = U+0643 input[1] = U+0644

input[0] = U+06a9 input[1] = U+0644

input[0] = U+06a9 input[1] = U+0644

کلمنېکلمنيكلمني


input[1] = U+0644 input[2] = U+0645 input[3] = U+0646 input[4] = U+064a

input[1] = U+0644 input[2] = U+0645 input[3] = U+0646 input[4] = U+064a

input[1] = U+0644 input[2] = U+0645 input[3] = U+0646 input[4] = U+06d0


ۍلکیلکكلى

input[0] = U+06a9 input[0] = U+06a9 input[0] = U+0643


input[0] = U+06a9 input[1] = U+0644 input[2] = U+06cd

input[0] = U+06a9 input[1] = U+0644 input[2] = U+06cc

input[0] = U+0643 input[1] = U+0644 input[2] = U+0649


Issues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations77777777. . . . . . . . Bidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional BehaviorIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further InvestigationsIssues Need Further Investigations77777777. . . . . . . . Bidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional BehaviorBidirectional Behavior

� Arabic script domains will include characters that are LTR (e.g., dash, dot, AE digits)

� Exiting IDNA2003 (stringprep) assumes that the first and last characters of the label must be RandALCat characters.


RandALCat characters.

Part III:Part III:Part III:Part III:Part III:Part III:Part III:Part III:Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working


Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working Arabic Script IDN Working GroupGroupGroupGroupGroupGroupGroupGroup (ASIWG) (ASIWG) (ASIWG) (ASIWG) (ASIWG) (ASIWG) (ASIWG) (ASIWG)

ASIWGASIWGASIWGASIWGASIWGASIWGASIWGASIWGFounding MembersFounding MembersFounding MembersFounding MembersFounding MembersFounding MembersFounding MembersFounding MembersASIWGASIWGASIWGASIWGASIWGASIWGASIWGASIWGFounding MembersFounding MembersFounding MembersFounding MembersFounding MembersFounding MembersFounding MembersFounding Members� Arabic Language

– Raed Al-Fayez, Abdulaziz Al-Zoman, Saudi Arabia

– Manal Ismail, George Victor, Egypt

� Urdu/Sindhi/Pashto– Sarmad Hussein, Pakistan

� Farsi– Alirezah Saleh, Siavash

� Open Working Group– Desire participation from:

• Registries implementing Arabic script

• Linguistic community experts

• DNS/Standards experts


– Alirezah Saleh, Siavash Shahshahhani, Behdad, Behnam Esfahbod, Iran

� Michael Everson (Linguist, Unicode) � Tina Dam, Baher Esmat (ICANN)

Organizers:– Ayman El-Sherbiniy (UN-ESCWA)– David Maher, Alexa Raad (PIR - .ORG)– Ram Mohan (Afilias - .INFO)

• DNS/Standards experts

– Members expected to provide substantive input into the WG, and contribute experts to the group

• Members fund own participation, to the extent possible

– Decisions based on rough consensus

ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG Initial GoalsInitial GoalsInitial GoalsInitial GoalsInitial GoalsInitial GoalsInitial GoalsInitial GoalsASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG Initial GoalsInitial GoalsInitial GoalsInitial GoalsInitial GoalsInitial GoalsInitial GoalsInitial Goals

� Establish a framework for implementation of IDNs in Arabic Script– Requires development of language tables and related Variants (confusingly similar characters)

� Consider, at a minimum, technical, linguistic and policy matters in the development of a Unified Arabic script table.

� Participants attempt to be inclusive with respect to


� Participants attempt to be inclusive with respect to languages that implement the Arabic script throughout the world.– Open membership to qualified contributors

� Conform to IETF IDNA Protocol and IDN Guidelines

ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG Language /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG Language /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & GuidelinesLanguage /Script Tables & Guidelines

Script Level: One Table (Unified Arabic Script Table)

Unified Arabic

Script TableScript Use Rules, Variant Tables +

IETF RFC


Arabic Language

Table

Language Group Level: A Table for each Language, Plus Variant Tables

Farsi Language Table Urdu Language

TableLinguistic

Guidelines forthe Arabic

Language + IETF RFC

LinguisticGuidelines for

the FarsiLanguage + IETF RFC

LinguisticGuidelines for

the UrduLanguage + IETF RFC

IETF RFC

ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG Initial OutcomesInitial OutcomesInitial OutcomesInitial OutcomesInitial OutcomesInitial OutcomesInitial OutcomesInitial OutcomesASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG Initial OutcomesInitial OutcomesInitial OutcomesInitial OutcomesInitial OutcomesInitial OutcomesInitial OutcomesInitial Outcomes

Consideration of a layeredmodel to address issues with regard to scripts

Level 4 Application/User Level

Level 3 Registry/Language/Policy Level

Level 4 deals the software application or user level, and includes display, rendering and user interface decisions that affect how IDNs are accessed by Internet users (both registrants and users of the IDN domain).


Level 2 Unified Arabic Script Level

Level 1 IDNA Protocol Level

Level 1 deals with for the IDNA protocol level with an impact on Arabic Script.

Level 3 deals with language implementation issues, usually at the level of a Registry operator, and includes policy and/or business rule decisions that affect how IDNs are registered and accessed. Further restrictions on the character set to be used may occur at this layer, and this layer allows some differentiation

Level 2 deals with the Unified Arabic Script, with an intent to be inclusive of the languages that use the script

ASIWGASIWGASIWGASIWGASIWGASIWGASIWGASIWGInitial OutcomeInitial OutcomeInitial OutcomeInitial OutcomeInitial OutcomeInitial OutcomeInitial OutcomeInitial OutcomeASIWGASIWGASIWGASIWGASIWGASIWGASIWGASIWGInitial OutcomeInitial OutcomeInitial OutcomeInitial OutcomeInitial OutcomeInitial OutcomeInitial OutcomeInitial Outcome

� IDNA Protocol

– The group reviewed the current set of IDNA200x DISALLOWED and controversial code points for the Arabic Code Block and have arrived at a set of recommendations that was sent to the IDNA designer team.


team.

� Start Identification of Visually Confusable characters

– Language based approach• Arabic, Farsi, Urdu, Sindhi, Pashto represented at the meeting

– Begun identifying a set of variants that help differentiate between visually confusable characters

ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ComingComingComingComingComingComingComingComing MeetingsMeetingsMeetingsMeetingsMeetingsMeetingsMeetingsMeetingsASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ASIWG ComingComingComingComingComingComingComingComing MeetingsMeetingsMeetingsMeetingsMeetingsMeetingsMeetingsMeetings

� Next meeting 28-29 May, 2008 Dubai (Host UAE TRA)

� Planning for a meeting side-by-side with ICANN Paris


Mailing List: [email protected]: http://lists.irnic.ir/mailman/listinfo/idna-arabicscript

Thank youThank youThank youThank youThank youThank youThank youThank you

راراراراككككشششش راراراراککککشششش


xnxn----mgbtimgbti44d d

input[0] = U+0634 input[1] = U+0643 input[2] = U+0631 input[3] = U+0627

xnxn----mgbtimgbti2828bb

input[0] = U+0634 input[1] = U+06a9 input[2] = U+0631 input[3] = U+0627

راراراراككككشششش راراراراککککشششش

Documents

Writing Domain Names Language VS. Scriptnic.sa/docs/lectures_and_presentations/... · – Letters that can be joined are always joined in both hand-written and printed Arabic