Using Lexical tools to convert Unicode characters to ASCII.
Unicode is an industry standard allowing computers to consistently represent and manipulate text expressed in most of the worlds writing systems. It is widely used in multilingual NLP (natural language processing) projects. On the other hand, there are some NLP projects still only dealing with ASCII characters. This paper describes methods of utilizing lexical tools to convert Unicode characters (UTF-8) to ASCII (7-bit) characters.
Lu
Chris J
CJ
Lockheed Martin/MSD, Bethesda, MD, USA.
Browne
Allen C
AC
Divita
Guy
G
D000465:Algorithms; D001185:Artificial Intelligence; D016247:Information Storage and Retrieval / Q000379:methods*; D009323:Natural Language Processing; D010363:Pattern Recognition, Automated / Q000379:methods*; D009626:Terminology as Topic; D014481:United States; D018875:Vocabulary, Controlled