python3實(shí)現(xiàn)全角和半角字符轉(zhuǎn)換的方法示例

更新時(shí)間：2017年09月21日 11:39:24 作者：陳鵬

在自然語言處理過程中，全角、半角的的不一致會(huì)導(dǎo)致信息抽取不一致，因此需要統(tǒng)一，下面這篇文章主要給大家介紹了關(guān)于python3中全角和半角字符轉(zhuǎn)換的方法，需要的朋友可以參考借鑒，下面來一起看看吧。

前言

本文主要給大家介紹了關(guān)于python3中全角和半角字符轉(zhuǎn)換的相關(guān)內(nèi)容，分享出來供大家參考學(xué)習(xí)，下面話不多說了，來一起看看詳細(xì)的介紹吧。

一、背景介紹

解決什么問題：快速方便的對(duì)文本進(jìn)行全角半角自動(dòng)轉(zhuǎn)換

適用什么場景：學(xué)生答題數(shù)據(jù)中全角字符替換為半角字符

二、全角半角原理

全角即：Double Byte Character，簡稱DBC

半角即：Single Byte Character，簡稱SBC

在 windows 中，中文和全角字符都占兩個(gè)字節(jié)，并且使用了 ascii　chart 2 (codes 128–255)；
全角字符的第一個(gè)字節(jié)總是被置為 163，而第二個(gè)字節(jié)則是相同半角字符碼加上128（不包括空格，全角空格和半角空格也要考慮進(jìn)去）；

對(duì)于中文來說，它的第一個(gè)字節(jié)被置為大于163，如'阿'為:176 162，檢測到中文時(shí)不進(jìn)行轉(zhuǎn)換。

例如：半角 a 為 65，則全角 a 是 163（第一個(gè)字節(jié)）、193（第二個(gè)字節(jié)，128+65）。

全角半角示例：（文本 test.txt 包含全角和半角字符）

F:\test>type test.txt
123456
１２３４５６
abcdefg
ａｂｃｄｅｆｇ
中國你好

三、使用 Python3 實(shí)現(xiàn)全角半角轉(zhuǎn)換

# -*- coding:utf-8 -*-
# i@mail.chenpeng.info

”'
全角即：Double Byte Character，簡稱：DBC
半角即：Single Byte Character，簡稱：SBC
”'

def DBC2SBC(ustring):
 ”' 全角轉(zhuǎn)半角 ”'
 rstring = “”
 for uchar in ustring:
  inside_code = ord(uchar)
  if inside_code == 0x3000:
  inside_code = 0x0020
  else:
  inside_code -= 0xfee0
  if not (0x0021 <= inside_code and inside_code <= 0x7e):
   rstring += uchar
   continue
  rstring += chr(inside_code)
 return rstring

def SBC2DBC(ustring):
 ”' 半角轉(zhuǎn)全角 ”'
 rstring = “”
 for uchar in ustring:
  inside_code = ord(uchar)
  if inside_code == 0x0020:
  inside_code = 0x3000
  else:
  if not (0x0021 <= inside_code and inside_code <= 0x7e):
   rstring += uchar
   continue
  inside_code += 0xfee0
  rstring += chr(inside_code)
 return rstring

s = ”'
array(‘０' => ‘0', ‘１' => ‘1', ‘２' => ‘2', ‘３' => ‘3', ‘４' => ‘4',
  ‘５' => ‘5', ‘６' => ‘6', ‘７' => ‘7', ‘８' => ‘8', ‘９' => ‘9',
  ‘Ａ' => ‘A', ‘Ｂ' => ‘B', ‘Ｃ' => ‘C', ‘Ｄ' => ‘D', ‘Ｅ' => ‘E',
  ‘Ｆ' => ‘F', ‘Ｇ' => ‘G', ‘Ｈ' => ‘H', ‘Ｉ' => ‘I', ‘Ｊ' => ‘J',
  ‘Ｋ' => ‘K', ‘Ｌ' => ‘L', ‘Ｍ' => ‘M', ‘Ｎ' => ‘N', ‘Ｏ' => ‘O',
  ‘Ｐ' => ‘P', ‘Ｑ' => ‘Q', ‘Ｒ' => ‘R', ‘Ｓ' => ‘S', ‘Ｔ' => ‘T',
  ‘Ｕ' => ‘U', ‘Ｖ' => ‘V', ‘Ｗ' => ‘W', ‘Ｘ' => ‘X', ‘Ｙ' => ‘Y',
  ‘Ｚ' => ‘Z', ‘ａ' => ‘a(chǎn)', ‘ｂ' => ‘b', ‘ｃ' => ‘c', ‘ｄ' => ‘d',
  ‘ｅ' => ‘e', ‘ｆ' => ‘f', ‘ｇ' => ‘g', ‘ｈ' => ‘h', ‘ｉ' => ‘i',
  ‘ｊ' => ‘j', ‘ｋ' => ‘k', ‘ｌ' => ‘l', ‘ｍ' => ‘m', ‘ｎ' => ‘n',
  ‘ｏ' => ‘o', ‘ｐ' => ‘p', ‘ｑ' => ‘q', ‘ｒ' => ‘r', ‘ｓ' => ‘s',
  ‘ｔ' => ‘t', ‘ｕ' => ‘u', ‘ｖ' => ‘v', ‘ｗ' => ‘w', ‘ｘ' => ‘x',
  ‘ｙ' => ‘y', ‘ｚ' => ‘z',
  ‘（' => ‘(‘, ‘）' => ‘)', ‘〔' => ‘[‘, ‘〕' => ‘]', ‘【' => ‘[‘,
  ‘】' => ‘]', ‘〖' => ‘[‘, ‘〗' => ‘]', ‘”‘ => ‘[‘, ‘”‘ => ‘]',
  ‘\” => ‘[‘, ‘\” => ‘]', ‘｛' => ‘{‘, ‘｝' => ‘}', ‘《' => ‘<‘,
  ‘》' => ‘>',
  ‘％' => ‘%', ‘＋' => ‘+', ‘—' => ‘-‘, ‘－' => ‘-‘, ‘～' => ‘-‘,
  ‘：' => ‘:', ‘。' => ‘.', ‘、' => ‘,', ‘，' => ‘.', ‘、' => ‘.',
  ‘；' => ‘,', ‘？' => ‘?', ‘！' => ‘!', ‘…' => ‘-‘, ‘‖' => ‘|',
  ‘”‘ => ‘”‘, ‘\” => ‘`', ‘\” => ‘`', ‘｜' => ‘|', ‘〃' => ‘”‘,
  ‘　' => ‘ ‘);
  ”'

# 全角轉(zhuǎn)半角
print(DBC2SBC(s))

# 半角轉(zhuǎn)全角
print(SBC2DBC(s))

s = ”'中文測試”'

# 全角轉(zhuǎn)半角
print(DBC2SBC(s))

# 半角轉(zhuǎn)全角
print(SBC2DBC(s))

四、總結(jié)

以上就是這篇文章的全部內(nèi)容了，希望本文的內(nèi)容對(duì)大家的學(xué)習(xí)或者工作能帶來一定的幫助，如果有疑問大家可以留言交流，謝謝大家對(duì)腳本之家的支持。

五、參考資料

http://thinkerou.com/2015-06/covert-dbc-sbc/

您可能感興趣的文章: