使用Python unicode的特殊字符问题

#!/usr/bin/env python
# -*- coding: utf_8 -*-

def splitParagraphIntoSentences(paragraph):

''' break a paragraph into sentences
    and return a list '''
    import re
# to split by multile characters

#   regular expressions are easiest (and fastest)
    sentenceEnders = re.compile('[.!?][\s]{1,2}(?=[A-Z])')
    sentenceList = sentenceEnders.split(paragraph, re.UNICODE)
    return sentenceList


if __name__ == '__main__':
p = "While other species (e.g. horse mango, M. foetida) are also grown ,Mangifera indica – the common mango or Indian mango – Sheffield’s only mango tree is valued at £9.2 billion."

sentences = splitParagraphIntoSentences(p)
for s in sentences:
    print s.strip()

预期输出： 虽然也种植其他品种（例如马芒果、M. foetida），但Mangifera indica（普通芒果或印度芒果）是谢菲尔德唯一的芒果树，价值 92 亿英镑。”

收到的输出： 虽然也种植其他品种（例如马芒果、M. foetida），Mangifera ind ica Çô 普通芒果或印度芒果 Çô 谢菲尔德ÇÖ 唯一的芒果树是 va 目标价为 92 亿┬ú。

忽略这句话的含义，重点是它无法访问“-”、“£”、“’”等特殊字符。 我尝试使用其他编码（例如 ascii、utf-32、cp-500、iso8859_15 和 utf-8）设置 sitecustomize.py 文件和此代码，但无法解决它。 抱歉，我是Python新手。提前感谢您的帮助。

Using Unicode string literals as Nam suggested is correct, but if your terminal is using the cp437 code page as your output suggests, it will not be able to display some of the Unicode characters you want to use. The Windows console doesn't support UTF-8, which is what you are sending if you declare coding: utf-8¹ in your source file and do not use Unicode literals. coding: utf-8 declares the encoding of your source file, so make sure you are actually saving your source in UTF-8 encoding.

当您使用 Unicode 文字时，Python 会解释声明的编码中的源字符串，并将其转换为 Unicode 字符串。当打印 Unicode 字符串时，Python 会使用终端编码对字符串进行编码，或者缺少终端编码，则使用默认编码ascii对于Python 2。

一个例子：

# coding: utf8

print '£9.2 billion'  # Sends UTF-8 to cp437 terminal (gibberish)
print u'£9.2 billion' # Correctly prints on cp437 terminal.
print 'Sheffield’s'   # Sends UTF-8 to cp437 terminal (gibberish)

# Replaces Unicode characters that are unsupported in cp437.
print u'Sheffield’s £9.2 billion'.encode('cp437','xmlcharrefreplace')

print u'Sheffield’s'  # UnicodeEncodeError.

Output

£9.2 billion
£9.2 billion
SheffieldΓÇÖs
Sheffield’s £9.2 billion
Traceback (most recent call last):
  File "C:\Documents and Settings\metolone\Desktop\x.py", line 10, in <module>
    print u'SheffieldΓÇÖs'  # UnicodeEncodeError.
  File "C:\dev\python27\lib\encodings\cp437.py", line 12, in encode
    return codecs.charmap_encode(input,errors,encoding_map)
UnicodeEncodeError: 'charmap' codec can't encode character u'\u2019' in position 9: character maps to <undefined>

因此，不要指望能够在 Windows 控制台上正确打印所有 Unicode。使用支持 UTF-8 的 Python IDE，例如 PythonWin（可在pywin32 http://sourceforge.net/projects/pywin32/files/pywin32扩大）。

要在 Windows 控制台中正确显示 Unicode 字符，您需要两件事：映射要显示的 Unicode 字符的编码，以及支持这些字符的正确字形的字体。对于您的示例，如果将控制台代码页更改为 Windows-1252 (chcp 1252）并将控制台字体更改为 Consolas 或 Lucida Console 而不是光栅字体，如果您使用 Unicode 文字（p = u"...").