Browse Source
closes bpo-33376: Update to Unicode 12.0.0. (GH-12256)
pull/12258/head
Benjamin Peterson
7 years ago
committed by
GitHub
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
10 changed files with
28458 additions and
27552 deletions
-
Doc/library/stdtypes.rst
-
Doc/library/unicodedata.rst
-
Doc/reference/lexical_analysis.rst
-
Doc/whatsnew/3.8.rst
-
Lib/test/test_unicodedata.py
-
Misc/NEWS.d/next/Core and Builtins/2019-03-09-15-47-05.bpo-36252.sCQFKq.rst
-
Modules/unicodedata_db.h
-
Modules/unicodename_db.h
-
Objects/unicodetype_db.h
-
Tools/unicode/makeunicodedata.py
|
|
|
@ -351,7 +351,7 @@ Notes: |
|
|
|
The numeric literals accepted include the digits ``0`` to ``9`` or any |
|
|
|
Unicode equivalent (code points with the ``Nd`` property). |
|
|
|
|
|
|
|
See http://www.unicode.org/Public/10.0.0/ucd/extracted/DerivedNumericType.txt |
|
|
|
See http://www.unicode.org/Public/12.0.0/ucd/extracted/DerivedNumericType.txt |
|
|
|
for a complete list of code points with the ``Nd`` property. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
@ -17,8 +17,8 @@ |
|
|
|
|
|
|
|
This module provides access to the Unicode Character Database (UCD) which |
|
|
|
defines character properties for all Unicode characters. The data contained in |
|
|
|
this database is compiled from the `UCD version 11.0.0 |
|
|
|
<http://www.unicode.org/Public/11.0.0/ucd>`_. |
|
|
|
this database is compiled from the `UCD version 12.0.0 |
|
|
|
<http://www.unicode.org/Public/12.0.0/ucd>`_. |
|
|
|
|
|
|
|
The module uses the same names and symbols as defined by Unicode |
|
|
|
Standard Annex #44, `"Unicode Character Database" |
|
|
|
@ -175,6 +175,6 @@ Examples: |
|
|
|
|
|
|
|
.. rubric:: Footnotes |
|
|
|
|
|
|
|
.. [#] http://www.unicode.org/Public/11.0.0/ucd/NameAliases.txt |
|
|
|
.. [#] http://www.unicode.org/Public/12.0.0/ucd/NameAliases.txt |
|
|
|
|
|
|
|
.. [#] http://www.unicode.org/Public/11.0.0/ucd/NamedSequences.txt |
|
|
|
.. [#] http://www.unicode.org/Public/12.0.0/ucd/NamedSequences.txt |
|
|
|
@ -316,7 +316,7 @@ The Unicode category codes mentioned above stand for: |
|
|
|
* *Nd* - decimal numbers |
|
|
|
* *Pc* - connector punctuations |
|
|
|
* *Other_ID_Start* - explicit list of characters in `PropList.txt |
|
|
|
<http://www.unicode.org/Public/11.0.0/ucd/PropList.txt>`_ to support backwards |
|
|
|
<http://www.unicode.org/Public/12.0.0/ucd/PropList.txt>`_ to support backwards |
|
|
|
compatibility |
|
|
|
* *Other_ID_Continue* - likewise |
|
|
|
|
|
|
|
|
|
|
|
@ -157,6 +157,10 @@ Improved Modules |
|
|
|
to cast the result to the desired type: ``OrderedDict(nt._asdict())``. |
|
|
|
(Contributed by Raymond Hettinger in :issue:`35864`.) |
|
|
|
|
|
|
|
* The :mod:`unicodedata` module has been upgraded to use the `Unicode 12.0.0 |
|
|
|
<http://blog.unicode.org/2019/03/announcing-unicode-standard-version-120.html>`_ |
|
|
|
release. |
|
|
|
|
|
|
|
|
|
|
|
asyncio |
|
|
|
------- |
|
|
|
|
|
|
|
@ -20,7 +20,7 @@ errors = 'surrogatepass' |
|
|
|
class UnicodeMethodsTest(unittest.TestCase): |
|
|
|
|
|
|
|
# update this, if the database changes |
|
|
|
expectedchecksum = '97a41f208c53d5e08c77c1175187e95386b82b6f' |
|
|
|
expectedchecksum = '9129d6f2bdf008a81c2476e5b5127014a62130c1' |
|
|
|
|
|
|
|
def test_method_checksum(self): |
|
|
|
h = hashlib.sha1() |
|
|
|
@ -80,7 +80,7 @@ class UnicodeFunctionsTest(UnicodeDatabaseTest): |
|
|
|
|
|
|
|
# Update this if the database changes. Make sure to do a full rebuild |
|
|
|
# (e.g. 'make distclean && make') to get the correct checksum. |
|
|
|
expectedchecksum = '4f73278b19c2ec3099724c132f0b90a1d25c19e4' |
|
|
|
expectedchecksum = '4cb02a243aed7c251067386dd738189146fddf94' |
|
|
|
def test_function_checksum(self): |
|
|
|
data = [] |
|
|
|
h = hashlib.sha1() |
|
|
|
|
|
|
|
@ -0,0 +1 @@ |
|
|
|
Update Unicode databases to version 12.0.0. |
|
|
|
@ -41,7 +41,7 @@ VERSION = "3.3" |
|
|
|
# * Doc/library/stdtypes.rst, and |
|
|
|
# * Doc/library/unicodedata.rst |
|
|
|
# * Doc/reference/lexical_analysis.rst (two occurrences) |
|
|
|
UNIDATA_VERSION = "11.0.0" |
|
|
|
UNIDATA_VERSION = "12.0.0" |
|
|
|
UNICODE_DATA = "UnicodeData%s.txt" |
|
|
|
COMPOSITION_EXCLUSIONS = "CompositionExclusions%s.txt" |
|
|
|
EASTASIAN_WIDTH = "EastAsianWidth%s.txt" |
|
|
|
|