Benjamin Peterson
7c69c1c0fb
update to Unicode 11.0.0 (closes bpo-33778) (GH-7439)
Also, standardize indentation of generated tables.
8 years ago
Benjamin Peterson
279a96206f
bpo-30736: upgrade to Unicode 10.0 ( #2344 )
Straightforward. While we're at it, though, strip trailing whitespace from generated tables.
9 years ago
Zachary Ware
6b6e687766
bpo-27425: Be more explicit in .gitattributes (GH-840)
Updates checked-in line endings on several files.
9 years ago
Jon Dufresne
3972628de3
bpo-30296 Remove unnecessary tuples, lists, sets, and dicts ( #1489 )
* Replaced list(<generator expression>) with list comprehension
* Replaced dict(<generator expression>) with dict comprehension
* Replaced set(<list literal>) with set literal
* Replaced builtin func(<list comprehension>) with func(<generator
expression>) when supported (e.g. any(), all(), tuple(), min(), &
max())
9 years ago
Benjamin Peterson
6775231597
Unicode 9.0.0
Not completely mechanical since support for East Asian Width changes—emoji
codepoints became Wide—had to be added to unicodedata.
10 years ago
R David Murray
44b548dda8
#27364 : fix "incorrect" uses of escape character in the stdlib.
And most of the tools.
Patch by Emanual Barry, reviewed by me, Serhiy Storchaka, and
Martin Panter.
10 years ago
Benjamin Peterson
4801383c29
upgrade to Unicode 8.0.0
11 years ago
Serhiy Storchaka
ba9ac5b5c4
Issue #16261 : Converted some bare except statements to except statements
with specified exception type. Original patch by Ramchandra Apte.
11 years ago
Zachary Ware
4c9c848159
Issue #17202 : Add .bat to .hgeol to force them to CRLF.
Using LF can a script to fail if it tries to use a label that is
split across 512 byte blocks. Who knows why.
11 years ago
Serhiy Storchaka
d3faf43f9b
Issue #23181 : More "codepoint" -> "code point".
11 years ago
R David Murray
5f16f90d1b
#18176 : Change generic UCD PropList link to version specific link.
12 years ago
R David Murray
5bd62420f4
#18176 : fix another reference and add it to the makeunicodedata comment.
12 years ago
R David Murray
7445a383a6
#18176 : updated stdtypes UCD link, added reminder to makeunicodedata.
Patch by Alexander Belopolsky.
12 years ago
Benjamin Peterson
3032ed7cb1
upgrade to unicode 7.0.0
12 years ago
Serhiy Storchaka
b992a0e102
Issue #19936 : Added executable bits or shebang lines to Python scripts which
requires them. Disable executable bits and shebang lines in test and
benchmark files in order to prevent using a random system python, and in
source files of modules which don't provide command line interface. Fixed
shebang line to use python3 executable in the unittestgui script.
12 years ago
Andrew Kuchling
9d5c071060
#1097797 : add the original mapping file
12 years ago
Andrew Kuchling
695f07b27b
Fix some PEP8-formatting problems in the generated code
12 years ago
Benjamin Peterson
94d08d908b
upgrade unicode db to 6.3.0 ( closes #19221 )
13 years ago
Ezio Melotti
7c4a7e6f3c
#18803 : fix more typos. Patch by Févry Thibault.
13 years ago
Antoine Pitrou
9ed5f27266
Issue #18722 : Remove uses of the "register" keyword in C code.
13 years ago
Serhiy Storchaka
e7275ffa4c
Issue #15239 : Make mkstringprep.py work again on Python 3.
13 years ago
Antoine Pitrou
1eff0fc3cd
Issue #15378 : Fix Tools/unicode/comparecodecs.py. Patch by Serhiy Storchaka.
14 years ago
Benjamin Peterson
b8350f1c7d
upgrade to UCD 6.2
14 years ago
Florent Xicluna
c20740109d
Some cleanup in the Tools directory.
14 years ago
Antoine Pitrou
aaefac76dd
Issue #14874 : Restore charmap decoding speed to pre-PEP 393 levels.
Patch by Serhiy Storchaka.
14 years ago
Benjamin Peterson
71f660e00f
update to Unicode 6.1
14 years ago
Benjamin Peterson
ad9c569825
delta encoding of upper/lower/title makes a glorious return ( #12736 )
14 years ago
Benjamin Peterson
d5890c8db5
add str.casefold() ( closes #13752 )
14 years ago
Benjamin Peterson
b2bf01d824
use full unicode mappings for upper/lower/title case ( #12736 )
Also broaden the category of characters that count as lowercase/uppercase.
14 years ago
Ezio Melotti
931b8aac80
#12753 : Add support for Unicode name aliases and named sequences.
15 years ago
Ezio Melotti
a9860aeb08
#13054 : fix usage of sys.maxunicode after PEP-393.
15 years ago
Ezio Melotti
2a1e926d63
Fix ResourceWarnings in makeunicodedata.py.
15 years ago
Ezio Melotti
13925008dc
#11565 : Fix several typos. Patch by Piotr Kasprzyk.
15 years ago
Georg Brandl
49857f8a93
Add updated .hgeol file and fix newlines in the 3.2 branch.
15 years ago
Georg Brandl
faa9ad2a46
Add updated .hgeol file and fix newlines in the 2.7 branch.
15 years ago
Antoine Pitrou
7f1e174c7a
Make svn:eol-style's more consistent
15 years ago
Alexander Belopolsky
827fdaae30
Issue #10552 : Partially fixed a sort error in Tools/unicode/gencodec.py
15 years ago
Martin v. Löwis
5cbc71e50a
Issue #10459 : Update CJK character names to Unicode 6.0.
15 years ago
Martin v. Löwis
baecd7243a
Upgrade to Unicode 6.0.0.
makeunicodedata.py: download all data files from unicode.org,
switch to extracting Unihan data from zip file.
Read linebreakprops and derivednormalizationprops even for
old versions, even though they are not used in delta records.
test:unicode.py: U+11000 is now assigned, use U+14000 instead.
16 years ago
Amaury Forgeot d'Arc
feb7307db4
#9210 : remove --with-wctype-functions configure option.
The internal unicode database is now always used.
(after 5 years: see
http://mail.python.org/pipermail/python-dev/2004-December/050193.html
)
16 years ago
Amaury Forgeot d'Arc
324ac65ceb
#5127 : Even on narrow unicode builds, the C functions that access the Unicode
Database (Py_UNICODE_TOLOWER, Py_UNICODE_ISDECIMAL, and others) now accept
and return characters from the full Unicode range (Py_UCS4).
The differences from Python code are few:
- unicodedata.numeric(), unicodedata.decimal() and unicodedata.digit()
now return the correct value for large code points
- repr() may consider more characters as printable.
16 years ago
Matthias Klose
8b8b260019
Tools/unicode/mkstringprep.py: Don't use string exceptions,
partial backport from r78982.
16 years ago
Florent Xicluna
806d8cf0e8
Merged revisions 79494,79496 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r79494 | florent.xicluna | 2010-03-30 10:24:06 +0200 (mar, 30 mar 2010) | 2 lines
#7643 : Unicode codepoints VT (0x0B) and FF (0x0C) are linebreaks according to Unicode Standard Annex #14 .
........
r79496 | florent.xicluna | 2010-03-30 18:29:03 +0200 (mar, 30 mar 2010) | 2 lines
Highlight the change of behavior related to r79494. Now VT and FF are linebreaks.
........
16 years ago
Florent Xicluna
22b243809e
#7643 : Unicode codepoints VT (0x0B) and FF (0x0C) are linebreaks according to Unicode Standard Annex #14 .
16 years ago
Florent Xicluna
f089fd67fc
Merged revisions 78982,78986 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r78982 | florent.xicluna | 2010-03-15 15:00:58 +0100 (lun, 15 mar 2010) | 2 lines
Remove py3k deprecation warnings from these Unicode tools.
........
r78986 | florent.xicluna | 2010-03-15 19:08:58 +0100 (lun, 15 mar 2010) | 3 lines
Issue #7783 and #7787 : open_urlresource invalidates the outdated files from the local cache.
Use this feature to fix test_normalization.
........
16 years ago
Florent Xicluna
faa663f03d
Fixed a failure in test_bigmem.
Merged revision 79059 via svnmerge from
svn+ssh://pythondev@svn.python.org/python/trunk
........
r79059 | florent.xicluna | 2010-03-18 22:50:06 +0100 (jeu, 18 mar 2010) | 2 lines
Issue #8024 : Update the Unicode database to 5.2
........
16 years ago
Florent Xicluna
f1789dee30
Revert Unicode UCD 5.2 upgrade in 3.x. It broke repr() for unicode objects, and gave failures in test_bigmem. Revert 79062, 79065 and 79083.
16 years ago
Florent Xicluna
8c8042734a
Missing update from previous changeset r79062.
16 years ago
Florent Xicluna
2e0a53fdf6
Issue #8024 : Update the Unicode database to 5.2
16 years ago
Florent Xicluna
dc36472472
Remove py3k deprecation warnings from these Unicode tools.
16 years ago