Skip to content

Commit 947cec0

Browse files
committed
Bump version to 1.21.0
1 parent 0edb0fd commit 947cec0

File tree

2 files changed

+8
-2
lines changed

2 files changed

+8
-2
lines changed

CHANGELOG.md

+7-1
Original file line numberDiff line numberDiff line change
@@ -21,13 +21,19 @@ The project follows [semantic versioning 2.0.0](https://semver.org/). The API co
2121

2222
### New features
2323

24+
### Fixes and improvements
25+
26+
## [v1.21.0](https://github.com/OpenNMT/Tokenizer/releases/tag/v1.21.0) (2020-10-22)
27+
28+
### New features
29+
2430
* Accept vocabularies with tab-separated frequencies (format produced by SentencePiece)
2531

2632
### Fixes and improvements
2733

2834
* Fix BPE vocabulary restriction when words have a leading or trailing joiner
2935
* Raise an error when using a multi-character joiner and `support_prior_joiner`
30-
* [Python] Implement `__hash__` method of `pyonmttok.Token` objects to be consistent with the `__eq__` implementation
36+
* [Python] Implement `__hash__` method of `pyonmttok.Token` objects to be consistent with the `__eq__` implementation
3137
* [Python] Declare `pyonmttok.Tokenizer` arguments (except `mode`) as keyword-only
3238
* [Python] Improve compatibility with Python 3.9
3339

bindings/python/setup.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ def _maybe_add_library_root(lib_name, header_only=False):
4040

4141
setup(
4242
name="pyonmttok",
43-
version="1.20.0",
43+
version="1.21.0",
4444
license="MIT",
4545
description="OpenNMT tokenization library",
4646
long_description=_get_long_description(),

0 commit comments

Comments
 (0)