Skip to content

Commit 8af11d7

Browse files
committed
Bump version to 1.19.0
1 parent db2c3b7 commit 8af11d7

File tree

2 files changed

+9
-2
lines changed

2 files changed

+9
-2
lines changed

CHANGELOG.md

+8-1
Original file line numberDiff line numberDiff line change
@@ -21,8 +21,15 @@ The project follows [semantic versioning 2.0.0](https://semver.org/). The API co
2121

2222
### New features
2323

24-
* Introduce the "Token API": a set of methods that manipulate `Token` objects instead of serialized strings
24+
### Fixes and improvements
25+
26+
## [v1.19.0](https://github.com/OpenNMT/Tokenizer/releases/tag/v1.19.0) (2020-09-02)
27+
28+
### New features
29+
2530
* Add BPE dropout ([Provilkov et al. 2019](https://www.aclweb.org/anthology/2020.acl-main.170/))
31+
* [Python] Introduce the "Token API": a set of methods that manipulate `Token` objects instead of serialized strings
32+
* [Python] Add `unicode_ranges` argument to the `detokenize_with_ranges` method to return ranges over Unicode characters instead of bytes
2633

2734
### Fixes and improvements
2835

bindings/python/setup.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ def _maybe_add_library_root(lib_name, header_only=False):
4040

4141
setup(
4242
name="pyonmttok",
43-
version="1.18.5",
43+
version="1.19.0",
4444
license="MIT",
4545
description="OpenNMT tokenization library",
4646
long_description=_get_long_description(),

0 commit comments

Comments
 (0)