This repository has been archived by the owner on Jul 7, 2023. It is now read-only.

v1.14.1

afrozenator released this 03 Oct 21:04

232225f

PRs Merged

#1720 thanks @przemb
#1698 #1699 test/util file fixes thanks to @Vooblin
Fix serving response from Cloud ML Engine (#1688) thanks to @evalphobia
Refine automatic mixed precision support via hyper param (#1681) thanks @vinhngx
correct return shape of rel_pos2abs_pos() (#1686) thanks to @Separius
save attention weights for relative attention v2 (#1682) thanks to @Ghostvv
Update generator_utils.py (#1674) thanks to @TanguyUrvoy

Docs

Transformer tutorial (#1675) many thanks to @Styleoshin

Problems

4 new dialog problems by @ricsinaruto in #1642

Models

Extend NeuralStack to support Dequeu by reading/writing in both directions, thanks @narphorium

TRAX

Lots of work on SimPLe tuning hyperparameters by @koz4k , @lukaszkaiser and @afrozenator
async data collection for RL in TRAX
New memory efficient Transformer using Reversible layers, thanks to Nikita Kitaev, @lukaszkaiser and Anselm Levskaya
Losses and metrics are layers now in trax, thanks to @lukaszkaiser
Activations in TRAX thanks to @joaogui1 in #1684 and #1666

Assets 2