Those are the two model I programmed for the competition. You will find : Neural Architecture Search using DeepHyper in the notebook : asl-signs-2nd-model-nas.ipynb My own implementation of a Transformer's encoder in the notebook : asl-signs-transformer.ipynb