Phi 3.5

Phi 3.5 is here!

Try it out here: https://colab.research.google.com/drive/1lN6hPQveB_mHSnTOYifygFcrO8C1bxq4?usp=sharing

What's Changed

• Llama 3.1 by @danielhanchen in #797
• Better debugging by @danielhanchen in #826
• fix UnboundLocalError by @xyangk in #834
• Gemma by @danielhanchen in #843
• Fix ROPE extension issue and device mismatch by @xyangk in #840
• Fix RoPE extension by @danielhanchen in #846
• fix: fix config.torch_dtype bug by @relic-yuexi in #874
• pascal support by @emuchogu in #870
• Fix tokenizers by @danielhanchen in #887
• Torch 2.4, Xformers>0.0.27, TRL>0.9, Python 3.12 + bug fixes by @danielhanchen in #902
• Fix DPO stats by @danielhanchen in #906
• Fix Chat Templates by @danielhanchen in #916
• Fix chat templates by @danielhanchen in #917
• Bug Fixes by @danielhanchen in #920
• Fix mapping by @danielhanchen in #921
• untrained tokens llama 3.1 base by @danielhanchen in #929
• Bug #930 by @danielhanchen in #931
• Fix NEFTune by @danielhanchen in #937
• Update README.md by @danielhanchen in #938

New Contributors

• @relic-yuexi made their first contribution in #874
• @emuchogu made their first contribution in #870

Full Changelog: July-Mistral-2024...August-2024