Support for Other Models in Edit Predictions

[athyfr]

Edit predictions are an amazing feature, and I think that local AI would be a wonderful usecase for them.

There are three potential circumstances where this would be useful: Bad internet connection, privacy concerns, potential for faster speed on fast computers.

Both of these are large demographics worth considering.

I suggest support is added for Ollama (and perhaps OpenAI-compatible API) for edit predictions.

Somebody has already uploaded the Zeta model to Ollama, though quantization (as is usual in Ollama) hasn't been done: https://ollama.com/lennyerik/zeta (ollama pull lennyerik/zeta)

Thanks for the amazing code-editor! I hope you will put a higher priority on local AI.