Aiinference

[Josephrp]

Why are these changes needed?

This PR introduces a new GithubLLM class to autogen, allowing users to leverage GitHub's inference endpoint with automatic fallback to Azure. It provides a seamless way to use GitHub's LLM capabilities within the autogen ecosystem, handling rate limits and ensuring high availability through Azure fallback.

Related Issues

Contributes to #3300

• align githubllm with [.Net][Feature Request]: Add AutoGen.AzureAIInference #3323 (comment) AzureEndpoint naming and conventions

Checks

• I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally.
• I've added tests (if relevant) corresponding to the changes introduced in this PR.
• I've made sure all auto checks have passed.

Tasks

• Inference

[Josephrp]

CHECKLIST (WiP / Help Wanted) :

• improve / rename tests
• add json / chat completions client

[ekzhu]

Do we need to check this from client side? Can we just let the server to check it.

[Josephrp]

it could be a good idea to keep it server side because the updates are frequent , is there any interest in this ? on my side , sure , i could always send it in for review if it's a good idea :-)

[rysweet]

This PR is against AutoGen 0.2. AutoGen 0.2 has been moved to the 0.2 branch. Please rebase your PR on the 0.2 branch or update it to work with the new AutoGen 0.4 that is now in main.

[Josephrp]

thanks !