Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature Request] Integrate Batch API for Models #1546

Open
1 of 2 tasks
Wendong-Fan opened this issue Feb 3, 2025 · 0 comments
Open
1 of 2 tasks

[Feature Request] Integrate Batch API for Models #1546

Wendong-Fan opened this issue Feb 3, 2025 · 0 comments
Assignees
@Asher-hss
Labels
Model Related to backend models New Feature P0 Task with high level priority
Milestone
Sprint 23

Comments

@Wendong-Fan
Copy link
Member

Wendong-Fan commented Feb 3, 2025 •
edited
Loading

Required prerequisites

Motivation

Batch API support sending asynchronous groups of requests with lower costs, a separate pool of higher rate limits

Including but no limited to OpenAI Batch API

https://platform.openai.com/docs/guides/batch

Solution

No response

Alternatives

No response

Additional context

No response
@Wendong-Fan Wendong-Fan added call for contribution Model Related to backend models New Feature P0 Task with high level priority labels Feb 3, 2025
@Wendong-Fan Wendong-Fan added this to the Sprint 23 milestone Feb 6, 2025
@Asher-hss Asher-hss self-assigned this Feb 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Asher-hss Asher-hss

Labels
Model Related to backend models New Feature P0 Task with high level priority
Projects
Project Camel
Status: No status
Milestone
Sprint 23
Development

No branches or pull requests
2 participants
@Asher-hss @Wendong-Fan