Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large project generation failure because of rate limits on Anthropic #1437

Open
aphtechme opened this issue Mar 3, 2025 · 0 comments
Open

Comments

@aphtechme
Copy link

Describe the bug

Generating small project work fine but when trying to generate a large project using Sonnet/Anthropic API, the system will fail and show the following error:

DEBUG api.chat usage {"promptTokens":120424,"completionTokens":32000,"totalTokens":152424}
INFO api.chat Reached max token limit (8000): Continuing message (2 switches left)
INFO LLMManager Found 6 cached models for Anthropic
INFO stream-text Sending llm call to Anthropic with model claude-3-7-sonnet-20250219
ERROR api.chat AI_RetryError: Failed after 3 attempts. Last error: This request would exceed the rate limit for your organization (xxx) of 16,000 output tokens per minute. For details, refer to: https://docs.anthropic.com/en/api/rate-limits. You can see the response headers for current usage. Please reduce the prompt length or the maximum tokens requested, or try again later. You may also contact sales at https://www.anthropic.com/contact-sales to discuss your options for a rate limit increase.

We are using:
📍 Current Version Tag: v"0.0.7"
📍 Current Commit Version: "4404f4a"
with Context Optimization enabled.

We believe that some sort of rate throttling functionality needs to be implemented to support large projects.

Link to the Bolt URL that caused the error

None

Steps to reproduce

Try to create any sophisticated projects with client and server support.

Expected behavior

Giving the rate limit restrictions, we expect the code generator to implement a throttling mechanism to avoid encountering such errors.

Screen Recording / Screenshot

No response

Platform

  • OS: macOS
  • Browser: Chrome and Safari
  • Version: v"0.0.7"

Provider Used

No response

Model Used

Sonnet 3.7

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant