Why is the Tool Generating Results Gradually and Not Fully Utilizing AI API Rate Limits?

Our tools are programmed to ensure your AI API account does not hit the rate limits set by the AI API providers. Here are the key reasons and details:

1. Rate Limit Management:

   • To prevent overloading the API and hitting rate limits, our tools manage requests per second based on your account's rate limit.
   • If your rate limit is very high, we still keep the request rate low enough to avoid overloading the API.
   • If you need more limits, consider upgrading your tier in OpenAI (to Tier 2) or Anthropic (to Tier 3) by adding more credit or adding balance to your API key in OpenRouter.

2. Handling Large Data:

   • Processing too many columns/rows or cells with a lot of data can lead to hitting token rate limits.
   • The tool will stop once it hits the limit, and you will need to click "continue" when the rate limit is available again.

3. Concurrent Usage:

   • If your API account or key is used concurrently elsewhere, it increases the likelihood of hitting rate limits.

Steps to Ensure Smooth Operation

• Know Your Rate Limit: Ensure you don't process more than the limit provided for both tokens and requests.
• Avoid Concurrent Usage: Try to limit the simultaneous use of the same API key in multiple places.
• Handle Large Data Efficiently: Break down large data sets into smaller batches to process them more efficiently.