| 123456789101112131415161718192021 |
- name: lightningai-rate-limit
- repo: https://github.com/dinosauria123/hermes-lightningai-rate-limit
- sha: dc7911a946f0b209a81cf680c168382177bb13bf
- description: >-
- Per-process throttle for Lightning AI (https://lightning.ai/api/v1) keeping LLM requests
- within the ~15 requests/min limit, using an in-memory token bucket. Gates only calls whose
- provider or base_url points at Lightning AI; no-op otherwise.
- Disclosure — registers one llm_execution middleware and nothing else; no network calls,
- files, or processes of its own.
- maintainer: dinosauria123
- tier: community
- category: models
- requires_hermes: ">=0.21.5"
- version: "1.1.0"
- platforms: []
- capabilities:
- provides_tools: []
- provides_hooks: []
- provides_middleware:
- - llm_execution
- requires_env: []
|