adaptive-inference-routing.yaml 1.3 KB

1234567891011121314151617181920212223242526
  1. name: adaptive-inference-routing
  2. repo: https://github.com/midhatn/adaptive-inference
  3. sha: "d6f4e201ba28602189872746922e527c58ed0cbd"
  4. subdir: plugins/hermes
  5. title: Adaptive Inference Routing
  6. description: >-
  7. Opt-in background scheduling for host-known delegated sessions, supported cron
  8. execution and explicit worker profiles using an existing Adaptive Inference
  9. gateway. Interactive and explicitly classified requests retain their routing;
  10. model, tools, prompts, output limits and credentials are unchanged.
  11. Disclosure: adds only X-Adaptive-Class on an exactly configured chat-completions
  12. endpoint. No network calls, file access, processes, telemetry or credential
  13. handling in plugin code. Uses a bounded in-memory session index. Cron detection
  14. requires the newer public execution-identity capability; auxiliary routing is
  15. an explicit provider configuration, not an auxiliary middleware claim.
  16. maintainer: midhatn
  17. tier: community
  18. category: models
  19. requires_hermes: ">=0.21.5"
  20. docs_url: https://github.com/midhatn/adaptive-inference/blob/d6f4e201ba28602189872746922e527c58ed0cbd/plugins/hermes/README.md
  21. version: "0.1.0"
  22. capabilities:
  23. provides_tools: []
  24. provides_hooks: [subagent_start, subagent_stop, post_compaction]
  25. provides_middleware: [llm_request]
  26. requires_env: []